Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

{2023.6}[2023b,a64fx] ESPResSo 4.2.2 + pyMBE 0.8.0 #782

Merged

Conversation

boegel
Copy link
Contributor

@boegel boegel commented Oct 11, 2024

I'm using this PR to verify that the changes made for support builds for dev.eessi.io don't cause trouble for the software.eessi.io builds, so it sits on top of:

This PR shouldn't be merged until #771 is merged, so marking it as draft...

@boegel boegel added 2023.06-software.eessi.io 2023.06 version of software.eessi.io a64fx labels Oct 11, 2024
Copy link

eessi-bot bot commented Oct 11, 2024

Instance eessi-bot-mc-aws is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
  • repositories: eessi.io-2023.06-compat, eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software

Copy link

eessi-bot bot commented Oct 11, 2024

Instance eessi-bot-mc-azure is configured to build for:

  • architectures: x86_64/amd/zen4
  • repositories: eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software, eessi.io-2023.06-compat

@boegel
Copy link
Contributor Author

boegel commented Oct 11, 2024

bot: build repo:eessi.io-2023.06-software arch:aarch64/a64fx

Copy link

eessi-bot bot commented Oct 11, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx
  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • no jobs were submitted

Copy link

eessi-build-deploy-bot-deucalion bot commented Oct 11, 2024

Updates by the bot instance boegel-bot-deucalion (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx
  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

Copy link

eessi-bot bot commented Oct 11, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx
  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • no jobs were submitted

Copy link

eessi-build-deploy-bot-deucalion bot commented Oct 11, 2024

New job on instance boegel-bot-deucalion for CPU micro-architecture aarch64-a64fx for repository eessi.io-2023.06-software in job dir /home/kehoste/project_dir/bot/jobs/2024.10/pr_782/161293

date job status comment
Oct 11 15:58:47 UTC 2024 submitted job id 161293 awaits release by job manager
Oct 11 15:59:33 UTC 2024 released job awaits launch by Slurm scheduler
Oct 11 16:00:36 UTC 2024 running job 161293 is running
Oct 11 22:29:49 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-161293.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-1728684016.tar.gzsize: 335 MiB (352166839 bytes)
entries: 37026
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
Bison/3.8.2-GCCcore-13.2.0.lua
Boost.MPI/1.83.0-gompi-2023b.lua
Brotli/1.1.0-GCCcore-13.2.0.lua
cppy/1.2.1-GCCcore-13.2.0.lua
Doxygen/1.9.8-GCCcore-13.2.0.lua
ESPResSo/4.2.2-foss-2023b.lua
fontconfig/2.14.2-GCCcore-13.2.0.lua
freetype/2.13.2-GCCcore-13.2.0.lua
giflib/5.2.1-GCCcore-13.2.0.lua
GSL/2.7-GCC-13.2.0.lua
gzip/1.13-GCCcore-13.2.0.lua
HDF5/1.14.3-gompi-2023b.lua
ICU/74.1-GCCcore-13.2.0.lua
IPython/8.17.2-GCCcore-13.2.0.lua
jbigkit/2.1-GCCcore-13.2.0.lua
jedi/0.19.1-GCCcore-13.2.0.lua
libdeflate/1.19-GCCcore-13.2.0.lua
libdrm/2.4.117-GCCcore-13.2.0.lua
libglvnd/1.7.0-GCCcore-13.2.0.lua
libiconv/1.17-GCCcore-13.2.0.lua
libjpeg-turbo/3.0.1-GCCcore-13.2.0.lua
libpng/1.6.40-GCCcore-13.2.0.lua
libsodium/1.0.19-GCCcore-13.2.0.lua
LibTIFF/4.6.0-GCCcore-13.2.0.lua
libunwind/1.6.2-GCCcore-13.2.0.lua
libwebp/1.3.2-GCCcore-13.2.0.lua
libxslt/1.1.38-GCCcore-13.2.0.lua
LittleCMS/2.15-GCCcore-13.2.0.lua
LLVM/16.0.6-GCCcore-13.2.0.lua
lxml/4.9.3-GCCcore-13.2.0.lua
lz4/1.9.4-GCCcore-13.2.0.lua
Mako/1.2.4-GCCcore-13.2.0.lua
matplotlib/3.8.2-gfbf-2023b.lua
Mesa/23.1.9-GCCcore-13.2.0.lua
NASM/2.16.01-GCCcore-13.2.0.lua
OpenJPEG/2.5.0-GCCcore-13.2.0.lua
OpenPGM/5.2.122-GCCcore-13.2.0.lua
Pillow/10.2.0-GCCcore-13.2.0.lua
Pint/0.24-GCCcore-13.2.0.lua
pyMBE/0.8.0-foss-2023b.lua
Qhull/2020.2-GCCcore-13.2.0.lua
Szip/2.1.1-GCCcore-13.2.0.lua
Tk/8.6.13-GCCcore-13.2.0.lua
Tkinter/3.11.5-GCCcore-13.2.0.lua
tqdm/4.66.2-GCCcore-13.2.0.lua
Wayland/1.22.0-GCCcore-13.2.0.lua
X11/20231019-GCCcore-13.2.0.lua
ZeroMQ/4.3.5-GCCcore-13.2.0.lua
zstd/1.5.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/aarch64/a64fx/software
Bison/3.8.2-GCCcore-13.2.0
Boost.MPI/1.83.0-gompi-2023b
Brotli/1.1.0-GCCcore-13.2.0
cppy/1.2.1-GCCcore-13.2.0
Doxygen/1.9.8-GCCcore-13.2.0
ESPResSo/4.2.2-foss-2023b
fontconfig/2.14.2-GCCcore-13.2.0
freetype/2.13.2-GCCcore-13.2.0
giflib/5.2.1-GCCcore-13.2.0
GSL/2.7-GCC-13.2.0
gzip/1.13-GCCcore-13.2.0
HDF5/1.14.3-gompi-2023b
ICU/74.1-GCCcore-13.2.0
IPython/8.17.2-GCCcore-13.2.0
jbigkit/2.1-GCCcore-13.2.0
jedi/0.19.1-GCCcore-13.2.0
libdeflate/1.19-GCCcore-13.2.0
libdrm/2.4.117-GCCcore-13.2.0
libglvnd/1.7.0-GCCcore-13.2.0
libiconv/1.17-GCCcore-13.2.0
libjpeg-turbo/3.0.1-GCCcore-13.2.0
libpng/1.6.40-GCCcore-13.2.0
libsodium/1.0.19-GCCcore-13.2.0
LibTIFF/4.6.0-GCCcore-13.2.0
libunwind/1.6.2-GCCcore-13.2.0
libwebp/1.3.2-GCCcore-13.2.0
libxslt/1.1.38-GCCcore-13.2.0
LittleCMS/2.15-GCCcore-13.2.0
LLVM/16.0.6-GCCcore-13.2.0
lxml/4.9.3-GCCcore-13.2.0
lz4/1.9.4-GCCcore-13.2.0
Mako/1.2.4-GCCcore-13.2.0
matplotlib/3.8.2-gfbf-2023b
Mesa/23.1.9-GCCcore-13.2.0
NASM/2.16.01-GCCcore-13.2.0
OpenJPEG/2.5.0-GCCcore-13.2.0
OpenPGM/5.2.122-GCCcore-13.2.0
Pillow/10.2.0-GCCcore-13.2.0
Pint/0.24-GCCcore-13.2.0
pyMBE/0.8.0-foss-2023b
Qhull/2020.2-GCCcore-13.2.0
Szip/2.1.1-GCCcore-13.2.0
Tk/8.6.13-GCCcore-13.2.0
Tkinter/3.11.5-GCCcore-13.2.0
tqdm/4.66.2-GCCcore-13.2.0
Wayland/1.22.0-GCCcore-13.2.0
X11/20231019-GCCcore-13.2.0
ZeroMQ/4.3.5-GCCcore-13.2.0
zstd/1.5.5-GCCcore-13.2.0
other under 2023.06/software/linux/aarch64/a64fx
2023.06/init/minimal_eessi_env
Oct 11 22:29:49 UTC 2024 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
✅ job output file slurm-161293.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Oct 12 20:16:06 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-a64fx-1728684016.tar.gz to S3 bucket succeeded

@boegel boegel marked this pull request as ready for review October 12, 2024 14:12
@boegel boegel added the bot:deploy Ask bot to deploy missing software installations to EESSI label Oct 12, 2024
@boegel
Copy link
Contributor Author

boegel commented Oct 13, 2024

@bedroge The 2023.06/init/minimal_eessi_env that's being deployed in here is due to the changes to it in #771, we should've done a build & deploy in there...

@bedroge
Copy link
Collaborator

bedroge commented Oct 14, 2024

This was deployed and ingested, but it turned out that this somehow included a wrong/old and broken version of minimal_eessi_env, so I've rolled back the transaction. We should do a rebuild here to make sure that the latest version is included, or do this in a separate PR.

@boegel
Copy link
Contributor Author

boegel commented Oct 14, 2024

This was deployed and ingested, but it turned out that this somehow included a wrong/old and broken version of minimal_eessi_env, so I've rolled back the transaction. We should do a rebuild here to make sure that the latest version is included, or do this in a separate PR.

The build was done before the commit that adds a guard for $EESSI_COMPAT_LAYER_DIR being defined was added, see 1afc599

Easiest way forward is just doing the build again here, which should pick up on the correct init/minimal_eessi_env...

@boegel
Copy link
Contributor Author

boegel commented Oct 14, 2024

bot: build repo:eessi.io-2023.06-software arch:aarch64/a64fx

Copy link

eessi-bot bot commented Oct 14, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx
  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Oct 14, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx
  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • no jobs were submitted

Copy link

eessi-build-deploy-bot-deucalion bot commented Oct 14, 2024

Updates by the bot instance boegel-bot-deucalion (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx
  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

Copy link

eessi-build-deploy-bot-deucalion bot commented Oct 14, 2024

New job on instance boegel-bot-deucalion for CPU micro-architecture aarch64-a64fx for repository eessi.io-2023.06-software in job dir /home/kehoste/project_dir/bot/jobs/2024.10/pr_782/167582

date job status comment
Oct 14 09:13:22 UTC 2024 submitted job id 167582 awaits release by job manager
Oct 14 09:14:05 UTC 2024 released job awaits launch by Slurm scheduler
Oct 14 09:15:09 UTC 2024 running job 167582 is running
Oct 14 15:34:54 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-167582.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-1728918317.tar.gzsize: 335 MiB (352175732 bytes)
entries: 37026
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
Bison/3.8.2-GCCcore-13.2.0.lua
Boost.MPI/1.83.0-gompi-2023b.lua
Brotli/1.1.0-GCCcore-13.2.0.lua
cppy/1.2.1-GCCcore-13.2.0.lua
Doxygen/1.9.8-GCCcore-13.2.0.lua
ESPResSo/4.2.2-foss-2023b.lua
fontconfig/2.14.2-GCCcore-13.2.0.lua
freetype/2.13.2-GCCcore-13.2.0.lua
giflib/5.2.1-GCCcore-13.2.0.lua
GSL/2.7-GCC-13.2.0.lua
gzip/1.13-GCCcore-13.2.0.lua
HDF5/1.14.3-gompi-2023b.lua
ICU/74.1-GCCcore-13.2.0.lua
IPython/8.17.2-GCCcore-13.2.0.lua
jbigkit/2.1-GCCcore-13.2.0.lua
jedi/0.19.1-GCCcore-13.2.0.lua
libdeflate/1.19-GCCcore-13.2.0.lua
libdrm/2.4.117-GCCcore-13.2.0.lua
libglvnd/1.7.0-GCCcore-13.2.0.lua
libiconv/1.17-GCCcore-13.2.0.lua
libjpeg-turbo/3.0.1-GCCcore-13.2.0.lua
libpng/1.6.40-GCCcore-13.2.0.lua
libsodium/1.0.19-GCCcore-13.2.0.lua
LibTIFF/4.6.0-GCCcore-13.2.0.lua
libunwind/1.6.2-GCCcore-13.2.0.lua
libwebp/1.3.2-GCCcore-13.2.0.lua
libxslt/1.1.38-GCCcore-13.2.0.lua
LittleCMS/2.15-GCCcore-13.2.0.lua
LLVM/16.0.6-GCCcore-13.2.0.lua
lxml/4.9.3-GCCcore-13.2.0.lua
lz4/1.9.4-GCCcore-13.2.0.lua
Mako/1.2.4-GCCcore-13.2.0.lua
matplotlib/3.8.2-gfbf-2023b.lua
Mesa/23.1.9-GCCcore-13.2.0.lua
NASM/2.16.01-GCCcore-13.2.0.lua
OpenJPEG/2.5.0-GCCcore-13.2.0.lua
OpenPGM/5.2.122-GCCcore-13.2.0.lua
Pillow/10.2.0-GCCcore-13.2.0.lua
Pint/0.24-GCCcore-13.2.0.lua
pyMBE/0.8.0-foss-2023b.lua
Qhull/2020.2-GCCcore-13.2.0.lua
Szip/2.1.1-GCCcore-13.2.0.lua
Tk/8.6.13-GCCcore-13.2.0.lua
Tkinter/3.11.5-GCCcore-13.2.0.lua
tqdm/4.66.2-GCCcore-13.2.0.lua
Wayland/1.22.0-GCCcore-13.2.0.lua
X11/20231019-GCCcore-13.2.0.lua
ZeroMQ/4.3.5-GCCcore-13.2.0.lua
zstd/1.5.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/aarch64/a64fx/software
Bison/3.8.2-GCCcore-13.2.0
Boost.MPI/1.83.0-gompi-2023b
Brotli/1.1.0-GCCcore-13.2.0
cppy/1.2.1-GCCcore-13.2.0
Doxygen/1.9.8-GCCcore-13.2.0
ESPResSo/4.2.2-foss-2023b
fontconfig/2.14.2-GCCcore-13.2.0
freetype/2.13.2-GCCcore-13.2.0
giflib/5.2.1-GCCcore-13.2.0
GSL/2.7-GCC-13.2.0
gzip/1.13-GCCcore-13.2.0
HDF5/1.14.3-gompi-2023b
ICU/74.1-GCCcore-13.2.0
IPython/8.17.2-GCCcore-13.2.0
jbigkit/2.1-GCCcore-13.2.0
jedi/0.19.1-GCCcore-13.2.0
libdeflate/1.19-GCCcore-13.2.0
libdrm/2.4.117-GCCcore-13.2.0
libglvnd/1.7.0-GCCcore-13.2.0
libiconv/1.17-GCCcore-13.2.0
libjpeg-turbo/3.0.1-GCCcore-13.2.0
libpng/1.6.40-GCCcore-13.2.0
libsodium/1.0.19-GCCcore-13.2.0
LibTIFF/4.6.0-GCCcore-13.2.0
libunwind/1.6.2-GCCcore-13.2.0
libwebp/1.3.2-GCCcore-13.2.0
libxslt/1.1.38-GCCcore-13.2.0
LittleCMS/2.15-GCCcore-13.2.0
LLVM/16.0.6-GCCcore-13.2.0
lxml/4.9.3-GCCcore-13.2.0
lz4/1.9.4-GCCcore-13.2.0
Mako/1.2.4-GCCcore-13.2.0
matplotlib/3.8.2-gfbf-2023b
Mesa/23.1.9-GCCcore-13.2.0
NASM/2.16.01-GCCcore-13.2.0
OpenJPEG/2.5.0-GCCcore-13.2.0
OpenPGM/5.2.122-GCCcore-13.2.0
Pillow/10.2.0-GCCcore-13.2.0
Pint/0.24-GCCcore-13.2.0
pyMBE/0.8.0-foss-2023b
Qhull/2020.2-GCCcore-13.2.0
Szip/2.1.1-GCCcore-13.2.0
Tk/8.6.13-GCCcore-13.2.0
Tkinter/3.11.5-GCCcore-13.2.0
tqdm/4.66.2-GCCcore-13.2.0
Wayland/1.22.0-GCCcore-13.2.0
X11/20231019-GCCcore-13.2.0
ZeroMQ/4.3.5-GCCcore-13.2.0
zstd/1.5.5-GCCcore-13.2.0
other under 2023.06/software/linux/aarch64/a64fx
2023.06/init/minimal_eessi_env
Oct 14 15:34:54 UTC 2024 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
✅ job output file slurm-167582.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Oct 14 15:49:02 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-a64fx-1728918317.tar.gz to S3 bucket succeeded

@boegel boegel added bot:deploy Ask bot to deploy missing software installations to EESSI and removed bot:deploy Ask bot to deploy missing software installations to EESSI labels Oct 14, 2024
@boegel
Copy link
Contributor Author

boegel commented Oct 14, 2024

@bedroge Can you verify that the init/minimal_eessi_env in the tarball is correct now?

@bedroge
Copy link
Collaborator

bedroge commented Oct 14, 2024

@bedroge Can you verify that the init/minimal_eessi_env in the tarball is correct now?

Extracted the tarball and did a diff with the file from the software-layer repo:

[bob@multixscale-stratum0 tmp]$ diff 2023.06/init/minimal_eessi_env software-layer/init/minimal_eessi_env 
[bob@multixscale-stratum0 tmp]$ 

And, indeed, the file now has:

# set $EPREFIX since that is basically a standard in Gentoo Prefix
# if $EESSI_COMPAT_LAYER_DIR is defined (for example by run_in_compat_layer_env.sh script), we use that value
if [ ! -z ${EESSI_COMPAT_LAYER_DIR} ]; then
    export EPREFIX=$EESSI_COMPAT_LAYER_DIR
else
    export EPREFIX=$EESSI_PREFIX/compat/$EESSI_OS_TYPE/$EESSI_CPU_FAMILY
fi

So, looks good to me now.

@bedroge bedroge merged commit 024e44c into EESSI:2023.06-software.eessi.io Oct 14, 2024
42 checks passed
Copy link

eessi-bot bot commented Oct 14, 2024

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.14

Copy link

eessi-bot bot commented Oct 14, 2024

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.14

@boegel boegel deleted the feature/dev.eessi.io_TEST branch October 15, 2024 06:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2023.06-software.eessi.io 2023.06 version of software.eessi.io a64fx bot:deploy Ask bot to deploy missing software installations to EESSI
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants