Skip to content

Wheels: Deactivate AVX512 in Blosc2 for non-OSX targets #1763

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Jun 20, 2025

Conversation

franzpoeschel
Copy link
Contributor

@franzpoeschel franzpoeschel commented Jun 17, 2025

Blosc2 activates AVX512 instructions by default if they are available. Since we cross-compile, this causes issues on architectures that do not have these instructions available (mainly AMD).

This PR additionally brings our Wheel deployments up to date with current software versions:

  • EOL of Github runners:
    • ubuntu-20.04 -> ubuntu-22.04
    • windows-2019 -> windows-2022, Visual Studio 16 -> Visual Studio 17
  • CMake 4 requires upgrading some dependencies
    • Zfp 0.5.5 -> 1.0.1
    • Zlib 1.2.13 -> 1.3.1
  • Fix the two issues discussed in the description of this ADIOS2 PR, coming up with upgrading from windows-2019 to windows-2022
  • Remove outdated depencencies: ADIOS1 + Blosc 1

Since this is just a post-release, I will upgrade no other dependencies where it is not necessary.

@franzpoeschel franzpoeschel added the continuous deployment automated shipping label Jun 17, 2025
@franzpoeschel
Copy link
Contributor Author

Tested on a system with AMD CPU: This fixes an observed issue when decompressing a dataset written with Blosc2:

> python -m venv env_old 
> . env_old/bin/activate
> pip install openpmd_api # Use current published wheel
> openpmd-pipe --infile checkpoint_005000.bp5/ --outfile uncompressed_%T.bp5
...
Illegal instruction (core dumped)
> python -m venv env_new
> . env_new/bin/activate
> pip install openpmd_api-0.16.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl # artifact from this PR
> openpmd-pipe --infile checkpoint_005000.bp5/ --outfile uncompressed_%T.bp5
# succeeds

@franzpoeschel franzpoeschel requested a review from ax3l June 20, 2025 08:59
@franzpoeschel franzpoeschel merged commit 2235b29 into openPMD:wheels Jun 20, 2025
9 of 10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
continuous deployment automated shipping
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant