Skip to content

Upgrade to hZCCl2 - #7

Open
JeffeyChou wants to merge 1 commit into
ZCCLorg:mainfrom
JeffeyChou:dev-zccl2
Open

Upgrade to hZCCl2#7
JeffeyChou wants to merge 1 commit into
ZCCLorg:mainfrom
JeffeyChou:dev-zccl2

Conversation

@JeffeyChou

Copy link
Copy Markdown
Contributor

This PR brings hZCCL2 (SC'26) into this repository.

What is new in it

  • Compressor: introduce 1. block-aligned thread partitioning support; 2. SIMD support(AVX2, AVX2-512); 3. new Outlier-FLE codec; 4. an optional lossless stage (zlib/blosc/zfp)
  • Collectives: 1. rebuilt collectives including broadcast, scatter, allreduce; 2. introduce Alltoall collective; 3. Safer datatype and buffer size management, addressing Fix buffer safety, MPI type size correctness, and empty-data edge cases #6 ;
  • Benchmarks and jobs: release job scripts associated with artifact.

Fixes

  • Every compressed buffer is sized by the codec's worst-case bound, so incompressible or fill-value data can no longer overflow.
  • Zero-length inputs are handled by every codec entry point and collective.
  • Dropped the library-side MPI_IN_PLACE definition that conflicted with Open MPI.
  • Element sizes no longer come from sizeof(MPI_Datatype); collectives accept MPI_FLOAT and return MPI_ERR_TYPE otherwise.

Supersedes #6.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant