Skip to content

Conversation

@hydrosat-dgleason
Copy link
Contributor

The default checksum algorithm for new uploaded objects to AWS S3 is CRC-64/NVME, according to their documentation: https://docs.aws.amazon.com/AmazonS3/latest/userguide/checking-object-integrity.html

Because S3 has default integrity protections, if objects are uploaded without a checksum, S3 automatically attaches the recommended full object CRC-64/NVME (CRC64NVME) checksum algorithm to the object.

The description and references below were taken from https://github.com/awesomized/crc64fast-nvme:

CRC-64/NVME comes from the NVM Express® NVM Command Set Specification (Revision 1.0d, December 2023) and has also been implemented in the Linux kernel (where it's called CRC-64/Rocksoft) and is AWS S3's recommended checksum option as CRC64-NVME. (Note that the Check value in the spec uses incorrect endianness [Section 5.2.1.3.4, Figure 120, page 83]).

Other references:

@rvagg rvagg merged commit be412d8 into multiformats:master Aug 21, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants