Describe your feature request
The MD5 file checksum hashing is O(n) and when we started to support big files you can notice a very abysmal performance. A 5GB file can easy take up to 20s to compute the hash. This RFC is for updating the file hashing function, which is used only to detect duplicates.
The
^ The XXH64 algo is 16X faster than MD5.
Where did you see this?
I was lurking at the source code and I noticed this performance bootle neck.
Community interest
Anyone having long waits after the media has been uploaded is likely due to this. File md5 hashing is slow as the bigger the file it gets and we should update in this.
The MD5 file checksum hashing is O(n) and when we started to support big files you can notice a very abysmal performance. A 5GB file can easy take up to 20s to compute the hash. This RFC is for updating the file hashing function, which is used only to detect duplicates.
The
xxh64 algo is way faster and collision resistant, it is natively supported by PHP and we can also easily add it to JavaScript (wasm) which is really fast in the browser.^ The XXH64 algo is 16X faster than MD5.
Where did you see this?
I was lurking at the source code and I noticed this performance bootle neck.
Community interest
Anyone having long waits after the media has been uploaded is likely due to this. File md5 hashing is slow as the bigger the file it gets and we should update in this.
Last edited: