hdf5
hdfgroup.org
Actively hiring
Information Technology
Follow
Overview
News
Salaries
Products
People
Growth
Offices
Financials
News
HSDS 1.0.0 Release: A Milestone for Cloud-Native HDF5
The HDF Group is happy to announce the release of HSDS 1.0.0, h5pyd 1.0.0, and hdf5-json 2.0.0. The three projects now share a single implementation of the HDF5 object model instead of maintaining three copies of it. Additionally, this release brings majo
Read more
Report
Oldie but a goodie
Nearly 40 years on, HDF4 receives one final official release focused on security, stability, and long-term use. HDF4 has supported scientific computing for nearly four decades. It has powered remote sensing systems, Earth science applications, aerospace w
Read more
Report
HDF5 beyond the file: findings from our safety, security, and privacy audit
Excerpt: A new ecosystem-level audit identifies recurring failure classes, clarifies where authority and responsibility reside, and proposes a phased mitigation roadmap for HDF5 and its wider software and data ecosystem. HDF5 is foundational infrastructur
Read more
Report
HDF5 was the mechanism, not the vulnerability
In our July 31 post, "When an HDF5 file points outside itself," we described the use of HDF5 external raw storage in the Hugging Face incident. Some later accounts have labeled this as an "HDF5 vulnerability." A recent Black Hat presentation, around 27:13
Read more
Report
Storing bfloat16 and FP8 tensors in HDF5 without a conversion tax
by Scot Breitenfeld, Director of Engineering, The HDF Group Training and deploying large models requires transferring significant volumes of low-precision tensors, including weights, gradients, activations, and KV caches. bfloat16 maintains float32's expo
Read more
Report
When an HDF5 file points outside itself
by Gerd Heber, Executive Director, The HDF Group When something goes wrong, someone is going to tell the story. You'll be better off if it's you. Otherwise, you create an opportunity for rumors, hearsay, and false information to spread. (Jason Fried & Dav
Read more
Report
Release of HDF5 2.2.0 and Two August Events (Newsletter #210)
HDF5 2.2.0 Now Available The HDF Group is pleased to announce the release of HDF5 2.2.0, delivering improved cloud performance, stronger security capabilities, enhanced build and deployment workflows, and numerous reliability and usability improvements ac
Read more
Report
Standardizing Tabular Data: Introducing the HDF5 Extension Proposal HEP001
In this episode of "Call the Doctor," Aleksandar Jelenak explores the HDF5 Extension Proposal HEP001. This proposal aims to modernize how we handle tabular data in HDF5 by introducing a columnar storage specification, moving beyond legacy row-based approa
Read more
Report
String-Based Filter Configuration with TOML - Scot Breitenfeld - Call the Doctor (5/12/26)
In this session of "Call the Doctor," The HDF Group's Scot Breitenfeld discusses a major modernization effort for HDF5: moving from opaque integer-based filter parameters to human-readable TOML strings. This update, targeted for the HDF5 2.2 release, simp
Read more
Report
A Simple Blockchain in HDF5 and a Preview of h5explain, our first "pickled" tool - Call the Doctor
In this episode of Call the Doctor, Gerd Heber addresses a growing need in high-performance computing: verifiable data provenance. He demonstrates that HDF5 is capable of supporting tamper-evident blockchain patterns by interlinking datasets with SHA-256
Read more
Report
Show more news