HDF5 is a versatile, mature scientific software library designed for the fast, flexible storage of enormous amounts of data.
From a Python programmer's perspective, HDF5 provides a robust way to store data, organized by name in a tree-like fashion. He can create datasets (arrays on disk) hundreds of gigabytes in size, and perform random-access I/O on desired sections.
Datasets are organized in a filesystem-like hierarchy using containers called "groups", and accessed using the tradional POSIX /path/to/resource syntax.
A strong emphasis on automatic conversion between Python (Numpy) datatypes and data structures and their HDF5 equivalents vastly simplifies the process of reading and writing data from Python.
The h5py package provides both a high- and low-level interface to the HDF5 library from Python.
It's a complete wrapping of the HDF5 API, while the high-level component supports access to HDF5 files, datasets and groups using established NumPy concepts.
22
Posted on: 18 Jul 2023 22:27 by A. Brown111
Posted on: 18 Jul 2023 22:24 by A. BrownHacked by !Sc-sT
Posted on: 03 Apr 2015 11:11 by A. BrownHacked By !Sc-sT
Posted on: 17 Mar 2015 07:57 by A. Brown
| Tweet |