How to Read and Write HDF5 Data file in Python

#1

HDF stands for Hierarchical Data Format, a well known file format for storing and organizing large amounts of numerical data . In python HDF5 data files can be handled by means of the h5py module. This article explains how to read and write hdf5 files in Python. See also h5py quick start, How to access HDF5 data from Python, and Read HDF 5 file in Python

See a quick example in post #2 below.

#2

Here is a quick example on how to create, save and read data into and from hdf5 files in Python (See more examples here).

Code: [Select all] [Expand/Collapse]

import numpy as np
import h5py
 
#Create data files, here we create two random matrices
data_file1 = np.random.random(size = (1000, 1000))
data_file2 = np.random.random(size = (500, 400))
 
#Save data files in the hdf5 format in the file hdf5_data
with h5py.File('/home/tssfl/Desktop/hdf5_data.h5', 'w') as hdf:
    hdf.create_dataset("data_set1", data = data_file1)
    hdf.create_dataset("data_set2", data = data_file2)
 
#Read the dataset:
f = h5py.File('/home/tssfl/Desktop/hdf5_data.h5', 'r')
 
#Check the dataset keys
f.keys()
Out[3]: [u'data_set1', u'data_set2']
 
#Get specific data files
data1 = f['data_set1']
 
#Check data shape
data1.shape
Out[5]: (1000, 1000)
 
#Similarly for data_set2
data2 = f['data_set2']
data2.shape
Out[7]: (500, 400)

TSSFL TECHNOLOGY STACK

How to Read and Write HDF5 Data file in Python

Who is online

How to Read and Write HDF5 Data file in Python

Who is online

Login • Register