Page 1 of 1
How to Read and Write HDF5 Data file in Python
Posted: Wed Aug 03, 2016 9:54 pm
by Eli
HDF stands for Hierarchical Data Format, a well known file format for storing and organizing large amounts of numerical data . In python HDF5 data files can be handled by means of the h5py module.
This article explains how to read and write hdf5 files in Python. See also
h5py quick start,
How to access HDF5 data from Python, and
Read HDF 5 file in Python
See a quick example in post #2 below.
Re: How to Read and Write HDF5 Data file in Python
Posted: Thu Sep 12, 2019 5:19 pm
by Eli
Here is a quick example on how to create, save and read data into and from hdf5 files in Python (See more examples
here).
import numpy as np
import h5py
#Create data files, here we create two random matrices
data_file1 = np.random.random(size = (1000, 1000))
data_file2 = np.random.random(size = (500, 400))
#Save data files in the hdf5 format in the file hdf5_data
with h5py.File('/home/tssfl/Desktop/hdf5_data.h5', 'w') as hdf:
hdf.create_dataset("data_set1", data = data_file1)
hdf.create_dataset("data_set2", data = data_file2)
#Read the dataset:
f = h5py.File('/home/tssfl/Desktop/hdf5_data.h5', 'r')
#Check the dataset keys
f.keys()
Out[3]: [u'data_set1', u'data_set2']
#Get specific data files
data1 = f['data_set1']
#Check data shape
data1.shape
Out[5]: (1000, 1000)
#Similarly for data_set2
data2 = f['data_set2']
data2.shape
Out[7]: (500, 400)