Skip to content

About

Satellite data files contain lots of useful information... sometimes too much. It can be a burden to read, process, and store the extraneous data. This notebook will open a file, keep wanted fields, and discard the rest. The results will be saved in a compressed netcdf4 file for future use.

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

4 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Thinning netCDF files

Author: Rebekah Esmaili

Objective

This Jupyter notebook will 'keep' a list of variables and remove the rest. It's barebones and meant to be illustrative.

Required libraries

You will need xarray to run this code. Xarray can support netcdf and HDF files, and I show one example for each (NUCAPS and IMERG, respectively). Using the code, the resulting file size is smaller, which can help with data storage if you have a lot of files.

  • NUCAPS reduces from 33 MB --> 37 MB
  • IMERG reduces from 10.5 MB --> 338 kB

In the HDF example, I also subset the data spatially to make the domain (and file) smaller. This is optional. Note that the saved files are in netCDF format.

About

Satellite data files contain lots of useful information... sometimes too much. It can be a burden to read, process, and store the extraneous data. This notebook will open a file, keep wanted fields, and discard the rest. The results will be saved in a compressed netcdf4 file for future use.

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Contributors

Languages