-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Format: 3.0 (quilt) Source: kerchunk Binary: python3-kerchunk, python-kerchunk-doc Architecture: all Version: 0.2.10-3 Maintainer: Debian GIS Project Uploaders: Antonio Valentino Homepage: https://github.com/fsspec/kerchunk Description: Cloud-friendly access to archival data Kerchunk is a library that provides a unified way to represent a variety of chunked, compressed data formats (e.g. NetCDF, HDF5, GRIB), allowing efficient access to the data from traditional file systems or cloud object storage. It also provides a flexible way to create virtual datasets from multiple files. It does this by extracting the byte ranges, compression information and other information about the data and storing this metadata in a new, separate object. This means that you can create a virtual aggregate dataset over potentially many source files, for efficient, parallel and cloud-friendly *in-situ* access without having to copy or translate the originals. It is a gateway to in-the-cloud massive data processing while the data providers still insist on using legacy formats for archival storage. . Features: . * completely serverless architecture * metadata consolidation, so you can understand a many-file dataset (metadata plus physical storage) in a single read * read from all of the storage backends supported by fsspec, including object storage (s3, gcs, abfs, alibaba), http, cloud user storage (dropbox, gdrive) and network protocols (ftp, ssh, hdfs, smb...) * loading of various file types (currently netcdf4/HDF, grib2, tiff, fits, zarr), potentially heterogeneous within a single dataset, without a need to go via the specific driver (e.g., no need for h5py) * asynchronous concurrent fetch of many data chunks in one go, amortizing the cost of latency * parallel access with a library like zarr without any locks * logical datasets viewing many (>~millions) data files, and direct access/subselection to them via coordinate indexing across an arbitrary number of dimensions Standards-Version: 4.7.4 Vcs-Browser: https://salsa.debian.org/debian-gis-team/kerchunk Vcs-Git: https://salsa.debian.org/debian-gis-team/kerchunk.git Testsuite: autopkgtest-pkg-pybuild Build-Depends: bitshuffle, debhelper-compat (= 13), dh-sequence-python3, dh-sequence-sphinxdoc , hdf5-filter-plugin, pybuild-plugin-pyproject, python3-aiohttp , python3-all, python3-astropy , python3-dask , python3-cfgrib, python3-cftime, python3-eccodes , python3-fsspec, python3-h5netcdf , python3-h5py, python3-hdf5plugin, python3-netcdf4 , python3-numcodecs, python3-numpy, python3-numpydoc , python3-pytest , python3-s3fs , python3-scipy, python3-setuptools, python3-setuptools-scm, python3-sphinx , python3-sphinx-rtd-theme , python3-tifffile , python3-ujson, python3-xarray, python3-zarr Package-List: python-kerchunk-doc deb doc optional arch=all python3-kerchunk deb python optional arch=all Checksums-Sha1: 9a9ce99fa7b3b262d2234c91d64a2a615bcade01 124793625 kerchunk_0.2.10.orig.tar.gz a0f733c053c95767d9e58dfba90fd299b789350c 8404 kerchunk_0.2.10-3.debian.tar.xz Checksums-Sha256: cc1b646580d5dca57d76af3415b47af9cf891fc92ed33e658d4322cdb354d542 124793625 kerchunk_0.2.10.orig.tar.gz a674750fc3d148eeca8728b9ebb5b2f5591d6379b1412aad6df2ab33f6cf6e64 8404 kerchunk_0.2.10-3.debian.tar.xz Files: f7e36dcfbe242a240cdc5b360fccc25f 124793625 kerchunk_0.2.10.orig.tar.gz 6f14a1e5983227982714a761a25f4689 8404 kerchunk_0.2.10-3.debian.tar.xz -----BEGIN PGP SIGNATURE----- iQJRBAEBCgA7FiEEO3DyCaX/1okDxHLF6/SKslePmBIFAmqrJPwdHGFudG9uaW8u dmFsZW50aW5vQHRpc2NhbGkuaXQACgkQ6/SKslePmBLznRAAxmoAbIvJ49CoNC6N 4BxyJVLzJZiUsoKjFEIShuwRVwfK6xYFoMTE9hd8CP1gU+IXidoeCDAHPlWrEd5J r5ULsSfv8FoqTc7S4qTuGR6q8nya4Cx4armub/6L6EF4rEUkYKQuhKLWTo2dFH2u Fasp3UruFx3P/TB0QVXc94hTGBn5Zhd3KgUU5UV1G03JRmcvhpuCi4b3zmafmNhH T/Aqx7LnDOiid7una7OcuBqcWFHmhvZ41i2UL5F9NjhxIp1iIzjwr3BnzKCIRWRo XwCjge3luKickKtMFZ2P0uW+UaxiwTV9TLkscEarO1aDS/sRU+jQk1y3ZsMo0HI5 Tzvi9i4yoZTaH+y6y73bOaFqN7xvkx0R4GYuC8ImBzgDRqkTM5OTz5+0V7uOkHv5 T7fTsaAXjfzWkHPTq932Hs8CmAoJGeNb3CZMT2jv9KAPR/h/BPPN5ECCTbRS5cUm zjufNxcpZ1+5bbJVUizfS1y8PkcbskVL1FoMq9Un1+i75jaXywGquy5GJ6w4ureU /6wKKil4pQUt9U1w6n22XLMDeKLfRJ3bhXifIq5qyb8mBPcAWXANb5NuvpNFA0HC eqX3/EtuHqRixRt31TtU9+qcor/KJ+eNvCaIz1acxjH4BNlGThqZF1118MaV/t2T QScwTtvyr8B/Ej/0Rsd5ZpU/AS8= =VyvY -----END PGP SIGNATURE-----