lazyarray: Persistent Large Data Array with Lazy-Loading on Demand
Multi-threaded serialization of compressed array that
fully utilizes modern solid state drives. It allows
to store and load extremely large data on demand within seconds
without occupying too much memories. With data stored on hard drive,
a lazy-array data can be loaded, shared across multiple R sessions.
For arrays with partition mode on, multiple R sessions can write to
a same array simultaneously along the last dimension (partition).
The internal storage format is provided by 'fstcore' package geared by
'LZ4' and 'ZSTD' compressors.
| Version: |
1.1.0 |
| Imports: |
Rcpp (≥ 1.0.4), R6, fstcore, yaml |
| LinkingTo: |
Rcpp, fstcore |
| Suggests: |
testthat, knitr, fst, rmarkdown, dipsaus (≥ 0.0.8) |
| Published: |
2020-07-18 |
| Author: |
Zhengjia Wang [aut, cre, cph],
Mark Klik [ctb, cph] (Copyright holder of fstcore package) |
| Maintainer: |
Zhengjia Wang <dipterix.wang at gmail.com> |
| BugReports: |
https://github.com/dipterix/lazyarray/issues |
| License: |
AGPL-3 |
| URL: |
https://github.com/dipterix/lazyarray |
| NeedsCompilation: |
yes |
| SystemRequirements: |
C++11 little-endian platform |
| Language: |
en-US |
| Materials: |
NEWS |
| CRAN checks: |
lazyarray results |
Documentation:
Downloads:
Linking:
Please use the canonical form
https://CRAN.R-project.org/package=lazyarray
to link to this page.