Data and Filesystem
Data and Filesystem#
This section describes how files and data storage are handled in 2i2c Hubs.
Some quick recommendations for how to handle data:
Use your home directory to store code, notebooks, and small data files (<1 GB) for personal use
Use cloud object storage to store larger datasets and to share data across your team
Consider whether your project would benefit from other cloud-native data storage solutions such as a database, data warehouse, or data lake
For more information, see the sections below.
- Filesystem and user directory
- Use Git / GitHub
- Share data files with your users
- Cloud Object Storage
References and attribution#
Much of this material was adapted from the Pangeo Cloud User Guide.