Skip to content

Commit

Permalink
Merge pull request #908 from FredHutch/issue_786
Browse files Browse the repository at this point in the history
Update storage summary with locations and updated charge schedule
  • Loading branch information
atombaby authored Sep 8, 2023
2 parents 30d8f77 + 5a43a26 commit a0b8bba
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions _scicomputing/store_overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -64,15 +64,15 @@ At this time both _fast_ and _secure_ storage platforms have the same capabiliti

Storage Resource | Costs (per TB/month)\* | Backup Location/Duration | Best Use
--- | --- | --- | --- | ---
Home | Free to 100GB limit | 7 days of Snapshots, Daily backups, Off Site copy | Only use this location for software and settings specific to a user, not for data, not shared to others. HARD LIMIT, cannot be expanded
Fast | $$$ beyond 1TB per PI | 7 days of Snapshots, Daily backups, Off Site copy | Large instrument files and data sets that need high performance access to computing resources, Unix file permissions, but not temporary data (such as intermediate files)
Economy Cloud | $ beyond 100TB per PI | Multi-datacenter replication, 90 day undelete (Trashcan) with request to `helpdesk` | Best for archiving large data sets, or primary storage of large files. Good for PHI or other data that requires encryption and auditing. *Requires Desktop Client to access, see [Object Storage page.](/scicomputing/store_objectstore/)*
Scratch | Free | Not backed up | Temporary files, such as those intermediate to a final result that only need to persist during a job, and secondary copies of files used in analysis but with a primary copy on more durable storage *Appropriate use can significantly reduce data storage costs- see the [Scratch Storage](/scicomputing/store_scratch/) page.*
OneDrive | None | Recycle Bin available | Documents, spreadsheets, and other similar administrative files
Home | No Charge (100GB limit) | On campus storage with offsite replication. 7 days of snapshots, daily backups | Only use this location for software and settings specific to a user, not for data, not shared to others. HARD LIMIT, cannot be expanded
Fast | $$$ beyond 5TB per PI | On campus storage with offsite replication. 7 days of snapshots, daily backups | Large instrument files and data sets that need high performance access to computing resources, Unix file permissions, but not temporary data (such as intermediate files)
Economy Cloud | $ beyond 100TB per PI | Offsite storage (cloud) with multi-datacenter replication, 90 day undelete with request to `helpdesk` | Best for archiving large data sets, or primary storage of large files. Good for PHI or other data that requires encryption and auditing. *Requires Desktop Client to access, see [Object Storage page.](/scicomputing/store_objectstore/)*
Scratch | No Charge | On campus storage, no snapshots, not backed up | Temporary files, such as those intermediate to a final result that only need to persist during a job, and secondary copies of files used in analysis but with a primary copy on more durable storage *Appropriate use can significantly reduce data storage costs- see the [Scratch Storage](/scicomputing/store_scratch/) page.*
OneDrive | No Charge | Offsite storage (cloud) with multi-datacenter replicaiton. No backups, but a "Recycle Bin" is available | Documents, spreadsheets, and other similar administrative files

Additional details for other CIT file services such as `Secure File` (aka J or R drive) features are available on [Centernet](https://centernet.fredhutch.org/cn/u/center-it/services/storedataprotect.html).

For expenses charged to your group for data storage in these systems, please see the [storage usage dashboard](https://grafana.fredhutch.org/d/dy5I3SIMk/data-core-storage-usage/). If you are interested in a breakdown of your storage ulitization by folder you can get these details at [Storage HotSpots](https://storage-hotspots.fhcrc.org/). Please select your PI as owner. You can also export all data as CSV. (Please note: for performance reasons only folders > 1GB without subfolders are shown here) . For pricing information please check [this page](https://centernet.fredhutch.org/cn/u/shared-resources/data-resource.html) on CenterNet.
For expenses charged to your group for data storage in these systems, please see the [storage usage dashboard](https://grafana.fredhutch.org/d/dy5I3SIMk/data-core-storage-usage/). If you are interested in a breakdown of your storage utilization by folder you can get these details at [Storage HotSpots](https://storage-hotspots.fhcrc.org/). Please select your PI as owner. You can also export all data as CSV. (Please note: for performance reasons only folders > 1GB without subfolders are shown here). For pricing information please check [this page](https://centernet.fredhutch.org/cn/u/shared-resources/data-resource.html) on CenterNet.

## Data Storage Guidance

Expand Down

0 comments on commit a0b8bba

Please sign in to comment.