Firewalled Environment Storage Overview - Revision history

Weiler: /* /data/scratch Space on the Servers */

2026-08-11T18:30:01Z

/data/scratch Space on the Servers

← Older revision		Revision as of 11:30, 11 August 2026
Line 103:		Line 103:

	Each server will generally have a local /data/scratch filesystem that you can use to store temporary files. '''BE ADVISED''' that /data/scratch is not backed up, and the data there could disappear in the event of a disk failure or anything else. Do not store important data there. If it is important, it should be moved somewhere else very soon after creation.		Each server will generally have a local /data/scratch filesystem that you can use to store temporary files. '''BE ADVISED''' that /data/scratch is not backed up, and the data there could disappear in the event of a disk failure or anything else. Do not store important data there. If it is important, it should be moved somewhere else very soon after creation.

			These filesystems are '''not shared''', and are local to each server.

	== Backups ==		== Backups ==

Weiler at 22:02, 27 July 2026

2026-07-27T22:02:31Z

← Older revision		Revision as of 15:02, 27 July 2026
Line 36:		Line 36:

	Your home directory will be located as "/private/home/username" and has a 100GB quota. Your home directory is meant for small scripts and login data, or a git repo. Please do not try to store large data there or computer on large jobs using data in your home directory.		Your home directory will be located as "/private/home/username" and has a 100GB quota. Your home directory is meant for small scripts and login data, or a git repo. Please do not try to store large data there or computer on large jobs using data in your home directory.

			This data is backed up once a week.

	The home directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:		The home directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:

Weiler at 22:01, 27 July 2026

2026-07-27T22:01:48Z

← Older revision		Revision as of 15:01, 27 July 2026
Line 55:		Line 55:

	The group storage directories are created per PI, and each group directory has a default 15TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/groups/hausslerlab. Request access to that group directory and you will then be able to write to it. Each of those group directories are shared by the lab it belongs to, so you must be wary of everyone's data usage and share the 15TB available per group accordingly.		The group storage directories are created per PI, and each group directory has a default 15TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/groups/hausslerlab. Request access to that group directory and you will then be able to write to it. Each of those group directories are shared by the lab it belongs to, so you must be wary of everyone's data usage and share the 15TB available per group accordingly.

			This data is backed up once a month.

	The groups storage directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:		The groups storage directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:
Line 76:		Line 78:

	The archive storage directories are created per PI '''by request''', and each group directory has a default 50TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/warm-archive/hausslerlab.		The archive storage directories are created per PI '''by request''', and each group directory has a default 50TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/warm-archive/hausslerlab.

			This data is '''not''' backed up.

	The archive storage directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:		The archive storage directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:

Weiler at 22:00, 27 July 2026

2026-07-27T22:00:38Z

← Older revision		Revision as of 15:00, 27 July 2026
Line 93:		Line 93:

	Every lab directory has a '''.quota_info''' file in its root.		Every lab directory has a '''.quota_info''' file in its root.

	~~== Storage Quota Alerting ==~~

	If you and/or folks in your lab would like an automated alert when the '''/private/groups/labname''' quota is getting to a certain percentage of fullness, we can set that up for you and others in your lab. Just email '''cluster-admin@soe.ucsc.edu''' with the following information:

	~~1: Which directory you would like to watch quotas on (i.e. /private/groups/somelab)~~
	~~2: What % full you would like an email alert at~~
	~~3: What email addresses you want on the alert list~~

	After setup, our alerting system will alert folks on that email list ''every 4 hours'' until the quota in question is reduced to an amount under the alerting % threshold you asked for. So it is a bit noisy, but will force folks to delete data in order to stop the alerts. When the system notices that the quota usage has decreased to under the alert threshold, you will receive one final email with an "OK" notification that things are OK now.

	== /data/scratch Space on the Servers ==		== /data/scratch Space on the Servers ==

Weiler at 00:23, 19 July 2026

2026-07-19T00:23:58Z

← Older revision		Revision as of 17:23, 18 July 2026
Line 36:		Line 36:

	Your home directory will be located as "/private/home/username" and has a 100GB quota. Your home directory is meant for small scripts and login data, or a git repo. Please do not try to store large data there or computer on large jobs using data in your home directory.		Your home directory will be located as "/private/home/username" and has a 100GB quota. Your home directory is meant for small scripts and login data, or a git repo. Please do not try to store large data there or computer on large jobs using data in your home directory.

			The home directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:

			cat /private/home/weiler/.quota_info

			==================================================
			ZFS Private Home Storage Quota Report: weiler
			==================================================
			Username: weiler
			Space Used: 2.4G
			Total Quota: 101G
			Available: 99G

			Last Updated: 2026-07-18 17:21:12 PDT
			==================================================

	'''Groups Directories (/private/groups/labname)'''		'''Groups Directories (/private/groups/labname)'''
Line 41:		Line 56:
	The group storage directories are created per PI, and each group directory has a default 15TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/groups/hausslerlab. Request access to that group directory and you will then be able to write to it. Each of those group directories are shared by the lab it belongs to, so you must be wary of everyone's data usage and share the 15TB available per group accordingly.		The group storage directories are created per PI, and each group directory has a default 15TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/groups/hausslerlab. Request access to that group directory and you will then be able to write to it. Each of those group directories are shared by the lab it belongs to, so you must be wary of everyone's data usage and share the 15TB available per group accordingly.

	The groups storage directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:		The groups storage directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:

	cat /private/groups/corbettlab/.quota_info		cat /private/groups/corbettlab/.quota_info

Weiler: /* Storage */

2026-05-30T17:43:47Z

Storage

← Older revision		Revision as of 10:43, 30 May 2026
Line 56:		Line 56:
	==================================================		==================================================

	Every lab directory has a .quota_info file in its root.		Every lab directory has a '''.quota_info''' file in its root.

	'''Archive Directories (/private/warm-archive/labname)'''		'''Archive Directories (/private/warm-archive/labname)'''

Weiler: /* Storage */

2026-05-30T16:24:54Z

Storage

← Older revision		Revision as of 09:24, 30 May 2026
Line 41:		Line 41:
	The group storage directories are created per PI, and each group directory has a default 15TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/groups/hausslerlab. Request access to that group directory and you will then be able to write to it. Each of those group directories are shared by the lab it belongs to, so you must be wary of everyone's data usage and share the 15TB available per group accordingly.		The group storage directories are created per PI, and each group directory has a default 15TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/groups/hausslerlab. Request access to that group directory and you will then be able to write to it. Each of those group directories are shared by the lab it belongs to, so you must be wary of everyone's data usage and share the 15TB available per group accordingly.

	On the ~~compute servers you can check your group's~~ current ~~'''/private/groups'''~~ quota usage ~~by using the 'getfattr' command~~. ~~You can only check the quota of a group you are part of~~ (~~you would be a member of the UNIX group of the same name~~). ~~If you wanted to check the quota usage of /private/groups/hausslerlab for~~ example~~, you would do~~:		The groups storage directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:

	~~$ getfattr -n ceph.dir.rbytes~~ /private/groups/~~hausslerlab~~		cat /private/groups/corbettlab/.quota_info

	~~getfattr: Removing leading '/' from absolute path names~~		==================================================
	~~# file~~: ~~private/groups/hausslerlab~~		CephFS Storage Quota Report: corbettlab
	~~ceph.dir.rbytes~~=~~"6522955553147"~~		==================================================
			Filesystem Tier: CephFS
	~~That number is in bytes.~~ ~~So divide by 1,000,000,000,000 and you get '6.522 TB'.~~ ~~That is how much data is currently being used.~~		Space Used: 72T
			Total Quota: 92T
	~~To check the max quota limit, use this command~~:		Available: 21T

	~~$ getfattr -n ceph.quota.max_bytes /private/groups/hausslerlab~~

	~~getfattr~~: ~~Removing leading '/' from absolute path names~~		Last Updated: 2026-05-30 09:22:31 PDT
	~~# file~~: ~~private/groups/hausslerlab~~		==================================================
	~~ceph.quota.max_bytes~~=~~"15000000000000"~~

	~~And 15000000000000 divided by 1,000,000,000,000 is 15 TB~~.		Every lab directory has a .quota_info file in its root.

	'''Archive Directories (/private/warm-archive/labname)'''		'''Archive Directories (/private/warm-archive/labname)'''

Weiler: /* Storage Quota Alerting */

2026-05-30T15:53:36Z

Storage Quota Alerting

← Older revision		Revision as of 08:53, 30 May 2026
Line 84:		Line 84:
	== Storage Quota Alerting ==		== Storage Quota Alerting ==

	If you and/or folks in your lab would like an automated alert when the /private/groups/labname quota is getting to a certain percentage of fullness, we can set that up for you and others in your lab. Just email '''cluster-admin@soe.ucsc.edu''' with the following information:		If you and/or folks in your lab would like an automated alert when the '''/private/groups/labname''' quota is getting to a certain percentage of fullness, we can set that up for you and others in your lab. Just email '''cluster-admin@soe.ucsc.edu''' with the following information:

	1: Which directory you would like to watch quotas on (i.e. /private/groups/somelab)		1: Which directory you would like to watch quotas on (i.e. /private/groups/somelab)

Weiler: /* Storage */

2026-05-30T15:53:14Z

Storage

← Older revision		Revision as of 08:53, 30 May 2026
Line 74:		Line 74:
	Project ID: 105		Project ID: 105
	Space Used: 148G		Space Used: 148G
	Total Quota: ~~100T~~		Total Quota: 50T
	Available: ~~100T~~		Available: 50T

	Last Updated: 2026-05-30 08:45:57 PDT		Last Updated: 2026-05-30 08:45:57 PDT

Weiler: /* Storage */

2026-05-30T15:52:31Z

Storage

← Older revision		Revision as of 08:52, 30 May 2026
Line 64:		Line 64:

	The archive storage directories are created per PI '''by request''', and each group directory has a default 50TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/warm-archive/hausslerlab.		The archive storage directories are created per PI '''by request''', and each group directory has a default 50TB hard quota. For example, if David Haussler is the PI that you report to directly, then the directory would exist as /private/warm-archive/hausslerlab.

			The archive storage directories have a file in the root of them that contains current quota usage info. These files (.quota_info) are updated once an hour. For example:

			cat /private/warm-archive/corbettlab/.quota_info

			==================================================
			ZFS Storage Quota Report: corbettlab
			==================================================
			Project ID: 105
			Space Used: 148G
			Total Quota: 100T
			Available: 100T

			Last Updated: 2026-05-30 08:45:57 PDT
			==================================================

			Every lab directory has a '''.quota_info''' file in its root.

	== Storage Quota Alerting ==		== Storage Quota Alerting ==