AWS S3 Lifecycle Management: Difference between revisions
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
(This page is a work in progress. The policies defined below | (This page is a work in progress. The policies defined below may still be adjusted, and are not actively deployed) | ||
==AWS S3 Lifecycle Policy Overview== | ==AWS S3 Lifecycle Policy Overview== | ||
AWS S3 buckets can be configured with lifecycle policies. These policies allow for automatically changing the storage class of objects based on the last time they were accessed. AWS S3 objects are typically stored in the Standard storage class, which provides easy access, but has relatively high GB/month storage costs. Other storage classes, such as Infrequent Access and Glacier are more suitable for objects that are rarely accessed. These storage class maintain a much lower GB/month cost as compared to the Standard S3 storage class. | AWS S3 buckets can be configured with lifecycle policies. These policies allow for automatically changing the storage class of objects based on the last time they were accessed. AWS S3 objects are typically stored in the Standard storage class, which provides easy access, but has relatively high GB/month storage costs. Other storage classes, such as Infrequent Access and Glacier are more suitable for objects that are rarely accessed. These storage class maintain a much lower GB/month cost as compared to the Standard S3 storage class, but also incur charges for access and retrieval. | ||
In order to reduce monthly S3 storage costs, the UCSC GI has implemented global S3 lifecycle policies that transition objects to cheaper storage classes if they have not been accessed recently. Specifically, AWS S3 objects are transitioned as follows: | In order to reduce monthly S3 storage costs, the UCSC GI has implemented global S3 lifecycle policies that transition objects to cheaper storage classes if they have not been accessed recently. Specifically, AWS S3 objects are transitioned as follows: | ||
* After '''30''' days of inactivity, objects are transitioned to the '''Infrequent Access''' storage class. | * After '''30''' days of inactivity, objects are transitioned to the '''Infrequent Access''' storage class. | ||
* After '''180''' days of inactivity, objects are transitioned to the '''Glacier''' storage class. | * After '''180''' days of inactivity, objects are transitioned to the '''Glacier''' storage class. | ||
==Object Recovery== | |||
In case there are objects in S3 that have been transitioned out of the Standard storage class, they can be recovered. Due to the increased access charges of objects in Infrequent Access and Glacier, if an object is expected to be accessed frequently, it should be returned to the Standard storage class. The object recovery method depends on the storage class the object is in, with Glacier being more time consuming and challenging to restore from than Infrequent Access. | |||
It is important to note that, in the event an object is recovered, the timer for transitioning the object back to Infrequent Access and Glacier is still running, and the objects will be moved again in the future if they meet the criteria. | |||
===Infrequent Access=== | |||
===Glacier=== | |||
Revision as of 23:43, 2 December 2021
(This page is a work in progress. The policies defined below may still be adjusted, and are not actively deployed)
AWS S3 Lifecycle Policy Overview
AWS S3 buckets can be configured with lifecycle policies. These policies allow for automatically changing the storage class of objects based on the last time they were accessed. AWS S3 objects are typically stored in the Standard storage class, which provides easy access, but has relatively high GB/month storage costs. Other storage classes, such as Infrequent Access and Glacier are more suitable for objects that are rarely accessed. These storage class maintain a much lower GB/month cost as compared to the Standard S3 storage class, but also incur charges for access and retrieval.
In order to reduce monthly S3 storage costs, the UCSC GI has implemented global S3 lifecycle policies that transition objects to cheaper storage classes if they have not been accessed recently. Specifically, AWS S3 objects are transitioned as follows:
- After 30 days of inactivity, objects are transitioned to the Infrequent Access storage class.
- After 180 days of inactivity, objects are transitioned to the Glacier storage class.
Object Recovery
In case there are objects in S3 that have been transitioned out of the Standard storage class, they can be recovered. Due to the increased access charges of objects in Infrequent Access and Glacier, if an object is expected to be accessed frequently, it should be returned to the Standard storage class. The object recovery method depends on the storage class the object is in, with Glacier being more time consuming and challenging to restore from than Infrequent Access.
It is important to note that, in the event an object is recovered, the timer for transitioning the object back to Infrequent Access and Glacier is still running, and the objects will be moved again in the future if they meet the criteria.
