Snapshot lifecycle management for Datasets

john.stanton-geddes

Meant to post this in 'Feature Requests' ... reposting there but can't figure out how to delete or move this post ...

Datasets are a very cool feature, and it's seemingly logical to have a Scheduled Job that would ingest some data on a regular basis, and update the dataset. However, as I found after my Scheduled Job failed on day 21, the default setting is limited to 20 snapshots. While you can manually delete snapshots, or do so using the CLI, it'd be nice to have the ability to set up "Snapshot Lifecycles" that would only keep the most recent X snapshots, or delete snapshots after X days.

https://docs.dominodatalab.com/en/4.1/reference/data/datasets/Datasets_overview.html