Lifecycles for Dataset Snapshots

Datasets are a very cool feature, and it's seemingly logical to have a Scheduled Job that would ingest some data on a regular basis, and update the dataset. However, as I found after my Scheduled Job failed on day 21, the default setting is limited to 20 snapshots. While you can manually delete snapshots, or do so using the CLI, it'd be nice to have the ability to set up "Snapshot Lifecycles" that would only keep the most recent X snapshots, or delete snapshots after X days.
https://docs.dominodatalab.com/en/4.1/reference/data/datasets/Datasets_overview.html
Comments
-
Note that others have had this issue https://community.dominodatalab.com/discussion/182/dataset-snapshot-limit
0 -
Thanks for the feedback @john.stanton-geddes! Our team is looking at the best way to address this issue, and we'll let you know when we have an update.
Katie
Field Data Scientist @ Domino
0
Howdy, Stranger!