R2 Data Catalog warns before manual delete operations
R2 Data Catalog now displays warnings in the dashboard and Wrangler CLI when you attempt to manually delete objects from a Data Catalog-enabled bucket, helping prevent data corruption from bypassing catalog transactions.
R2 Data Catalog is a managed Apache Iceberg ↗ catalog built directly into your R2 bucket. Iceberg tracks your data through a tree of metadata files, so every insert, update, and delete must go through a catalog transaction. Manually adding, modifying, or deleting objects outside the catalog can leave pointers referencing files that no longer exist, corrupting the table into an inconsistent state that is difficult to recover from.
To help prevent this, the R2 dashboard and Wrangler now warn you when you attempt a manual delete operation on a Data Catalog-enabled bucket.
Dashboard
When you try to delete objects from a bucket that has R2 Data Catalog enabled, the dashboard displays a warning explaining that the operation could leave the catalog in an invalid state, with a link to the documentation for deleting data correctly. You can cancel the operation or choose to proceed anyway.
Wrangler
Wrangler now checks whether a bucket is Data Catalog-enabled before running a delete and warns you before continuing:
Data Catalog is enabled for this bucket.
Proceeding may leave the data catalog in an invalid state. Continue?
To learn how to safely manage and delete data in your tables, refer to the R2 Data Catalog documentation.
Source: original entry ↗