Databricks uses Lakebase branching to create an independent database per PR: a CI/CD practice
Databricks describes Snorkel AI's CI/CD solution that uses Lakebase branching to create an independent read-write database for each open PR, reducing branch readiness time from over 30 minutes to under 60 seconds. Branches use copy-on-write; on a production dataset of about 2.5 TB, 100 concurrent PR branches store only 5 to 10 GB of data each for their own changes, and TTL automatically cleans them up after the PR ends. Production data is continuously synchronized to the main branch via AWS DMS; developers log in with Okta SSO, and the CI pipeline authenticates with a service principal and short-lived OAuth tokens.

for each open PR, reducing branch readiness time from over 30 minutes to under 60 seconds. Branches use copy-on-write; on a production dataset of about 2.5 TB, 100 concurrent PR branches store only 5 to 10 GB of data each for their own changes, and TTL automatically cleans them up after the PR ends. Production data is continuously synchronized to the main branch via AWS DMS; developers log in with Okta SSO, and the CI pipeline authenticates with a service principal and short-lived OAuth tokens.
Matched fieldsSummary、Body









