You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/examples/sqlmesh_cli_crash_course.md
+8-8Lines changed: 8 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -992,11 +992,11 @@ This command is intended be run on a schedule. It will skip the physical and vir
992
992
);
993
993
```
994
994
995
-
###**Forward-Only Development Workflow**
995
+
## **Forward-Only Development Workflow**
996
996
997
-
This is an advanced workflow and specifically designed for extremely large incremental models that take a long time to run even during development. It solves for:
997
+
This is an advanced workflow and specifically designed for large incremental models (ex: > 200 million rows) that take a long time to run even during development. It solves for:
998
998
999
-
-Transformaing data with constant schema evolution in json and nested array data types.
999
+
-Transforming data with constant schema evolution in json and nested array data types.
1000
1000
- Retaining history of a calculated column and applying a new calculation to new rows going forward.
1001
1001
1002
1002
When you apply the plan to `prod` after the dev worfklow, it will NOT backfill historical data. It will only execute model batches **forward only** for new intervals (new rows).
@@ -1025,8 +1025,8 @@ When you apply the plan to `prod` after the dev worfklow, it will NOT backfill h
1025
1025
1026
1026
- I applied a change to a new column
1027
1027
- It impacts 2 downstream models
1028
-
- I enforced a forward-only plan to avoid backfilling historical data
1029
-
- I previewed the changes in a clone of the models impacted (clones will NOT be reused in production)
1028
+
- I enforced a forward-only plan to avoid backfilling historical data for the incremental model (ex: `preview` language in the CLI output)
1029
+
- I previewed the changes in a clone of the incremental impacted (clones will NOT be reused in production) along with the full and view models (these are NOT clones).
1030
1030
1031
1031
```bash
1032
1032
Differences from the `dev` environment:
@@ -1058,7 +1058,7 @@ When you apply the plan to `prod` after the dev worfklow, it will NOT backfill h
@@ -1080,7 +1080,7 @@ When you apply the plan to `prod` after the dev worfklow, it will NOT backfill h
1080
1080
```
1081
1081
1082
1082
1083
-
When this is applied to `prod`, it will only execute model batches for new intervals (new rows). That's why you notice it only made a virtual layer update for this example.
1083
+
When this is applied to `prod`, it will only execute model batches for new intervals (new rows). This will NOT re-use `preview` models in development.
1084
1084
1085
1085
```bash
1086
1086
Differences from the `prod` environment:
@@ -1131,7 +1131,7 @@ When you apply the plan to `prod` after the dev worfklow, it will NOT backfill h
1131
1131
```
1132
1132
1133
1133
1134
-
###**Miscellaneous**
1134
+
## **Miscellaneous**
1135
1135
1136
1136
If you notice you have a lot of old development schemas/data, you can clean them up with the following command. This process runs automatically during the `sqlmesh run` command. This defaults to deleting old data past 7 days.
0 commit comments