Skip to content

Commit 145de0e

Browse files
authored
Merge pull request #435 from digital-land/feat/move-tasks-to-data-pipeline-section
feat: move tasks explanation to data-pipeline-architecture
2 parents 3ce630b + a9f430c commit 145de0e

2 files changed

Lines changed: 3 additions & 2 deletions

File tree

docs/data-operations-manual/Explanation/Key-Concepts/Tasks.md renamed to docs/architecture-and-infrastructure/data-pipeline-architecture/Key-Concepts/Tasks.md

File renamed without changes.

docs/architecture-and-infrastructure/data-pipeline-architecture/processes/generate-tasks.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,8 @@ title: Generate tasks
44

55
# Generate tasks
66

7-
The generate-tasks process reads collection logs and issue data produced by the nightly pipeline runs and produces a [task](../../../data-operations-manual/Explanation/Key-Concepts/Tasks.md) table. This gives data providers a single queryable source of data quality problems they need to fix.
7+
The generate-tasks process reads collection logs and issue data produced by the nightly pipeline runs and produces a [task](../Key-Concepts/Tasks.md) table.
8+
This gives data providers a single queryable source of data quality problems they need to fix.
89

910
## When it runs
1011

@@ -31,7 +32,7 @@ For each collection in S3, the job reads three files:
3132

3233
The output is a [Delta Lake](https://delta.io/) table written to `s3://{env}-parquet-datasets/task/`. The table is fully overwritten on each run — it always reflects the current state of all collections.
3334

34-
The table schema matches the [task columns](../../../data-operations-manual/Explanation/Key-Concepts/Tasks.md#task-columns) defined in the key concepts page.
35+
The table schema matches the [task columns](../Key-Concepts/Tasks.md#task-columns) defined in the key concepts page.
3536

3637
## Implementation
3738

0 commit comments

Comments
 (0)