Skip to content

Add a data pipeline page for curators - #3

Merged
nando-bingani merged 1 commit into
mainfrom
pipeline-page
Oct 7, 2026
Merged

nando-bingani merged 1 commit into
mainfrom
pipeline-page

Conversation

@nando-bingani

Copy link
Copy Markdown
Collaborator

/admin/pipeline, linked from the review queue, is a read-only view of what the data pipeline loaded:

  • each source's last load;
  • rows in the source, kept out, in the app and public;
  • recent runs;
  • conflicts: projects changed in both the app and the source, where the app's version was kept;
  • data-quality issues, each opening a worklist of the affected projects (e.g. the legacy projects still without a province).

Reviewers only (validate-submission), like the queue. Needs nccrd-server's /pipeline endpoints. The source labels the review queue used now live in utils/dataSources.js for both pages.

/admin/pipeline, linked from the review queue, is a read-only view of what
the data pipeline loaded:
- each source's last load;
- rows in the source, kept out, in the app and public;
- recent runs;
- conflicts: projects changed in both the app and the source, where the
  app's version was kept;
- data-quality issues, each opening a worklist of the affected projects
  (e.g. the legacy projects still without a province).

Reviewers only (validate-submission), like the queue. Needs nccrd-server's
/pipeline endpoints. The source labels the review queue used now live in
utils/dataSources.js for both pages.
@nando-bingani
nando-bingani merged commit c77d545 into main Oct 7, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant