Skip to content
This repository was archived by the owner on Oct 6, 2026. It is now read-only.

NGWPC-11732 - Update API Docs - #109

Merged
quercoak merged 4 commits into
mainfrom
NGWPC-11732
Sep 21, 2026
Merged

quercoak merged 4 commits into
mainfrom
NGWPC-11732

Conversation

@brock-hinkson

Copy link
Copy Markdown

Updating API docs to bring information in-line with current tools/schemas

Additions

  • NHF and HFv2.2 Schemas - tables and JSON formulation
  • New catalog/icechunk localization script docs
  • Catalog update doc

Removals

  • References to export_catalog.py
  • References to other old/deleted tools

Changes

  • Refactored deployment instructions from README to the mkdocs setup, moved local TAR deploy to top
  • General refactoring/updating and removal of outdated info

@brock-hinkson brock-hinkson self-assigned this Sep 16, 2026
@brock-hinkson

Copy link
Copy Markdown
Author

As I'm moving onto the Confluence docs, I can/will come back to this to update based on feedback - I have been divorced from the API side of Icefabric for a while, so cleaning up the docs was a denser task than anticipated. Hopefully getting eyes on the current changes will highlight where more changes should be made, or more fixes, etc.

@quercoak quercoak left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I haven't had time to run the dashboard live yet, but please fix based on comments. You deleted a lot of content in the move from readme to deployment. The streamlit and local running is still relevant information worth keeping around, just not at the top of the file. I pushed a small commit with some things I wanted to add so make to pull.

./compose.sh api test
# Prod (OE) deploy
./compose.sh api prod
```

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You removed everything about the dashboard. Please add back info about running the dashboard locally and docker.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

☑️

Comment thread README.md
```
Note: Functionality is split into `optional-dependencies` in `pyproject.toml`. If you only require base functionality, install as `uv sync`. If you require some extras (e.g. `icechunk`, `io`), you can specify `uv sync --extra icechunk --extra io` as needed. For local develpoment, `--all-extras` is recommended for complete functionality.

### Running/deploying the services

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please leave this heading pointing the user at deployment.md for full details. Keep here:

  • running the API locally (glue or sql)
  • full local deployment from archive
    And move the rest to deployment.md alerting users to find additional details there

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

☑️

Comment thread docs/user_guide/icefabric_tools.md Outdated

### Overview

Script located at `tools/local_catalog_sync.py` - downloads the Icefabric catalog from S3 and rewrites paths for local use

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You need aws environment variables set

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

☑️

Comment thread docs/user_guide/icefabric_tools.md Outdated

### Overview

Script located at `tools/localize_streamflow.py` - downloads the Icechunk store from S3 to the local filesystem

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

need aws env vars set

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

☑️

Comment thread docs/index.md
@@ -18,27 +18,6 @@ source .venv/bin/activate
```
Note: Functionality is split into `optional-dependencies` in `pyproject.toml`. If you only require base functionality, install as `uv sync`. If you require some extras (e.g. `icechunk`, `io`), you can specify `uv sync --extra icechunk --extra io` as needed. For local develpoment, `--all-extras` is recommended for complete functionality.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add a header here called Deployment and direct the user to the URI of the page

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

☑️

"flowpaths": Flowpaths,
"nexus": Nexus,
"reference_flowpaths": ReferenceFlowpaths,
"waterbodies": Waterbodies,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

deprecated, remove

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

☑️

ReservoirDA,
VirtualFlowpaths,
VirtualNexus,
Waterbodies,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

☑️

python -m app.main --catalog glue --deploy-env test
# Prod
python -m app.main --catalog glue --deploy-env prod
```

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add running from local sql

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

☑️

@brock-hinkson

Copy link
Copy Markdown
Author

Just updated to resolve Quercus' comments - linked to the full API deploy docs where possible, as well as with the Dashboard deploy full doc

@quercoak
quercoak merged commit 0cff694 into main Sep 21, 2026
9 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants