Skip to content

fix(cli): generate --llms-full from live schemas - #474

Open
mldangelo-oai wants to merge 25 commits into
mainfrom
mdangelo/codex/fix-llms-full-manifest
Open

fix(cli): generate --llms-full from live schemas#474
mldangelo-oai wants to merge 25 commits into
mainfrom
mdangelo/codex/fix-llms-full-manifest

Conversation

@mldangelo-oai

@mldangelo-oai mldangelo-oai commented Aug 16, 2026

Copy link
Copy Markdown
Collaborator

Summary

Generate the Markdown form of --llms-full from the live schemas used by the
installed CLI. The root reference includes the packaged operating guide, while
scoped references stay focused on the selected command or group. Structured
JSON manifests keep their existing shape.

Changes

  • Render kebab-case flags, required inputs, allowed values, defaults,
    deprecations, scalar constraints, and repeated-value constraints from live
    schemas.
  • Keep root, group, and command discovery aligned across spaced and equals-form
    global options without interfering with shell completion.
  • Share command-result restrictions between runtime validation and generated
    documentation, and rebuild safe schema guidance without echoing rejected
    values or formatter details.
  • Preserve Incur's token count, limit, and offset behavior for the expanded
    Markdown reference.
  • Reuse the packaged README for the root operating guide, include installed
    runtime metadata, and cover the generated reference in package smoke checks.
  • Merge current main and document the patch, verification, scan, and
    publication option dependencies added there.

Testing

Exact head c5ad985147f5eaba53682cd816fd60c5c9e6f50d:

  • Focused manifest, CLI, publication, patch, and verification suites: 237
    passed, zero failures.
  • Seed 12345 full suite: 1,594 passed, 30 skipped, zero failures.
  • TypeScript types, Prettier, build, and Git diff checks: passed.
  • Fresh npm artifact checks and installed-package smoke: passed, including the
    public import, strict NodeNext consumer, CLI, bundled plugin, bundled Codex,
    and nested worker.
  • Fresh exact-tree correctness and simplification reviews found no remaining
    actionable issues.

Risk and rollout

This intentionally changes the Markdown emitted by the existing
--llms-full flag and makes related validation errors more specific. It does
not add a command, flag, environment variable, dependency, persisted-state
migration, or plugin-version change. Explicit JSON discovery remains
structured, and scoped Markdown omits the full operating guide by design.

This PR does not publish or release a package. Exact-head cross-platform CI and
human approval remain merge requirements. Processing continues without waiting
for CI, and any exact-head failures will be handled in the return sweep.

Public disclosure review

The branch, title, description, commits, diff, tests, logs, and links added by
this update were reviewed. Existing automated review comments contain
requester-only Codex task reports and an access-gated settings link, so the
nonpublic-links attestation remains unchecked.

  • No customer, partner, prospect, or user identities, data, or identifying details are included.
  • No credentials, personal data, private source, scan findings, or nonpublic links or tickets are included.
  • I reviewed the branch name, title, description, commits, changes, comments, logs, screenshots, attachments, and links for public disclosure.

@github-actions github-actions Bot added the bug Something isn't working label Aug 16, 2026

Copy link
Copy Markdown
Collaborator Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Security review completed. No security issues were found in this pull request.

Reviewed commit: 5789da8956

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Nice work!

Reviewed commit: 5789da8956

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@mldangelo-oai
mldangelo-oai marked this pull request as ready for review August 16, 2026 03:54

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5789da8956

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread sdk/typescript/tests-ts/cli-manifest.test.ts Outdated

Copy link
Copy Markdown
Collaborator Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Security review completed. No security issues were found in this pull request.

Reviewed commit: d2e63a0a1d

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d2e63a0a1d

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread sdk/typescript/src/cli-manifest.ts
Comment thread sdk/typescript/src/cli-manifest.ts

Copy link
Copy Markdown
Collaborator Author

@codex review

Please review the current head, 59ae515c1f81f982a0edeaaa0b07574653e899db.

@chatgpt-codex-connector

Copy link
Copy Markdown

Security review completed. No security issues were found in this pull request.

Reviewed commit: 59ae515c1f

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 59ae515c1f

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread sdk/typescript/tests-ts/cli-manifest.test.ts Outdated

Copy link
Copy Markdown
Collaborator Author

@codex review

Please review the current head, beedc8eee5352c29787ba0882c2564a75ad1277e.

@chatgpt-codex-connector

Copy link
Copy Markdown

Security review completed. No security issues were found in this pull request.

Reviewed commit: beedc8eee5

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Nice work!

Reviewed commit: beedc8eee5

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

zcrab-oai
zcrab-oai previously approved these changes Aug 16, 2026

@zcrab-oai zcrab-oai left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the generated CLI reference against actual command schemas; verified scoped equals-form options and repeatable-value constraints.

@mldangelo-oai

Copy link
Copy Markdown
Collaborator Author

@codex review

Please review the current head, 5f8ccba09350c854495abfda2659d04fcba1c7a4.

@chatgpt-codex-connector

Copy link
Copy Markdown

Security review completed. No security issues were found in this pull request.

Reviewed commit: 5f8ccba093

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Delightful!

Reviewed commit: 5f8ccba093

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Copy link
Copy Markdown
Collaborator Author

@codex review

Please review exact head 025bf950a16979dba72d880034019a29b95b3ad7, including the current-main package-contract merge. The normal and seed-12345 full suites each passed 1,356 tests with 14 skipped. Types, formatting, the installed-package smoke test, and a strict NodeNext consumer passed. Three fresh native review passes and an independent verifier are clean. Older source-addressed review threads remain open for maintainer disposition.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 🚀

Reviewed commit: 025bf950a1

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Copy link
Copy Markdown
Collaborator Author

@codex security review

Please review the current head 025bf950a16979dba72d880034019a29b95b3ad7.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 025bf950a1

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread sdk/typescript/src/cli-manifest.ts
@mldangelo-oai mldangelo-oai changed the title fix(cli): make --llms-full complete and accurate fix(cli): generate --llms-full from live schemas Aug 22, 2026
@mldangelo-oai

Copy link
Copy Markdown
Collaborator Author

@codex review

Please review exact head c5ad985 against current main.

@mldangelo-oai

Copy link
Copy Markdown
Collaborator Author

@codex security review

Please review exact head c5ad985 against current main.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Aug 22, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-08-25T15:15:34.761326Z aa81998 Manual request
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Another round soon, please!

Reviewed commit: c5ad985147

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c5ad985147

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread sdk/typescript/src/cli.ts Outdated

@kmbroai kmbroai left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Critical review

Reviewed head c5ad985147f5eaba53682cd816fd60c5c9e6f50d.

Recommendation: useful discovery improvement, with one remaining documentation correction; no new execution blocker found. Deriving accepted flags and constraints from live schemas is preferable to maintaining a second handwritten CLI reference. The Markdown adapter correctly leaves the machine-readable schemas intact.

Remaining accuracy gap

The existing comment about bulk-scan's hint still applies. It documents that CSV mode requires --output-dir, but not the reverse restriction: bulk-scan --output-dir /tmp/results without a CSV is rejected before the interactive wizard starts. Scoped bulk-scan --llms-full omits the root operating guide. Add the reverse dependency to the command-owned guidance. This is an incomplete reference, not evidence that the runtime validation itself is broken.

Necessity and simplification

The new module does more than render documentation: it also owns result-format rules, global-option parsing, and reconstruction of safe validation messages. Shared runtime/reference rules are worthwhile, but keep those ownership boundaries visible. In particular, humanValidationMessage depends on Incur's human-output shape; when the dependency changes, it must fail closed to the existing redacted message rather than assume arbitrary output is schema-owned. The current fallback does that.

I would not add a general command-dependency DSL to fix the remaining hint. Use command-owned guidance for the few cross-option rules, and schemas for type/value constraints. The adapter should stay a compatibility layer for the pinned Incur omissions, not grow into a competing CLI framework. Its comments should remain tied to those upstream omissions so it can eventually be removed.

The previously reported equals-form global options, repeated-value constraints, and patch selector guidance are addressed at this head; I am not treating old comments as unresolved without checking the current code.

Verification

Ran cli-manifest.test.ts and cli.test.ts: 157 passed, 0 failed, covering scoped discovery, structured schema parity, global-option forms, and existing CLI behavior. Linux, Bun 1.3.14 / Node 22.13.1 with cached dependencies. No published-package smoke or native Windows run was performed.

@mldangelo-oai

Copy link
Copy Markdown
Collaborator Author

@codex review the current head 91a3b7d.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 👍

Reviewed commit: 91a3b7d29b

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@mldangelo-oai

Copy link
Copy Markdown
Collaborator Author

@codex review the current head aa81998.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: aa81998336

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

...commands.map((command) => {
const restrictions = commandResultRestrictions(command.name ?? "");
return [
Skill.generate(cli.name, [command]).replace(/^#/gmu, "###"),

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Document scan-components selector exclusivity

For the scoped scan-components --llms-full reference, this renders --component, --components-file, and --auto as independently optional and includes no command guidance, while the live refinement in cli.ts rejects every invocation that does not select exactly one of them. Because scoped output deliberately omits the README operating guide, an agent following this reference can construct commands that are guaranteed to fail; include the refinement through shared command guidance or another schema-derived source.

AGENTS.md reference: sdk/typescript/AGENTS.md:L16-L16

Useful? React with 👍 / 👎.

Comment thread sdk/typescript/src/cli.ts
Comment on lines +2077 to +2080
hint:
"--linear-team or CODEX_SECURITY_LINEAR_TEAM is required. " +
"--linear-assignee requires --linear-api-key or CODEX_SECURITY_LINEAR_API_KEY. " +
"If both --linear-project and --project are set, they must select the same project.",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Share publication requirements with the check command

These destination requirements are attached only to publish scan, so publish check --llms-full still presents --linear-team, --linear-assignee, and both project selectors without their dependencies. The publish check handler calls the same publicationDestination helper at cli.ts:2561, which rejects a missing team, an assignee without an API key, or conflicting project selectors; reuse this guidance for both publication commands so the scoped check reference does not advertise guaranteed-invalid combinations.

AGENTS.md reference: sdk/typescript/AGENTS.md:L16-L16

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants