Skip to content

Document agent_id resolution when version is omitted #111

Closed

Description

Source

Discovered during E2E validation of #78.

Problem

docs/how-it-works.md documents the Foundry endpoint format as agent_id: my-agent:3 (name:version). In testing, a bare agent_id: FoundryAgent (no :version) was silently accepted and the cloud evaluation succeeded.

Questions to resolve in docs

  • Does omitting the version default to "latest"? "deployed"? something else?
  • Is reproducibility affected by omitting version (next run could pick up a different agent revision)?
  • Should the runner log the resolved version on startup so logs and results.json are reproducible without re-checking the Foundry portal?

Likely fix

  • Update docs (docs/how-it-works.md, docs/tutorial-basic-foundry-agent.md) to spell out behavior.
  • Optionally: have the Foundry backend log the resolved agent name + version after the first API round-trip.

Severity

Low (docs / observability)

Activity

  1. added a commit that references this issue on Apr 29, 2026
  2. Dongbumlee commented on Apr 29, 2026

    @Dongbumlee
    Author

    Fix in flight: PR #118 → develop. Will auto-close when merged.

  3. Dongbumlee commented on Apr 29, 2026

    @Dongbumlee
    Author

    Reopening — PR #118 is being reverted via #119 because PR #108 (1.0 revamp) supersedes most of those fixes by deleting the systems they patched. Defects still apply; we'll re-scope against the flat agentops.yaml schema after #108 merges. See #119 for details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    sprint3Sprint 3 test scenarios

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions