Repository navigation

feat: implement /opt/fournos/entrypoint contract for FORGE engine - #2

Closed

ashtarkb wants to merge 1260 commits into

mainfrom

fournos-entrypoint-contract

Closed

feat: implement /opt/fournos/entrypoint contract for FORGE engine#2
ashtarkb wants to merge 1260 commits into
mainfrom
fournos-entrypoint-contract

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 15, 2026
- Merge pull request #222 from kpouget/postprocess
  kpouget
  authored
  16cee46
Commits on Sep 16, 2026
- fix: Resolve kaleido version conflict breaking image builds
  albertoperdomo2
  committed
  67eb6b6
- Merge pull request #223 from albertoperdomo2/fix/kaleido-version-conflict
  albertoperdomo2
  authored
  1234fe1
- [matrix_benchmarking] Remove
  kpouget
  committed
  173b3d6
- [projects/legacy] Remove
  kpouget
  committed
  9142334
- pyproject.toml: remove matrixbenchmarking and the legacy projects
  kpouget
  committed
  38ab485
- [llm_d_legacy] Remove
  kpouget
  committed
  67fe34f
- [jump_ci] Remove
  kpouget
  committed
  ce0c897
- [repo] toolbox: repo: remove
  kpouget
  committed
  95d276d
- Remove TOPSAIL dependencies on fire and ansible
  kpouget
  committed
  7f79992
- [core] Finish updating the get_ci_metadata_dir function
  kpouget
  committed
  2514d57
- Merge pull request #225 from kpouget/metadata_dir
  kpouget
  authored
  b7482f9
- Merge pull request #224 from kpouget/legacy
  kpouget
  authored
  348fdc2
- [core] notifications: send: update the CI base link
  kpouget
  committed
  d54a47a
- Merge pull request #226 from kpouget/ocpci-artifacts
  kpouget
  authored
  9e8165a
- gitops: add Intlab Forge overlay
  Harshith-umesh
  committed
  a96e1d7
- docs: clarify Intlab Forge deployment
  Harshith-umesh
  committed
  f02591a
- Merge pull request #228 from Harshith-umesh/fix/intlab-forge-resolver
  Harshith-umesh
  authored
  8387834
- rhaiis: add B200 cluster preset
  Harshith-umesh
  committed
  1790c37
- rhaiis: add MI355X cluster preset
  Harshith-umesh
  committed
  5bfb2bb
- rhaiis: configure MI355X and B200 presets
  Harshith-umesh
  committed
  8b33b5f
- Merge pull request #231 from Harshith-umesh/fix/intlab-forge-resolver
  Harshith-umesh
  authored
  a060ed3
Commits on Sep 17, 2026
Commits on Sep 18, 2026
Commits on Sep 19, 2026
- [fournos_launcher] orchestration: tunnelling: set the localhost URL in the kubeconfig
  kpouget
  committed
  0dfeafd
Commits on Sep 20, 2026
- [fournos_launcher] orchestration: pr_args: add /external parameter
  kpouget
  committed
  29324fa
Commits on Sep 21, 2026
- Merge pull request #240 from kpouget/intlab
  kpouget
  authored
  cb3066a
- [cluster] toolbox: capture_prometheus: main: fix shell.run call
  kpouget
  committed
  c62aefc
- Merge pull request #242 from kpouget/fix_capture_prometheus
  kpouget
  authored
  0a290ff
- [core] dsl: runtime: don't include the exec in the script
  kpouget
  committed
  0f62d00
- [core] ci_entrypoint: update the project config with the fjob metadata
  kpouget
  committed
  339caa5
- [core] library: export: inject the fjob metadata in the mlflow tags
  kpouget
  committed
  c22a4be
- [caliper] engine: file_export: mlflow_backend: include the main params in the multi-run children
  kpouget
  committed
  e39b797
- Merge pull request #241 from kpouget/prom
  kpouget
  authored
  bd68aed
- Merge pull request #214 from ashtarkb/ui-submit-pages
  openshift-merge-bot[bot]
  authored
  e37bafd
- feat: support GuideLLM 0.7.x CLI in benchmark job rendering
  
  authored and
  aas008
  committed
  df852b7
- Fix ruff formatting
  
  aas008
  and
  claude
  committed
  7ca6f03
- Fix data spec conversion and decimal rate handling for GuideLLM 0.7.x
  
  aas008
  and
  claude
  committed
  881b7e6
- Support GuideLLM 0.7.x output JSON format in dashboard parser
  
  aas008
  and
  claude
  committed
  dd66d43
- Inject --warmup into v0.7.x --profile spec instead of passthrough
  
  aas008
  and
  claude
  committed
  5d0d806
- Remove GuideLLM v0.6.x backward compatibility
  
  aas008
  and
  claude
  committed
  8210e40
- Add test coverage for CLI arg translation and dashboard fallbacks
  
  aas008
  and
  claude
  committed
  e5ada9c
- Convert --processor to --tokenizer for v0.7.x and fix rampup in no-rate profile branch
  
  aas008
  and
  claude
  committed
  918f975
- Bump default GuideLLM image to v0.7.4
  
  aas008
  and
  claude
  committed
  536d9e1
- Use v0.7.x --tokenizer arg directly in llm_d test_phase
  
  aas008
  and
  claude
  committed
  0966af3
- Fix default GuideLLM image in toolbox and update llm_d test assertion
  
  aas008
  and
  claude
  committed
  70ebd6b
- Preserve --processor-args as tokenizer load_kwargs and fix fallback guard
  
  aas008
  and
  claude
  committed
  bbd50e9
- Update benchmark image assertion to match v0.7.4 default
  
  aas008
  and
  claude
  committed
  afbba82
- [rhaiis] Add SGLang CI quick preset
  aas008
  committed
  52cffb7
- Add sglang-ci-quick preset to presets.yaml
  aas008
  committed
  1bf7fa9
- Remove duplicate and cluster-specific config from sglang-ci-quick
  aas008
  committed
  1539ee3
- Remove dashboard setting from sglang-ci-quick preset
  aas008
  committed
  bf73079
- Remove workload rate/max_seconds overrides from sglang-ci-quick preset
  
  aas008
  and
  claude
  committed
  d49ba4f
- Split presets.yaml into separate files by category
  
  aas008
  and
  claude
  committed
  df5bebb
- Add singular workload_key to sglang-ci-quick preset
  
  aas008
  and
  claude
  committed
  2862c7b
- Add slack_notify_always, remove cluster-specific config from sglang-ci-quick
  
  aas008
  and
  claude
  committed
  91fa05a
- Add version string to sglang-ci-quick preset
  
  aas008
  and
  claude
  committed
  946d175
- Remove csv_dashboard.enabled from sglang-ci-quick preset
  
  aas008
  and
  claude
  committed
  b58a54d
- Use deleteme version label for sglang-ci-quick test data
  
  aas008
  and
  claude
  committed
  6c774c0
- Restore csv_dashboard.enabled: false in sglang-ci-quick preset
  
  aas008
  and
  claude
  committed
  4bfeea0
- Add cluster_hera/cluster_zeus presets and make ci-quick the default
  
  aas008
  and
  claude
  committed
  c46c019
- Add cluster_old_zeus preset for zeus1
  
  aas008
  and
  claude
  committed
  8971951
- Remove warmup override from benchmark preset
  
  aas008
  and
  claude
  committed
  57e905d
- Keep csv_dashboard default enabled, override in ci-quick instead
  
  aas008
  and
  claude
  committed
  ac5c655
- Revert config.yaml defaults, keep ci-quick overrides in preset
  
  aas008
  and
  claude
  committed
  67ff47f
- Include ci-quick in cluster presets for single-command smoke tests
  
  aas008
  and
  claude
  committed
  4569147
- Make ci-quick values the config defaults
  
  aas008
  and
  claude
  committed
  c89f93d
- Revert config.yaml, keep ci-quick in preset and cluster extends
  
  aas008
  and
  claude
  committed
  3e2e04b
- Remove accidentally committed CLAUDE.md
  
  aas008
  and
  claude
  committed
  a8e5d33
- Remove ci-quick from cluster preset extends
  
  aas008
  and
  claude
  committed
  5f49b5c
- Define run_uuid default in config to suppress missing-key warning
  
  aas008
  and
  claude
  committed
  e853a4f
- Merge pull request #209 from aas008/rhaiis-sglang-presets
  openshift-merge-bot[bot]
  authored
  0dff256
- Merge pull request #230 from aas008/feat/cluster-hera-preset-defaults
  openshift-merge-bot[bot]
  authored
  289da2c
- Add projects/guidellm/tests to pytest testpaths
  
  aas008
  and
  claude
  committed
  fa3d751
- Convert --request-type to backend request_format and update v0.6.0 fallbacks to v0.7.4
  
  aas008
  and
  claude
  committed
  44134bf
- Merge pull request #229 from aas008/feat/guidellm-0.7x-support
  openshift-merge-bot[bot]
  authored
  3b963ae
Commits on Sep 22, 2026
- rhaiis: standardize workload timing
  Harshith-umesh
  committed
  3d8b537
- rhaiis: retain workload profile names
  Harshith-umesh
  committed
  9edff1b
- rhaiis: keep names in planning sheet
  Harshith-umesh
  committed
  854451d
- feat: Install and use benchconf
  albertoperdomo2
  committed
  12a00c6
- fix: Keep benchconf outside of the toolbox
  albertoperdomo2
  committed
  69b4888
- chore: Fix CI
  albertoperdomo2
  committed
  2863e58
- fix: Tests
  albertoperdomo2
  committed
  5424138
- chore: Fix review comments
  albertoperdomo2
  committed
  757bac1
- temporary: Install Benchconf
  albertoperdomo2
  committed
  aa1ba39
- temporary: Use correct Benchconf branch
  albertoperdomo2
  committed
  81047bb
- chore: Update the benchconf ref
  albertoperdomo2
  committed
  19b3935
- chore: Remove benchconf from EXTRA_PACKAGES
  
  albertoperdomo2
  and
  claude
  committed
  3f7db70
- chore: Address comments
  albertoperdomo2
  committed
  1d7cc0f
- fix: Add missing imports
  albertoperdomo2
  committed
  06e6a07
- fix: GuideLLM args parsing for 0.7.0
  albertoperdomo2
  committed
  a34c4c3
- fix: Multiline command and fix tests
  albertoperdomo2
  committed
  e36fc48
- fix: Tests
  albertoperdomo2
  committed
  d9e8c6d
- fix: GuideLLM 0.7.0 upgrade issue
  albertoperdomo2
  committed
  629d7d4
- fix: Use slugified model name
  albertoperdomo2
  committed
  eeb961b
- fix: Use correct model name
  albertoperdomo2
  committed
  9dea88a
- fix: Use correct model name in smoke request
  albertoperdomo2
  committed
  0487c20
- feat: Add Benchconf-based smoke test
  albertoperdomo2
  committed
  265c20c
- [core] library: export_notifications: include the hardware and clusterless flags
  kpouget
  committed
  6c73f05
- [core] ci_entrypoint: prepare_ci: fix the git history listing
  kpouget
  committed
  1fea730
- Merge pull request #246 from kpouget/git-history
  kpouget
  authored
  a9b572e
- fix: Parse --backend properly
  albertoperdomo2
  committed
  ddd3ec0
- Merge branch 'main' into feat/benchconf-integration
  albertoperdomo2
  authored
  6eb78c2
- fix: Correctly move the output file
  albertoperdomo2
  committed
  8854d6c
- Merge branch 'feat/benchconf-integration' of github.com:albertoperdomo2/forge into feat/benchconf-integration
  albertoperdomo2
  committed
  916a4cc
- rhaiis: add nightly release model presets
  Harshith-umesh
  committed
  8f0ede3
- rhaiis: rename GPT-OSS 120B preset
  Harshith-umesh
  committed
  933c8b1
- rhaiis: configure per-workload warmup
  Harshith-umesh
  committed
  29c1f3c
- rhaiis: shorten ci quick workload
  Harshith-umesh
  committed
  eed5ec7
- rhaiis: keep ci quick timing minimal
  Harshith-umesh
  committed
  0483fea
- rhaiis: add GLM 5.2 FP8 preset
  Harshith-umesh
  committed
  a75ef54
- Skip GitHub notifications for non-PR jobs
  Harshith-umesh
  committed
  9beafc6
- Merge pull request #249 from Harshith-umesh/fix/skip-github-notification-without-pr
  Harshith-umesh
  authored
  6d32877
- rhaiis: keep warmup duration at 60 seconds
  Harshith-umesh
  committed
  3097836
- Merge pull request #245 from Harshith-umesh/rhaiis-workload-timing-275s
  Harshith-umesh
  authored
  654fee7
- rhaiis: add accelerator CPT regression matrices
  Harshith-umesh
  committed
  cfe2a31
- rhaiis: scope CPT model args to matrix definitions
  Harshith-umesh
  committed
  ef9d5a0
- rhaiis: remove duplicated CPT model args
  Harshith-umesh
  committed
  f477f9b
- Merge pull request #251 from Harshith-umesh/codex/rhaiis-cpt-upstream
  Harshith-umesh
  authored
  703d55b
- [rhaiis] group models.yaml entries by family
  
  aas008
  and
  cursoragent
  committed
  ed31622
- Merge pull request #250 from aas008/rhaiis-group-models-yaml
  Harshith-umesh
  authored
  52b7136
- rhaiis: disable profiling for MI355X CPT
  Harshith-umesh
  committed
  f2a7835
- Merge pull request #253 from Harshith-umesh/codex/rhaiis-mi355x-no-profiler
  Harshith-umesh
  authored
  bb600fe
Commits on Sep 23, 2026
- fix(rhaiis): remove invalid old-zeus fsGroup override
  Harshith-umesh
  committed
  1d4909c
- Merge pull request #254 from Harshith-umesh/fix/rhaiis-old-zeus-fsgroup
  Harshith-umesh
  authored
  4c6f2f2
- Set writable FlashInfer cache for B200 CPT
  Harshith-umesh
  committed
  3ed7d4e
- Merge pull request #255 from Harshith-umesh/fix/b200-flashinfer-cache
  Harshith-umesh
  authored
  47e06a3
- Apply FlashInfer cache path to B200 preset
  Harshith-umesh
  committed
  2bbc045
- Merge pull request #256 from Harshith-umesh/fix/b200-flashinfer-cache-preset
  Harshith-umesh
  authored
  11ea313
- Set B200 FlashInfer env map as a preset value
  Harshith-umesh
  committed
  2389716
- Merge pull request #257 from Harshith-umesh/fix/b200-flashinfer-env-map
  Harshith-umesh
  authored
  e2ca9cd
- [llm_d] test_efa_implementation: remove test file
  kpouget
  committed
  8ef3192
- Merge pull request #258 from kpouget/llm_d
  kpouget
  authored
  b41918b
- fix: Detect result files correctly
  albertoperdomo2
  committed
  b178895
- Merge branch 'main' into feat/benchconf-integration
  albertoperdomo2
  authored
  6fb0e8f
- Merge pull request #198 from albertoperdomo2/feat/benchconf-integration
  openshift-merge-bot[bot]
  authored
  927d73c
- [projects] s/write_test_labels/create_test_metadata
  kpouget
  committed
  73df8b9
- [core] library: postprocess: remove outdated comment
  kpouget
  committed
  287b927
- [core] library: postprocess: new functions to update the caliper metadata file
  kpouget
  committed
  22053a4
- [llm_d] orchestration: ci: simplify the vault listing
  kpouget
  committed
  b97e591
- [llm_d] orchestration: cli: fix outdated comment
  kpouget
  committed
  d213b9c
- [llm_d] orchestration: test_phase: use the library functions
  kpouget
  committed
  116fa23
- [minimal] New project to provide a minimal template project
  kpouget
  committed
  3fecad4
- [core] library: vault: fail if the config isn't initilized
  kpouget
  committed
  892d7e4
- [llm_d] tests: test_profiles: adjust the tests
  kpouget
  committed
  ef8768f
- [core] library: export: dont'r request model vault if agentic review not enabled
  kpouget
  committed
  1f95145
- Merge pull request #259 from kpouget/minimal
  kpouget
  authored
  120ad6f
- [llm_d] orchestration: continue the prom-capture integration
  kpouget
  committed
  88a3d18
- [cluster] toolbox: enable_user_workload_monitoring: new script to enable OCP UWM
  kpouget
  committed
  3c4cfc3
- [cluster] library: prom_collection: new library to control prometheus capture
  kpouget
  committed
  8cc317e
- [llm_d] orchestration: add the ability to define the default target cluster
  kpouget
  committed
  7f43162
- [guidellm] toolbox: run_guidellm_benchmark: utils: fix the smoke test rate issue
  kpouget
  committed
  ff2f84d
- projects: add inference-playbooks smoke test
  ssaketh-ch
  committed
  3063c61
- Merge pull request #243 from kpouget/prom
  kpouget
  authored
  024f780
- fournos: support foreign testing project override
  
  ssaketh-ch
  authored and
  kpouget
  committed
  b184933
- fournos_launcher: reject unset Forge project
  
  ssaketh-ch
  authored and
  kpouget
  committed
  9a2b4cf
- fournos: namespace foreign testing metadata
  
  ssaketh-ch
  authored and
  kpouget
  committed
  db1d21b
- fournos: preserve foreign PR metadata
  
  ssaketh-ch
  authored and
  kpouget
  committed
  3fdbb2b
- Merge pull request #260 from ssaketh-ch/ssaketh-ch/inference-playbooks-project
  openshift-merge-bot[bot]
  authored
  8e3093f
- fix(guidellm): include default benchmark artifacts in dashboard export
  Harshith-umesh
  committed
  d13a48f
- fournos: preserve foreign repository identity
  ssaketh-ch
  committed
  0c67298
- Merge pull request #248 from openshift-psap/fournos-testing
  openshift-merge-bot[bot]
  authored
  48fd4ff
- Merge pull request #261 from Harshith-umesh/fix/guidellm-dashboard-default-artifacts
  Harshith-umesh
  authored
  71d64bf
- fix(rhaiis): preserve MLflow link for early failures
  Harshith-umesh
  committed
  0f6f606
- fix(mlflow): create job marker at CI entrypoint
  Harshith-umesh
  committed
  845a4eb
- fix(mlflow): validate existing destination marker
  Harshith-umesh
  committed
  99a9f93
- fix(mlflow): reuse one destination across llm-d tests
  Harshith-umesh
  committed
  1f1f62f
- fix(rhaiis): reuse job mlflow destination
  Harshith-umesh
  committed
  4f6c805
- refactor(mlflow): use one job destination
  Harshith-umesh
  committed
  eb132d3
- fix(mlflow): reuse destination for multi-run exports
  Harshith-umesh
  committed
  e5047b2
- refactor(mlflow): follow destination marker review
  Harshith-umesh
  committed
  730a525
- fix(mlflow): propagate job destination to dashboard metrics
  Harshith-umesh
  committed
  2202913
- Merge pull request #216 from Harshith-umesh/fix/rhaiis-mlflow-failure-link
  Harshith-umesh
  authored
  a3b5cd8
- [fournos_launcher] orchestration: submit: update to fix the OCPCI link
  kpouget
  committed
  775e67f
- Merge pull request #262 from kpouget/notif
  kpouget
  authored
  34d7db3
- [core] notifications: send: accept the foreign testing PR number
  kpouget
  committed
  0e5625a
- Merge pull request #263 from kpouget/notif
  kpouget
  authored
  d20bbd0
- foreign-testing: initialize repository checkout
  ssaketh-ch
  committed
  753af88
- [core] ci_entrypoint: prepare_ci: skip the git banner in when foreign testing
  kpouget
  committed
  34b130f
- style: format foreign checkout initializer
  ssaketh-ch
  committed
  9ccdbb4
- Merge branch 'main' into ssaketh-ch/foreign-repository-checkout
  ssaketh-ch
  authored
  ba32006
- Merge pull request #265 from kpouget/notif
  kpouget
  authored
  de14981
- test: log foreign checkout proof file
  ssaketh-ch
  committed
  d5c2909
- foreign-testing: support configured repository revisions
  ssaketh-ch
  committed
  7de0ec4
- fix: correct foreign testing config shape
  ssaketh-ch
  committed
  29fd414
- Merge branch 'main' into ssaketh-ch/foreign-repository-checkout
  ssaketh-ch
  authored
  8c880dd
Commits on Sep 24, 2026
Commits on Sep 25, 2026
- [projects] Rename s/TestBaseNode/BaseTestNode to mute pytest warning
  kpouget
  committed
  628e0c8
- Merge pull request #269 from kpouget/pytest
  kpouget
  authored
  2e05e4a
Commits on Sep 28, 2026
- feat: implement /opt/fournos/entrypoint contract for FORGE engine
  
  ashtarkb
  and
  cursoragent
  committed
  a6ad6eb

Commits

Commits on Sep 15, 2026

Commits on Sep 16, 2026

Commits on Sep 17, 2026

Commits on Sep 18, 2026

Commits on Sep 19, 2026

Commits on Sep 20, 2026

Commits on Sep 21, 2026

Commits on Sep 22, 2026