Issues

• [VAKRA-GatedTest Access]: Chaoyang University of Technology

  IBM/vakra#46 · Filter by author SuSi-77 opened on Oct 27, 2026

• [VAKRA-GatedTest Access]: ak2021

  IBM/vakra#45 · Filter by author Anurag-1205 opened on Oct 26, 2026

• [VAKRA-GatedTest Access]: ak2021

  IBM/vakra#44 · Filter by author Anurag-1205 opened on Oct 26, 2026

• [Bug] Litellm reports wrong tool schema to the server

  IBM/vakra#43 · Filter by author oughhhhh opened on Oct 25, 2026

• [VAKRA-GatedTest Access]: Artem Bondarenko SPBU

  IBM/vakra#42 · Filter by author oughhhhh opened on Oct 25, 2026

• [VAKRA-GatedTest Access]: Nipun Thejan Fonseka

  IBM/vakra#41 · Filter by author nipun-thejan opened on Oct 24, 2026

• PolicyJudge access request: Sho Okiyama (Aillis, Inc.), SemEval-2027 Task 11

  IBM/vakra#40 · Filter by author sho-okiyama opened on Oct 23, 2026

• [VAKRA-GatedTest Access]: Sho Okiyama (Aillis, Inc.)

  IBM/vakra#39 · Filter by author sho-okiyama opened on Oct 23, 2026

• [VAKRA-GatedTest Access]: Ruofan Li

  IBM/vakra#38 · Filter by author Lithium9767 opened on Oct 16, 2026

• [VAKRA-GatedTest Access]: Thomas Young (UC Berkeley MIDS)

  IBM/vakra#37 · Filter by author thomasyoung88 opened on Oct 16, 2026

• [VAKRA-GatedTest Access]: Bjorn Melin (UC Berkeley MIDS)

  IBM/vakra#36 · Filter by author BjornMelin opened on Oct 16, 2026

• [VAKRA-GatedTest Access]: UT San Antonio

  IBM/vakra#35 · Filter by author keebanvillarreal opened on Oct 14, 2026

• VAKRA-GatedTest Access: University of Cincinnati

  IBM/vakra#34 · Filter by author roshanbaskaran opened on Oct 6, 2026

• [VAKRA-GatedTest Access]: Siwan Yang

  IBM/vakra#33 · Filter by author siwany opened on Oct 4, 2026

• [VAKRA-GatedTest Access]: Ilaria Salogni

  IBM/vakra#32 · Filter by author IlariaSalogni opened on Sep 30, 2026

• Possible data issues in a few Capability 3 (multi-hop reasoning) questions

  IBM/vakra#31 · Filter by author Mystic-Slice opened on Sep 29, 2026

• [Benchmark Output Submission]: CUGA

  IBM/vakra#29 · Filter by author segevshlomovIBM opened on Sep 8, 2026

• Proposal: map vakra's Example/ExampleResult types to a portable eval schema (EvalPort)

  IBM/vakra#28 · Filter by author adhabnr-ux opened on Aug 23, 2026

• GroundednessJudge silently scores infra/API errors (negative max_tokens crash) as hard fails

  IBM/vakra#25 · Filter by author haroldship opened on Jul 22, 2026

• make build fails during Docker apt-get update due to DNS resolution issues

  IBM/vakra#18 · Filter by author AnkitaNaik opened on May 19, 2026

• Discussion: Hybrid Deterministic Routing Approach for Capability 2

  IBM/vakra#15 · Filter by author amethystani opened on May 2, 2026
  1

• [Benchmark Output Submission]: Verificate HELIX V1.4

  IBM/vakra#9 · Filter by author Verificate-Dev opened on Apr 8, 2026
  4