Skip to content

Add minojev to the Jev directory - #63

Closed
zeredy879 wants to merge 1 commit into
hellogumbo:mainfrom
zeredy879:add-minojev
Closed

zeredy879 wants to merge 1 commit into
hellogumbo:mainfrom
zeredy879:add-minojev

Conversation

@zeredy879

@zeredy879 zeredy879 commented Sep 21, 2026 •

Copy link
Copy Markdown
Contributor

Adds minojev to the research category (independent replica, one entry).

I maintain the project. It is an independent Jev-style replica — no TypeSafe API calls — built around head training: the backbone stays frozen, candidate-path features are cached once, and only the small decision head is trained, followed by dev-fitted temperature calibration.

What it does: returns calibrated Choice (2–255 candidates), Boolean (Noul-shaped), and Score (2–10 ordered levels) distributions in one forward pass with decode_steps: 0. Code consumes the distribution and applies its own thresholds; the confidence explorer page demonstrates accept/escalate at a chosen confidence.

Evidence committed in the repo:

  • results/compare-general.md — same-backbone head-to-head against token generation on a balanced 120-decision suite (95.8% vs 80.0% accuracy, 0 vs 3.48 output tokens/decision, ~5× better p95).
  • results/general-metrics.json — calibrated 200-request evaluation: 97.5% accuracy, ECE 0.014, selective accuracy at ≥0.9 confidence: 89.5% coverage at 98.9% accuracy.
  • Converted datasets with source-level OOD isolation and per-line license metadata; weights and data on Hugging Face.

Boundaries stated honestly: trained only on permissively licensed sources (MIT / Apache-2.0 / CC-BY); NC datasets are reserved for evaluation. On a deliberate out-of-distribution workload the head-trained model scored below a zero-shot generative baseline (31.7% vs 40.0%), which the repo reports rather than hides.

Links: repo · demos · benchmark page · models · data

This PR changes only data/projects.json; npm run validate passes (697 entries valid).


View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need. Autofix is disabled.

Summary by CodeRabbit

  • New Features
    • Added the Minojev research project to the project catalog, including its website, repository, description, programming language, star count, and addition date.

@coderabbitai

coderabbitai Bot commented Sep 21, 2026 •

Copy link
Copy Markdown

Review Change StackReview Change Stack

Understand this PR’s impact

Explore downstream dependencies and potential security impact with Blast Radius.

View blast radius →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Advanced

Run ID: 3bb4093b-c060-4aa7-adaf-29aa895ce8ab

📥 Commits

Reviewing files that changed from the base of the PR and between e18fa74 and 359399a.

📒 Files selected for processing (1)
  • data/projects.json

Included review availability: Your plan provides up to 2 included reviews per hour; 1 remains after this review.


📝 Walkthrough

Walkthrough

Changes

Project catalog

Layer / File(s) Summary
Add minojev catalog entry
data/projects.json
Adds the minojev research project with repository, website, description, Python language, zero stars, and 2026-09-21 addition date.

Priority: ⬇️ Low

Estimated code review effort: 1 (Trivial) | ~3 minutes

Change: Feature

Suggested reviewers: scald

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly states the main change: adding minojev to the Jev directory.
Description check ✅ Passed The description explains the project, its research category, repository links, maintainer status, validation result, and that only data/projects.json changed. It does not reproduce the template headin…
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create a new PR

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

scald pushed a commit that referenced this pull request Sep 24, 2026
@scald

scald commented Sep 24, 2026

Copy link
Copy Markdown
Contributor

Landed on main as d155b64 with you as the commit author, now live on https://awesomejev.com. Closing rather than merging because every PR appends to the same data file and they conflict with each other; landing directly keeps your authorship. Thanks!

@scald scald closed this Sep 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants