Repository navigation

ENH: Support for GiftEval and FEV-Bench - #17

Merged

felixdivo merged 29 commits into

benchopt:mainfrom

eddardd:feat/gift-eval-support

Jul 9, 2026

Merged

ENH: Support for GiftEval and FEV-Bench#17
felixdivo merged 29 commits into
benchopt:mainfrom
eddardd:feat/gift-eval-support

Commits on May 28, 2026
- ENH batch forecasting predict() across series and cutoffs
  
  GeoffNN
  and
  claude
  committed
  ad0464d
- ENH add SeasonalNaive forecasting solver
  
  GeoffNN
  and
  claude
  committed
  2972813
- PERF batch chronos-2 / moirai-2 in one cross_validate call
  
  GeoffNN
  and
  claude
  committed
  7b24d94
- REFACTOR typed ForecastInput, Covariates dataclass, prediction_length at dataset level
  
  GeoffNN
  and
  claude
  committed
  efe5ad5
- ENH add quantile dimension to forecasting outputs
  
  GeoffNN
  and
  claude
  committed
  1eced14
- REFACTOR ForecastOutput is a single object + Chronos-2 batched local inference
  
  GeoffNN
  and
  claude
  committed
  0138146
- Merge remote-tracking branch 'origin/main' into refactor/batched-predict-api
  GeoffNN
  committed
  d910ba5
- FIX tighten chronos-forecasting pin; drop redundant torch dep
  
  GeoffNN
  and
  claude
  committed
  3ea97db
- Merge pull request #1 from GeoffNN/refactor/batched-predict-api
  eddardd
  authored
  70a2873
- Merge branch 'main' into main
  eddardd
  authored
  5c1876a
Commits on May 29, 2026
- feat: move constants to a dedicated file
  eddardd
  committed
  1829e41
- feat: gift evall support
  eddardd
  committed
  6689046
- Merge branch 'main' into feat/gift-eval-support
  eddardd
  authored
  5e4a675
- feat: adds support for fev bench
  eddardd
  committed
  2a4a740
- minor fixes
  eddardd
  committed
  848effb
- fixes, prepare(), all behavior for gifteval and fevbench
  eddardd
  committed
  b2dc953
Commits on Jun 15, 2026
- Merge branch 'main' into feat/gift-eval-support
  tomMoral
  authored
  b792561
Commits on Jul 6, 2026
- Merge remote-tracking branch 'origin/main' into pr-17
  tomMoral
  committed
  795cbad
Commits on Jul 8, 2026

Navigation Menu

Repository navigation

ENH: Support for GiftEval and FEV-Bench - #17

ENH: Support for GiftEval and FEV-Bench#17
felixdivo merged 29 commits into
benchopt:mainfrom
eddardd:feat/gift-eval-support

Commits on May 28, 2026

ENH batch forecasting predict() across series and cutoffs

ENH add SeasonalNaive forecasting solver

PERF batch chronos-2 / moirai-2 in one cross_validate call

REFACTOR typed ForecastInput, Covariates dataclass, prediction_length at dataset level

ENH add quantile dimension to forecasting outputs

REFACTOR ForecastOutput is a single object + Chronos-2 batched local inference

Merge remote-tracking branch 'origin/main' into refactor/batched-predict-api

FIX tighten chronos-forecasting pin; drop redundant torch dep

Merge pull request #1 from GeoffNN/refactor/batched-predict-api

Merge branch 'main' into main

Commits on May 29, 2026

feat: move constants to a dedicated file

feat: gift evall support

Merge branch 'main' into feat/gift-eval-support

feat: adds support for fev bench

minor fixes

fixes, prepare(), all behavior for gifteval and fevbench

Commits on Jun 15, 2026

Merge branch 'main' into feat/gift-eval-support

Commits on Jul 6, 2026

Merge remote-tracking branch 'origin/main' into pr-17

Commits on Jul 8, 2026

FIX freq handling: multiplier-aware seasonality, M4 horizons, sub-hourly Monash freqs

REF factor rolling-window split into shared build_forecasting_data, y_train=None for forecasting

FIX GiftEval: load only data-*.arrow shards, reduce skip plumbing to the _skip_reason sentinel

FIX FEV: target column is the sole channel, robust freq inference and channel detection

PERF GiftEval/FEV: columnar Arrow access with early slicing, local-first HF snapshot

REF factor cache-first HF snapshot into benchmark_utils.download_hf, rename download.py to download_pooch.py

Update datasets/fev.py

ENH shared FORECASTING_METRICS in forecasting_constants.py (renamed from constants.py), same 10 metrics everywhere

CLN single download path in snapshot_hf_files (review suggestion)

ENH derive GiftEval canonical combos from the leaderboard CSV (fetched by prepare, cached on disk)

TST load dataset classes via Benchmark.check_dataset_patterns instead of importlib