fix: forward beta to GRPOConfig (GRPO ran with no KL term) and stop growing the vocab every run - #96
Draft
kayyar-roblox wants to merge 4 commits into
Draft
fix: forward beta to GRPOConfig (GRPO ran with no KL term) and stop growing the vocab every run#96kayyar-roblox wants to merge 4 commits into
kayyar-roblox wants to merge 4 commits into