Skip to content

T1-R1: aprender-train refuses hybrid/GDN (qwen3.5) arch until modelled; fix qwen3_5 head_dim override #4552

Closed as not planned

Description

@noahgift

From la-72 (L2, epic #4000 'Train What You Serve'). Finding: training verbs have no qwen35 refusal; aprender-train silently models qwen3.5 as dense qwen3 (no GDN; head_dim forced to 128).

Falsifier: a qwen35 .apr into finetune/distill exits non-zero with a named refusal, until GDN fwd+bwd lands (T1).
Sub-issue of #4000.

Activity

  1. added this to the 0.72.0 milestone on Sep 27, 2026
  2. noahgift commented on Oct 14, 2026

    @noahgift
    MemberAuthor

    merged into #5314 (master ticket for epic #4000; triage rule 7b, 2026-10-14). It is a checklist row there; reopen this issue when work on it starts or its PR opens.

  3. noahgift commented on Oct 14, 2026

    @noahgift
    MemberAuthor

    Moved: this sub-ticket is now a row in #5341 (apr finetune and LoRA adapters: correct loading, merging and CUDA training), split out of #5314 by theme.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions