Skip to content

测试基建:✨ 补齐 FP8 与 TE MoE 对齐测试能力#682

Merged
cangtianhuang merged 5 commits into
PFCCLab:mainfrom
cangtianhuang:main
Jul 16, 2026
Merged

测试基建:✨ 补齐 FP8 与 TE MoE 对齐测试能力#682
cangtianhuang merged 5 commits into
PFCCLab:mainfrom
cangtianhuang:main

Conversation

@cangtianhuang

Copy link
Copy Markdown
Collaborator

🔧 主要变更

1. 统一比较异常分类

accuracyaccuracy_stablepaddle_device_vs_*paddle_cinn_vs_dygraph 等 tester 中的重复异常处理改为调用统一的 report_compare_error,并修复 [torch_assert_OOM] 的 OOM 分类,提升报告日志的一致性。

2. 修复 numpy 与 MoE 边界输入生成

在 embedding、cross entropy、take along axis 等依赖随机索引上界的配置生成中增加 0-size 兜底;MoE routemap 生成同时处理 topk == 0topk > num_experts,避免 numpy 采样异常并保持 tokens_per_expert 与 routemap 一致。

3. 扩展 FP8 与 TE MoE 转换规则

fp8_quant_blockwise 增加 Transformer Engine 参考实现和环境变量切换能力,补齐 1x128 / 128x128、scale transpose、input transpose、ue8m0 packed scale 等路径;同时完善 MoE unzipped scale scatter 和 fused FP8 quant 的 ue8m0 输出打包逻辑。

📁 改动文件

tester/
├── accuracy.py                         # 精度比较异常统一上报
├── accuracy_stable.py                  # 稳定性比较异常统一上报
├── base.py                             # runtime error 分类与 compare error 上报入口
├── paddle_cinn_vs_dygraph.py           # CINN / dygraph 比较异常统一上报
├── paddle_device_vs_cpu.py             # device / CPU 比较异常统一上报
├── paddle_device_vs_gpu.py             # device / GPU 比较异常统一上报
├── api_config/
│   └── config_analyzer.py              # numpy 输入生成与 MoE routemap 边界处理
└── paddle_to_torch/
    └── rules.py                        # FP8、TE MoE 与 ue8m0 转换规则扩展

@paddle-bot

paddle-bot Bot commented Jul 16, 2026

Copy link
Copy Markdown

Thanks for your contribution!

@cangtianhuang
cangtianhuang enabled auto-merge (squash) July 16, 2026 12:51
@cangtianhuang
cangtianhuang merged commit 16113fe into PFCCLab:main Jul 16, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant