Skip to content

[MODEL REQUEST] Qwen3-TTS adaptation for Qualcomm devices with NPU #321

Description

Is your feature request related to a problem? Please describe.
I am working on adapting Qwen3-TTS for on-device inference on Qualcomm Snapdragon devices, especially with NPU / HTP acceleration.

Qwen3-TTS is a strong open-source TTS model, but deploying it efficiently on mobile devices requires model decomposition, export-path adaptation, backend placement, and runtime optimization. I have already built an initial Qualcomm-oriented prototype and achieved around RTF ≈ 1 in my local test setup. I would like to discuss whether this work can be aligned with qualcomm/ai-hub-models and potentially upstreamed as an official model contribution.

Details of model being requested

Additional context for requested model
I have completed an initial Qualcomm-oriented adaptation of Qwen3-TTS. The current work includes:

  • Model component decomposition for deployment-oriented execution
  • Model architecture adaptation for Qualcomm runtime compatibility
  • Mixed-precision quantization across different model components
  • Experiments with different compute backends, including CPU and NPU / HTP paths

Based on this preliminary prototype, I would like to collaborate with the Qualcomm AI Hub Models maintainers to further improve and upstream this work. I am especially looking for guidance on model structure optimization, quantization strategy, backend placement, and the preferred integration path for making this model work well on Qualcomm devices.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions