Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

We still don't use BFDOT on macOS CPU because Apple compiler used for PyTorch wheel is outdated聽#1444

Open
Open
We still don't use BFDOT on macOS CPU because Apple compiler used for PyTorch wheel is outdated#1444
Labels
Known GapsThese are known Gaps/Issues/Bug items in torchchatMPS/MetalIssues related to Metal MPS/env set upperformancetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Description

@swolchok
swolchok
opened on Dec 27, 2024

馃殌 The feature, motivation and pitch

See pytorch/pytorch#143913 . This is blocking improved CPU performance for bfloat16 decoding on Mac; setting up an issue on torchchat side to track.

Alternatives

robust setup for decoding using accelerators on Mac

Additional context

No response

RFC (Optional)

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Known GapsThese are known Gaps/Issues/Bug items in torchchatMPS/MetalIssues related to Metal MPS/env set upperformancetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions