Skip to content

perf(rocprofiler-sdk): kernel replay phase 2: performance optimizations - #10916

Draft
MythreyaK wants to merge 1 commit into
users/vkale/kernel-replay-rocprofv3from
users/mkuriche/kernel-replay-perf-experiments
Draft

perf(rocprofiler-sdk): kernel replay phase 2: performance optimizations#10916
MythreyaK wants to merge 1 commit into
users/vkale/kernel-replay-rocprofv3from
users/mkuriche/kernel-replay-perf-experiments

Conversation

@MythreyaK

Copy link
Copy Markdown
Member

Motivation

Experimental performance improvements for kernel replay. For now, this branch focuses on exclusive device-side snap/restore (i.e., is device memory is full, replay fails).

Upcoming commits might include graceful host-side fallback etc.

Technical Details

Performance optimizations on top of #7960 kernel replay. As implemented,

  • snap on device memory (only, for now)
  • implement blit copies batched with kernel dispatch for gap-free restores, without host-side API call for restoring memory
  • signal reuse for dispatches (saves ~200us)

Overall, on a simple babel stream benchmark, runtime improves ~9.4x. Concrete results and a formal rocprofiler-sdk/benchmark suite will be added after implementation stabilizes.

Issue Tracking

Test Plan

Test Result

Submission Checklist

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant