Skip to content

Add robust Groq rate limiting - #2

Merged
talhasarit merged 2 commits into
mainfrom
feat/groq-rate-limits
Mar 11, 2026
Merged

Add robust Groq rate limiting#2
talhasarit merged 2 commits into
mainfrom
feat/groq-rate-limits

Conversation

@talhasarit

Copy link
Copy Markdown
Owner

Summary

  • add a SQLite-backed Groq transcription limiter that enforces per-model request and audio-duration quotas before uploads are sent
  • wire the limiter into the transcription fallback path, track reservation outcomes, and add deterministic tests for single-worker and concurrent worker scenarios
  • add a read-only /jobs/groq/rate-limit endpoint plus docs so current limiter usage and remaining headroom are easy to inspect

Test plan

  • pytest

Made with Cursor

Enforce Groq request and audio-duration quotas locally so concurrent transcription workers do not oversubscribe upstream model limits.

Made-with: Cursor
Expose a read-only snapshot of the active Groq limiter so current usage and remaining quota headroom are easy to inspect during debugging.

Made-with: Cursor
@cursor

cursor Bot commented Mar 11, 2026

Copy link
Copy Markdown

You have run out of free Bugbot PR reviews for this billing cycle. This will reset on April 7.

To receive reviews on all of your PRs, visit the Cursor dashboard to activate Pro and start your 14-day free trial.

@talhasarit
talhasarit merged commit 357f731 into main Mar 11, 2026
2 checks passed
@talhasarit
talhasarit deleted the feat/groq-rate-limits branch March 11, 2026 03:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant