Add worker telemetry for key metrics (KV Cache Utilization, queue depth) at a configurable interval - #28

Add worker telemetry for key metrics (KV Cache Utilization, queue depth) at a configurable interval#28

jamesyan2028 wants to merge 2 commits into

IBM:mainIBM/opal-sim:mainfrom

jamesyan2028:feature/Add-Worker-Telemetryjamesyan2028/opal-sim:feature/Add-Worker-TelemetryCopy head branch name to clipboard