rag: set embedding server batch and ubatch size to match context size - #2923

rag: set embedding server batch and ubatch size to match context size#2923

JohnnyWilson16 wants to merge 2 commits into

containers:maincontainers/ramalama:mainfrom

JohnnyWilson16:fix-rag-embedding-batch-sizeJohnnyWilson16/ramalama:fix-rag-embedding-batch-sizeCopy head branch name to clipboard