docs: document llmman as a local model server - #948
Open
ericcurtin wants to merge 1 commit into
Open
ericcurtin wants to merge 1 commit into
ericcurtin wants to merge 1 commit into
Conversation
llmman (https://github.com/llmmanorg/llmman) serves the Ollama API on port 17434, so it already works through any-llm's ollama/ provider by pointing api_base at it. Ollama only appears in docs and docstrings, so mirror those touchpoints: models.md, the AgentConfig.api_base docstring, and the Local Agent cookbook (.md and .ipynb).
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Documents llmman, a local model runner that serves the Ollama API on port 17434. any-agent has no Ollama-specific code (Ollama goes through any-llm's
ollama/provider), so llmman already works viaapi_base; this PR mirrors the existing Ollama docs touchpoints only:docs/agents/models.md: list llmman next to Ollama and add a shortAgentConfigexample with theapi_baseoverride.AgentConfig.api_basedocstring (src/any_agent/config.py): add the llmman URL next to the Ollama one (rendered into the API docs)..mdand.ipynb, kept in parallel): a two-line note under "Ollama setup"; the notebook change is a single markdown cell.ollama/prefix; a nativellmmanprovider is proposed separately in any-llm.Testing:
ruff check/ruff format --check(v0.15.4) onconfig.py,py_compile,codespellon the four changed files, notebook re-parsed as JSON;mktestdocs.check_md_file("docs/agents/models.md")executes the new snippet. Not run against a live llmman server.PR Type
Relevant issues
None.
Checklist
tests/docsmktestdocs check covers the new snippet)tests/docssuite could not be run locally for pre-existing dependency reasons; the relevant mktestdocs check passes)AI Usage Information
AI Model used: Claude
AI Developer Tool used: OpenCode
Any other info you'd like to share: Drafted with AI, reviewed and submitted by the author.
I am an AI Agent filling out this form (check box if true)