Skip to content

feat(runtime): add OpenAI-compatible HTTP agent for BYOK #74

Description

@walliai666

Summary

The current BYOK mode only supports the Anthropic Messages API (anthropic-api). I'd like to add an openai-api HTTP agent that speaks the OpenAI Chat Completions protocol (POST /v1/chat/completions), using the same kind: 'http' extension point already established by anthropic-api.

This single addition covers a large surface of providers without any further changes, since most modern LLM APIs implement the OpenAI-compatible interface: OpenAI, Azure OpenAI, Groq, Together AI, Fireworks, Ollama, LM Studio, and any other OpenAI-shim provider.

Motivation

  • Many users already have an OpenAI API key and no Anthropic key.
  • Self-hosted / local inference stacks (Ollama, LM Studio, vLLM) expose /v1/chat/completions — this would make html-video usable fully offline without a CLI agent installed.
  • The runtime already has a clean AgentDef.httpHandler + httpProbe interface (packages/runtime/src/types.ts), so this is a contained addition with no interface changes.

I'm happy to submit a PR for this.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requesthelp wantedExtra attention is needed

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions