LLM Hosting Container

⚠️ This repository is no longer actively maintained.

This repository contains the Dockerfiles and associated resources for building and hosting containers for large language models and embedding models.

Hugging Face Text Generation Inference (TGI) container — deprecated and no longer maintained
Hugging Face Text Embeddings Inference (TEI) container — moved to AWS Deep Learning Containers

Security

See CONTRIBUTING for more information.

This project is licensed under the Apache-2.0 License.