Trying to build docker container

[bekzod]

Hi, sorry if it is not related directly to flute, but would appricate if you could help.

I am trying to build docker image on top of vllm docker image with following:

# Use vllm/vllm-openai:latest as the base image
FROM vllm/vllm-openai:latest

# Install flute-kernel using pip with cache optimization
RUN --mount=type=cache,target=/root/.cache/pip \
    python3 -m pip install flute-kernel --no-cache-dir

# Set the entrypoint to use the specified command
ENTRYPOINT ["python3", "-m", "flute.integrations.vllm vllm.entrypoints.openai.api_server"]

but I am getting following error when I run docker buildx build --platform linux/amd64 -t flute:latest -f Dockerfile .:

 > [stage-0 2/2] RUN --mount=type=cache,target=/root/.cache/pip     python3 -m pip install flute-kernel --no-cache-dir:       
0.957 ERROR: Could not find a version that satisfies the requirement flute-kernel (from versions: none)                       
1.346 
1.346 [notice] A new release of pip is available: 24.2 -> 24.3.1
1.346 [notice] To update, run: python3 -m pip install --upgrade pip
1.347 ERROR: No matching distribution found for flute-kernel
------
Dockerfile:5
--------------------
   4 |     # Install flute-kernel using pip with cache optimization
   5 | >>> RUN --mount=type=cache,target=/root/.cache/pip \
   6 | >>>     python3 -m pip install flute-kernel --no-cache-dir
   7 |     

do you know the reason ?

[HanGuo97]

This happens when the system you are using is not supported. The current release of FLUTE supports following settings:

flute/.github/workflows/wheels.yaml

Lines 16 to 21 in 6806c1b

	strategy:
	matrix:
	os: ['ubuntu-20.04']
	python-version: ['3.8', '3.9', '3.10', '3.11']
	pytorch-version: ['2.4.0']
	cuda-version: ['11.8', '12.1']