Support for Colpali

[amit-jain]

Is support for Colpali been feasible? I chanced upon this repository for embedding inference and would be interested in Colpali and related adpater support.
It probably needs additional endpoints though which may not align with the project.

[S1LV3RJ1NX]

the support is added I guess.

[michaelfeil]

Just added support! Still experimental in 0.0.68 - requires some testing with external libraries as comparison.

@S1LV3RJ1NX do you know any good libraries to unit-test against?

[simjak]

Is there a notebook on how I can use ColPali or ColQwen models?
Can I run those models in Runpod?
@michaelfeil

[simjak]

I tried to run https://huggingface.co/vidore/colqwen2-v1.0 via RunPod, but got errors.

[simjak]

here are more details:
#507

[michaelfeil]

The version of Runpod is pinned to ~0.050 which does not allow multi model yet.

[simjak]

where can I update the version?

[michaelfeil]

https://github.com/runpod-workers/worker-infinity-embedding/blob/main/builder/requirements.txt

Be wary, infinity changed over time (python API), will take some effort.