Sign inSign up

peakji92/bge-m3:encoder

Index digest

sha256:14ef58b5430af5e022531c587680b5e91d1b9623ff4635cd635b7e3ab309a0c9

OS/ARCH

linux/amd64

Compressed size

1.8 GB

Last pushed

over 2 years by peakji92

Type

Image

Manifest digest

sha256:ef1ca2fad5fdbcc6e137e3c88746141da07a1136a8d4ba031b98af5202bfa76f

Image Layers

Image Layers

1ARG RELEASE0 B
2ARG LAUNCHPAD_BUILD_ARCH0 B
3LABEL org.opencontainers.image.ref.name=ubuntu0 B
4LABEL org.opencontainers.image.version=22.040 B
5ADD file ... in / 28.17 MB
6CMD ["/bin/bash"]0 B
7ENV NVARCH=x86_640 B
8ENV NVIDIA_REQUIRE_CUDA=cuda>=12.2 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<4710 B
9ENV NV_CUDA_CUDART_VERSION=12.2.53-10 B
10ENV NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-20 B
11ARG TARGETARCH0 B
12LABEL maintainer=NVIDIA CORPORATION <[email protected]>0 B
13RUN |1 TARGETARCH=amd64 /bin/sh -c4.41 MB
14ENV CUDA_VERSION=12.2.00 B
15RUN |1 TARGETARCH=amd64 /bin/sh -c53.48 MB
16RUN |1 TARGETARCH=amd64 /bin/sh -c185 B
17ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
18ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib640 B
19COPY NGC-DL-CONTAINER-LICENSE / # buildkit6.72 KB
20ENV NVIDIA_VISIBLE_DEVICES=all0 B
21ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility0 B
22ARG DEFAULT_USE_FLASH_ATTENTION=True0 B
23ENV HUGGINGFACE_HUB_CACHE=/data PORT=80 USE_FLASH_ATTENTION=True0 B
24COPY /usr/src/target/release/text-embeddings-router /usr/local/bin/text-embeddings-router # buildkit464.09 MB
25ENTRYPOINT ["text-embeddings-router"]0 B
26CMD ["--json-output"]0 B
27COPY /model /model # buildkit1.26 GB
28EXPOSE map[80/tcp:{}]0 B
29ENV MODEL_ID=/model0 B
30ENV DTYPE=float160 B
31ENV MAX_CONCURRENT_REQUESTS=5120 B
32ENV MAX_BATCH_TOKENS=327680 B
33ENV MAX_CLIENT_BATCH_SIZE=10240 B
34ENV HOSTNAME=0.0.0.00 B
35ENV PORT=800 B
36ENV PAYLOAD_LIMIT=320000000 B
37ENV LOG_LEVEL=WARN0 B
38ENTRYPOINT ["text-embeddings-router"]0 B
39CMD []0 B

Command

 ARG RELEASE