Hugging Face's logo

Spaces:
yusufs
/
vllm-inference
Paused

App Files
vllm-inference / Dockerfile

Commit History

feat(download_model.py): remove download_model.py during build, it causing big image size
c360fd3

yusufs commited on

docs(Dockerfile): add comment about estimated image size after compile
8dc2050

yusufs commited on

feat(add-model): always download model during build, it will be cached in the consecutive builds
8679a35

yusufs commited on

feat(hf_token): set hf token during build
493a5f1

yusufs commited on

fix(hf_token): export HF_TOKEN during build
c6efe6a

yusufs commited on

feat(download-model): add download model at runtime
fc30f26

yusufs commited on

feat(run.sh): add script for running openai server
ded2af7

yusufs commited on

fix(python): fix absolute path of python script
d2e0be1

yusufs commited on

fix(cmd): fix 'error: failed to solve: dockerfile parse error on line 19: unknown instruction: "python3",'
de6b236

yusufs commited on

feat(openai): VLLM OpenAI compatible server
147b3a2

yusufs commited on

feat(t4-gpu): add t4 gpu capability
4998ce7

yusufs commited on

fix(expose-port): add EXPOSE in Dockerfile
6d19ece

yusufs commited on

fix(module): fix 'error module app' it should be 'main'
6a914f2

yusufs commited on

feat(first-commit): follow examples and tutorials
ae7cfbb

yusufs commited on