-
-
-
-
-
-
Inference Providers
Active filters:
web-llm
mlc-ai/Llama-3-8B-Instruct-q0f32-MLC
Updated
mlc-ai/Llama-3-70B-Instruct-q3f16_1-MLC
Updated
•
127
•
1
mlc-ai/Llama-3-8B-Instruct-q3f16_2-MLC
mlc-ai/Hermes-2-Pro-Mistral-7B-q4f16_1-MLC
Updated
•
688
•
1
mlc-ai/Phi-3-mini-4k-instruct-q0f32-MLC
mlc-ai/Phi-3-mini-4k-instruct-q0f16-MLC
mlc-ai/Phi-3-mini-4k-instruct-q4f16_1-MLC
Updated
•
2.84k
mlc-ai/Phi-3-mini-4k-instruct-q4f16_2-MLC
Updated
mlc-ai/Phi-3-mini-128k-instruct-q0f32-MLC
Updated
mlc-ai/Phi-3-mini-128k-instruct-q4f16_2-MLC
mlc-ai/Llama-2-7b-chat-hf-q0f16-MLC
Updated
mlc-ai/stablelm-2-zephyr-1_6b-q0f16-MLC
Updated
mlc-ai/stablelm-2-zephyr-1_6b-q0f32-MLC
Updated
mlc-ai/stablelm-2-zephyr-1_6b-q4f32_1-MLC
Updated
•
74
mlc-ai/stablelm-2-zephyr-1_6b-q4f16_1-MLC
Updated
•
151
mlc-ai/Qwen1.5-0.5B-Chat-q3f16_1-MLC
mlc-ai/Phi-3-mini-4k-instruct-q4f32_1-MLC
Updated
•
274
mlc-ai/Llama-3-70B-Instruct-q4f16_1-MLC
mlc-ai/Phi-3-mini-128k-instruct-q0f16-MLC
mlc-ai/Mistral-7B-Instruct-v0.3-q0f16-MLC
Updated
mlc-ai/Mistral-7B-Instruct-v0.3-q4f16_1-MLC
Updated
•
2.35k
mlc-ai/Mistral-7B-Instruct-v0.3-q4f32_1-MLC
Updated
•
81
mlc-ai/Phi-3-mini-128k-instruct-q4f16_1-MLC
Updated
•
39
•
1
mlc-ai/Phi-3-mini-128k-instruct-q4f32_1-MLC
Updated
mlc-ai/Llama-3-8B-Instruct-q4f32_1-MLC
Updated
•
689
•
1
mlc-ai/Llama-3-8B-Instruct-q0f16-MLC
Updated
mlc-ai/Llama-3-8B-Instruct-q3f16_1-MLC
Updated
•
70
•
1
mlc-ai/Qwen1.5-0.5B-Chat-q4f32_1-MLC
Updated
mlc-ai/Qwen1.5-0.5B-Chat-q4f16_1-MLC
Updated
•
218
mlc-ai/Qwen1.5-0.5B-Chat-q0f16-MLC