Erik Kaunismäki's picture

6 9 3

Erik Kaunismäki

erikkaum

·

https://www.erikkaum.com/

AI & ML interests

None yet

Recent Activity

new activity about 2 months ago

openai/whisper-large-v3-turbo:WTF is going on?

commented on their article 3 months ago

Test-Driving the LLMD Inference Engine by ZML 🚀

posted an update 3 months ago

ZML just released a technical preview of their new Inference Engine: LLMD. - Just 2.4GB container, which means fast startup times and efficient autoscaling - Cross-Platform GPU Support: works on both NVIDIA and AMD GPUs. - written in Zig I just tried it out and deployed it on Hugging Face Inference Endpoints and wrote a quick guide 👇 You can try it in like 5 minutes! https://huggingface.co/blog/erikkaum/test-driving-llmd-inference-engine

View all activity

Organizations

erikkaum 's datasets

None public yet