Can you provide specific quantification methods and scripts?
1
#2 opened 15 days ago
by
yangbohust
Does vllm 0.8.4 support this quantized model?
1
#1 opened 21 days ago
by
traphix