ruikangliu
/

DeepSeek-R1-Distill-Qwen-32B-quantized.gptq-gptqmodel-w4g128

4-bit precision

Model card Files Files and versions

Quantized model from Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models.

Downloads last month: 3

Safetensors

Model size

5.74B params

Tensor type

I32

·

BF16

·

F16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including ruikangliu/DeepSeek-R1-Distill-Qwen-32B-quantized.gptq-gptqmodel-w4g128

DeepSeek-R1-Distill-Quantized

8 items • Updated May 27 • 1