Update README.md

README.md

@@ -81,7 +81,27 @@ Please follow the [Build llama.cpp locally](https://github.com/ggerganov/llama.c
 **5*80G gpu is needed(could optimize), 1.4T cpu memory is needed**
 
 
-**3   tuning**
+**1 add meta data to bf16 model** https://huggingface.co/opensourcerelease/DeepSeek-R1-bf16
+
+~~~python
+import safetensors
+from safetensors.torch import save_file
+ 
+for i in range(1, 164):
+    idx_str = "0" * (5-len(str(i))) + str(i)
+    safetensors_path = f"model-{idx_str}-of-000163.safetensors"
+    print(safetensors_path)
+    tensors = dict()
+    with safetensors.safe_open(safetensors_path, framework="pt") as f:
+        for key in f.keys():
+            tensors[key] = f.get_tensor(key)
+    save_file(tensors, safetensors_path, metadata={'format': 'pt'})
+~~~
+
+
+
+**2 remove torch.no_grad** in  modeling_deepseek.py  as we need some tuning in AutoRound. 
+
 ```python
 import torch
 from transformers import AutoModelForCausalLM, AutoTokenizer