Spaces:

HuggingFaceM4
/

idefics-8b

Running

merve HF Staff commited on Apr 16, 2024

Commit

7062ece

verified ·

1 Parent(s): e57a9e9

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -14,7 +14,7 @@ processor = AutoProcessor.from_pretrained("HuggingFaceM4/idefics2-8b")
 model = Idefics2ForConditionalGeneration.from_pretrained(
         "HuggingFaceM4/idefics2-8b",
         torch_dtype=torch.bfloat16,
-        _attn_implementation="flash_attention_2",
         trust_remote_code=True).to("cuda")
 @spaces.GPU(duration=180)

 model = Idefics2ForConditionalGeneration.from_pretrained(
         "HuggingFaceM4/idefics2-8b",
         torch_dtype=torch.bfloat16,
+        #_attn_implementation="flash_attention_2",
         trust_remote_code=True).to("cuda")
 @spaces.GPU(duration=180)