Spaces:

VeuReu
/

svision

Running on Zero

VeuReu commited on 16 days ago

Commit

510ece7

verified ·

1 Parent(s): 3706526

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -342,8 +342,7 @@ def _get_image_list_description(
     model = LlavaOnevisionForConditionalGeneration.from_pretrained(
         path_model,
         torch_dtype=torch.float16,
-        low_cpu_mem_usage=True,
-        device_map="auto"
     ).to("cuda")
     # System prompt for image description

     model = LlavaOnevisionForConditionalGeneration.from_pretrained(
         path_model,
         torch_dtype=torch.float16,
+        low_cpu_mem_usage=False
     ).to("cuda")
     # System prompt for image description