Spaces:

rinrikatoki
/

my-lora-inference

Runtime error

rinrikatoki commited on May 14

Commit

86ca92c

verified ·

1 Parent(s): ffcffe0

Upload app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -39,8 +39,6 @@ print("🔹 در حال بارگذاری مدل پایه...")
 base_model = AutoModelForCausalLM.from_pretrained(
     BASE_MODEL,
     device_map="auto",
-    torch_dtype=torch.float16,
-    load_in_4bit=True,
     trust_remote_code=True,
     token=hf_token
 )

 base_model = AutoModelForCausalLM.from_pretrained(
     BASE_MODEL,
     device_map="auto",
     trust_remote_code=True,
     token=hf_token
 )