runtime error
Exit code: 1. Reason: �� | 129M/1.47G [00:03<00:33, 40.1MB/s] [A model.safetensors: 45%|████▌ | 665M/1.47G [00:04<00:03, 209MB/s] [A generation_config.json: 0%| | 0.00/142 [00:00<?, ?B/s][A generation_config.json: 100%|██████████| 142/142 [00:00<00:00, 873kB/s] adapter_config.json: 0%| | 0.00/991 [00:00<?, ?B/s][A adapter_config.json: 100%|██████████| 991/991 [00:00<00:00, 5.03MB/s] model.safetensors: 100%|██████████| 1.47G/1.47G [00:04<00:00, 301MB/s] adapter_model.safetensors: 0%| | 0.00/56.7M [00:00<?, ?B/s][A adapter_model.safetensors: 100%|██████████| 56.7M/56.7M [00:01<00:00, 35.1MB/s][A adapter_model.safetensors: 100%|██████████| 56.7M/56.7M [00:01<00:00, 35.0MB/s] /usr/local/lib/python3.10/site-packages/accelerate/utils/modeling.py:1598: UserWarning: The following device_map keys do not match any submodules in the model: ['base_model.model.decoder.embed_tokens', 'base_model.model.encoder.embed_tokens'] warnings.warn( Traceback (most recent call last): File "/app/app.py", line 16, in <module> model = PeftModel.from_pretrained(base_model, "gog444/egyptian-to-fusha-v1") File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 568, in from_pretrained load_result = model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1430, in load_adapter dispatch_model( File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 383, in dispatch_model raise ValueError( ValueError: We need an `offload_dir` to dispatch this model according to this `device_map`, the following submodules need to be offloaded: base_model.model.encoder.block.10, base_model.model.encoder.block.11, base_model.model.encoder.final_layer_norm, base_model.model.encoder.dropout, base_model.model.decoder.block, base_model.model.decoder.final_layer_norm, base_model.model.decoder.dropout, base_model.model.lm_head.
Container logs:
Fetching error logs...