Error while loading unsloth/gemma-2-9b-bnb-4bit #2878
Unanswered
RyanStout2001
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Today I wanted to run the code which uses the gemma-2-9b model again, but it suddenly doesn't work anymore. While running the model I get the following error:
RuntimeError Traceback (most recent call last)
/tmp/ipython-input-4-2629227664.py in <cell line: 0>()
7 #9db9d7ae7c202d8c72c095bb0e74c4b8586fa103
8
----> 9 model, tokenizer = FastLanguageModel.from_pretrained(
10 model_name = model_name,
11 max_seq_length = 1024,
/usr/local/lib/python3.11/dist-packages/unsloth/models/loader.py in from_pretrained(model_name, max_seq_length, dtype, load_in_4bit, load_in_8bit, full_finetuning, token, device_map, rope_scaling, fix_tokenizer, trust_remote_code, use_gradient_checkpointing, resize_model_vocab, revision, use_exact_model_name, fast_inference, gpu_memory_utilization, float8_kv_cache, random_state, max_lora_rank, disable_log_stats, *args, **kwargs)
238 f"PeftConfig error: {peft_error}\n\n"
239 )
--> 240 raise RuntimeError(combined_error)
241 pass
242
RuntimeError: Unsloth: Failed to load model. Both AutoConfig and PeftConfig loading failed.
AutoConfig error: name 'layer_type_validation' is not defined
PeftConfig error: Can't find 'adapter_config.json' at 'unsloth/gemma-2-9b-bnb-4bit'
I then looked at the notebook for the unsloth/gemma-2-9b-bnb-4bit provided by unsloth itself and I get the same error here. I can't seem to figure out where it is going wrong. Anybody that has an idea how I can fix this, so that I can continue writing my master's thesis?
Thank you in advance!
Beta Was this translation helpful? Give feedback.
All reactions