Skip to content

Error in loading Lora #11224

Open
Open
@D1-3105

Description

@D1-3105

Describe the bug

lora_unet_label_emb_0_0.alpha not supported error. I have uploaded the model on hugging face. Error appears on load_lora_weights() function

Reproduction


from diffusers import DiffusionPipeline

pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0")
pipe.load_lora_weights("artemonlysuno/sdxl-lora-neutral1")

prompt = "abstract portrait of 1girl,undefined gender,fragmented visual style,red and black color palette,evokes feelings of rebellion,passion,and freedom,blurred boundaries,high resolution,aesthetic,"
image = pipe(prompt).images[0]

Logs

Traceback (most recent call last):
  File "/home/user/rw/Oleg/sd-base-api/test_lora.py", line 5, in <module>
    pipe.load_lora_weights("artemonlysuno/sdxl-lora-neutral1")
  File "/home/user/anaconda3/envs/3.7/lib/python3.12/site-packages/diffusers/loaders/lora_pipeline.py", line 543, in load_lora_weights
    state_dict, network_alphas = self.lora_state_dict(
                                 ^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/anaconda3/envs/3.7/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/home/user/anaconda3/envs/3.7/lib/python3.12/site-packages/diffusers/loaders/lora_pipeline.py", line 698, in lora_state_dict
    state_dict = _maybe_map_sgm_blocks_to_diffusers(state_dict, unet_config)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/anaconda3/envs/3.7/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 59, in _maybe_map_sgm_blocks_to_diffusers
    raise ValueError(f"Checkpoint not supported because layer {layer} not supported.")
ValueError: Checkpoint not supported because layer lora_unet_label_emb_0_0.alpha not supported.

System Info

Diffusers version: Version: 0.33.0.dev0
Python: 3.12.9

Who can help?

@sayakpaul

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinglorastaleIssues that haven't received updates

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions