Error in init from pretrained for LTXConditionPipeline

[Vickeyhw]

Describe the bug

pipe = LTXConditionPipeline.from_pretrained("Lightricks/LTX-Video-0.9.7-dev", torch_dtype=torch.bfloat16)

File "/opt/nas/p/conda/envs/diffuser0526/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/opt/nas/p/conda/envs/diffuser0526/lib/python3.10/site-packages/diffusers/pipelines/pipeline_utils.py", line 986, in from_pretrained
loaded_sub_model = load_sub_model(
File "/opt/nas/p/conda/envs/diffuser0526/lib/python3.10/site-packages/diffusers/pipelines/pipeline_loading_utils.py", line 711, in load_sub_model
raise ValueError(
ValueError: The component <class 'transformers.models.t5.tokenization_t5._LazyModule.getattr..Placeholder'> of <class 'diffusers.pipelines.ltx.pipeline_ltx_condition.LTXConditionPipeline'> cannot be loaded as it does not seem to have any of the loading methods defined in {'ModelMixin': ['save_pretrained', 'from_pretrained'], 'SchedulerMixin': ['save_pretrained', 'from_pretrained'], 'DiffusionPipeline': ['save_pretrained', 'from_pretrained'], 'OnnxRuntimeModel': ['save_pretrained', 'from_pretrained'], 'PreTrainedTokenizer': ['save_pretrained', 'from_pretrained'], 'PreTrainedTokenizerFast': ['save_pretrained', 'from_pretrained'], 'PreTrainedModel': ['save_pretrained', 'from_pretrained'], 'FeatureExtractionMixin': ['save_pretrained', 'from_pretrained'], 'ProcessorMixin': ['save_pretrained', 'from_pretrained'], 'ImageProcessingMixin': ['save_pretrained', 'from_pretrained'], 'ORTModule': ['save_pretrained', 'from_pretrained']}.

Reproduction

from transformers import CLIPVisionModel
from diffusers import LTXConditionPipeline, LTXLatentUpsamplePipeline
pipe = LTXConditionPipeline.from_pretrained("Lightricks/LTX-Video-0.9.7-dev", torch_dtype=torch.bfloat16)

Logs

System Info

• 🤗 Diffusers version: 0.34.0.dev0
• Platform: Linux-5.15.0-91-generic-x86_64-with-glibc2.35
• Running on Google Colab?: No
• Python version: 3.10.16
• PyTorch version (GPU?): 2.7.0+cu126 (True)
• Flax version (CPU?/GPU?/TPU?): not installed (NA)
• Jax version: not installed
• JaxLib version: not installed
• Huggingface_hub version: 0.32.0
• Transformers version: 4.52.3
• Accelerate version: 1.7.0
• PEFT version: 0.15.2
• Bitsandbytes version: not installed
• Safetensors version: 0.5.3
• xFormers version: not installed
• Accelerator: NVIDIA A800-SXM4-40GB, 40960 MiB

Who can help?

@yiyixuxu @DN6

[DN6]

@a-r-r-o-w could you take a look here please

[a-r-r-o-w]

I replicated the package versions mentioned in the system info and tried to run the example code. Cannot seem to reproduce the error here though.

@Vickeyhw This could most likely be a faulty environment or download of the models/configs. Could you try to delete any existing model files that have been cached, and restart the process?