Skip to content

Added Differential Diffusion to Auraflow. #9597

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 26 commits into
base: main
Choose a base branch
from

Conversation

satani99
Copy link
Contributor

@satani99 satani99 commented Oct 6, 2024

What does this PR do?

Fixes partially #8924

Before submitting

How to test

import torch
from diffusers.utils import load_image
from pipeline_aura_flow_differential_img2img import AuraFlowDifferentialImg2ImgPipeline
pipe = AuraFlowDifferentialImg2ImgPipeline.from_pretrained(
    "fal/AuraFlow", torch_dtype=torch.float32
)
pipe.enable_sequential_cpu_offload()
source_image = load_image(
    "https://huggingface.co/datasets/OzzyGT/testing-resources/resolve/main/differential/20240329211129_4024911930.png"
)
map = load_image(
    "https://huggingface.co/datasets/OzzyGT/testing-resources/resolve/main/differential/gradient_mask_2.png"
)
prompt = "a green pear"
negative_prompt = "blurry"
image = pipe(
    prompt=prompt,
    negative_prompt=negative_prompt,
    image=source_image,
    num_inference_steps=28,
    guidance_scale=4.5,
    strength=1.0,
    map=map,
).images[0]

Who can review?

@a-r-r-o-w @DN6

@yiyixuxu
Copy link
Collaborator

yiyixuxu commented Oct 7, 2024

cc @asomoza or @a-r-r-o-w for a review!

Copy link
Member

@a-r-r-o-w a-r-r-o-w left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for working on this! Just some minor comments, and could you post your results here too?

Copy link
Contributor

github-actions bot commented Dec 8, 2024

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

@github-actions github-actions bot added the stale Issues that haven't received updates label Dec 8, 2024
@a-r-r-o-w a-r-r-o-w removed the stale Issues that haven't received updates label Dec 11, 2024
Copy link
Contributor

github-actions bot commented Jan 6, 2025

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

@github-actions github-actions bot added the stale Issues that haven't received updates label Jan 6, 2025
@yiyixuxu yiyixuxu removed the stale Issues that haven't received updates label Jan 6, 2025
Copy link
Contributor

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

@github-actions github-actions bot added the stale Issues that haven't received updates label Jan 31, 2025
@asomoza asomoza added close-to-merge and removed stale Issues that haven't received updates labels Jan 31, 2025
@asomoza
Copy link
Member

asomoza commented Jan 31, 2025

Hi @satani99 can you post some result images like this comment asked

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants