About training datasets

[EleFreelance]

Big Guy, that's an amazing piece of work, but I was wondering what data set did you use to train your U^2net model?

[samhaswon]

Thanks! It's a custom dataset I made myself. I'm still working on it, hoping to reduce bias and increase accuracy.

[EleFreelance]

Thank you very much for your reply, do I have a chance to share your custom data set? I want to replicate your effect and do some exploration of model structure optimization.

[samhaswon]

Not currently. I'm still working on it, so I would just be changing it again. If you want something to test with, you can use an already public dataset like this one:
https://zenodo.org/records/5834916#.YkYQCShBw2x

It is technically different but it would give you a good starting point. This dataset doesn't include the eyes and lips if I remember correctly. Regardless, it would give you a good starting point for doing like you are talking about. You could even use the weights I have released to make your own dataset with a bit of cleanup.

[EleFreelance]

Ok, you gave me a very good idea. but I have a question about Google's MediaPipe model that you mentioned in the readme. Which one is better for creating the training datasets, or the model you release?In other words, is your current release model more effective than Google's MediaPipe model for skin detection?

[samhaswon]

I would just use one of the ones I released. You can try the Google one if you want, the code is right there, but I couldn't ever get what I would call "good" results. I wouldn't even call what they have in the documentation for it good. But, it's a tiny model for what it is doing.

[samhaswon]

Also, if you're building an unlabelled dataset, this might help you out: https://github.com/samhaswon/bing_image_downloader
Or, you could use what I forked it from: https://github.com/gurugaurav/bing_image_downloader

My fork is more optimized for Stable Diffusion dataset building whereas the upstream repo will bring in more watermarked images (but less overall) if you are looking for that. Mine also allows you to use a list of queries (demoed using a file) to reduce the duplicates you would have to filter through and make it easier to build a large dataset.