Skip to content

Conversation

ProGamerGov
Copy link
Contributor

@ProGamerGov ProGamerGov commented Apr 26, 2022

  • Added the CLIP ResNet 50x4 model used in the 'Multimodal Neurons in Artificial Neural Networks' research paper: https://distill.pub/2021/multimodal-neurons/
  • To make it easier to conduct research, the CLIP ResNet 50x4 model is divided into two parts; the image model and the text model.

I have a couple tutorials ready that use this model. I also have another PR ready that implements the tokenizer for the text model, using torchtext's CLIPTokenizer.

@ProGamerGov ProGamerGov force-pushed the optim-wip-clip-vis branch from 3dca15b to e9598ea Compare May 13, 2022 21:21
@ProGamerGov
Copy link
Contributor Author

The CLIP PRs are: #927, #943, #945, #961, #965, #966, #968

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants