You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
but am unable to load it into ollama for real-world testing as it appears every “torch to GGUF” article out there starts off with “download a model from HF, use llama.cpp’s convert scripts” - which is not what I need.
Seems like every other article is re fine-tuning some existing model staying within the HF ecosystem. Kinda stunts efforts to use novel non-HF models in common LLM tooling...
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Exploring this interesting embedding model:
https://github.com/exlab-research/Banyan
but am unable to load it into ollama for real-world testing as it appears every “torch to GGUF” article out there starts off with “download a model from HF, use llama.cpp’s convert scripts” - which is not what I need.
Seems like every other article is re fine-tuning some existing model staying within the HF ecosystem. Kinda stunts efforts to use novel non-HF models in common LLM tooling...
Thanks in advance!
Beta Was this translation helpful? Give feedback.
All reactions