Skip to content

Update ollama to use openai api proxy #475

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Conversation

mina-parham
Copy link
Contributor

No description provided.

Copy link

codecov bot commented Jul 21, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

📢 Thoughts on this report? Let us know!

@mina-parham mina-parham marked this pull request as ready for review July 21, 2025 17:55
@mina-parham mina-parham requested a review from dadmobile July 21, 2025 17:56
Copy link
Member

@dadmobile dadmobile left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Testing on my machine I got:

"/Users/tony/.transformerlab/workspace/plugins/ollama_server/main.py", line 113, in <module>
2025-07-21 22:05:21 | ERROR | stderr |     model_dir, model_filename = os.path.split(model_path)
2025-07-21 22:05:21 | ERROR | stderr |                                               ^^^^^^^^^^
2025-07-21 22:05:21 | ERROR | stderr | NameError: name 'model_path' is not defined

First problem is that model_path doesn't get set if the os path exists was up in teh code.
Second problem ist hat my args.model_path is a hugging face model ID...but that one migth be my problem.

@dadmobile
Copy link
Member

I tried to run a model with a valid model_path and it gave me an error about Ollama not being installed or not running.
This is true...I wasn't runnign ollama yet. I think before it used to start ollama if it wasn't running as a side effect of starting the connection?

@dadmobile
Copy link
Member

(Once I dealt with these two errors everythign worked BTW)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants