Selected Personality Model is not loaded, instead the Gemma base is loaded #3

New Issue

2025-03-23T21:45:06Z

kfoxirl commented

2025-03-23 21:45:06 +00:00

Hi, I set the MODEL_NAME env in my .env file to match the name of the personality model I wish to use so it looks like this, this matches what I get in openweb ui playground as a name:

MODEL_NAME=nikolas-tesla

I've tried with and without single and double quotes and with quotes I get "model not found" but while it works with MODEL_NAME=nikolas-tesla it is very clearly the baseline for gemma and has not loaded nikolas-tesla personality model.

I'm sure its something silly I'm doing wrong. But could use some guidance. Thanks

Hi, I set the MODEL_NAME env in my .env file to match the name of the personality model I wish to use so it looks like this, this matches what I get in openweb ui playground as a name: MODEL_NAME=nikolas-tesla I've tried with and without single and double quotes and with quotes I get "model not found" but while it works with MODEL_NAME=nikolas-tesla it is very clearly the baseline for gemma and has not loaded nikolas-tesla personality model. I'm sure its something silly I'm doing wrong. But could use some guidance. Thanks

jknapp commented

2025-03-23 23:37:08 +00:00

Are you using Gemma as the base model? Chances are that it is not working the same as the Llama3 model it was written for.

I would recommend trying a different base model, or tweaking the custom model. How does the model respond from within the Open WebUI

Are you using Gemma as the base model? Chances are that it is not working the same as the Llama3 model it was written for. I would recommend trying a different base model, or tweaking the custom model. How does the model respond from within the Open WebUI

kfoxirl commented

2025-03-24 19:43:07 +00:00

I am using Gemma as base model. Open WebUI it responds correctly as I have nikolas-tesla set as the default personality model.

jknapp commented

2025-03-24 20:11:45 +00:00

Is the personality set via the System Prompt or through the use of tools/functions/KBs?

Have you tried to perform requests against OWUI API endpoints directly using curl?

If the bot is responding in Discord, then that part of the code is working correctly, and the issue stems from how the model responds over the API.

Is the personality set via the System Prompt or through the use of tools/functions/KBs? Have you tried to perform requests against OWUI API endpoints directly using curl? If the bot is responding in Discord, then that part of the code is working correctly, and the issue stems from how the model responds over the API.

kfoxirl commented

2025-03-25 17:04:02 +00:00

It just a prompt I believe, I imported it but that's all it seems to be. I have not tried making API calls directly with curl.

I agree when I circle back to this when the ADHD train comes around I'll see if I can figure out how to make those API calls with curl :)

It just a prompt I believe, I imported it but that's all it seems to be. I have not tried making API calls directly with curl. I agree when I circle back to this when the ADHD train comes around I'll see if I can figure out how to make those API calls with curl :)

jknapp commented

2025-03-26 02:05:57 +00:00

Sounds good, I'll close this issue.

jknapp closed this issue

2025-03-26 02:05:58 +00:00

Sign in to join this conversation.

2 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: OpenWebAI-DiscordBots/OpenWebUI-Discordbot#3