Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple settings aren't saved on restart #6498

Open
1 task done
Lex-DRL opened this issue Oct 27, 2024 · 2 comments
Open
1 task done

Multiple settings aren't saved on restart #6498

Lex-DRL opened this issue Oct 27, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@Lex-DRL
Copy link

Lex-DRL commented Oct 27, 2024

Describe the bug

When restarting webUI, many essential parameters are reset to their defaults with seemingly no way to save them. Specifically:

  • Parameters > Instruction template > Custom system message
    • I clicked around, but couldn't find a way to save it to a template or associate with a model either.
  • The last loaded model.
  • Basically every field on the main Chat page. I personally face it with:
    • Chat style
    • Command for chat-instruct mode

Is there an existing issue for this?

  • I have searched the existing issues

Reproduction

  • Start the webUI with --verbose flag.
  • Go to "Parameters > Instruction template" and set "Custom system message" to some custom string.
  • Load a model, go to "Chat" tab and ask the model something.
  • Verify in terminal that custom system message is indeed added to the context.
  • Close the browser tab and restart webUI - again, with --verbose flag; load the model again.
  • On the "Chat" tab, re-generate the model's response. Verify in terminal that this time system message wasn't added.

Screenshot

No response

Logs

-

System Info

Server (running webUI in local network):
OS: Manjaro Linux
CPU: Intel(R) Core(TM) i7-13700K
GPU: NVIDIA RTX 4090

Client:
OS: Windows 10 x64
Browser: Firefox 131.0.3
@Lex-DRL Lex-DRL added the bug Something isn't working label Oct 27, 2024
@mefich
Copy link
Contributor

mefich commented Oct 27, 2024

Some settings can be saved by using "Save UI defaults" in Session tab.
For example command for chat-instruct mode, some settings from parameters tab, etc.

@Lex-DRL
Copy link
Author

Lex-DRL commented Oct 27, 2024

Hmmm... Thanks for the info.

The issue isn't a bug but a feature request then.
If so, maybe such settings need to be on the same page, which also contains save button?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants