An Error Prompted When Trying to Run vicuna through a UI via oobabooga
If you are trying to run vicuna through a UI via oobabooga and have encountered an error while adding --wbits 4 --groupsize 128 after "call python webui.py" in your start.bat file, this article might help you solve the problem.
In the tutorial you are following, you might have been instructed to add the above-mentioned code in your start.bat file. However, upon running the start.bat file, you might have encountered an error prompting that indicated a problem with the command you have just added.
The best way to solve this problem is to remove --wbits 4 --groupsize 128 from the start.bat file altogether. Although it was suggested in the tutorial, it might not always work as expected. In fact, it could generate errors and prevent vicuna from generating responses to your input.
Instead, you can try launching the UI without --chat --wbits4 --groupsize 128 in the start.bat file. Although this might not be the optimal solution, it could still help you get the job done without any errors.
If you continue to face issues, it could be beneficial to seek assistance from the community or the tutorial author to help you get vicuna up and running through a UI via oobabooga.
