Get a Limitless AI ChatGPT — How to Install Ollama and Open WebGUI Without Docker
Ironman the movie predicted the invention of ChatGPT. In the movie, Tony Stark uses Jarvis, his AI assistant to find a new element for his zero-point power source. Now, in the present, we have ChatGPT. Competitors of ChatGPT include Meta AI, Google Gemini, Duck Duck Go AI Chat, Deep AI, and several others.
The downside of these cloud AI providers is that they are rate-limited, meaning you do not have unlimited uses. This is why having your own privately hosted AI chatbot is an option for people who use it for:
- Below are the official installation instructions for Ollama: https://github.com/ollama/ollama/blob/main/docs/linux.md
Installation Steps:
In my case, I am using Linux Mint. Let's download the installer and run it with sudo. Check that the daemon is running and look for models. The above steps should show an empty list of models.
Next, download the model "codellama" to use it like IronMan's Jarvis. See here for a list of models: https://ollama.com/search
Now, let’s install the web GUI for Ollama. At the time of writing, open-webui requires Python 3.11, so let's install it. Create a virtual environment in the opt directory and install open-webui. Create a daemon for open-webui with secure defaults and enable the daemon.
Navigate to http://localhost:8080/. Be cautious as by default, this app listens on all interfaces. If this concerns you, set up a local firewall. You now have your very own AI chatbot like Jarvis from Iron Man.
If you are in the IT industry, this can be your competitive advantage. Having unlimited usage access enables you to summarize many documents and be very productive.
If your setup is slow, consider purchasing eGPUs for laptops or setting up a dedicated server for Ollama.
If you found this article helpful, useful, or simply liked it, please consider:
- Leaving claps on the article (you can clap up to 50 times)
- Commenting for any corrections or support
- Reading the article for at least 30 seconds for Medium to count it as a valid read
- Joining and following me on Medium
Remember, "Knowledge is power. But how you use that power defines whether you are good or evil."
