Inspiration
In the recent months OpenAI ChatGPT got a lot of attention. Its potentials are quite intriguing to me as well.
I’ve got inspired by a scientist Brian Roemmele's publication “How You Can Install A ChatGPT-like Personal AI On Your Own Computer And Run It With No Internet” . In this recent publication, he describes the concept of Personal AI and how to install its implementation GPT4All. GPT4All is an open-source project, which implements an assistant-style large language model based (GPT-J and LLaMa) This project is hosted at https://github.com/nomic-ai/gpt4all.
Why it is important?
- It can be a potent tool for researchers as the model can be tailored for a specific research domain.
- It doesn’t require an Internet connection to operate. And it can be used in scenarios where the Internet connection is not reliable or limited.
- It can enable a new cohort of scientists, who doesn't have programming skills to collaborate with the AI using natural language.
While GPT4All can run on PCs without special accelerators unfortunately, there is no image for RPi available yet. RPi 4B is comparable in it CPU speed to many modern PCs and should be close to satisfy GPT4All system requirements.
Plan
Here is my high-level project plan:
- Explore the concept of Personal AI, analyze open-source large language models similar to GPT4All, analyse their potential scientific applications and constraints related to RPi 4B capabilities.
- Deploy/build code and run models on RPi 4B,
- Evaluate scintific applications
- Natural language interaction to explore telemetry data sets
- Reasoning capabilities
- Create the project summary
The Sci-Pi GPT project logo was generated by Bing Image Creator powered by DALL-E.