Welcome! Soba provides you with three main projects that work together to provide a solution for interacting with open-source LLM (Large Language Model) servers.

1. Soba-Frontend
2. Soba-Server
3. Soba-Inferer

This soba-frontend project is built using React & Typescript to provide a responsive interface for interacting with a Local LLM server.

• Developed with React and Vite using Typescript.
• Utilizes React Router for navigation.
• Supports Markdown rendering with marked.js and syntax highlighting with highlight.js.

1. Install Node.js: Ensure you have Node.js installed. You can download it from Node.js official website.
2. Clone the Repository:

   git clone https://github.com/DoudouFanClub/soba-frontend.git
   cd soba-frontend

3. Install Dependencies:

   npm install

4. Run the Development Server:

   npm run dev

The soba-server project is developed in Golang to handle database operations, runtime data caching, and communication between the Frontend and LLM Inferer.

• Developed using Golang.
• Uses MongoDB for database operations.
• Uses Redis for caching runtime data.

1. Install WSL (Windows Subsystem for Linux): Follow the instructions on the Microsoft WSL Documentation.
2. Install MongoDB: Refer to the MongoDB installation guide for your specific operating system.
3. Install Redis: Follow the installation instructions from the Redis official documentation.
4. Clone the Repository:

   git clone https://github.com/DoudouFanClub/soba-server.git
   cd soba-server

5. Install Golang: Download and install Go from the official website.
6. Install Dependencies:

   go mod tidy

7. Run the Server:

   go run .

This project connects open-source LLM models with the frontend, enabling users to interact with the models directly.

• Developed using Python to integrate with LLM models.
• Uses ollama for model management.
• Uses asyncio for asynchronous operations.

1. Install Python: Ensure you have Python installed. You can download it from the Python official website.
2. Clone the Repository:

   git clone https://github.com/DoudouFanClub/soba-inferer.git
   cd soba-inferer

3. Install Dependencies:

   pip install -r requirements.txt

4. Run the Inferer:

   python main.py