Today I was browsing Github and discovered a very popular open-source project in the past two days - FreeAskInternet, with the number of stars skyrocketing, already reaching 5K+ stars in just a few days.
Project Introduction
FreeAskInternet is a completely free, private, and locally run search aggregator and answer generator (i.e., a Q&A AI tool) that uses LLM technology without the need for GPU.
We can directly ask questions, and the project will use searxng for multi-engine search and combine the search results with ChatGPT3.5 LLM to generate answers based on the search results.
All processes run locally, without the need for GPU or OpenAI or Google API keys.
This project was only open-sourced in early April, and in just a few days, it has already received 5.6k stars and continues to increase.
Features
Completely free (no need for any API keys)
Completely local (no need for GPU, can run on any computer)
Completely private (all run locally, using custom LLM)
Does not use LLM hardware (no need for GPU)
Uses free ChatGPT3.5 / Qwen / Kimi / ZhipuAI(GLM) API (no need for API keys)
Supports custom LLM (ollama, llama.cpp)
Uses Docker Compose for quick deployment and ease of operation
Web and mobile-friendly interface, designed for AI-enhanced chat in web search, easily accessible from any device.
How It Works
- The project receives user input questions in the FreeAskInternet UI interface (locally run) and calls searxng (locally run) to search on multiple search engines.
- Crawls the content of search result links and passes it to ChatGPT3.5 / Kimi / Qwen / ZhipuAI / ollama (using custom LLM), asking LLM to answer user questions based on this content as a reference.
- Streams the answers to the Chat UI.
- The project supports custom LLM settings, theoretically supporting unlimited LLMs.
Project Installation and Deployment
The deployment method is also very simple, the official recommendation is to use docker
git clone https://github.com/nashsu/FreeAskInternet.git
cd ./FreeAskInternet
docker-compose up -d
Then open the following address in your browser: http://localhost:3000
FreeAskInternet is a practical tool that combines free, local, private, powerful search, and intelligent Q&A in one. It breaks the limitations of traditional search engines, allowing you to access information more efficiently.
For more details and features of the project, interested friends can check out the project address.
Project Address:
https://github.com/nashsu/FreeAskInternet