Kagi Small Web Search: Combating AI Spam with Crowdsourcing

Subscription-based search engine Kagi has launched a new search mode called the 'Small Web' index, designed to filter out AI-generated content farm spam. The index focuses exclusively on personal blogs, independent websites, and academic pages. By bypassing commercial SEO-optimized rings, Kagi hopes to restore the exploration and discovery that characterized the early internet.

The Small Web index is constructed using crowdsourced submissions from Kagi users and heuristic filters that detect commercial advertising density and keyword stuffing. When users perform a search in this mode, Kagi's ranking algorithms prioritize authentic, human-written content. This approach provides a refreshing alternative to traditional search results which are increasingly dominated by synthetic content.

Web developers and bloggers have welcomed Kagi's initiative, noting that finding high-quality independent writing has become difficult in recent years. While the index is smaller than Google's, it offers high-signal answers for niche programming topics and personal journals. The launch reflects growing demand for platforms that prioritize human creativity over automated content scaling.