Skip to content
StreamSearch

Writing

Notes from inside the index.

Long-form engineering notes on indexing, ranking and retrieval. Existing posts keep their URLs; new ones publish from Markdown with the same layout.

2026-10

Sovereign Search: Enterprise Search with Data Sovereignty

Introducing Sovereign Search by StreamSearch: find information across enterprise systems while respecting data sovereignty and access controls. Available for focused enterprise pilots.

2 min · enterprise-search
2025-11

Search Engine Crawlers: A Deep Dive Into Architecture and Engineering Challenges

Inside the architecture of web crawlers — frontiers, fetchers, politeness and dedup — with lessons from building one at national scale for Zarebin.ir.

6 min · crawling

Also available as RSS.