Gearhawk is live in developmentTake a look
Data infrastructure for the messy web
DataFlare Labs builds the collection, extraction and ETL systems that turn scattered, unstructured web data into something you can query, chart and act on — with agentic pipelines writing the extractors so the crawl itself stays cheap.
What we build
Web data collection
Distributed crawlers that keep working against paginated catalogues, rendered pages and rate limits.
Structured extraction
Turning listings, documents and semi-structured pages into typed records with a schema you can query.
Normalisation
Reconciling the same entity described five different ways across five different sources into one record.
ETL pipelines
Scheduled and event-driven pipelines that move data from collection through transformation into storage.
Agentic workflows
Models generate the deterministic extractor once per source, then plain code runs it — so cost stays flat as crawl volume grows.
Change detection
Tracking values over time so a snapshot becomes a history, and a history becomes a signal worth alerting on.
Storage and search
Relational stores for the record of truth, search indexes for the query path, and analytics jobs over the accumulated history.
Delivery
Getting the result somewhere useful — an API, a warehouse table, a dashboard, or a notification.
In development
Gearhawk
Gearhawk is our own platform, and the proving ground for everything above. It tracks ammunition pricing across retailers and gives shooters, hunters and enthusiasts one place to compare prices, follow historical trends and get told when something they want gets cheaper. It is live today as a web application.
Visit gearhawk.ioAggregated retailer pricing
Listings are collected from a wide range of retailers and normalised into a single catalogue, so one search covers the whole market instead of a dozen browser tabs.
Price history
Every observed price is retained and charted, turning a single quote into a trend a buyer can actually reason about.
Custom alerts
Watchlists notify buyers when a tracked item drops in price or comes back into stock.
Structured search and filters
Free-text product titles are parsed into structured attributes — calibre, grain weight, round count, manufacturer — which is what makes precise filtering possible.