Guides

How to actually get this data

The free routes first, then the exact point where each one stops. Written from the inside, by the people who maintain these datasets.

›How to get YouTube transcripts in bulk

The free routes, the point where each one stops, and what it costs to pull transcripts for hundreds or thousands of videos.

›Is there a Google Trends API?

What Google does and does not offer, why Trends numbers break when you compare them wrong, and the working routes.

›How to export YouTube comments to CSV

Extensions, the official API and its quota, and how to pull comments for a whole channel without babysitting it.

›How to scrape Google News results

The free RSS route, the Python route, and what changes once you need this every day without failures.

›Is there a Google Jobs API?

Why the indexing API is not what most people are looking for, and how to read Google for Jobs results instead.

›How to get App Store and Google Play data

Apple has an official lookup API, Google Play does not. What that means for your data, and the storefront mistake that quietly measures the wrong country.

›How to check DNS, SSL and domain health in bulk

Eight lookups per domain, the SPF chain that silently breaks past ten, and how to get one row per domain instead of eight tabs.

›How to check SPF, DKIM and DMARC for a list of domains

Why a valid-looking SPF record can be broken, why DKIM cannot be discovered from outside, and what p=none actually protects.

›How to find out what a website is built with, in bulk

What tech lookup tools really do, the three things that make the answer wrong, and what it costs for a prospect list.

›How to get Shopify and WooCommerce store data

Your own store exports for free. For someone else's, decide first whether you need every product row or an answer at store level.

›How to extract text from PDFs at scale

Digital versus scanned, the edge cases that ruin naive scripts, and the point where a library stops being worth the afternoon.

›The SEC EDGAR API: rules, rate limit and what trips people up

The User-Agent rule that stops most first attempts, the ten-per-second limit, and why starting from a ticker instead of a CIK causes silent mismatches.

›Is there a Hacker News API?

There are two, and the official one is the wrong tool for almost every question people actually ask.