Web and domain tooling

Website Tech Stack Detector (robots-respecting)

Detect the technologies behind up to 500 websites per run: CMS, ecommerce platform, analytics, tag managers, frameworks, server, CDN, payment providers, consent tools and more, with the evidence for every detection. Skips sites whose robots.txt forbids it, at no cost. Pay per site analysed.

$50.00per 1,000 · Site analysed

One website analysed and delivered. Sites blocked by their own robots.txt, dead domains, timeouts and bot walls are never charged.

Call it from your code

curl
ACTOR=steadydata~website-tech-stack
URL="https://api.apify.com/v2/acts/$ACTOR/run-sync-get-dataset-items"

curl -X POST "$URL?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"urls": ["apify.com", "nu.nl", "shopify.com"], "language": "en-US,en;q=0.9", "includeEvidence": true}'
python
import os, requests

ACTOR = "steadydata~website-tech-stack"
URL = f"https://api.apify.com/v2/acts/{ACTOR}/run-sync-get-dataset-items"

rows = requests.post(
    URL,
    params={"token": os.environ["APIFY_TOKEN"]},
    json={'urls': ['apify.com', 'nu.nl', 'shopify.com'], 'language': 'en-US,en;q=0.9', 'includeEvidence': True},
    timeout=900,
).json()

# every row carries a status; failures are records, not exceptions
ok = [r for r in rows if r.get("status") == "ok"]
print(len(ok), "rows delivered")
javascript
const ACTOR = "steadydata~website-tech-stack";
const url =
  `https://api.apify.com/v2/acts/${ACTOR}/run-sync-get-dataset-items` +
  `?token=${process.env.APIFY_TOKEN}`;

const rows = await fetch(url, {
  method: "POST",
  headers: { "Content-Type": "application/json" },
  body: JSON.stringify({"urls": ["apify.com", "nu.nl", "shopify.com"], "language": "en-US,en;q=0.9", "includeEvidence": true}),
}).then((r) => r.json());

// one object per delivered row, same shape every time
console.log(rows.filter((r) => r.status === "ok").length, "rows");

Use it in an agent

Point an MCP client at Apify's hosted server with this dataset in the tools list, or run our own server locally. The field explanations in the table below travel with the schema, so your agent reads them straight from the platform instead of from this page.

mcp url
https://mcp.apify.com?tools=steadydata/website-tech-stack

# the tool arrives in your agent as steadydata--website-tech-stack

Input

FieldTypeNameWhat it does
urls
required
array of stringWebsitesDomains or URLs, one per row, up to 500 (example: nu.nl or https://www.example.com). The home page is analysed. A site that forbids automated access in its robots.txt is skipped and not charged.
languagestringAccept-LanguageLanguage header sent with the request, which decides the language of the page you get back.
includeEvidencebooleanInclude evidenceAdd the exact signal behind every detection (header, cookie, script URL or HTML pattern). Keep it on if you need to verify or debug a detection; switch it off for a slimmer dataset.

What you get back

output schema, one object per delivered row
{
  "url": string | null,
  "finalUrl": string | null,
  "statusCode": integer | null,
  "technologyCount": integer | null,
  "technologies": array | null,
  "cms": string | null,
  "ecommerce": string | null,
  "analytics": array | null,
  "tagManagers": array | null,
  "frameworks": array | null,
  "jsLibraries": array | null,
  "server": string | null,
  "cdn": array | null,
  "hosting": array | null,
  "paymentProviders": array | null,
  "consentTools": array | null,
  "marketingTools": array | null,
  "supportTools": array | null,
  "otherTechnologies": array | null,
  "title": string | null,
  "metaDescription": string | null,
  "generator": string | null,
  "isHttps": boolean | null,
  "redirected": boolean | null,
  "pageSizeBytes": integer | null,
  "responseTimeMs": integer | null,
  "robotsRule": string | null,
  "status": string | null,
  "input": string | null,
  "errorCode": string | null,
  "error": string | null,
  "thirdPartyDomains": array | null
}
FieldTypeWhen it is filled
urlstring, null
finalUrlstring, null
statusCodeinteger, null
technologyCountinteger, null
technologiesarray, nullEvery detection with its category, and with the exact signal behind it when includeEvidence is on.
cmsstring, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
ecommercestring, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
analyticsarray, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
tagManagersarray, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
frameworksarray, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
jsLibrariesarray, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
serverstring, nullFilled when the server names itself in its headers; many sites hide this.
cdnarray, nullFilled when a content delivery network was detected in the headers or the page.
hostingarray, nullFilled when the hosting provider was detected; most sites give no signal for this.
paymentProvidersarray, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
consentToolsarray, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
marketingToolsarray, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
supportToolsarray, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
otherTechnologiesarray, nullFilled when a technology of this kind was detected; empty when the site uses none we recognise.
titlestring, nullFilled when the page has a title tag.
metaDescriptionstring, nullFilled when the page has a meta description.
generatorstring, nullThe meta generator tag, the strongest single signal for a CMS; many sites remove it.
isHttpsboolean, null
redirectedboolean, nullTrue when the final URL differs from the one submitted.
pageSizeBytesinteger, null
responseTimeMsinteger, null
robotsRulestring, nullThe robots.txt rule that decided whether this URL could be fetched, so the choice can be checked.
statusstring, nullEither 'ok' or 'error'. An error row carries errorCode and error, and leaves the data fields empty; it is never charged.
inputstring, nullThe input this row was built from, so a row can always be traced back.
errorCodestring, nullFilled on an error row only; a delivered row leaves it empty.
errorstring, nullFilled on an error row only; a delivered row leaves it empty.
thirdPartyDomainsarray, nullOther domains the page loads from; empty for a page that loads everything from itself.

Related datasets

Already using this one? Ratings are the first thing other buyers look at, and this dataset has none yet. If it does a job for you, a rating on its Apify page is the one thing that helps. It takes a minute and it is the only thing we ask for.

Open the Apify page