Developer tools scrapers
APIs, datasets and dev infrastructure scrapers.
GMGN Scraper — Trending Memecoins, Smart Money & Wallets
Scrape GMGN.ai with no API key: trending memecoins, new launches, smart-money buys, top-trader wallets, token rugcheck, holders, wallet PnL and KOL signals across 6 chains.
DexScreener Scraper - Boosted & Trending Tokens API
DexScreener scraper, no API key: boosted/trending tokens + marketing spend, search pairs, price/volume/liquidity, plus token security audits. Export CSV, JSON.
JSON-LD Schema & Meta Tag Extractor
Extract JSON-LD Schema.org, meta tags, OpenGraph & Twitter Cards from any URL. For technical SEO audits & competitor analysis. Export clean JSON & CSV.
Dev.to Scraper - Articles by Tag & Author
Scrape Dev.to articles by tag or author: title, tags, reactions, comments, reading time, author. No API key, no login. Export CSV, JSON, Excel.
Stack Overflow Scraper - Questions by Tag
Scrape Stack Overflow & Stack Exchange questions by tag: title, score, views, answers, author, reputation. No API key, no login. Export CSV, JSON, Excel.
Website SEO Audit Crawler — On-Page Analyzer
Crawl an entire site and audit on-page SEO for every page: titles, meta, H1s, canonical, schema, word count and detected issues. Bulk technical SEO at scale.
Bulk URL Status Checker – Broken Link & Redirect Audit
Check thousands of URLs for 200/301/302/404/410/500, redirects and final URL. Fast bulk broken link checker for SEO audits, migrations and monitoring. Includes response time.
Sitemap to URL Crawler — Extract Sitemap.xml URLs for RAG
Fastest Sitemap to URL extractor. Recursively scrape XML sitemaps to build datasets for RAG, LLM training, and SEO. Export URLs to JSON instantly. Browserless & efficient.
ClinicalTrials.gov Scraper
Scrape ClinicalTrials.gov for trial status, phase, sponsor, conditions, interventions, locations & dates. 585K+ studies, no API key. Export CSV, JSON, Excel.
GitHub Repository Scraper - Stars, Topics, Trending
Scrape public GitHub repositories by search query, no API key. Export stars, forks, language, topics, owner, license & dates to CSV, JSON, Excel.
App Store Scraper — iOS App Data, Reviews & ASO API
App Store scraper for iOS app data, reviews, ratings, top charts, ASO keywords & privacy labels. No API key. Export CSV, JSON, Excel. 10 endpoints.
FDA Data Scraper - openFDA Recalls & Events
Scrape FDA recalls, adverse events, drug labels & 510(k)s via the openFDA API. Get recalling_firm, classification, reason. No API key. Export CSV, JSON, Excel.
Gate.io Market Data Scraper - 2,200+ Crypto Pairs
Scrape Gate.io market data with no API key: pair, last price, 24h change %, high/low, base/quote volume, bid/ask for 2,200+ spot pairs. Export CSV, JSON, Excel.
Google Play Scraper — App Data, Reviews & ASO API
Google Play scraper for Android app data, reviews, ratings, top charts, ASO keywords, permissions & data safety. No API key. Export CSV, JSON, Excel.
Wayback Machine URL Extractor - Archived URLs
Extract every archived URL for a domain from the Wayback Machine CDX API with capture date, status and snapshot link. No API key, export to CSV or JSON.
Apple Podcasts Scraper — Episodes, Audio URLs & RSS Data
Extract podcast shows and full episode lists from Apple Podcasts. Titles, descriptions, audio MP3 URLs, durations, publish dates, artwork, genres, transcripts. Via iTunes Search/Lookup API + RSS.
Polymarket Leaderboard Scraper – Top Wallets, PnL
Scrape the Polymarket leaderboard: top traders & wallets ranked by PnL, ROI, win rate, volume across politics, crypto, sports. No API key. CSV, JSON, Excel.
Subdomain Finder - Discover Subdomains via CT Logs
Find all subdomains of any domain from Certificate Transparency logs. Bulk subdomain enumeration for recon, attack-surface mapping and SEO. No API key, CSV/JSON.
Bulk DNS Records Lookup - A, MX, TXT, NS, CNAME
Bulk DNS records lookup for thousands of domains — A, AAAA, MX, TXT, NS, CNAME, SOA, CAA over DNS-over-HTTPS. No API key. Export to CSV or JSON for email and DNS audits.
RSS Feed Reader - Bulk RSS & Atom Feed Parser
Read hundreds of RSS, Atom and RDF feeds in one run, or auto-discover feeds from any website. Extract full item metadata. No API key. Export to CSV or JSON.
Bulk WHOIS Lookup - Domain Registration & Expiry
Bulk WHOIS / RDAP lookup for thousands of domains: registrar, creation and expiry dates, nameservers and status. No API key. Export to CSV or JSON at scale.
NPM Package Scraper – Download Stats, Deps, Versions
Scrape NPM packages by keyword, name or scope: daily/weekly/monthly downloads, dependencies, dependents, maintainers, versions. No API key. CSV, JSON, Excel.
Binance API Scraper - Spot Prices for 3,500+ Pairs
Scrape Binance spot prices for 3,500+ pairs with no API key: symbol, last price, 24h change %, high/low, volume, bid/ask, trade count. Export CSV, JSON, Excel.
Hacker News API Scraper
Scrape Hacker News posts, comments, polls, Show HN & Ask HN via the HN Algolia API. Title, author, points, comments, URL. No API key. Export CSV, JSON, Excel.
Bulk SSL Certificate Checker — Expiry, Issuer & TLS
Check SSL/TLS certificates for thousands of domains at once. Get expiry date, issuer, SANs, days remaining and TLS versions in CSV/JSON. No API key needed.
Hugging Face Scraper - Models, Datasets, Papers
Scrape Hugging Face Hub models, datasets, spaces & papers: downloads, likes, task, library, license, README. No token. Export CSV, JSON, Excel for ML research.
Bulk Email Deliverability Checker — MX, SPF, DKIM, DMARC & BIMI
Check email deliverability for thousands of domains. Verify MX, SPF, DKIM, DMARC and BIMI records and get a 0-100 score exported to CSV or JSON. No API key.
Image Scraper - Download All Images From Site
Scrape and download all images, video & audio from any website. Get media URL, alt text, dimensions & source page. For AI datasets. Export CSV, JSON, Excel.
Bulk HTTP Security Headers Analyzer - CSP, HSTS
Scan thousands of URLs for 11 HTTP security headers (CSP, HSTS, X-Frame-Options and more), get a 0-100 score and A+ to F grade. No API key, export CSV/JSON.
Bulk URL Unshortener — Redirect Chain Resolver
Resolve thousands of short URLs (bit.ly, t.co, ow.ly, TinyURL) and trace every redirect hop, HTTP status and final URL. No API key. Export to CSV or JSON.
Website Link Graph & Outbound Links Crawler
Crawl a website and map every internal & outbound link: source, target, anchor text, nofollow/sponsored flags. For internal-linking and outbound-link SEO audits.
Website to Markdown Crawler for LLM & RAG
Crawl any website to clean Markdown & text for LLM, RAG & AI. Get title, word count, meta & boilerplate-free content per page. Export CSV, JSON, Excel.
Broken Link Checker - Find Dead 404 Links
Broken link checker that crawls a whole website to find dead 404 & 5xx links. Get source page, anchor text & HTTP status. Export CSV, JSON, Excel.
Bulk Website Screenshot Capture — Full-Page PNG/JPEG
Capture full-page or viewport screenshots of hundreds of URLs in bulk with headless Chromium. Desktop, mobile & tablet profiles, cookie auto-dismiss, PNG/JPEG.
Website Change Monitor - Page Diff & Alerts
Monitor any website for content changes automatically. Get line-by-line diff reports of added, removed and modified text, scheduled daily. Track pricing, jobs and regulations.
OpenGraph & Social Card Inspector — Meta Tag Extractor API
Extract OpenGraph, Twitter Card and JSON-LD meta tags from any URL at scale. Audit social link previews and export og:title, og:image and more to CSV or JSON.
Wikipedia Category Scraper — Article Lists & Data
Extract structured article lists from any Wikipedia category across 10 languages, no API key. Export titles, URLs and first-paragraph summaries to CSV or JSON.
CVE Security Advisory Monitor — AI Agent Vulnerability API
Keyless vulnerability intelligence for AI agents: NVD + GitHub Advisory + OSV merged, daily new CVEs, CVSS, affected versions, patch info. No key.
arXiv Paper Scraper — Abstracts, Authors & Metadata
Scrape arXiv research papers via the public API with no API key. Export titles, abstracts, authors, categories, PDF links and DOIs to CSV or JSON at scale.
Certificate Transparency Monitor — AI Agent Recon API
Keyless CT-log intelligence for AI agents: crt.sh new TLS certs daily, subdomain discovery via wildcard, batch domains. Issuer, SAN, serial. No key.
IMDb Scraper — Movies, TV, Ratings, Reviews & Cast API
Scrape IMDb movies, TV shows, ratings, reviews, episodes, cast & crew with no API key. Export structured IMDb datasets to JSON, CSV or Excel.
Website Tech Stack Detector - CMS & Framework
Detect any website's tech stack in bulk: CMS, framework, analytics, hosting. BuiltWith alternative for prospecting & competitive intel. Export CSV, JSON, Excel.
GitHub Activity Stream — AI Agent Dev Monitoring API
Keyless GitHub activity for AI agents: commits, PRs, issues, releases, events for any repo/org/user. Time-windowed, thousands of events. No key.
Token Due Diligence Report – Crypto Rug & Risk Scan
Crypto token due diligence in one click: rug/honeypot risk score, buy/sell tax, liquidity, FDV, holder concentration, LP lock. No API key. CSV, JSON, Excel.
Discogs Scraper — Vinyl, Music Releases, Artists & Labels
Scrape Discogs releases, discographies, artists, labels and marketplace prices with no API key. Export vinyl & music datasets to CSV or JSON.
MyAnimeList Scraper — Anime & Manga Data, Ratings API
Scrape anime and manga data, ratings, seasonal charts and characters from MyAnimeList with no API key. Export to JSON, CSV or Excel.
TVMaze Scraper — TV Shows, Episodes, Cast & Schedule API
Scrape TV shows, episodes, cast and air schedules from TVMaze with no API key. Export TV series datasets to JSON, CSV or Excel.
Company Deep Research — AI Agent Dossier API
One-call company dossier for AI agents: tech stack, socials, contacts, SEO, news, competitors. Name or domain to structured JSON. No key, no browser.
News Intelligence Scraper — AI Agent Real-Time News API
Multi-source real-time news for AI agents: Google + Bing + DuckDuckGo News merged, deduplicated, sentiment-scored. Topic to structured feed. No key.
Docker Hub Scraper — Search, Repos & Tags
Scrape Docker Hub by keyword or namespace. Extract image name, pull count, star count, tags, description, official status. No API key needed. Bulk export.
Federal Register Scraper — Rules, Notices & Regulations
Scrape US Federal Register documents by keyword or agency. No API key needed. Extract document numbers, titles, types, abstracts, agencies, dates, and citations at scale.
Crates.io Scraper — Rust Packages, Downloads & Metadata
Scrape crates.io by top downloads, keyword search, or crate name. Extract name, version, downloads, categories, repo URL for Rust ecosystem research. No API key.
GitLab Scraper — Projects, Issues, MRs & Users
Scrape GitLab public projects, issues, and merge requests by keyword, project ID, or username. Extract stars, forks, topics, URLs. No API key needed.
Packagist Scraper — PHP Packages, Downloads & Deps
Scrape Packagist.org by keyword, vendor, or name. Extract downloads (total/monthly/daily), favers, license, dependencies, and authors. No API key needed.
PyPI Package Scraper — Downloads, Deps & Metadata
Scrape PyPI packages by name or top-N list. Get version, author, license, dependencies, release date, and 30-day downloads. No API key required.