MCP Server Directory

web-scraping com.superagnt/web-scraping

Web scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser.

EU-native web scraping for AI agents. scrape pages, map sites, run background jobs, check usage.

Finds the robots.txt lines that reserve nothing — retired crawler tokens, shadowed groups, rules abo

Crawl4Agent com.saastemly/crawl4agent

crawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...

prismcrawl io.github.prismcrawl/prismcrawl

Live Google, Bing, Amazon, Maps, Yelp & app store data. As low as $0.15/1K successes; failures free.

Use this MCP server to Radio Browser, 40,000+ internet radio stations searchable by genre, tag,...

Monocrawl com.monocrawl/mcp

Public social media, search and e-commerce data from 70+ platforms, on one API key.

ai-visibility com.lastminutedealshq/ai-visibility

AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.

Ashby Jobs Scraper & API - All Companies, Remote, Last 24 Hours io.github.AnshumanAtrey/ashby-jobs-search

Ashby Jobs Scraper - Search Every Ashby Job Board

NM Signals: AI crawler audit io.github.newmediamadman/nm-signals

Audit webpage access for AI crawlers. API key and Premium or Partner plan required.

Microsoft Teams for Claude — read your chats, teams, channels, and open messages, via your browser

screenshot io.github.DataLeadsPRO/screenshot

Pixel-perfect webpage screenshots rendered in a real browser, full-page or viewport, via one POST.

ai-crawler-readiness com.lumnika/ai-crawler-readiness

Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index

PlaywrightGen com.playwrightgen/playwrightgen

Approved test intent, reviewed Playwright automation and run evidence, inside your editor.

Commoncrawl io.github.pipeworx-io/commoncrawl

Common Crawl's public web archive — find every time a URL was crawled since 2008 and read the…

web-scraper io.github.DataLeadsPRO/web-scraper

Fetch, crawl, and browse protected pages with anti-bot handling - renders in a real browser and

url-to-markdown io.github.DataLeadsPRO/url-to-markdown

Convert any webpage to clean LLM-ready markdown, extraction-first, with article and news modes.

Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.

Showoff dev.showoff/showoff

Turn app screenshots into 3D device mockups, App Store sets and launch videos, straight from chat.

Proofhand dev.proofhand/proofhand

Human QA on real phones and browsers for your coding agent. Pass/fail per step, with screenshots.

Snap Screenshots com.i2dev/snap

Screenshot any public web page from an AI agent. Free without signup, or with an API key.

Scrappa co.scrappa/scrappa

Scraping API for Google Search, Maps, Flights, Jobs, YouTube, LinkedIn, Trustpilot and more.

oassis — web scraping, crawling and browser control for AI agents dev.oassis/scraper-crawler

Scrape to markdown, map and crawl sites, drive a real browser. Pay per call, no API key, no signup.

Found17 com.found17/found17

Public web tools for agents: product extraction, claim checks, webpage QA and ranked audits.