How to Scrape Reddit With MCP (2026 Setup)

To scrape Reddit with MCP in 2026, install the BigIdeasDB Clipper Chrome extension, turn on its Reddit Connector, then connect the BigIdeasDB MCP to Claude, Cursor or ChatGPT. Your AI client calls a Reddit tool, Chrome fetches the page through your own Reddit login, and the posts or comments come back into the chat. No Reddit API keys, no developer app, about five minutes.

One fact first, because it is why this setup exists. Reddit shut off logged-out .json in late May 2026, and new API access stops on October 31 and RSS on November 13. BigIdeasDB is the only Reddit scraper still working, thanks to a proprietary session-based method. The dated test is on our Reddit scraper page. This page is the tutorial.

The top Google results for “reddit mcp server” on October 24, 2026 are GitHub repositories, a directory listing and forum threads. They show a config line, not a walkthrough, and none of them is written for the post-update setup. Below is the full path, with the exact buttons, tool names and error messages from the product.

How to scrape Reddit with MCP in six steps

1. Get BigIdeasDB Pro and Chrome. The Reddit MCP tools and the Reddit Connector need BigIdeasDB Pro, desktop Chrome and a Reddit login in that Chrome profile.
2. Install the BigIdeasDB Clipper. Add BigIdeasDB Clipper (version 1.2.0 or later) from the Chrome Web Store and log in to reddit.com in the same Chrome profile.
3. Turn on the Reddit Connector. Click the Clipper icon, open the Reddit tab, click Turn on Reddit Connector, accept Chrome's reddit.com prompt, then click Test connection.
4. Connect the BigIdeasDB MCP to your AI client. Generate MCP credentials in the dashboard and add https://bigideasdb.com/api/mcp/bigideasdb-mcp with X-Client-Id and X-Client-Secret headers to Claude, Cursor, ChatGPT or another client.
5. Run your first scrape. Ask your client to call search_reddit, fetch_subreddit or fetch_post_comments with one subreddit, one topic and one time window.
6. Turn the results into a table or file. Ask the client to group the posts, keep one short quote per finding, and export the table as CSV or JSON.

Steps 1 to 3 happen once. After that, every Reddit question is one prompt. The rest of this page walks through each step, then shows recipes, limits and fixes.

What you need before you start

The Reddit tools are one of 13 data sources in the BigIdeasDB MCP. The MCP feature page and the Reddit MCP page show the full set. Every non-Reddit tool queries BigIdeasDB’s own data and works without the connector.

Step 1: Install the Clipper and turn on the Reddit Connector

The Reddit Connector is a switch inside the BigIdeasDB Clipper Chrome extension. It is off by default, and Chrome asks for reddit.com access only when you turn it on.

1. Install BigIdeasDB Clipper from the Chrome Web Store. You need version 1.2.0 or later. If you already have it, Chrome updates it on its own.
2. Log in to reddit.com in the same Chrome profile. The connector reads Reddit as you.
3. Click the Clipper icon in the toolbar and open the Reddit tab, next to Copy and History.
4. Click Turn on Reddit Connector. Accept Chrome’s prompt for reddit.com access. The status line changes to “On: your AI can read Reddit”.
5. Click Test connection. You should see “On: connected as” followed by your Reddit username. If it says “Not logged in to reddit.com. Log in, then test again.”, log in and test again.

That is the whole extension setup. The button label flips to Turn off Reddit Connector once it is on, and turning it off removes the reddit.com permission. The Reddit Connector guide and the Clipper extension docs cover the rest, including the copy-as-Markdown features.

Only reddit.com pages your own AI client asks for are fetched, and only while the connector is on. Nothing runs between requests, and fetched pages are deleted from BigIdeasDB servers once delivered.

Step 2: Connect the BigIdeasDB MCP to your AI client

The MCP is hosted, so there is nothing to install or run. Generate a credential pair in the BigIdeasDB dashboard (Pro required). The client ID starts with biddb_, the secret starts with biddb_sec_, and the secret is shown once. The server URL is the same in every client.

https://bigideasdb.com/api/mcp/bigideasdb-mcp

Both headers are required: X-Client-Id and X-Client-Secret. An Authorization bearer header does not work here. Pick your client below.

Claude Code

claude mcp add bigideasdb-mcp --transport http https://bigideasdb.com/api/mcp/bigideasdb-mcp \
  --header "X-Client-Id: your_client_id" \
  --header "X-Client-Secret: your_client_secret"

Claude Desktop

Add the entry to the mcpServers object in the app’s configuration file, then fully quit and reopen the app. Claude Desktop only loads servers at startup.

{
  "mcpServers": {
    "bigideasdb-mcp": {
      "type": "http",
      "url": "https://bigideasdb.com/api/mcp/bigideasdb-mcp",
      "headers": {
        "X-Client-Id": "your_client_id",
        "X-Client-Secret": "your_client_secret"
      }
    }
  }
}

Cursor (and Windsurf)

Cursor and Windsurf connect through the mcp-remote bridge, which forwards your two headers. Put this in Cursor’s mcp.json and reload the editor.

{
  "mcpServers": {
    "bigideasdb-mcp": {
      "command": "npx",
      "args": [
        "mcp-remote",
        "https://bigideasdb.com/api/mcp/bigideasdb-mcp",
        "--header",
        "X-Client-Id: your_client_id",
        "--header",
        "X-Client-Secret: your_client_secret"
      ]
    }
  }
}

VS Code with GitHub Copilot

{
  "servers": {
    "bigideasdb-mcp": {
      "type": "http",
      "url": "https://bigideasdb.com/api/mcp/bigideasdb-mcp",
      "headers": {
        "X-Client-Id": "your_client_id",
        "X-Client-Secret": "your_client_secret"
      }
    }
  }
}

ChatGPT and other connector-style clients

ChatGPT adds hosted MCP servers as a connector. Give it the server URL and supply the credential pair as two custom headers. The same three fields work in Codex, JetBrains AI and Replit.

name: bigideasdb-mcp
url:  https://bigideasdb.com/api/mcp/bigideasdb-mcp
headers:
  X-Client-Id: your_client_id
  X-Client-Secret: your_client_secret

Reload the client and confirm the BigIdeasDB tools appear. The full walk-through is in Connect the MCP to Claude and other clients, and what each assistant can and cannot read on its own is in connecting ChatGPT, Claude and Gemini to Reddit. One credential pair works in every client. All clients share one limit of 1,000 requests a day and 100 a minute, and one prompt can be several requests (see MCP rate limits and clients).

Step 3: Your first scrape, tool by tool

You do not call tools by hand. You ask in plain English and the client picks the tool. These are the four Reddit tools, with their real parameters from the BigIdeasDB tool registry.

search_reddit: find the threads

Copy-paste prompt:

Search Reddit for "invoicing" threads from the last month, sorted by relevance, limit 15. List title, subreddit, score and comment count.

What comes back is a total and a list of posts. Each post carries id, title, url, score, upvote_ratio, num_comments, subreddit, selftext, author and created_utc. On October 24, 2026 we ran a 5-post search for “reddit mcp server” sorted by top for the month. It returned 5 posts, none about MCP, because top sort ranks by score across all of Reddit. Use relevance sort for topic searches, and top only inside one subreddit.

fetch_subreddit: read a community

Fetch the top 10 posts of the week from r/smallbusiness. Show title, score and comments, then group them by theme.

Same fields as search. We ran a top-of-the-month call for r/mcp with a limit of 3 on October 24, 2026, and it returned these three posts.

fetch_post_comments: read the replies

Load the comments on this thread: [paste the post URL]. Pull 30 comments and separate complaints, workarounds and tools people name.

The result has a post object (title, selftext, score, subreddit, num_comments) and a list of comments with id, body, score and created_utc. On October 24 a call on a 29-comment r/mcp thread with comment_limit 3 returned exactly 3 comments. The maximum is 50 per call, and the tool returns top-level comments, so ask for a bigger limit when a thread matters.

fetch_reddit_json: the escape hatch

Call fetch_reddit_json with /r/SaaS/top.json?t=week and summarize the five highest-scoring posts.

Use it for a Reddit path the other three do not cover. The connector only fetches reddit.com URLs, and it refuses anything else. We did not run this tool in the October 24 session, so we make no claim about its output beyond what the registry states.

Posts come back trimmed to a fixed set of fields. The tool keeps id, title, permalink, score, upvote_ratio, num_comments, subreddit, selftext, author, created_utc, stickied and body, which keeps each call small enough for your client’s context window.

Recipes: five things to do with the data

1. Mine pain points in one subreddit

Fetch the top 25 posts of the month from r/[subreddit]. Group them into the 5 most repeated complaints. For each, give the post count, one short quote and the subreddit.

Narrow beats broad. One subreddit, one month, one question. For a full method, see how to find business ideas on Reddit and the Reddit market research help page.

2. Track competitor mentions

Search Reddit for "[competitor] alternative" and "[competitor] too expensive" from the last year. List what people say they switched to and why. Keep one quote per reason.

Run both phrasings as separate searches. A thread titled “alternative to X” is a buyer asking for a replacement, which is a stronger signal than a thread that only mentions X. The same pattern powers how to find customers on Reddit.

3. Turn a full comment thread into a table

Load the comments on [post URL], 40 comments. Make a table with columns: comment summary, type (complaint, workaround, tool named, question), score.

The score column keeps the table honest. A comment with 3 points is one voice, one with 300 is a crowd.

4. Export to CSV or JSON

Take the posts above and write them to reddit_posts.csv with columns: title, subreddit, score, num_comments, created_utc, one-line summary. Then give me the same data as JSON.

Claude Code and Cursor can write the file straight to your project. Claude Desktop and ChatGPT return the CSV or JSON in the chat for you to copy. Convert created_utc to a date in the same prompt. Drop the author field from anything you share.

5. Cross-check Reddit against 1M+ complaints

A Reddit thread tells you what people say. The BigIdeasDB corpus of 1M+ complaints from review sites and app stores tells you whether it holds up. After a scrape, ask for the match:

For the top 3 complaints you found, run search_pain_points with source all and tell me which ones also show up in Capterra reviews.

The search_pain_points tool returns title, description, frequency, impact, subreddit, the reason a gap exists and quotes. On October 24, 2026 a Reddit-only search for “invoicing” with limit 2 returned pain points from r/taxpros (fee quoting and scope) and r/quickbooks (workflow outages), both rated high frequency and high impact. BigIdeasDB holds 2,400+ analyzed Reddit pain points to match against. More on this pairing in Reddit data for Claude, Cursor and other AI clients and the Reddit research MCP.

Limits and good behavior

This is a research tool, and it behaves like one. Know the edges before you build a workflow on it.

• Human pace. Clipper spaces Reddit fetches about one second apart, one at a time. A 100-post call is a pile of requests, so ask for 10 to 25 first.
• Not a bulk scraper. Bulk or excessive use is against the BigIdeasDB Terms and can lead to throttling. For dataset-scale work, apply for Reddit approval or a data license.
• Reddit’s rules still apply to you. Reddit says non-commercial use such as learning and community is open, commercial use needs written approval, and unapproved AI training on its data is banned. This is not legal advice. The reading is in is scraping Reddit allowed.
• Only what you ask for. The connector fetches only reddit.com pages your client requests, and only while it is on. It does not browse for you.
• Chrome and a login. No Chrome, no Reddit session, no fetch. It is not for a headless server cron job.
• Shared MCP limits. Every tool call counts against 1,000 requests a day and 100 a minute across all your clients.
• Anonymize. Keep the quote and the subreddit. Drop usernames and links to profiles from anything you publish or share.

Troubleshooting the Reddit MCP

Almost every failure shows one of these messages. Find yours, apply the fix, retry the prompt.

If the Reddit tools stay down, BigIdeasDB’s own analyzed Reddit data does not depend on the connector. Ask your client to call search_pain_points or search_saas_opportunities with source: "reddit" in the meantime.

What developers said when Reddit MCP servers broke

The pattern in r/ClaudeAI was the same for weeks. A Reddit MCP server that worked in the spring started returning nothing, and people assumed their own config was wrong. One post on May 31, 2026 named the cause:

“Reddit now blocks anonymous access to its JSON API at the network level.” – r/ClaudeAI

A week later a second r/ClaudeAI post separated the anonymous path from the logged-in one, which is the whole basis of the Reddit Connector:

“it's not your code.” – r/ClaudeAI

“Reddit only killed the ANONYMOUS path.” – r/ClaudeAI

In r/redditdev the answers to the same question were as short:

“They stopped serving the json endpoints.” – r/redditdev

The same threads also describe the tradeoff of any session-based method, in one developer’s words: it needs Reddit open in a real browser. That is why the Reddit Connector needs Chrome running, and why it is for research and not for unattended server jobs. More on the 403 itself is in why a Reddit .json URL returns 403, and the end dates are in Reddit RSS feeds are ending on November 13. If you are weighing an API route, see the Reddit API alternative for AI and the PRAW alternative.

Methodology and limits

This page does not claim that Reddit will keep every date above, that any route is approved by Reddit for your use, or how any other Reddit MCP server behaves for you.

Frequently asked questions

More on this topic: the free Reddit keyword research tool for zero-cost keyword work, and the full list of MCP tools.

BigIdeasDB Research. (2026). How to Scrape Reddit With MCP (2026 Setup). BigIdeasDB. Retrieved from https://bigideasdb.com/how-to-scrape-reddit-with-mcp