Reddit Subreddit Posts Scraper

Operated by Sourcelane✓ verified

A scraper for Reddit that fetches posts from any public subreddit without requiring login or cookies, returning per-post metadata and content for analysis. It captures identifiers, title and full body text (including HTML), author and permalink/URL, engagement metrics (score, upvote ratio, comment count, awards), listing context (sort and time-range), flair and post hint, domain and thumbnail, content flags (NSFW, spoiler, stickied, locked), media indicator, and timestamps. The connector supports multiple listing sorts (Hot, New, Top, Rising, Controversial), time-range filtering for Top/Controversial, and cursor-based pagination to resume across runs and fetch large or unlimited numbers of posts. Outputs are structured as one record per post, optimized for keyword, sentiment, trend, monitoring, and archival use cases.

Verified Sep 28, 12:10 AM

$0.0015

per post

Up to 100 per call. Only pay for results returned; failed calls are refunded.

What people use it for

Track a community's most-discussed topics for content research
Build a results for sentiment, trend, or topic analysis
Monitor mentions of a brand, product, or competitor across subreddits
Archive a subreddit's top posts for historical research
Feed current Reddit content into language-model or other analysis pipelines

Trust & reliability

7d uptime trend

Window	Uptime	Success rate	p50	p95
24h	—	—	—	—
7d	—	—	—	—
30d	—	—	—	—

Calling contract

Call it through Sourcelane's gateway or MCP server. We run the connector, apply your agent's spend guardrails, and bill only the results returned.

Call it via Sourcelane

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"reddit-subreddit-posts-scraper","params":{"subreddit":"programming","maxItems":5},"maxResults":10}'

Request params

Field	Type	Required	Description
`subreddit`	string	required	Subreddit name (e.g. 'programming'), with or without leading r/. Full URLs (https://www.reddit.com/r/programming) are also accepted.
`sort`	string	optional	Listing sort. 'Top' and 'Controversial' use the Time Filter window; the others ignore it.
`timeFilter`	string	optional	Time window for 'Top' and 'Controversial' sorts. Ignored for other sorts.
`maxItems`	integer	optional	Maximum posts to return. 0 = no cap (paginates until the listing is exhausted or the run times out). Capped at 100 per call.
`pageId`	string	optional	Optional. Paste the NEXT_PAGE_ID from the previous run's Key-value store to resume paginating from where you left off.

Each result contains

No fields declared for this schema.

Use Reddit Subreddit Posts Scraper from Claude, ChatGPT or Cursor

Pick your tool and connect in under a minute. Then just ask — for example: “What do r/espresso users say about the Breville Bambino? Summarise pros and cons.”

Connect Claude

Web, desktop and mobile. Paste one URL.

1Copy your personal connector URL
2In Claude open Settings → Connectors → Add custom connector
3Paste the URL and click Add — done

Manual setup (config files, REST, Python) +

Claude Code

Adds the Sourcelane MCP server with your key as a header.

terminal

claude mcp add --transport http sourcelane https://cool-puffin-608.convex.site/mcp \
  --header "Authorization: Bearer sl_live_your_agent_key"

Claude Desktop (config file)

Alternative to the connector URL: add to claude_desktop_config.json, then restart Claude.

claude_desktop_config.json

{
  "mcpServers": {
    "sourcelane": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://cool-puffin-608.convex.site/mcp",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

Cursor & Windsurf

Add to ~/.cursor/mcp.json (or Windsurf's mcp_config.json).

mcp.json

{
  "mcpServers": {
    "sourcelane": {
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

VS Code

Save as .vscode/mcp.json. VS Code prompts for your key once.

.vscode/mcp.json

{
  "servers": {
    "sourcelane": {
      "type": "http",
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer ${input:sourcelane-key}"
      }
    }
  },
  "inputs": [
    {
      "type": "promptString",
      "id": "sourcelane-key",
      "description": "Sourcelane agent key",
      "password": true
    }
  ]
}

ChatGPT Custom GPT (Actions)

Create a GPT → Actions → Import from URL, then Authentication: API Key, Bearer.

OpenAPI schema URL

https://sourcelane-amber.vercel.app/openapi.json

REST

One POST. Pass maxResults to cap cost.

curl

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"reddit-subreddit-posts-scraper","params":{"subreddit":"programming","maxItems":5},"maxResults":10}'

Python, LangChain, CrewAI, OpenAI Agents SDK…

Wrap the REST call as a tool, or point an MCP client at the endpoint.

python

import requests

res = requests.post(
    "https://cool-puffin-608.convex.site/v1/call",
    headers={"Authorization": "Bearer sl_live_your_agent_key"},
    json={
        "listing": "reddit-subreddit-posts-scraper",
        "params": {"subreddit":"programming","maxItems":5},
        "maxResults": 10,
    },
    timeout=300,
)
body = res.json()
print(body["receipt"]["chargedMicros"], "micro-USD for", body["receipt"]["results"], "results")
print(body["data"])

Reviews

—

0 reviews

Leave a review

Loading reviews…