X (Twitter) Community Info & Moderators Scraper

X (Twitter)

Operated by Sourcelane✓ verified

A web-scraping connector that extracts comprehensive metadata for X (Twitter) Communities and optional moderator profiles. It collects community-level data such as name, description and joining question, member and moderator counts, creation date, join and invites policies, primary topic and search tags, NSFW flag, and the full rules list (rule titles and descriptions); it also captures community creator and admin identifiers, banner image link, and direct community link. Optionally it harvests moderator profile data including usernames and user identifiers, display names, verification status, bios and locations, follower/following counts, total post counts, account creation dates, and profile images and URLs. Operates without user authentication or cookies and produces structured community and moderator records for downstream analysis, discovery, outreach, and research.

Verified Sep 28, 12:10 AM

$0.02

per community

Up to 50 per call. Only pay for results returned; failed calls are refunded.

What people use it for

Community vetting — check size, rules, and activity before joining or partnering
Influencer & partnership outreach — identify moderators as engaged, connected contacts in a niche
Competitor research — examine how competing brands structure and grow their Communities
Niche discovery — compare member counts and topics across Communities in a vertical
Lead generation — build lists of Community admins and moderators in a target market

Trust & reliability

7d uptime trend

Window	Uptime	Success rate	p50	p95
24h	—	—	—	—
7d	—	—	—	—
30d	—	—	—	—

Calling contract

Call it through Sourcelane's gateway or MCP server. We run the connector, apply your agent's spend guardrails, and bill only the results returned.

Call it via Sourcelane

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"x-community-info-scraper","params":{"communityIds":["1493446837214187523"]},"maxResults":10}'

Request params

Field	Type	Required	Description
`communityIds`	array	required	One or more numeric X Community IDs or full Community URLs (https://x.com/i/communities/). Find the ID in the address bar when viewing a Community on x.com.
`includeModerators`	boolean	optional	Also fetch the moderator list for each Community (one results row per moderator, with full profile info).
`maxModeratorsPerCommunity`	integer	optional	Maximum moderators to fetch per Community. Set 0 to skip moderators entirely.

Each result contains

Field	Type	Description
`recordType`	string	Record Type
`communityId`	string	Community Id
`name`	string	Name
`description`	string	Description
`question`	string	Question
`memberCount`	integer	Member Count
`moderatorCount`	integer	Moderator Count
`createdAt`	string	Created At
`joinPolicy`	string	Join Policy
`invitesPolicy`	string	Invites Policy
`isNsfw`	boolean	Is Nsfw
`primaryTopic`	string	Primary Topic
`bannerUrl`	string	—
`searchTags`	array	—
`rules`	array	—
`creatorUsername`	string	—
`adminUsername`	string	—
`communityUrl`	string	—

Use X (Twitter) Community Info & Moderators Scraper from Claude, ChatGPT or Cursor

Pick your tool and connect in under a minute. Then just ask — for example: “Find the 50 most-liked tweets about 'MCP servers' this month and summarise the takes.”

Connect Claude

Web, desktop and mobile. Paste one URL.

1Copy your personal connector URL
2In Claude open Settings → Connectors → Add custom connector
3Paste the URL and click Add — done

Manual setup (config files, REST, Python) +

Claude Code

Adds the Sourcelane MCP server with your key as a header.

terminal

claude mcp add --transport http sourcelane https://cool-puffin-608.convex.site/mcp \
  --header "Authorization: Bearer sl_live_your_agent_key"

Claude Desktop (config file)

Alternative to the connector URL: add to claude_desktop_config.json, then restart Claude.

claude_desktop_config.json

{
  "mcpServers": {
    "sourcelane": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://cool-puffin-608.convex.site/mcp",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

Cursor & Windsurf

Add to ~/.cursor/mcp.json (or Windsurf's mcp_config.json).

mcp.json

{
  "mcpServers": {
    "sourcelane": {
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

VS Code

Save as .vscode/mcp.json. VS Code prompts for your key once.

.vscode/mcp.json

{
  "servers": {
    "sourcelane": {
      "type": "http",
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer ${input:sourcelane-key}"
      }
    }
  },
  "inputs": [
    {
      "type": "promptString",
      "id": "sourcelane-key",
      "description": "Sourcelane agent key",
      "password": true
    }
  ]
}

ChatGPT Custom GPT (Actions)

Create a GPT → Actions → Import from URL, then Authentication: API Key, Bearer.

OpenAPI schema URL

https://sourcelane-amber.vercel.app/openapi.json

REST

One POST. Pass maxResults to cap cost.

curl

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"x-community-info-scraper","params":{"communityIds":["1493446837214187523"]},"maxResults":10}'

Python, LangChain, CrewAI, OpenAI Agents SDK…

Wrap the REST call as a tool, or point an MCP client at the endpoint.

python

import requests

res = requests.post(
    "https://cool-puffin-608.convex.site/v1/call",
    headers={"Authorization": "Bearer sl_live_your_agent_key"},
    json={
        "listing": "x-community-info-scraper",
        "params": {"communityIds":["1493446837214187523"]},
        "maxResults": 10,
    },
    timeout=300,
)
body = res.json()
print(body["receipt"]["chargedMicros"], "micro-USD for", body["receipt"]["results"], "results")
print(body["data"])

Reviews

—

0 reviews

Leave a review

Loading reviews…