Operated by Sourcelane✓ verified
Extract every post from any X (Twitter) Community - full text, author, and engagement metrics. Ideal for niche audience research and content monitoring.
A scraper for X (Twitter) Communities that extracts every post from a specified Community in a single run, providing full post text, post identifiers and canonical URLs, creation timestamps, detected language, comprehensive engagement metrics (retweets, replies, likes, quotes, view counts, bookmark counts), author metadata (username, numeric ID, display name, verification status, follower count, profile image URL), and a pagination cursor for fetching subsequent pages; operates without login or cookies and is focused on bulk collection of Community posts for analysis.
Verified Sep 28, 3:56 AM
$0.0015
per tweet
Up to 100 per call. Only pay for results returned; failed calls are refunded.
Niche audience research to analyze topic-focused Community discussions
Content monitoring of posts within a specific Community
Lead generation by surfacing active, engaged accounts posting in a Community
Trend detection to identify emerging discussions within a Community
Numeric X Community ID or full Community URL.
Optional settings
| Window | Uptime | Success rate | p50 | p95 | Calls |
|---|---|---|---|---|---|
| 24h | — | — | — | — | 0 |
| 7d | — | — | — | — | 0 |
| 30d | — | — | — | — | 0 |
Call it through Sourcelane's gateway or MCP server. We run the connector, apply your agent's spend guardrails, and bill only the results returned.
Call it via Sourcelane
curl -X POST https://api.usesourcelane.com/v1/call \
-H "Authorization: Bearer sl_live_your_agent_key" \
-H "Content-Type: application/json" \
-d '{"listing":"x-community-tweets-scraper","params":{"communityId":"1493446837214187523","maxItems":5},"maxResults":10}'Request params
| Field | Type | Required | Description |
|---|---|---|---|
communityId | string | required | Numeric X Community ID or full Community URL (https://x.com/i/communities/). Find it in the address bar when viewing a Community on x.com. |
maxItems | integer | optional | Maximum tweets to return. Set 0 for unlimited (auto-paginates across the whole Community feed). Capped at 100 per call. |
pageId | string | optional | Optional. Paste NEXT_PAGE_ID from a previous run's Key-value store to fetch the next page. |
Each result contains
| Field | Type | Description |
|---|---|---|
communityId | string | Community Id |
tweetId | string | Tweet Id |
url | string | Url |
text | string | Text |
createdAt | string | Created At |
lang | string | Lang |
retweetCount | integer | Retweet Count |
replyCount | integer | Reply Count |
likeCount | integer | Like Count |
quoteCount | integer | Quote Count |
viewCount | integer | View Count |
bookmarkCount | integer | Bookmark Count |
isReply | boolean | — |
conversationId | string | — |
authorUsername | string | — |
authorUserId | string | — |
authorName | string | — |
authorIsBlueVerified | boolean | — |
authorFollowersCount | integer | — |
authorProfilePicture | string | — |
Pick your tool and connect in under a minute. Then just ask — for example: “Find the 50 most-liked tweets about 'MCP servers' this month and summarise the takes.”
Connect Claude
Web, desktop and mobile. One click, then confirm.
Adds the Sourcelane MCP server with your key as a header.
claude mcp add --transport http sourcelane https://api.usesourcelane.com/mcp \
--header "Authorization: Bearer sl_live_your_agent_key"Alternative to the connector URL: add to claude_desktop_config.json, then restart Claude.
{
"mcpServers": {
"sourcelane": {
"command": "npx",
"args": [
"-y",
"mcp-remote",
"https://api.usesourcelane.com/mcp",
"--header",
"Authorization:${AUTH_HEADER}"
],
"env": {
"AUTH_HEADER": "Bearer sl_live_your_agent_key"
}
}
}
}Add to ~/.cursor/mcp.json (or Windsurf's mcp_config.json).
{
"mcpServers": {
"sourcelane": {
"url": "https://api.usesourcelane.com/mcp",
"headers": {
"Authorization": "Bearer sl_live_your_agent_key"
}
}
}
}Save as .vscode/mcp.json. VS Code prompts for your key once.
{
"servers": {
"sourcelane": {
"type": "http",
"url": "https://api.usesourcelane.com/mcp",
"headers": {
"Authorization": "Bearer ${input:sourcelane-key}"
}
}
},
"inputs": [
{
"type": "promptString",
"id": "sourcelane-key",
"description": "Sourcelane agent key",
"password": true
}
]
}Create a GPT → Actions → Import from URL, then Authentication: API Key, Bearer.
https://usesourcelane.com/openapi.jsonOne POST. Pass maxResults to cap cost.
curl -X POST https://api.usesourcelane.com/v1/call \
-H "Authorization: Bearer sl_live_your_agent_key" \
-H "Content-Type: application/json" \
-d '{"listing":"x-community-tweets-scraper","params":{"communityId":"1493446837214187523","maxItems":5},"maxResults":10}'Wrap the REST call as a tool, or point an MCP client at the endpoint.
import requests
res = requests.post(
"https://api.usesourcelane.com/v1/call",
headers={"Authorization": "Bearer sl_live_your_agent_key"},
json={
"listing": "x-community-tweets-scraper",
"params": {"communityId":"1493446837214187523","maxItems":5},
"maxResults": 10,
},
timeout=300,
)
body = res.json()
print(body["receipt"]["chargedMicros"], "micro-USD for", body["receipt"]["results"], "results")
print(body["data"])—
0 reviews
Leave a review
Loading reviews…