X (Twitter) List Timeline Scraper

X (Twitter)

Operated by Sourcelane✓ verified

Scrapes every tweet from a public X (Twitter) List timeline and extracts tweet content and metadata in a single run. The connector captures full tweet text, unique identifiers and URLs, creation timestamps, language, engagement metrics (retweets, replies, likes, quotes, views, bookmarks), and author metadata (username, user identifier, display name, verification status, follower count, profile image). It operates without login or cookies and provides a pagination cursor to fetch complete timelines across multiple runs, producing structured records suitable for indexing, analysis, and archival.

Verified Sep 28, 12:10 AM

$0.0015

per list tweet

Up to 100 per call. Only pay for results returned; failed calls are refunded.

What people use it for

Curated feed monitoring: track tweets from a hand-picked List of accounts
Competitor and industry tracking: watch a List of competitors or thought leaders
Content aggregation: pull a topical List into a dashboard or newsletter pipeline
Sentiment and trend analysis: analyze what a defined group is posting over time

Trust & reliability

7d uptime trend

Window	Uptime	Success rate	p50	p95
24h	—	—	—	—
7d	—	—	—	—
30d	—	—	—	—

Calling contract

Call it through Sourcelane's gateway or MCP server. We run the connector, apply your agent's spend guardrails, and bill only the results returned.

Call it via Sourcelane

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"x-list-timeline-scraper","params":{"listId":"1591607867192311809","maxItems":5},"maxResults":10}'

Request params

Field	Type	Required	Description
`listId`	string	required	Numeric X List ID or full List URL (https://x.com/i/lists/). Find it in the address bar when viewing a List on x.com.
`maxItems`	integer	optional	Maximum tweets to return. Set 0 for unlimited (auto-paginates across the whole List timeline). Capped at 100 per call.
`pageId`	string	optional	Optional. Paste NEXT_PAGE_ID from a previous run's Key-value store to fetch the next page.

Each result contains

Field	Type	Description
`listId`	string	List Id
`tweetId`	string	Tweet Id
`url`	string	Url
`text`	string	Text
`createdAt`	string	Created At
`lang`	string	Lang
`retweetCount`	integer	Retweet Count
`replyCount`	integer	Reply Count
`likeCount`	integer	Like Count
`quoteCount`	integer	Quote Count
`viewCount`	integer	View Count
`bookmarkCount`	integer	Bookmark Count
`isReply`	boolean	—
`conversationId`	string	—
`authorUsername`	string	—
`authorUserId`	string	—
`authorName`	string	—
`authorIsBlueVerified`	boolean	—
`authorFollowersCount`	integer	—
`authorProfilePicture`	string	—

Use X (Twitter) List Timeline Scraper from Claude, ChatGPT or Cursor

Pick your tool and connect in under a minute. Then just ask — for example: “Find the 50 most-liked tweets about 'MCP servers' this month and summarise the takes.”

Connect Claude

Web, desktop and mobile. Paste one URL.

1Copy your personal connector URL
2In Claude open Settings → Connectors → Add custom connector
3Paste the URL and click Add — done

Manual setup (config files, REST, Python) +

Claude Code

Adds the Sourcelane MCP server with your key as a header.

terminal

claude mcp add --transport http sourcelane https://cool-puffin-608.convex.site/mcp \
  --header "Authorization: Bearer sl_live_your_agent_key"

Claude Desktop (config file)

Alternative to the connector URL: add to claude_desktop_config.json, then restart Claude.

claude_desktop_config.json

{
  "mcpServers": {
    "sourcelane": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://cool-puffin-608.convex.site/mcp",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

Cursor & Windsurf

Add to ~/.cursor/mcp.json (or Windsurf's mcp_config.json).

mcp.json

{
  "mcpServers": {
    "sourcelane": {
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

VS Code

Save as .vscode/mcp.json. VS Code prompts for your key once.

.vscode/mcp.json

{
  "servers": {
    "sourcelane": {
      "type": "http",
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer ${input:sourcelane-key}"
      }
    }
  },
  "inputs": [
    {
      "type": "promptString",
      "id": "sourcelane-key",
      "description": "Sourcelane agent key",
      "password": true
    }
  ]
}

ChatGPT Custom GPT (Actions)

Create a GPT → Actions → Import from URL, then Authentication: API Key, Bearer.

OpenAPI schema URL

https://sourcelane-amber.vercel.app/openapi.json

REST

One POST. Pass maxResults to cap cost.

curl

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"x-list-timeline-scraper","params":{"listId":"1591607867192311809","maxItems":5},"maxResults":10}'

Python, LangChain, CrewAI, OpenAI Agents SDK…

Wrap the REST call as a tool, or point an MCP client at the endpoint.

python

import requests

res = requests.post(
    "https://cool-puffin-608.convex.site/v1/call",
    headers={"Authorization": "Bearer sl_live_your_agent_key"},
    json={
        "listing": "x-list-timeline-scraper",
        "params": {"listId":"1591607867192311809","maxItems":5},
        "maxResults": 10,
    },
    timeout=300,
)
body = res.json()
print(body["receipt"]["chargedMicros"], "micro-USD for", body["receipt"]["results"], "results")
print(body["data"])

Reviews

—

0 reviews

Leave a review

Loading reviews…