X (Twitter) Profile Scraper

X (Twitter)

Operated by Sourcelane✓ verified

A web scraper for X (formerly Twitter) that pulls full public profile metadata without requiring account login, supporting bulk and concurrent profile extraction for large lists of handles or profile URLs. It captures structured profile identity information (handle and display name, account identifier, account creation date, public profile URL), bio content and every link in the bio, audience metrics (follower and following counts, total posts, media and likes counts, listed count), verification and status details (blue/legacy verification, protected status, verification reason text), affiliate relationships (parent account name, link, and badge image), high-resolution media links (profile image and banner), pinned-post identifiers, and quality signals (default-avatar and possibly-sensitive flags), producing record-oriented metadata suitable for analysis, enrichment, and monitoring workflows.

Verified Sep 28, 12:10 AM

$0.0015

per result

Up to 100 per call. Only pay for results returned; failed calls are refunded.

What people use it for

Influencer research: vet creators, verify follower counts, and detect affiliate relationships
Lead generation: extract bio links and websites from target account lists
Competitor and audience analysis: track follower growth and engagement footprint over time
Data enrichment: append X profile metadata to existing marketing or CRM records
Brand monitoring: identify verified versus unverified accounts mentioning a brand

Trust & reliability

7d uptime trend

Window	Uptime	Success rate	p50	p95
24h	—	—	—	—
7d	—	—	—	—
30d	—	—	—	—

Calling contract

Call it through Sourcelane's gateway or MCP server. We run the connector, apply your agent's spend guardrails, and bill only the results returned.

Call it via Sourcelane

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"x-profile-scraper","params":{"usernames":["elonmusk","naval","vercel"]},"maxResults":10}'

Request params

Field	Type	Required	Description
`usernames`	array	required	X handles (with or without @) or full profile URLs (https://x.com/elonmusk).
`maxConcurrency`	integer	optional	How many profiles to fetch in parallel.

Each result contains

Field	Type	Description
`username`	string	Username
`userId`	string	User Id
`name`	string	Name
`description`	string	Description
`descriptionUrls`	array	—
`location`	string	Location
`website`	string	Website
`websiteShort`	string	Website Short
`followersCount`	integer	Followers Count
`followingCount`	integer	Following Count
`tweetsCount`	integer	Tweets Count
`mediaCount`	null	Media Count
`likesCount`	null	Likes Count
`listedCount`	null	—
`isBlueVerified`	boolean	—
`isVerified`	boolean	—
`isProtected`	boolean	—
`defaultProfileImage`	boolean	—
`possiblySensitive`	boolean	—
`professionalType`	null	—
`verificationReason`	null	—
`affiliateLabel`	null	—
`profileImageUrl`	string	—
`profileBannerUrl`	string	—
`pinnedTweetIds`	array	—
`createdAt`	string	—
`profileUrl`	string	—
`scrapedAt`	string	—

Use X (Twitter) Profile Scraper from Claude, ChatGPT or Cursor

Pick your tool and connect in under a minute. Then just ask — for example: “Find the 50 most-liked tweets about 'MCP servers' this month and summarise the takes.”

Connect Claude

Web, desktop and mobile. Paste one URL.

1Copy your personal connector URL
2In Claude open Settings → Connectors → Add custom connector
3Paste the URL and click Add — done

Manual setup (config files, REST, Python) +

Claude Code

Adds the Sourcelane MCP server with your key as a header.

terminal

claude mcp add --transport http sourcelane https://cool-puffin-608.convex.site/mcp \
  --header "Authorization: Bearer sl_live_your_agent_key"

Claude Desktop (config file)

Alternative to the connector URL: add to claude_desktop_config.json, then restart Claude.

claude_desktop_config.json

{
  "mcpServers": {
    "sourcelane": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://cool-puffin-608.convex.site/mcp",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

Cursor & Windsurf

Add to ~/.cursor/mcp.json (or Windsurf's mcp_config.json).

mcp.json

{
  "mcpServers": {
    "sourcelane": {
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

VS Code

Save as .vscode/mcp.json. VS Code prompts for your key once.

.vscode/mcp.json

{
  "servers": {
    "sourcelane": {
      "type": "http",
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer ${input:sourcelane-key}"
      }
    }
  },
  "inputs": [
    {
      "type": "promptString",
      "id": "sourcelane-key",
      "description": "Sourcelane agent key",
      "password": true
    }
  ]
}

ChatGPT Custom GPT (Actions)

Create a GPT → Actions → Import from URL, then Authentication: API Key, Bearer.

OpenAPI schema URL

https://sourcelane-amber.vercel.app/openapi.json

REST

One POST. Pass maxResults to cap cost.

curl

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"x-profile-scraper","params":{"usernames":["elonmusk","naval","vercel"]},"maxResults":10}'

Python, LangChain, CrewAI, OpenAI Agents SDK…

Wrap the REST call as a tool, or point an MCP client at the endpoint.

python

import requests

res = requests.post(
    "https://cool-puffin-608.convex.site/v1/call",
    headers={"Authorization": "Bearer sl_live_your_agent_key"},
    json={
        "listing": "x-profile-scraper",
        "params": {"usernames":["elonmusk","naval","vercel"]},
        "maxResults": 10,
    },
    timeout=300,
)
body = res.json()
print(body["receipt"]["chargedMicros"], "micro-USD for", body["receipt"]["results"], "results")
print(body["data"])

Reviews

—

0 reviews

Leave a review

Loading reviews…