Instagram Posts & Reels Scraper

Instagram

Operated by Sourcelane✓ verified

A scraper for collecting every post and Reel from a public Instagram profile, extracting structured post records that include timestamps (ISO 8601 and Unix), caption text with extracted hashtags and mentions, engagement metrics (likes, comments, views/play counts, video duration), media classification (photo, video, carousel; feed vs Reels/clips), media URLs (thumbnail/cover and direct video MP4 when available), author profile metadata (ID, username, display name, profile picture, verification and privacy flags), location metadata (name and city when present), and a pagination cursor to resume large-profile collections across multiple runs; operates without login or cookies and produces normalized, keyword-rich post-level data suitable for analysis, archiving, and downstream processing.

Verified Sep 28, 12:10 AM

$0.003

per post

Up to 100 per call. Only pay for results returned; failed calls are refunded.

What people use it for

Competitor analysis — track a brand’s full posting history, formats, and engagement over time
Influencer vetting — measure engagement rates and posting cadence for partnership assessment
Content strategy — analyze top-performing posts to identify hooks, formats, and audio that drive engagement
Reels research — extract a profile’s Reels feed to study short-form viral trends
Brand monitoring — archive posts and media for compliance, reporting, or record-keeping
results building — assemble structured post-level data for dashboards, spreadsheets, or ML models

Trust & reliability

7d uptime trend

Window	Uptime	Success rate	p50	p95
24h	—	—	—	—
7d	—	—	—	—
30d	—	—	—	—

Calling contract

Call it through Sourcelane's gateway or MCP server. We run the connector, apply your agent's spend guardrails, and bill only the results returned.

Call it via Sourcelane

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"instagram-posts-scraper","params":{"username":"natgeo","maxItems":5},"maxResults":10}'

Request params

Field	Type	Required	Description
`username`	string	required	Instagram username to scrape posts from (with or without @), e.g. natgeo or @nasa.
`mode`	string	optional	Which feed to scrape. 'All Posts' returns the full profile grid. 'Reels Only' returns just the Reels tab.
`maxItems`	integer	optional	Maximum number of posts to scrape. Set 0 for unlimited (caps at platform timeout). Capped at 100 per call.
`pageId`	string	optional	Optional. Paste NEXT_PAGE_ID from the previous run's Key-value store to fetch the next page.

Each result contains

Field	Type	Description
`postId`	string	Post Id
`shortcode`	string	Shortcode
`postUrl`	string	Post Url
`mediaType`	string	Media Type
`productType`	string	Product Type
`takenAt`	string	Taken At
`takenAtTimestamp`	integer	Taken At Timestamp
`caption`	string	Caption
`hashtags`	array	Hashtags
`mentions`	array	Mentions
`likeCount`	integer	Like Count
`commentCount`	integer	Comment Count
`viewCount`	integer	—
`playCount`	integer	—
`videoDuration`	integer	—
`isPaidPartnership`	boolean	—
`thumbnailUrl`	string	—
`videoUrl`	null	—
`authorId`	string	—
`authorUsername`	string	—
`authorFullName`	string	—
`authorProfilePicUrl`	string	—
`authorIsVerified`	boolean	—
`authorIsPrivate`	boolean	—
`locationName`	null	—
`locationCity`	null	—

Use Instagram Posts & Reels Scraper from Claude, ChatGPT or Cursor

Pick your tool and connect in under a minute. Then just ask — for example: “Pull the last 20 posts from @natgeo and tell me which formats get the most engagement.”

Connect Claude

Web, desktop and mobile. Paste one URL.

1Copy your personal connector URL
2In Claude open Settings → Connectors → Add custom connector
3Paste the URL and click Add — done

Manual setup (config files, REST, Python) +

Claude Code

Adds the Sourcelane MCP server with your key as a header.

terminal

claude mcp add --transport http sourcelane https://cool-puffin-608.convex.site/mcp \
  --header "Authorization: Bearer sl_live_your_agent_key"

Claude Desktop (config file)

Alternative to the connector URL: add to claude_desktop_config.json, then restart Claude.

claude_desktop_config.json

{
  "mcpServers": {
    "sourcelane": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://cool-puffin-608.convex.site/mcp",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

Cursor & Windsurf

Add to ~/.cursor/mcp.json (or Windsurf's mcp_config.json).

mcp.json

{
  "mcpServers": {
    "sourcelane": {
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

VS Code

Save as .vscode/mcp.json. VS Code prompts for your key once.

.vscode/mcp.json

{
  "servers": {
    "sourcelane": {
      "type": "http",
      "url": "https://cool-puffin-608.convex.site/mcp",
      "headers": {
        "Authorization": "Bearer ${input:sourcelane-key}"
      }
    }
  },
  "inputs": [
    {
      "type": "promptString",
      "id": "sourcelane-key",
      "description": "Sourcelane agent key",
      "password": true
    }
  ]
}

ChatGPT Custom GPT (Actions)

Create a GPT → Actions → Import from URL, then Authentication: API Key, Bearer.

OpenAPI schema URL

https://sourcelane-amber.vercel.app/openapi.json

REST

One POST. Pass maxResults to cap cost.

curl

curl -X POST https://cool-puffin-608.convex.site/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"instagram-posts-scraper","params":{"username":"natgeo","maxItems":5},"maxResults":10}'

Python, LangChain, CrewAI, OpenAI Agents SDK…

Wrap the REST call as a tool, or point an MCP client at the endpoint.

python

import requests

res = requests.post(
    "https://cool-puffin-608.convex.site/v1/call",
    headers={"Authorization": "Bearer sl_live_your_agent_key"},
    json={
        "listing": "instagram-posts-scraper",
        "params": {"username":"natgeo","maxItems":5},
        "maxResults": 10,
    },
    timeout=300,
)
body = res.json()
print(body["receipt"]["chargedMicros"], "micro-USD for", body["receipt"]["results"], "results")
print(body["data"])

Reviews

—

0 reviews

Leave a review

Loading reviews…