ScrapeCreators SOP

Appearance

Content Research ​

Sweep every major platform for content around a topic. Combines hashtag and keyword search across TikTok, Instagram, YouTube, and Pinterest into one ranked dataset.

Steps ​

  1. Define the topic plus three to five seed keywords and three to five hashtags.
  2. Hit each platform's search endpoint in parallel.
  3. Normalize results to a common shape: { platform, url, title, engagement, posted_at }.
  4. Sort by engagement and write a CSV.

Node Script ​

js
import fs from 'node:fs';

const SC_KEY = process.env.SCRAPECREATORS_API_KEY;

async function sc(path, params) {
  const qs = new URLSearchParams(params).toString();
  const res = await fetch(`https://api.scrapecreators.com${path}?${qs}`, {
    headers: { 'x-api-key': SC_KEY },
  });
  if (!res.ok) return { error: res.status };
  return res.json();
}

async function researchTopic(topic, hashtags = [], keywords = []) {
  const calls = [];

  for (const h of hashtags) {
    calls.push(['tiktok-hashtag', sc('/v1/tiktok/search/hashtag', { hashtag: h })]);
    calls.push(['youtube-hashtag', sc('/v1/youtube/search/hashtag', { hashtag: h })]);
  }

  for (const kw of keywords) {
    calls.push(['tiktok-keyword', sc('/v1/tiktok/search/keyword', { query: kw })]);
    calls.push(['instagram-reels', sc('/v2/instagram/reels/search', { query: kw })]);
    calls.push(['youtube', sc('/v1/youtube/search', { query: kw })]);
    calls.push(['pinterest', sc('/v1/pinterest/search', { query: kw })]);
  }

  const results = await Promise.all(calls.map(([_, p]) => p));
  return calls.map(([source], i) => ({ source, data: results[i] }));
}

const data = await researchTopic('cold plunge', ['coldplunge', 'icebath'], ['cold plunge benefits', 'ice bath morning']);
fs.writeFileSync('content-research.json', JSON.stringify(data, null, 2));
console.log(`Pulled ${data.length} search batches.`);

Notes ​

  • Each search call costs 1 credit. Six platforms times five keywords times three hashtags is roughly 45 credits.
  • Use GET /v1/tiktok/search/top to pull TikTok's curated Top tab which blends photos and videos.
  • For trend monitoring, run this daily on a cron and diff results to detect new viral content.
  • GET /v1/tiktok/search/hashtag
  • GET /v1/tiktok/search/keyword
  • GET /v2/instagram/reels/search
  • GET /v1/youtube/search
  • GET /v1/youtube/search/hashtag
  • GET /v1/pinterest/search
  • GET /v1/reddit/search
  • GET /v1/google/search