Universal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Search, Google Trends, Reddit, Airbnb, Yelp, and 15+ more platforms. Use for lead generation, brand monitoring, competitor analysis, influencer discovery, trend research, content analytics, audience analysis, review analysis, SEO intelligence, recruitment, or any data extraction task.
Detected risks:
This skill provides a universal AI-powered web scraping interface built on the Apify CLI. It helps users extract structured data from a wide range of online platforms such as social networks, search engines, review sites, marketplaces, and analytics sources. Instead of manually building scrapers or dealing with brittle APIs, it streamlines the process of selecting prebuilt Apify Actors, configuring them via standardized JSON inputs, and executing data extraction tasks through a consistent command-line workflow. The skill is designed to solve the complexity of multi-platform scraping by abstracting platform-specific logic into reusable Actors and workflows.
It includes a structured workflow for selecting the appropriate Actor from an indexed catalog or dynamically searching available Actors when needed. The skill supports retrieving input schemas and documentation for each Actor, ensuring correct configuration before execution. It enforces reliable CLI usage patterns such as JSON-only output, authentication handling via tokens or OAuth, and proper command execution for consistent results. Users can run scraping jobs, monitor execution status, and retrieve results from datasets in JSON or CSV formats. A "quick answer" mode enables fast extraction of top results for lightweight queries, while full dataset retrieval supports deeper analysis pipelines.
This skill is designed for users who need scalable data extraction across multiple platforms without building custom scrapers. It is suitable for developers, analysts, marketers, and researchers working on lead generation, competitor intelligence, influencer discovery, brand monitoring, SEO analysis, trend research, recruitment, and e-commerce intelligence. By leveraging Apify’s ecosystem of Actors, it enables flexible and automated data workflows for both simple lookups and complex multi-step data pipelines.
You can authenticate using `apify login` for interactive OAuth login, by setting an environment variable `APIFY_TOKEN`, or by sourcing a `.env` file containing the token.
It supports a wide range of platforms including Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Search, Reddit, Airbnb, Yelp, and many others through Apify Actors.
You need Apify CLI v1.4.0 or higher, an active internet connection, and a valid authenticated Apify session using a token or login method.
It depends on available Apify Actors and requires proper authentication. CLI commands must use JSON output and redirect stderr for stable parsing, and some features depend on Actor-specific capabilities.
Quick Setup:
.claude/skills/Repository
apify/agent-skills