Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.0The Bright Data toolkit connects Arcade to Bright Data's proxy and scraping infrastructure, enabling large-scale web scraping, search engine querying, and structured data extraction without bot-blocking.
Capabilities
- Web scraping: Fetch any public webpage and receive clean Markdown output, suitable for downstream parsing or LLM ingestion.
- Search engine queries: Run searches across Google, Bing, or Yandex with control over result count, search type (web/images), and target country.
- Structured data feeds: Extract pre-parsed, schema-aligned data from major platforms — including Amazon, LinkedIn, Instagram, Facebook, X, Zillow, YouTube, Booking.com, and ZoomInfo — without building custom scrapers.
Secrets
This toolkit requires two secrets, configured in your Arcade environment.
-
BRIGHTDATA_API_KEY— A Bright Data API key used to authenticate all requests. Obtain it from the Bright Data Control Panel under Account Settings → API Token. A paid Bright Data account is required; the key grants access to all zones associated with your account. -
BRIGHTDATA_ZONE— The name of the Bright Data proxy/scraping zone to route requests through. Zones are created and managed in the Bright Data Control Panel under Proxies & Scraping Infrastructure. Each zone corresponds to a specific product (e.g., Web Unlocker, Scraping Browser, Residential Proxies); the zone name is the string identifier shown in the zone settings, not a numeric ID.
For instructions on registering secrets with Arcade, see Create Tool Secrets. You can manage secret values at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MADE UP LINKS - IF LINKS ARE NEEDED, EXECUTE search_engine FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 2 |