Search APIVerified

POST Tavily Crawl

Traverse a website and return structured crawl results.

search apitavilycrawlwebsite

Endpoints

1 shown

POST

/apis/v1/tavily/crawl

/apis/v1/tavily/crawl

Crawl a website with limits.

/apis/v1/tavily/crawl

POST/apis/v1/tavily/crawl

Path parameters

This endpoint has no path parameters.

cURL request

curl -X POST "https://api.aisa.one/apis/v1/tavily/crawl" \
  -H "Authorization: Bearer $AISA_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "url": "https://example.com",
  "instructions": "example",
  "chunks_per_source": 1,
  "max_depth": 100,
  "max_breadth": 1,
  "limit": 10,
  "select_paths": [
    "example"
  ],
  "select_domains": [
    "example.com"
  ],
  "exclude_paths": [
    "example"
  ],
  "exclude_domains": [
    "example.com"
  ],
  "allow_external": true,
  "include_images": true,
  "extract_depth": "example",
  "format": "example"
}'

Related APIs

Tavily Search

Search the web, extract page content, crawl sites, and map URLs with Tavily through the AIsa API gateway.

Firecrawl

Scrape pages to clean markdown, search the web, map site URLs, parse documents, and run asynchronous crawl and batch-scrape jobs through the AIsa API gateway.

Oxylabs

GEO/AEO visibility: query the major AI answer engines (ChatGPT, Gemini, Perplexity, Google AI Overviews, Google AI Mode) and get back the AI-generated answer text plus cited source URLs, so you can monitor how a brand or product is surfaced and cited across AI answers.