Live ChatGPT LLM Scraper
Live ChatGPT LLM Scraper endpoint provides results from ChatGPT searches.
Documentation Index
Fetch the complete documentation index at: https://aisa.one/docs/llms.txt
Use this file to discover all available pages before exploring further.
Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Body
keyword required field you can specify up to 2000 characters in the keyword field all %## will be decoded (plus character ‘+’ will be decoded to a space character) if you need to use the “%” character for your keyword, please specify it as “%25”; if you need to use the “+” character for your keyword, please specify it as “%2B”learn more about rules and limitations of keyword and keywords fields in DataForSEO APIs in this Help Center article
full name of search engine location required field if you don't specify location_code if you use this field, you don't need to specify location_code you can receive the list of available locations of the search engine with their location_name by making a separate request to the https://api.dataforseo.com/v3/ai_optimization/chat_gpt/llm_scraper/locations example: United States
search engine location code required field if you don't specify location_name if you use this field, you don't need to specify location_name you can receive the list of available locations of the search engines with their location_code by making a separate request to the https://api.dataforseo.com/v3/ai_optimization/chat_gpt/llm_scraper/locations example: 2840
full name of search engine language required field if you don't specify language_code; if you use this field, you don't need to specify language_code; you can receive the list of available languages of the search engine with their language_name by making a separate request to the https://api.dataforseo.com/v3/ai_optimization/chat_gpt/llm_scraper/languages
search engine language code required field if you don't specify language_name; if you use this field, you don't need to specify language_name; you can receive the list of available languages of the search engine with their language_code by making a separate request to the https://api.dataforseo.com/v3/ai_optimization/chat_gpt/llm_scraper/languages
force AI agent to use web search optional field when enabled, the AI model is forced to access and cite current web information; default value: false; Note: even if the parameter is set to true, there is no guarantee web sources will be cited in the response
user-defined task identifier optional field the character limit is 255 you can use this parameter to identify the task and match it with the result you will find the specified tag value in the data object of the response
Response
Successful response
the current version of the API
general status code you can find the full list of the response codes here Note: we strongly recommend designing a necessary system for handling related exceptional or error conditions
general informational message you can find the full list of general informational messages here
execution time, seconds
total tasks cost, USD
the number of tasks in the tasks array
the number of tasks in the tasks array returned with an error
array of tasks
task identifier unique task identifier in our system in the UUID format
status code of the task generated by DataForSEO; can be within the following range: 10000-60000 you can find the full list of the response codes here
informational message of the task you can find the full list of general informational messages here
execution time, seconds
cost of the task, USD
number of elements in the result array
URL path
contains the same parameters that you specified in the POST request
array of results
keyword received in a POST array the keyword is returned with decoded %## (plus symbol '+' will be decoded to a space character)
location code in a POST array
language code in a POST array
indicates the model version
direct URL to search engine results you can use it to make sure that we provided exact results
date and time when the result was received in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00
content of the element in markdown format content of the result formatted in the markdown markup language
array of search results all web search outputs the model retrieved when looking up information, including duplicates and unused entries
type of element='chatgpt_search_result'n
result URL
result domain
result title
result description
breadcrumb
array of sources the sources the model actually cited or relied on in its final answer
type of element='chat_gpt_source'
source title
source description
source domain
source URL
source thumbnail
source name
date and time when the result was published in the format: “year-month-date:minutes:UTC_difference_hours:UTC_difference_minutes” example: 2019-11-15 12:57:46 +00:00
content of the element in markdown format content of the result formatted in the markdown markup language
array of fan-out queries contains related search queries derived from the main query to provide a more comprehensive response
array of brand entities contains information on brands mentioned in the response
type of the element = 'chat_gpt_brand_entity'
name of the brand
category of the brand
brand name in markdown format contains brand name formatted in the markdown markup language
array of URLs and domains relevant to the brand
URL
domain
total number of results
types of search results contains types of search results (items) found in SERP. possible item types: chat_gpt_text, chat_gpt_table, chat_gpt_navigation_list, chat_gpt_images, chat_gpt_local_businesses, chat_gpt_products
the number of results returned in the items array
elements of ChatGPT results
element in the response
type of element='chat_gpt_text'
group rank in SERP position within a group of elements with identical type values positions of elements with different type values are omitted from rank_group
absolute rank in SERP absolute position among all the elements in SERP
content of the element in markdown format content of the result formatted in the markdown markup language
array of sources
type of element='chat_gpt_source'n
source title
source description
source domain in SERP
source URL
source thumbnail
source name
date and time when the result was published in the format: “year-month-date:minutes:UTC_difference_hours:UTC_difference_minutes” example: 2019-11-15 12:57:46 +00:00
content of the element in markdown format content of the result formatted in the markdown markup language
array of brand entities contains information on brands mentioned in the text
type of the element = 'chat_gpt_brand_entity'
name of the brand
category of the brand
brand name in markdown format contains brand name formatted in the markdown markup language
array of URLs and domains relevant to the brand
URL
domain
element in the response
type of element='chat_gpt_table'
group rank in SERP position within a group of elements with identical type values positions of elements with different type values are omitted from rank_group
absolute rank in SERP absolute position among all the elements in SERP
text of the element
content of the element in markdown format content of the result formatted in the markdown markup language
table present in the element the header and content of the table present in the element
content in the header of the table
array of contents of the table present in the element each array represents the table row
array of brand entities contains information on brands mentioned in the table
type of the element = 'chat_gpt_brand_entity'
name of the brand
category of the brand
brand name in markdown format contains brand name formatted in the markdown markup language
array of URLs and domains relevant to the brand
URL
domain
element in the response
type of element='chat_gpt_navigation_list'
group rank in SERP position within a group of elements with identical type values positions of elements with different type values are omitted from rank_group
absolute rank in SERP absolute position among all the elements in SERP
title of the element
array of sources
type of element='chat_gpt_source'
source title
source description
source domain in SERP
source URL
source thumbnail
source name
date and time when the result was published in the format: “year-month-date:minutes:UTC_difference_hours:UTC_difference_minutes” example: 2019-11-15 12:57:46 +00:00
content of the element in markdown format content of the result formatted in the markdown markup language
element in the response
type of element='chat_gpt_images'
group rank in SERP position within a group of elements with identical type values positions of elements with different type values are omitted from rank_group
absolute rank in SERP absolute position among all the elements in SERP
content of the element in markdown format content of the result formatted in the markdown markup language
items present in the element
type of element = 'chat_gpt_images_element'
alt tag of the image
relevant URL
URL of the image the URL leading to the image on the original resource or DataForSEO storage (in case the original source is not available)
content of the element in markdown format content of the result formatted in the markdown markup language
element in the response
type of element='chat_gpt_local_businesses'
group rank in SERP position within a group of elements with identical type values positions of elements with different type values are omitted from rank_group
absolute rank in SERP absolute position among all the elements in SERP
content of the element in markdown format content of the result formatted in the markdown markup language
items present in the element
type of element = 'chat_gpt_local_businesses_element'
title of the local business
description of the local business
address of the local business
phone of the local business
total number of reviews submitted for the local business
website URL of the local business
domain name of the local business
rating of the corresponding local business popularity rate based on reviews and displayed in SERP
type of rating here you can find the following elements: Max5, Percents, CustomMax
the average rating based on all reviews
the number of votes
the maximum value for a rating_type
element in the response
type of element='chat_gpt_products'
group rank in SERP position within a group of elements with identical type values positions of elements with different type values are omitted from rank_group
absolute rank in SERP absolute position among all the elements in SERP
items present in the element
type of element = 'chat_gpt_products_element'
product id
merchant(s) offering the product
product identifier token Base64-encoded token containing Google Shopping product IDs associated with the product
title of the product
rating of the product popularity rate based on reviews and displayed in SERP
type of rating here you can find the following elements: Max5, Percents, CustomMax
the average rating based on all reviews
the number of votes
the maximum value for a rating_type
product price
currency of the listed price ISO code of the currency applied to the price
tag text
result URL
result domain in SERP
image URLs of the element contains URLs leading to the images on the original resource or DataForSEO storage (in case the original source is not available)
Google Shopping product identifiers array of Google Shopping product IDs associated with the product
type of element = 'chat_gpt_google_shopping_product'
event identifier internal event identifier used by Google
product identifier can be used as a data_docid in Google Shopping API endpoints
Google Shopping catalog identifier of the product can be used as a product_id in Google Shopping API endpoints
Google product cluster identifier can be used as a gid in Google Shopping API endpoints
document identifier of the main offer in the headline can be used as a data_docid in Google Shopping API endpoints
identifier for the displayed product’s image
resource descriptor string internal Google resource descriptor string that identifies the product within Google's Shopping index
search query search query used by ChatGPT to retrieve the product from Google Shopping
merchant identifier identifier of the seller or merchant account in Google Shopping
product view type internal Google parameter that specifies the product view type used when rendering the product item
encoded location parameter indicates the location for a search
country code indicates the location for which search results are displayed
host language code indicates the language in which search results are displayed