> ## Documentation Index > Fetch the complete documentation index at: https://aisa.one/docs/llms.txt > Use this file to discover all available pages before exploring further. # OnPage API Non-indexable Pages > This endpoint returns a list of pages that are blocked from being indexed by Google and other search engines through `robots. ## OpenAPI ````yaml openapi/dataforseo.json POST /dataforseo/on_page/non_indexable openapi: 3.0.3 info: title: DataForSEO API version: 1.0.0 description: DataForSEO API endpoints exposed through the AIsa unified gateway. servers: - url: https://api.aisa.one/apis/v1 security: - BearerAuth: [] paths: /dataforseo/on_page/non_indexable: post: summary: OnPage API Non-indexable Pages description: >- This endpoint returns a list of pages that are blocked from being indexed by Google and other search engines through `robots.txt`, HTTP headers, or meta tags settings. operationId: post_dataforseo_on_page_non_indexable requestBody: required: true content: application/json: schema: type: object properties: id: type: string description: >- ID of the task required field you can get this ID in the response of the Task POST endpoint example: “07131248-1535-0216-1000-17384017ad04” limit: type: integer description: >- the maximum number of returned pages optional field default value: 100 maximum value: 1000 offset: type: integer description: >- offset in the results array of returned pages optional field default value: 0 if you specify the 10 value, the first ten pages in the results array will be omitted and the data will be provided for the successive pages filters: type: array items: type: string description: >- array of results filtering parameters optional field you can add several filters at once (8 filters maximum) you should set a logical operator and, or between the conditions the following operators are supported: regex, not_regex, , , >, >=, =, , in, not_in, like, not_like you can use the % operator with like and not_like to match any string of zero or more characters example: ["reason","=","robots_txt"][["reason","","robots_txt"], "and", ["url","not_like","%/wp-admin/%"]] [["url","not_like","%/wp-admin/%"], "and", [["reason","","meta_tag"],"or",["reason","","http_header"]]] The full list of possible filters is available by this link. required: - id responses: '200': description: Successful response content: application/json: schema: type: object properties: version: type: string description: the current version of the API status_code: type: integer description: >- general status code you can find the full list of the response codes here Note: we strongly recommend designing a necessary system for handling related exceptional or error conditions status_message: type: string description: >- general informational message you can find the full list of general informational messages here time: type: string description: execution time, seconds cost: type: number description: total tasks cost, USD tasks_count: type: integer description: the number of tasks in the tasks array tasks_error: type: integer description: >- the number of tasks in the tasks array returned with an error tasks: type: array items: type: string description: array of tasks tasks.id: type: string description: >- task identifier unique task identifier in our system in the UUID format tasks.status_code: type: integer description: >- status code of the task generated by DataForSEO; can be within the following range: 10000-60000 you can find the full list of the response codes here tasks.status_message: type: string description: >- informational message of the task you can find the full list of general informational messages here tasks.time: type: string description: execution time, seconds tasks.cost: type: number description: cost of the task, USD tasks.result_count: type: integer description: number of elements in the result array tasks.path: type: array items: type: string description: URL path tasks.data: type: object description: >- contains the same parameters that you specified in the POST request tasks.result: type: array items: type: string description: array of results tasks.result.crawl_progress: type: string description: >- status of the crawling session possible values: in_progress, finished tasks.result.crawl_status: type: object description: details of the crawling session tasks.result.crawl_status.max_crawl_pages: type: integer description: >- maximum number of pages to crawl indicates the max_crawl_pages limit you specified when setting a task tasks.result.crawl_status.pages_in_queue: type: integer description: number of pages that are currently in the crawling queue tasks.result.crawl_status.pages_crawled: type: integer description: number of crawled pages tasks.result.total_items_count: type: integer description: total number of relevant items in the database tasks.result.items_count: type: integer description: number of items in the results array tasks.result.items: type: array items: type: string description: items array tasks.result.reason: type: string description: >- the reason why the page is non-indexable can take the following values: robots_txt, meta_tag, http_header, attribute, too_many_redirects tasks.result.url: type: string description: url of the non-indexable page '400': description: Bad request '401': description: Unauthorized '429': description: Rate limit exceeded '500': description: Internal server error components: securitySchemes: BearerAuth: type: http scheme: bearer ````