ExamGecko
Question list
Search
Search

List of questions

Search

Related questions











Question 49 - PT0-002 discussion

Report
Export

Given the following output:

User-agent:*

Disallow: /author/

Disallow: /xmlrpc.php

Disallow: /wp-admin

Disallow: /page/

During which of the following activities was this output MOST likely obtained?

A.
Website scraping
Answers
A.
Website scraping
B.
Website cloning
Answers
B.
Website cloning
C.
Domain enumeration
Answers
C.
Domain enumeration
D.
URL enumeration
Answers
D.
URL enumeration
Suggested answer: D

Explanation:

URL enumeration is the activity of discovering and mapping the URLs of a website, such as directories, files, parameters, or subdomains. URL enumeration can help to identify the structure, content, and functionality of a website, as well as potential vulnerabilities or misconfigurations. One of the methods of URL enumeration is to analyze the robots.txt file of a website, which is a text file that tells search engine crawlers which URLs the crawler can or can't request from the site1. The output shown in the question is an example of a robots.txt file that disallows crawling of certain URLs, such as /author/, /xmlrpc.php, /wp-admin, or /page/.

asked 02/10/2024
Joe Mon
29 questions
User
Your answer:
0 comments
Sorted by

Leave a comment first