What is the purpose of the 'robots.txt' file on a website?
A. To configure the web server
B. To instruct search engine crawlers which parts of the site to index
C. To store user login credentials
D. To block malicious users
Answer: Option B
Solution (By JKSSB Mock Tests)
The robots.txt file is a standard used by websites to communicate with web crawlers, indicating which pages or sections should not be crawled or indexed.
What mechanism does a web server implement to gracefully instruct a browser that an old web resource has changed its location permanently to a new URL address asset?
A.Setting a temporary session tracking cookie inside memory
B.Issuing a general 500 Internal Error crash notification alert
C.Issuing an HTTP 301 Moved Permanently response code with the new location header
D.Altering the local computer DNS router configurations
Explanation:
An HTTP 301 redirect informs browsers and search engines that a page has permanently relocated, prompting them to update their links and pass SEO ranking history to the new URL.
Explanation:
Session cookies only exist in temporary volatile memory while the user navigates the site and are wiped upon closing the browser application.
Explanation:
URL encoding (percent-encoding) replaces unsafe ASCII characters with a '%' followed by two hexadecimal digits to ensure the URL is valid and transmitted correctly.
No comments yet. Be the first to start the discussion!