Which file is placed on a website's server to give instructions to search engine web crawlers about which paths and directories should not be scanned or indexed? MCQ with Answer and Explanation

Question

Which file is placed on a website's server to give instructions to search engine web crawlers about which paths and directories should not be scanned or indexed?

A. robots.txt

B. sitemap.xml

C. htaccess

D. index.html

Answer: Option A

Solution (By JKSSB Mock Tests)

The robots.txt file is a standard text file used by websites to guide web robots and crawlers regarding which parts of the site they are allowed to index.

This question belongs to: Computer Internet and Web Technologies

Request complete Subject PDF

Discuss this Question (0)

No comments yet. Be the first to start the discussion!

Practice More Internet and Web Technologies Questions

Question #1

Share Report

Which of the following is a component of a web browser that interprets JavaScript code?

A. JavaScript engine

B. Rendering engine

C. Cache manager

D. Network stack

View Answer & Solution Discuss

Get Complete Subject PDF for Computer

Correct Answer: Option A

Explanation:
The JavaScript engine (e.g., V8 for Chrome) parses and executes JavaScript code within the browser.

This question belongs to: Computer Internet and Web Technologies

Question #2

Share Report

What is the function of the 'autofocus' attribute in an HTML input field?

A. To automatically give focus to the input when the page loads

B. To validate the input automatically

C. To clear the input value

D. To set the input to read-only

View Answer & Solution Discuss

Get Complete Subject PDF for Computer

Correct Answer: Option A

Explanation:
The autofocus attribute indicates that the input should automatically receive focus when the page loads, improving usability.

This question belongs to: Computer Internet and Web Technologies

Question #3

Share Report

Which type of web architecture uses a 'Three-Tier' format to divide application logical structures cleanly?

A. HTML file, CSS style script, and JavaScript dynamic loader

B. Local router, WAN switch, and Global satellite interface

C. Sender inbox, Gateway router, and Recipient junk folder

D. Presentation tier (Browser), Application tier (Server logic), and Data tier (Database)

View Answer & Solution Discuss

Get Complete Subject PDF for Computer

Correct Answer: Option D

Explanation:
A standard three-tier web application architecture separates concerns into the presentation layer (UI), the application logic tier, and the database storage tier.

This question belongs to: Computer Internet and Web Technologies

Explore All Internet and Web Technologies MCQs