Explain what a crawler is and what it does.

What will be an ideal response?

A crawler searches the World Wide Web for URLs and tokens. The main work of crawler is to build an index (a list of tokens) that are associated with the page. For each token, the crawler creates a list of the URLs associated with that token.

Computer Science & Information Technology

You might also like to view...

The ________ is used to specify how the speaker's notes will display on the printed page

Fill in the blank(s) with correct word

Computer Science & Information Technology

If you need a function to get both the number of items and the cost per item from a user, which would be a good function declaration to use?

a. int,float getData(); b. int getData(float cost); c. void getData(int count, float cost); d. void getData(int& count, float& cost);

Computer Science & Information Technology