Thejollyhellhound20
Thejollyhellhound20 Thejollyhellhound20
  • 07-11-2018
  • Computers and Technology
contestada

1. How do i find a robots txt for a website?
2. Why is robots txt file used?
3. What is Webcrawling and how do i stop it

Respuesta :

XXthunder6 XXthunder6
  • 07-11-2018

I TINK THE ANSWER IS 1

Answer Link

Otras preguntas

What is globalization?
A student determines that a 9.8 g mixture of MgCl₂ (s) and NaNO3(s) contains 0.050 mol of MgCl₂(s). Based on the student's measurement, what is the mass percent
One of the primary goals of the United Nations is to: A. help countries resolve disputes without resorting to armed conflict. O B. place legal limits on the siz
Consider the debate about whether viruses are alive or not. Both Viewpoint #1 and Viewpoint #2 have points of evidence in common. Evidence includes ALL BUT ____
In a 24 marathon, solve the 24 puzzle given by the poster above you, and post a new 24 puzzle of your own!
Please help ASAP. This is Science
Imagine that you are in a car, driving along the main road. Along the road there are signs telling you how far it is to the next town. At the roadside, there ma
You deposit Php1000 in a savings account that earns 6% interest per year Compound interest
Evaluate x4 + 4x3 - 2x2 + 11x - 6 for x = 3
What was the reaction of Sir Syed Ahmad Khan when the British rulers introduced the British system of Democracy in India?