Als u het crawlen van de website wilt blokkeren, moet het robots.txt-bestand normaal worden geretourneerd (met de HTTP-resultaatcode 200 (geslaagd)) met daarin de instructie 'disallow'.
In order to block crawling of the website, the robots.txt must be returned normally (with a 200 "OK" HTTP result code) with an appropriate "disallow" in it.
U kunt het crawlen van alle pagina's tijdelijk opschorten door de HTTP-resultaatcode 503 voor alle URL's te retourneren, inclusief het robots.txt-bestand.
You can temporarily suspend all crawling by returning a HTTP result code of 503 for all URLs, including the robots.txt file.
De HTTP-resultaatcode 403 wordt, net als alle andere 4xx HTTP-resultaatcodes, gezien als signaal dat het robots.txt-bestand niet bestaat.
The HTTP result code 403-as all other 4xx HTTP result codes-is seen as a sign that the robots.txt file does not exist.
Potentially sensitive or inappropriate content
Examples are used only to help you translate the word or expression searched in various contexts. They are not selected or validated by us and can contain inappropriate terms or ideas. Please report examples to be edited or not to be displayed. Potentially sensitive, inappropriate or colloquial translations are usually marked in red or in orange.
No results found for this meaning.
Synonyms and analogies of "HTTP-resultaatcode" in Dutch
