STANDARD FOR ROBOT EXCLUSION
\stˈandəd fɔː ɹˈə͡ʊbɒt ɛksklˈuːʒən], \stˈandəd fɔː ɹˈəʊbɒt ɛksklˈuːʒən], \s_t_ˈa_n_d_ə_d f_ɔː ɹ_ˈəʊ_b_ɒ_t ɛ_k_s_k_l_ˈuː_ʒ_ə_n]\
Sort: Oldest first
-
A proposal to try to prevent the havocwreaked by many of the early World-Wide Web robots whenthey retrieved documents too rapidly or retrieved documentsthat had side effects (such as voting). The proposed standardfor robot exclusion offers a solution to these problems in theform of a file called "robots.txt" placed in the documentroot of the web site.W3C standard(http://w3.org/TR/html4/appendix/notes.html#h-B.4.1.1).
By Denis Howe
Word of the day
hydromorphic
- [Greek] Structurally adapted to an aquatic environment, as organs of water plants.
Nearby Words
- standard candle
- standard cell
- standard commands for programmable instruments
- standard d'echange et de transfert
- standard deviation
- standard for robot exclusion
- standard for the exchange of product model data
- standard gauge
- standard generalised markup language
- standard generalized markup language
- standard guinea-pig