Google posts draft to formalize Robots Exclusion Protocol Specification

Google posts draft to formalize Robots Exclusion Protocol Specification 1



Google open sources its robots.txt parser as part of this announcement.

Please visit Search Engine Land for the full article.

Google posts draft to formalize Robots Exclusion Protocol Specification 2 Google posts draft to formalize Robots Exclusion Protocol Specification 3 Google posts draft to formalize Robots Exclusion Protocol Specification 4 Google posts draft to formalize Robots Exclusion Protocol Specification 5 Google posts draft to formalize Robots Exclusion Protocol Specification 6 Google posts draft to formalize Robots Exclusion Protocol Specification 7 Google posts draft to formalize Robots Exclusion Protocol Specification 8

Google posts draft to formalize Robots Exclusion Protocol Specification 9



Source link