ここの情報は古いです。ご理解頂いた上でお取り扱いください。

Changes between Initial Version and Version 1 of RobotsTxt


Ignore:
Timestamp:
Jun 23, 2017, 10:33:02 AM (6 months ago)
Author:
urabe
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • RobotsTxt

    v1 v1  
     1User-agent: *
     2Crawl-delay: 300
     3
     4User-agent: Slurp
     5Crawl-delay: 5