Всем привет, подскажите какой robots.txt правельный
| Код |
|---|
User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /*trackback
Disallow: /*feed
Disallow: /*.php
Disallow: /*?
Crawl-delay: 3
User-agent: Yandex
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /*trackback
Disallow: /*feed
Disallow: /*.php
Disallow: /*?
Crawl-delay: 3
Host: kulinarnoye-puteshestviye.ru
Sitemap: http://kulinarnoye-puteshestviye.ru/sitemap.xml
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: YandexImages
Allow: /wp-content/uploads/
|
или
| Код |
|---|
User-agent: *
Disallow: /wp-includes
Disallow: /wp-feed
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Host: kulinarnoye-puteshestviye.ru
Sitemap: http://kulinarnoye-puteshestviye.ru/sitemap.xml
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: YandexImages
Allow: /wp-content/uploads/ |
Какой из них загрузить на сайт.
