WebSite X5Help Center

 
Adrian B.
Adrian B.
User

Is my robot file correct?  en

Автор: Adrian B.
Просмотрено 1009, Подписчики 1, Размещенный 0  

This is my robot file content - is it correct?:

User-agent: *

Disallow: *

Disallow: /*

Thank you

Размещено
4 Ответы
Aleksej H.
Aleksej H.
Moderator

Hello.If you want to prohibit indexing the entire site, then write this:

User-agent: *

Disallow: /

Читать больше
Размещено От Aleksej H.
Adrian B.
Adrian B.
User
Автор

No I want whatever normal should be, nothing blocked on the site

Читать больше
Размещено От Adrian B.
JJ. JUAG
JJ. JUAG
User

The recommendation for robots.txt in wx5 is current:

User-agent: *
Disallow: /admin
Disallow: /captcha
Disallow: /imemail

This has the effect that these 3 directories are excluded for all search engines (agents), since the contents of these directories are not suitable for searches

JJ.

Where: 1 Settings - Website Optimization, Seo - Include file robots.txt (in pro version)

Читать больше
Размещено От JJ. JUAG
Adrian B.
Adrian B.
User
Автор

Thank you I see the robot file on my server is exactly that

Читать больше
Размещено От Adrian B.