WebSite X5Help Center

 
Adrian B.
Adrian B.
User

Is my robot file correct?  en

Autor: Adrian B.
Visited 1145, Followers 1, Udostępniony 0  

This is my robot file content - is it correct?:

User-agent: *

Disallow: *

Disallow: /*

Thank you

Posted on the
4 ODPOWIEDZI
Aleksej H.
Aleksej H.
Moderator

Hello.If you want to prohibit indexing the entire site, then write this:

User-agent: *

Disallow: /

Czytaj więcej
Posted on the from Aleksej H.
Adrian B.
Adrian B.
User
Autor

No I want whatever normal should be, nothing blocked on the site

Czytaj więcej
Posted on the from Adrian B.
JJ. JUAG
JJ. JUAG
User

The recommendation for robots.txt in wx5 is current:

User-agent: *
Disallow: /admin
Disallow: /captcha
Disallow: /imemail

This has the effect that these 3 directories are excluded for all search engines (agents), since the contents of these directories are not suitable for searches

JJ.

Where: 1 Settings - Website Optimization, Seo - Include file robots.txt (in pro version)

Czytaj więcej
Posted on the from JJ. JUAG
Adrian B.
Adrian B.
User
Autor

Thank you I see the robot file on my server is exactly that

Czytaj więcej
Posted on the from Adrian B.