Is my robot file correct?
Auteur : Adrian B.
Visité 1149,
Followers 1,
Partagé 0
This is my robot file content - is it correct?:
User-agent: *
Disallow: *
Disallow: /*
Thank you
Posté le
Hello.If you want to prohibit indexing the entire site, then write this:
User-agent: *
Disallow: /
Auteur
No I want whatever normal should be, nothing blocked on the site
The recommendation for robots.txt in wx5 is current:
User-agent: *
Disallow: /admin
Disallow: /captcha
Disallow: /imemail
This has the effect that these 3 directories are excluded for all search engines (agents), since the contents of these directories are not suitable for searches
JJ.
Where: 1 Settings - Website Optimization, Seo - Include file robots.txt (in pro version)
Auteur
Thank you I see the robot file on my server is exactly that