WebSite X5Help Center

 
Adrian B.
Adrian B.
User

Is my robot file correct?  en

Autor: Adrian B.
Besucht 1024, Followers 1, Geteilt 0  

This is my robot file content - is it correct?:

User-agent: *

Disallow: *

Disallow: /*

Thank you

Gepostet am
4 ANTWORTEN
Aleksej H.
Aleksej H.
Moderator

Hello.If you want to prohibit indexing the entire site, then write this:

User-agent: *

Disallow: /

Mehr lesen
Gepostet am von Aleksej H.
Adrian B.
Adrian B.
User
Autor

No I want whatever normal should be, nothing blocked on the site

Mehr lesen
Gepostet am von Adrian B.
JJ. JUAG
JJ. JUAG
User

The recommendation for robots.txt in wx5 is current:

User-agent: *
Disallow: /admin
Disallow: /captcha
Disallow: /imemail

This has the effect that these 3 directories are excluded for all search engines (agents), since the contents of these directories are not suitable for searches

JJ.

Where: 1 Settings - Website Optimization, Seo - Include file robots.txt (in pro version)

Mehr lesen
Gepostet am von JJ. JUAG
Adrian B.
Adrian B.
User
Autor

Thank you I see the robot file on my server is exactly that

Mehr lesen
Gepostet am von Adrian B.