WebSite X5Help Center

 
Adrian B.
Adrian B.
User

Is my robot file correct?  en

Autor: Adrian B.
Visitado 1144, Followers 1, Compartido 0  

This is my robot file content - is it correct?:

User-agent: *

Disallow: *

Disallow: /*

Thank you

Publicado en
4 RESPUESTAS
Aleksej H.
Aleksej H.
Moderator

Hello.If you want to prohibit indexing the entire site, then write this:

User-agent: *

Disallow: /

Leer más
Publicado en de Aleksej H.
Adrian B.
Adrian B.
User
Autor

No I want whatever normal should be, nothing blocked on the site

Leer más
Publicado en de Adrian B.
JJ. JUAG
JJ. JUAG
User

The recommendation for robots.txt in wx5 is current:

User-agent: *
Disallow: /admin
Disallow: /captcha
Disallow: /imemail

This has the effect that these 3 directories are excluded for all search engines (agents), since the contents of these directories are not suitable for searches

JJ.

Where: 1 Settings - Website Optimization, Seo - Include file robots.txt (in pro version)

Leer más
Publicado en de JJ. JUAG
Adrian B.
Adrian B.
User
Autor

Thank you I see the robot file on my server is exactly that

Leer más
Publicado en de Adrian B.