WebSite X5Help Center

 
Adrian B.
Adrian B.
User

Is my robot file correct?  en

Autore: Adrian B.
Visite 1147, Followers 1, Condiviso 0  

This is my robot file content - is it correct?:

User-agent: *

Disallow: *

Disallow: /*

Thank you

Postato il
4 RISPOSTE
Aleksej H.
Aleksej H.
Moderator

Hello.If you want to prohibit indexing the entire site, then write this:

User-agent: *

Disallow: /

Leggi di più
Postato il da Aleksej H.
Adrian B.
Adrian B.
User
Autore

No I want whatever normal should be, nothing blocked on the site

Leggi di più
Postato il da Adrian B.
JJ. JUAG
JJ. JUAG
User

The recommendation for robots.txt in wx5 is current:

User-agent: *
Disallow: /admin
Disallow: /captcha
Disallow: /imemail

This has the effect that these 3 directories are excluded for all search engines (agents), since the contents of these directories are not suitable for searches

JJ.

Where: 1 Settings - Website Optimization, Seo - Include file robots.txt (in pro version)

Leggi di più
Postato il da JJ. JUAG
Adrian B.
Adrian B.
User
Autore

Thank you I see the robot file on my server is exactly that

Leggi di più
Postato il da Adrian B.