Google Analytics and Robot.txt
Author: Henry L.Google Analytics does not show that robots are indexing my pages. I searched the help file and found the following post by Steve R. regarding robot.txt function. This appeared to be posted in response to not have indexing take place. I hate to pose the obvious question, but I am assuming that unchecking the check box in the expert panel stops the indexing function from being applied. With that assumption in mind I have built my websites with the block checked, so robots should be hitting the pages indexed. I was surprised to see according to Google that robots were not. Is there something that I am doing wrong? Have I missed something? Please advise. "Robot.txt is use to set the filter to some folders on your server. This has to be managed manually taking care of the folders present on your server. To index (or not) some pages on your website you simply have to select the page you want from Step 2 (Map) and click to access the page properties. Here you can uncheck the Sitemap option (Expert tab)."
how long is your site online? It could take months befor it is visited bij a google crawler...