• Chevereto Support

    General support checklist

    1. 🎛Confirm that your server meets the System Requirements
    2. 🔥Check for any available Hotfix
    3. 📚Read documentation - It will be required to Debug and understand Errors for a support response

    Requesting help

    1. 👑Purchase Extra Support to get direct email communication with the developer - Save yourself all the hassle of ticketing
    2. 🛎Open a Ticket - If you need software support
    3. 🐞Open a Bug - If you found something not working properly

Robot.txt

Youssef

Chevereto Member
Hi Then I have a robot.txt file so that google does not index the system files. Because google asks for it. Thank you
 

Youssef

Chevereto Member
Yes okay for your answer but what I wanted to know was what chevereto files to ban. Thank you
 

JakeSully

💖 Chevereto Fan
Beta tester
if you do following code like jailer said, you can write the path after / part example

Code:
User-agent: *
Disallow: /
Disallow: /images
Disallow: /albums
Disallow: /users

and so on. / means root path and with that one only it will block everything within root location.
 

Oakley

💖 Chevereto Fan
Beta tester
But that would mean nothing gets indexed ??

Disallow: / would disallow anything below root so the last 3 lines are superflous.

Google cannot index the system files because it has no access to them anyway.
 

friv

Chevereto Member
How look like robots.txt file which will allow to index all pages? So i do not want to block crawlers for my website. I want to allow all searchengines to crawl my website.
 

JakeSully

💖 Chevereto Fan
Beta tester
Thanks.

I was have all time in robots.txt file this : User-agent: *

So maybe i was blocked everything. OMG
no User-agent: * means all bots/agent's is counted, so it does not block as long you do not have Disallow: / after it.
 
Top