# Robots.txt file created by http://www.room4rent.com.au # For domain: http://www.room4rent.com.au # All robots will spider the domain User-agent: * Disallow: # Disallow directory /crm User-agent: * Disallow: /crm