User-agent: * Disallow: /lib/ Disallow: /site/includes/ Disallow: /admin/ Disallow: /database/