User-agent: * Disallow: /api/ Disallow: /css/ Disallow: /js/ Allow: / Disallow: /php/ Disallow: /cache/ Disallow: /sample.php