User-agent: * Disallow: /api/* Disallow: /public/*.js Disallow: /google-feed.tsv Disallow: /echo