User-agent: * Allow: / Allow: /us Allow: /us?* Allow: /us/* Allow: /ca Allow: /ca?* Allow: /ca/* Disallow: /deal/link/* Disallow: /deal/like/* Disallow: /deal/show/* Disallow: /auth/* Disallow: /api/* Disallow: /goto/*