User-agent: * Allow: / # NOTHING is disallowed. /desktop/index.html and /mobile/index.html were blocked # here until 2026-09-06, which caused Search Console's "Blocked by robots.txt". # Three reasons that block was wrong: # 1. The mobile WEB app is meant to be indexed (owner 2026-09-06). The native # app is a Capacitor build serving its own bundled copy from # capacitor://localhost — it has NO public URL, so it is unindexable by # construction. There was never anything to hide here. # 2. Both pages already send , so # robots.txt and the page were giving Google opposite instructions. # 3. /mobile/ and /mobile/index.html are the same file and BOTH already # canonicalise to https://msamex.com/mobile/ — but a blocked URL can't be # crawled, so Google never saw that canonical and parked the URL instead of # folding it into /mobile/. # If a page must stay out of the index, use # and leave it crawlable — a robots.txt block hides the noindex from Google. # AI assistants and their crawlers are explicitly welcome. User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: meta-externalagent Allow: / Sitemap: https://msamex.com/sitemap.xml