Hello everyone,
I'm having an issue with the robots.txt recrawl request in Google Search Console for my website:
When I request a recrawl, I get this error:
"Recrawl request failed for
https://www.hiddenbyadmin.com/.com/robots.txt"
The robots.txt file is publicly accessible, and we recently migrated our website from the non-www version to the www version using 301 redirects.
Could someone help me understand:
- Can Googlebot access the robots.txt file successfully?
- Are there any redirect, DNS, server, or crawl issues?
- Is this a temporary Google Search Console issue, or do I need to make changes to my website?
Any suggestions would be greatly appreciated.
Thank you!