https://updatedideas.com/technical-seo-what-things-impact-the-crawlability-of-search-engine-bots/
Technical SEO - What Things Impact the Crawlability of Search Engine Bots?