Crawlers Can't Always Access Infinite Scroll And if crawlers can't access it, the page may not rank. When using infinite scroll for your site, make sure there is a series of paginated pages in addition to the long scroll. Make sure you implement replaceState / pushState on the infinite scroll page. This is a fun little optimization that most web developers aren't aware of, so be sure to check your infinite scroll for rel =" next " and rel =" prev " in the code. 4. Google doesn't care how you structure your sitemap As long as it's XML, you can structure your sitemap however you like - the category breakdown and overall structure is up to you and won't affect how Google crawls your site. 5. The noarchive tag will not hurt your Google rankings This tag will keep Google from showing the cached version of a page in its search results,
but it will not negatively affect that page's overall ranking. 6. Google usually crawls your homepage first It's not a rule, but generally speaking, Google usually finds the homepage first. An exception would be if there are a large number of links to a specific page Shadow Making on your site. No, but it's usually the first page we find on a site. - John ☆ .o (≧ ▽ ≦) o. ☆ (@JohnMu) August 24, 2017 7. Google Rates Internal and External Links Differently A link to your content or website from a third-party site is weighted differently than a link from your own site. 8. You can check your crawl budget in Google Search Console Your crawl budget is the number of pages search engines can and want to crawl in a given amount of time.
You can get an idea of yours in your Search Console. From there, you can try increasing it if needed. 9. Banning pages with no SEO value will improve your crawl budget Pages that are not essential to your SEO efforts often include privacy policies, expired promotions, or terms and conditions. My rule is if the page is not meant to rank and it doesn't have 100% unique quality content, block it. 10. There's a lot to know about sitemaps XML sitemaps must be encoded in UTF-8. They cannot include session IDs from URLs. They must be less than 50,000 URLs and no more than 50MB. One sitemap index file is recommended instead of multiple sitemap submissions.