...

Crawling and Indexing

  • AMP on Google Search

    As more people access the web on mobile devices, speed and performance have become critical for both user experience and SEO. To address this, Google introduced AMP (Accelerated Mobile Pages),...

    Read More
  • APIs-Google User Agent

    When learning about Google crawlers, it’s easy to think that all of them are focused on indexing and ranking your website. But Google has several crawlers with special purposes that...

    Read More
  • Ask Google to Recrawl Your URLs

    What “Recrawling” Means for You When you make a change to your website like fixing a typo, updating content, or adding a new page you want a search engine to...

    Read More
  • Crawl Budget

    Google’s bots are constantly crawling the internet, but even they have a limited budget. A crawl budget is the number of pages Google’s bots will crawl on your website within...

    Read More
  • Crawl Stats Report

    Have you ever wondered what’s going on behind the scenes of your website’s SEO? The Crawl Stats report is like a secret window that shows you how search engines are...

    Read More
  • Enhance AMP Content for Google Search

    Accelerated Mobile Pages (AMP) are built to make web pages load quickly, especially on mobile devices. While speed is the foundation of AMP, speed alone does not guarantee strong visibility...

    Read More
  • Feedfetcher

    When we think about Google crawlers, most people only know about Googlebot, the main crawler for indexing web pages. However, Google also uses other crawlers that serve different purposes. One...

    Read More
  • File Types Indexed by Google

    The Big Picture: More Than Just Web Pages When you think of a search engine, you probably think of a tool that finds websites. But a search engine’s world is...

    Read More
  • Google Coverage Statuses

    When you create new content, search engines try to crawl and index it. The Coverage Status tells you what’s happening with that process. It shows you the status of your...

    Read More
  • Google Read Aloud User Agent

    What is the Google Read Aloud User Agent? In the past, a search engine was all about text. But with the rise of voice search and smart devices, a search...

    Read More
  • Googlebot

    Before we dive deeper into SEO technicalities, it’s important to understand the role of Googlebot, the crawler at the heart of Google Search. In this section, we’ll explore what Googlebot...

    Read More
  • How AMP Works in Search Results

    Before diving into the technical details, it’s important to step back and understand how AMP works, why AMP matters in the first place. Google Search is designed to give users...

    Read More
  • How HTTP status codes, and network and DNS errors affect Google Search

    Why Technical Errors Matter for SEO When someone clicks on your website, their browser asks your server for the page. If everything works, the page loads normally. But if there’s...

    Read More
  • Image Sitemaps

    What is an Image Sitemap? An image sitemap is a special file that gives a search engine detailed information about the images on your website. While Google can crawl images...

    Read More
  • Large Site Owner’s Guide to Managing Your Crawl Budget

    Managing a large site is not just about publishing content and updating pages it’s also about making sure search engines can find and index the right pages at the right...

    Read More
  • Link Best Practices for Google

    The Big Picture: How Links Work for Your Website In the world of SEO, a link is a signal of trust and authority. A link is a connection from one...

    Read More
  • List of Google User-Triggered Fetchers

    Why User-Triggered Fetchers Matter Sometimes, a search engine’s crawlers don’t come to your website automatically. Instead, they are triggered by an action you or another user takes. These are called...

    Read More
  • List of Google’s Common Crawlers

    Google uses automated bots, known as crawlers, to discover and index content across the web. These crawlers don’t just fetch your site once different types of crawlers are assigned to...

    Read More
  • List of Google’s Special-Case Crawlers

    Besides the common crawlers like Googlebot for web, images, and videos, Google also runs special-case crawlers. These are designed for specific purposes such as site verification, structured data testing, or...

    Read More
  • Managing Crawling of Faceted Navigation URLs

    When you visit a large online store, you often see a set of filters on the side of the page. You can filter products by things like color, size, or...

    Read More
  • News Sitemaps

    Why News Needs a Special Sitemap In the fast-paced world of news, every second counts. If you publish a news article, you want it to be indexed by a search...

    Read More
  • Redirect

    In the world of website management, a URL redirect is a way of sending visitors from one web address to another automatically. It’s a fundamental part of keeping your site...

    Read More
  • Reduce the Google Crawl Rate

    When Googlebot crawls your website, it tries to balance two things: discovering new content quickly and not overloading your server. In most cases, Google automatically manages the crawl rate efficiently....

    Read More
  • Remove AMP Pages from Google Search

    Sometimes a website owner may decide that AMP is no longer the right fit. This could be because maintaining AMP pages requires extra work, or because modern mobile pages already...

    Read More
  • Removing pages from Google and Bing

    As an SEO, you’re usually trying to get your content indexed by search engines. But sometimes, you need to do the opposite and remove a page from search results. This...

    Read More
  • Robots Meta Tags

    Have you ever wondered how to tell a search engine not to look at a certain page on your site? That’s what a robots meta tags are for. It’s a...

    Read More
  • Robots.txt Blocked

    Have you ever gotten a notification from Google that says some of your pages are “Indexed, though blocked by robots.txt”? This can seem confusing because these two things shouldn’t happen...

    Read More
  • Validate AMP Content for Google Search

    Validate AMP Content Before AMP content can perform well in Google Search, it needs to be valid. Validation ensures that AMP pages follow the required technical standards and are properly...

    Read More
  • Verifying Googlebot and Other Google Crawlers

    Every website receives traffic from bots, but not all of them are trustworthy. Some bots pretend to be Googlebot, hoping to sneak past your security and scrape your content or...

    Read More
  • Video Sitemap

    What is a Video Sitemap? A video sitemap is a special type of sitemap file that provides search engines with extra information about the videos on your website. Just like...

    Read More
  • XML Sitemap

    An XML sitemap is essentially a road map of your website for search engines. It’s a file that lists all the important pages, videos, and images on your site that...

    Read More

SEO Academy

  1. AMP