Visibility

Technical SEO as part of maintenance: indexing, structure and Search Console

Technical SEO is not a one-off project. A guide to monitoring indexing, sitemaps, canonical URLs, structured data and Search Console as part of regular maintenance.

Updated

When people talk about search engine optimisation, they usually think of content and keywords. Good content does not help, however, if the search engine cannot find a page, cannot read it or is pointed to the wrong version. Technical SEO makes sure these basics are in place.

Technical SEO is not a one-off project. Updates, new plugins, added content and site changes can break things that were fine at launch. That is why it belongs in regular maintenance.

The areas of technical SEO include indexability, crawlability, site structure, speed, mobile-friendliness, HTTPS, duplicate content management and structured data. The Finnish SEO agency eLuotsi has also listed these areas on its technical SEO page (in Finnish).

The three stages of a search engine

A search engine processes a page in three stages:

  1. Discovery and crawling: the search engine finds the page through links or the sitemap and fetches it.
  2. Indexing: the search engine interprets the content of the page and decides whether to store it in its index, and as which version of the address.
  3. Ranking: the indexed page competes in the search results.

Technical SEO focuses on the first two stages. If there is a problem there, the third is never reached.

Managing indexing

robots.txt

robots.txt tells search engines which parts of a site must not be crawled. A common mistake is a block from the development phase (Disallow: /) that stays in place after launch. Note that robots.txt prevents crawling but not necessarily indexing: a blocked page can still appear in search results without a description if other pages link to it.

noindex

The noindex meta tag tells search engines not to index a page. It is used, for example, on thank-you pages, internal search results and staging environments. WordPress has a setting called "Discourage search engines from indexing this site", which is sometimes left on when a site is moved from staging to production. Check it after every move.

Canonical URLs

The same content can be available at several addresses, for example the http and https versions, addresses with and without the www prefix, and versions with parameters. The canonical URL (rel="canonical") tells search engines which version is the primary one. The canonical URL of every indexable page should point to the page itself, unless the content is intentionally a copy.

Sitemap

An XML sitemap lists the indexable addresses of a site. Submit it to Search Console and make sure it only contains addresses that return status code 200, are not set to noindex and are canonical.

Site structure and internal linking

Search engines find pages primarily through links. A good structure is shallow: important pages are at most a few clicks from the home page, and related pages link to each other with descriptive link text.

Things to monitor in maintenance:

  • Orphan pages: pages that nothing links to. Search engines only find them through the sitemap.
  • Broken internal links: deleting content or changing an address breaks links on other pages.
  • Redirect chains: a link points to an old address that redirects to another and then to a third. Update internal links to point directly to the final address.

Structured data

Structured data tells search engines in machine-readable form what a page contains. The most common types on business websites are:

Type Use
Organization / LocalBusiness Company name, logo, contact details, opening hours
Article Articles and blog posts
BreadcrumbList Breadcrumbs
Product and Offer Online shop products and prices
FAQPage Frequently asked questions

Check structured data with Google's Rich Results Test and follow the Enhancements reports in Search Console. Structured data is also useful for visibility in AI search, because it makes the meaning of the content unambiguous.

Search Console as a maintenance tool

Google Search Console is the free and most important tool for monitoring the technical state of a site. In a monthly check, go through:

  1. Pages report: why are pages left unindexed? Pay particular attention to 404 errors, soft 404 errors, server errors and "Discovered – currently not indexed".
  2. Sitemaps: has the sitemap been read successfully?
  3. Performance: changes in impressions and clicks. A sudden drop often points to a technical problem.
  4. Core Web Vitals: pages with poor experience metrics. Read more in Site speed and Core Web Vitals.
  5. Security and manual actions: notice of a break-in or a violation of Google's guidelines.

Also add a Domain property to Search Console, which covers all subdomains and both the http and https versions. That way you also see addresses on old subdomains that search engines are still trying to fetch.

Search Console can also be used to improve search visibility, for example by spotting search terms that rank just below the top, a weak click-through rate or a drop in traffic. These are covered in more detail in eLuotsi's article Google Search Console – an SEO specialist's daily tool (in Finnish).

Technical SEO after updates

Add these to your post-update check:

  • Is the site still indexable (no noindex setting)?
  • Do the most important pages return status code 200?
  • Does the sitemap work?
  • Is structured data showing correctly?
  • Have any settings changed in the SEO plugin?

Monthly checklist

  • New errors in the Pages report in Search Console
  • Sitemap status
  • Broken internal links and redirect chains
  • Core Web Vitals report
  • Changes in search visibility for the most important pages

If the site is redesigned, technical SEO takes centre stage. Redirect planning is covered in Site redesign and 301 redirects.

Frequently asked questions

How often should Search Console be checked?

Monthly is a good basic rhythm for an ordinary business website. Search Console also sends email notifications about significant problems, so make sure the notifications go to an address that is read. After a site redesign, check weekly.

Why can't my page be found on Google?

The most common reasons are a noindex tag, a robots.txt block, missing internal links, a canonical URL pointing to another page or Google simply not having visited the page yet. The URL Inspection tool in Search Console tells you why a page has not been indexed and lets you request indexing.

Does a small website need a sitemap?

A small, well-linked website will be found without one, but a sitemap helps search engines find new and updated pages faster, and Search Console reports indexing status based on it. WordPress creates a sitemap automatically.

What does structured data mean?

Structured data is machine-readable information added to a page's code, usually with the schema.org vocabulary in JSON-LD format. It tells search engines, for example, that a page is an article, a product or a company's contact page. Structured data can make rich results possible, but it does not guarantee them.

Sources

  1. Google Search Central: SEO Starter Guide
  2. Google Search Central: Introduction to robots.txt
  3. Google Search Central: Canonicalization
  4. Google Search Central: Introduction to structured data
  5. Google Search Console
  6. eLuotsi: Tekninen hakukoneoptimointi (technical SEO, in Finnish)
  7. eLuotsi: Google Search Console – an SEO specialist's daily tool (in Finnish)