If a page isn’t in Google’s index, there’s 0% chance that it will receive organic traffic.
Indexation, in an over simplified nutshell, is step 2 in Google’s ranking process:
This article will focus on how to get Googlebot to index more pages on your site, faster.
Read my post about managing your website’s crawl
How to check if your pages are indexed by Google
The first step is understanding what your website’s indexation rate is.
Indexation rate = # of pages in Google’s index / # of pages on your site
You can review how many pages your website has indexed in Google Search Console’s “Index Coverage Status Report“.
If you see errors or a large number of pages outside of the index:
- Your sitemap might have URLs that are non-indexable (i.e. pages set to NOINEX, blocked via robots.txt or require user login)
- Your site might have a large number ‘low quality’ or duplicate pages that Google deems unworthy
- Your site might not have enough ‘authority’ to justify all the pages
You can dig into the specifics in the table underneath (this is an awesome new feature in Google’s updated Search Console).
How to get pages on your site indexed
I hate to be cliche, but you really need to deliver the right experience to get Google’s attention. If your site doesn’t meet Google’s guidelines in regards to trust, authority and quality, these tips will likely not work for you.
With that being said, you can use these tactics to improve your site’s indexation rate.
1. Use Fetch As Google
Google Search Console has a feature allowing you to input a URL for Google to “Fetch”. After submission, Googlebot will visit your page and index.
Here’s how to do it…
- Log into Google Search Console
- Navigate to Crawl Fetch as Google
- Take the URL you’d like indexed and paste it into the search bar
- Click the Fetch button
- After Google had found the URL, click Submit to Index
Assuming the page is indexable, it will be picked up within a few hours.
2. Use internal links
Search engines crawl from page to page through HTML links.
We can use authority pages on your site to push equity to others. I like to use Ahrefs “best pages by links” report.
Recommended for You
This report tells me the most authoritative pages on my site – I can simply add an internal link from here to a page that needs equity.
It’s important to note, the 2 interlinking pages need to be relevant – it’s not a good idea to link unrelated pages together.
Read my guide about internal linking silos
3. Block low quality pages from Google’s index
While content is a cornerstone of a high quality website, the wrong content can be your demise. Too many low quality pages can decrease the number of times Google crawls, indexes and ranks your site..
For that reason, we want to periodically “prune” our website’s by removing the garbage pages
Pages that serve no value should be:
- Set to NOINDEX. When the page still has value to your audience, but not search engines (think thank you pages, paid landing pages, etc).
- Blocked via crawl through Robots.txt file. When an entire set of pages has value to your audience, but not search engines (think archives, press releases).
- 301 redirected. When the page has no value to your audience or search engines, but has existing traffic or links (think old blog posts with links).
- Deleted (404). When the page has no value to your audience or search engines, and has no existing traffic or links.
4. Include the page in your sitemap
5. Share the page on social media
Google+ is the fastest and easiest platform to get your backlinks indexed.
I use my personal Google+ profile to index about 50% of my site’s backlinks. That includes links built on private blog networks.
6. Share the page in high traffic sites
Social bookmarks are links from highly crawled sites like StumbleUpon, Diigo and Reddit.
If you’ve got your own accounts, use these. If not, use Rank Crew. They provide 30 social bookmarks for $4 and 50 for $5.
The bookmarks are 100 times better than Fiverr gigs and they’re not spammed to death with garbage sites.
7. Create content more frequently
8. Secure external links to the page
As previously mentioned, Google crawls from page to page through HTML links.
Getting other websites to link to yours is not only a huge ranking factor, but a great way to pick up the indexation of your website.
The easiest ways to get links:
- Guest post on a relevant, authoritative website
- Find relevant bloggers or media sites and reach out with an advertising request
This is grossly over simplified – you can check out my top link building tactics for more ideas.
9. “Ping” your website
Sites like Ping-O-Matic that send “pings” to search engines to notify them that your blog has been updated.
Honestly, it’s not the greatest method – but it’s fast, free and easy to use
Site Search 360 Trends