Posts Tagged ‘experiments’

Ranking versus indexing – update

Friday, August 8th, 2008

Back after a week or so’s total inattention, and an interesting pattern is emerging. With the power of external links beginning to kick in, the home page for the site is now ranking at #5 in the big G for the familiar phrase. However, all of the non-blog pages appear to have disappeared from the index – at least, those few that were there already. None are currently indexed.

I suspect that this is part of a general fluctuation common with new sites, but I’d make the following observations. 

  1. The blog pages aren’t affected by this. Those that are set to be indexed are there in the big G index.
  2. Since the last update I’ve introduced an XML sitemap with all URLs in there (which updates with any new blog posts). So far no beneficial effect for non-blog pages.
  3. Some of the inbound links are showing in G webmaster tools now, but I suspect that this ranking means that all have been taken into account. The most powerful link is on a page that has now been crawled since the link was introduced.
  4. None of the links is from a page relevant to the subject matter. 
  5. Yahoo is not indexing anything but the homepage at present. Site Explorer is however showing links to pages other than the home page. I’m not quite sure how Y can count links to pages that it doesn’t recognise as indexed.
No firm conclusions as yet. Tentative conclusions are:
  • Using a blog platform is better for getting your pages indexed than hand-crafting HTML
  • Possibly this effect is helped by tagging, as other sites collate, aggregate and link to posts based on tagging
  • It’s easier to get one page to rank for a search term than it is to get a suite of pages into the index
However, at present it is also making it difficult to draw conclusions about either the CSS/picture experiment or the anchor text/noindex experiment.

The importance of a controlled environment

Thursday, July 24th, 2008

The meta-experiment relating to indexing is over, having fallen victim to a failure to maintain a hermetically sealed environment for the experiment.

The idea was to see whether pages from the site would be indexed by Google when they had no external links and no submission to Google had been made.

Despite the fact that no submission has been made and no links sought or set up, one has crept through.

It seems that Technorati have some detail about this blog, presumably through some hook-up with Wordpress. The relevant Technorati pages don’t currently appear in the Goo index, but this aggregator is picking up and publishing blog posts from Technorati with certain tags, in this case “w3c”, and publishing them.

All very interesting in itself, but it does rather blow the intended experiment. Which just goes to show how hard it is to maintain a hermetic environment for experiments on the web.

Anyhow, now that it’s blown, I can pump in a bit of link juice from elsewhere – I need the pages to be indexed for current and future experiments.