Web site Design and Search Engine Optimization

   

 

Keyword Search Tools - Keyword Suggestion Tools - Free Keyword Tools - Keyword Research

 

 

Keyword research is the science of discovering keywords that internet surfers are using to find the information they seek. It is estimated that search engines such as Google and Yahoo provide 8% of traffic to websites.

  • The success of a Website is dependant on the quantity and quality of its content.
  • The content should be structured around keywords.

No keyword research tool can accurately identify every search conducted for a given keyword.

Keyword research tools provide access to databases of information provided by the search engines.

Each keyword tool database is subject to their sources and they all use different sources.

As a result:

  • The numbers of searches reported by the different tools vary.
  • KEI calculations will differ.

Until recently, Google, the largest source for search engine keyword referrals, only provided relative frequency graphs.

From July 2008, Google has commenced offering actual numbers of searches for the previous month. 

 

OVERTURE KEYWORD SUGGESTION:

The first keyword tool that actually gave SEO keyword selection was Overture Keyword Suggestion Tool (now owned by Yahoo).

This tool is is dying. The keyword counts have not been updated since January 2007 and Yahoo! publicly said they will no longer support or maintain it. Overture's keyword suggestion tool was a great tool whose purpose was to promote Overture (or Yahoo Search Marketing).

A number of software developers created keyword tools that bombard this database with so many requests that the tool barely (if ever) responds any more. Overture used to get a good number of searches per day. Here's a look back in 2003 when they received 167 million searches per day and were pretty competitive with Google at the time.

This keyword suggestion tool obtained its information from searches done on the Overture.com search engine and based the data for its keyword count over the 30 days prior to the month you would be searching for keywords. There has never been certainty of the actual size that the 30-days of database covered, but  it was  sizeable as it produced counts considerably higher than other keyword sources.


The creators of WordTracker, discovered back in 2000/2001 that the data Overture was providing in their Keyword Suggestion Tool was NOT producing the kind of traffic promised for them or their SEO clients. In otherwise, it was inaccurate.

When they analyzed what was going on and why the traffic for a specific keyword did not produce the results the Overture keyword suggestion tool promise, they Apparently, the problem is that when business and bid management companies used automated scripts to query Overture.com about a particular bid position for their paid results, each time a robot searches for a keyword phrase, that query WILL count toward the Keyword Suggestion Tool count. This could potentially increase the numbers and give you inaccurate figures to base your research upon.

The following table demonstrates some problems.

 

  Date ymmdd Keyword Tool Keyword Searches Google results R/S KEI  
A 80407 Overture life expectancy 5627 7040000 1251 4.5  
  80623 Overture life expectancy 5627 9550000 1697 3.32  
                 
B 80623 WordTracker life expectancy 307 12200000 39739 0.01  
                 
C 80624 Keyword Discovery Premium life expectancy 999       365 days
  80624 Keyword Discovery Historical life expectancy 64992       365 days
                 
D 80624 Keyword Discovery Historical life expectancy 5,333       30 days
                 
                 
E 80623 WebWords life expectancy 911 9,550,000 10483 0.09  
F 80717 Google life expectancy 368,000 12,200,000   11100  
G                

A:

The results using Keyword Analyzer (Overture) shows that there is no apparent change in the number of searches in "the preceding month" for the keyword "life expectancy" - not surprising as Overture is not being updated. The Google results has increased suggesting an increase in R/S and fall in KEI - You are more likely to achieve high rankings for keywords with low R/S and high KEI.

Overture is a free tool - http://inventory.overture.com/ It is so popular that it is virtually impossible to link to it.

Keyword Discovery Historical is also free and provides a database of similar size. - http://www.keyworddiscovery.com/search.html - It is not as well known and seems to be more accessable.

F:

Note the relatively high number of searches as shown by Google and the increased KEI.


WORDTRACKER


WordTracker is the first real keyword tool that offered a real toolset to harvest and analyze keywords.

Wordtracer utilised their observation that the keyword data and information collected by Meta Search Engines allowed them to avoid the automated robot searches that was inflating keyword count with the Overture tool.

These search engines do not attract that much attention from robots because they do not offer pay-per-click services and most Internet marketers tend to focus on the big three engines like Google, Yahoo and MSN. Results on Wordtracker therefore are more accurate when it comes to gauging what kind of traffic you may receive when ranking on Page One for a specific keyword.

It acquires search eengine logs from two search engines  DogPile.com and MetaCrawler.com, both meta search engines.

So this collective data that WordTracker receives from Dogpile.com and MetaCrawled reflects keyword phrase counts over the past 90-100 days, and their database during that period of time is usually between 300-340 million keywords.


InfoSpace, Inc., which owns both Dogpile.com and Metacrawler.com, occupy about .5% (point 5 percent) of the entire searches on the Internet (it was .9% as reflected in that 2005 chart).

This ultimately means that there is at least 99.5% of the rest of the world's search data, 96% of which is housed by Google, Yahoo, MSN, AOL and Ask.com.

Whiile WordTracker is the most accurate of the entire bunch of databases, it is far from being scientifically accurate.

So when you want the freshest keyword data for your project, do not hesitate to think twice and use WordTracker as the source.

KEYWORD DISCOVERY:

From 1999 until mid 2005, WordTracker was really the sole and dominant force as a keyword research service and source of keywords.

There were other keyword services who tried to penetrate the market and failed -- but most keyword tools that came out were usually desktop tools that used the FREE Overture keyword suggestion tool as the source of data. And those developers are now nowhere to be found in the wake of the Overture keyword tool's virtual demise.

Then, around July 2005, Keyword Discovery emerged onto the scene with what seemed to be this massive keyword database of 32 - 35 billion keywords that would overshadow and compete in a major way with WordTracker's keyword database.

Keyword Discovery said that their database contained keyword data from major search engines (some of which were Google, MSN, Yahoo, Alta Vista and many others) and that their database was in the billions.

The keyword database was large and it gave count numbers in the millions for a good many number of main keywords.

However, the problem occurred that the count were overblown, much like the Overture tool's inflated numbers as a result of automated keyword scripts, ranking tools and big management script that would hit the large search engines where the data came from.

The one major advantage to the data collected in this database was it spanned over a period of one year, so seasonal terms could be mined, but the huge search count figures brought into question the accuracy (or inaccuracy) of the search count.

This was something Keyword Discovery had to address and they did so with a new database called their Premium Database.

The first large database Keyword Discovery started out with that contained around 35 billion keywords was moved into a secondary archived position called the Historical database - the Global Historical database.

Then the Premium Database was moved into the forefront as the default database. The advantage of the new database was that Keyword Discovery could segment the searches done in different countries.

This new Premium Database was initially comprised of 4,000,000 (4 million) private panel users and the promise of this database would be that it would alleviate any skew from actual robotic scripts and bid management tools check.

The parent company of Keyword Discovery, Trellian, Inc., distributes a toolbar from its site and other various sites.

Whenever someone uses that toolbar installed on their desktop computer, it not only acts as a tool for the consumer, it also reports back to the Keyword Discovery Premium Database that someone made a search on a particular search engine.

Since the data that is collected reports directly back from the toolbar itself the data is not from search engine logs, there is no potential for skew in the search count whatsoever.

There was a huge and dramatic shift in the search count numbers going from the now Historical archived database and moving to the new Premium Database.

NicheBOT users that utilized the older archived historical database were shocked at how low the numbers were at first because the database size was quite small when you consider there were only 4,000,000 users as the sample size and we know the Internet to have 1.5 billion users.

So with the WordTracker database and the Keyword Discovery database, keyword research is not particularly accurate as the data is relatively small, but it is representative and certainly better than guessing.

Google certainly is a better way to confirm whether a keyword has some true volume on a particular keyword phrase or not.

GOOGLE KEYWORDS

Google is currently the most used search engine.

 



Google does not allow you to view any exact search volume counts with any specific number.

Google displays a bar graph from 1 to 5 with the number 1 representing a very low search volume and 5 representing extremely high search count.
The following is a typical graph:




Some experts recommend that if you are using WordTracker or Keyword Discovery to find the high volume keywords to check against the Google Search Volume graph shown in the above screenshot. It's always best to verify one smaller source against the biggest available source.

Here's a screenshot of a Google Trends graph:



And since, once again, Google does not show the actual search count in the trends graphs, there's no real way to show a comparison of popularity from one keyword overlapping another. Google's keyword engine discovering keywords that may not be identifiable from other services.

Keyword Analyzer

This is my first choice keyword research tool. It utilises the overture database. Although this is no longer current, Google Trends (see graph above) demonstrates that there is no significant shift in the number of searches being conducted for the keywords that I am seeking.

A useful feature that can be utilised with Keyword Analyzer is the "Results in Quotes" when searching with Overture. (Settings> Campagne - Get Results in Qoutes. This returns the Google results for a narrow search. Using the example of life expectancy table, there are 280,000 webpages on broad search and 14700 with narrow search. This feature identifies lower R/S and higher KEI. "Life expectancy table" has a reasonable number of searches and would therefore be a useful keyword phrase to target.

 

  Keyword Searches Google results R/S KEI
  life expectancy 5627 10800000 1919 2.93
Results in Quotes life expectancy 5627 9530000 1694 3.32
  life expectancy table 1343 280000 208 6.44
Results in Quotes life expectancy table 1343 14700 11 122.7
  life expectancy calculator 1029 254000 247 4.17
Results in Quotes life expectancy calculator 1029 31100 30 34.05
  average life expectancy 642 1820000 2835 0.23
Results in Quotes average life expectancy 642 762000 1187 0.54
 

Keyword Analyzer also provides the option to utilise national data. There were 356 searhes for "accountant London" on overture.com but 3,206 searches with overture.co.uk. The KEI is also reasonable.

    Keyword Searches Google results R/S KEI
Broad Search Overture.com accountant 253545 43900000 173 1464.35
Broad Search Overture.com accountant London 356 328000 921 0.39
Broad Search Overture.com tax accountant 98286 2080000 21 4644.3
             
Narrow Search Overture.com accountant 253545 43900000 173 1464.35
Narrow Search Overture.com accountant London 356 51600 145 2.46
Narrow Search Overture.com tax accountant 98286 1940000 20 4979.45
             
Broad Search Overture UK accountant London 3206 327000 102 31.43
Broad Search Overture UK accountant 187425 43800000 234 802.01
Broad Search Overture UK tax accountant 75640 516000 7 11088
80621            
Narrow Search Overture UK accountant 187425 43800000 234 802.01
Narrow Search Overture UK accountant London 3206 51600 16 199.19
Narrow Search Overture UK tax accountant 75640 243000 3 23544.9


By searching for "accountant London" on overture.co.uk a number of additional useful keyword phrases are revealed by Keyword Analyzer.

 

    Keyword Searches Google results R/S KEI
Narrow Search Overture UK accountant London 3206 51600 16 199.19
Narrow Search Overture UK chartered accountant London 350 4960 14 24.7
Narrow Search Overture UK accountant in London 188 10700 57 3.3
Narrow Search Overture UK accountant greater London 181 5090 28 6.44
Narrow Search Overture UK accountant north London 135 884 7 20.62
Narrow Search Overture UK accountant central London 37 846 23 1.62
Narrow Search Overture UK accountant west London 32 1170 37 0.88
Narrow Search Overture UK tax accountant London 27 2810 104 0.26
Narrow Search Overture UK