The dominant search engine is Google. That is well understood by the average Internet searcher and by search engine optimization professionals (SEOs). Google currently is the largest volume player on the search engine landscape. With the recent announcement of new search technology, the giant Microsoft Corporation plans to make inroads into Google’s search leadership position.

Most optimization efforts by website owners and search engine optimization experts have been geared toward achieving high search engine rankings in Google. With the marketing and financial muscle of Microsoft behind the revised MSN Search, some thought should be given to ranking well in that search engine too.

The question faced by SEOs and by the many millions of website owners is whether their Google optimization techniques will play well with MSN Search as well.

The good news for most website owners is much of the website optimization value for Google is also helpful in MSN Search. The differences are more those of component emphasis between the two search algorithms rather than diametrically opposed techniques. While many standard Google optimization methods will also work well in MSN, there are many other optimization applications that require more attention.

By understanding the similarities and differences between the MSN and Google search algorithms, it is possible to secure high rankings in both search engines.

One of the first important articles I wrote for SEO Chat covered click fraud. A year and a half later, two search engines (Google and Yahoo) settled click fraud class action lawsuits, but the problem is still with us, and shows no sign of going away. That’s just a small part of what Outsell is telling us with the results of its survey.

As I mentioned, the company conducted the survey in May. More than 400 online advertisers responded, with yearly advertising budgets ranging from several thousand dollars to more than $10 million. Together, these advertisers control about $1 billion per year of online advertising money.

That might seem like a drop in the bucket for more conventional advertising, but for Internet advertising, it’s a very significant fraction of a growing field. According to research firm eMarketer, this market was worth $10 billion in 2005 and will be worth more than $15 billion in 2006. Google and Yahoo together will capture nearly half of that market. So Outsell’s study examines the online marketing experiences, monetarily speaking, of about ten percent of the customers. Outsell describes those who responded to the survey as a representative cross section.

So what did Outsell find in its survey? According to some figures, it found a $1.3 billion problem with click fraud. While there have been percentage estimates of the problem before, few actually put a dollar amount on it. And how did Outsell come up with that figure? Apparently, all it did was apply simple math to the results of its survey.

The reasons for that are three-fold. First, every single website is different. Second, we have no idea what we're dealing with just by glancing at a site. Lastly, and most importantly, we spend a large amount of time performing the analysis because it's such an important part of putting together a plan for a site's SEO project.

While this might appear at first to be not a particularly earth-shattering revelation, it surprises me how many so-called SEOs don't actually do an initial site analysis.  Another thing that gets me shaking my head is the standard single page of statistics that many SEO firms consider to be an analysis. In this article, I'm going to share with you a couple of secrets to finding out what may really be going on with your website that we always look at during the course of an SEO analysis.  But first, I want to show you a few so-called SEO analyses that quite frankly have me hopping mad.

I am a firm believer in looking at the entire SEO picture.  There is no magic formula to optimizing a website for search engines; no secret formula to that winning combination. There are, however, a few foundational aspects of good, basic SEO.  One of those is the analysis.

Now I don't want to sound like a suspicious, cynical individual who can find nothing better to do than to "spy" on my competition. I do, however, try to find out what other SEO firms are doing for my own benefit. So when a company offers a free analysis, I ask for one. I have several other websites that honestly have nothing to do with SEO. I have my own personal website with a blog, pictures of my kids, and my writing portfolio. I frankly don't have time to optimize it well. But I'm not really looking to gain a bunch of visitors to my site from the search engines; it's just my own outlet for personal stuff. So usually I ask for an analysis on this site. I also dabble in some web design, and occasionally, I'll want an analysis on that site, too. I usually reserve asking for the analysis on the last one for when I run across a particularly obtuse company who may not notice the many blurbs or links I have to my SEO site. 

In my own research and desire to streamline my own analysis efforts, I have compared my information over the span of a few months. These are just a few of my findings.

The company unveiled the new service at the O'Reilly Open Source Developers Conference. It's called Project Hosting, and like all Google betas, it's free to use, though you do need to have a Google account. The service is supposed to give open source software developers a web-based ability to track bugs and other issues with their software, collaborate, and otherwise handle the many details involved in working on and coordinating an open source project.

The search engine wars are fought with strategies, alliances, and robots. As Yahoo! primes itself to be the number one contender for market share after Google, websites that want to optimize for Yahoo must study how Yahoo ranks pages and how it indexes pages. The Yahoo web crawler SLURP should be studied; your site server logs should have recorded visits from various robots, including SLURP. If you do not have records of SLURP visiting your site, then this article will give tips on how to get SLURP to crawl (hopefully deep crawl) your site.

The Preamble

Yahoo SLURP evolved from Inktomi SLURP. The Yahoo SLURP robot is an upgrade from Inktomi’s SLURP. Yahoo used Inktomi’s search engine to replace Google, which used to take care of its search results. This officially triggered the second search engine wars (the first was won by Google without it declaring hostilities).

Yahoo has at least 130 million registered users on its network. Granted, Google is the definitive search engine, but Yahoo is large enough that it should not be ignored.

Behavioral marketing has actually been around for a few years. In its crudest form, pre-Internet, it may have consisted of special mailings to repeat customers. Today, behavioral marketing involves serving up ads to a particular individual based on his or her previous online behavior. It is not to be confused with contextual advertising, which serves up ads that are related to the content of the web page on which they're appearing.

This means that two people seeing the same web page could see completely different ads. For example, let's take two surfers, one an outdoorsman who likes to visit hiking-related websites, another a big theater buff. They're both planning a visit to South Florida. Maybe they both end up on the same site with general information about the area, but the outdoorsman sees ads for the local parks or hiking groups, while the theater enthusiast sees ads for tickets to upcoming theater performances.

You can probably see why many online advertisers are very excited about behavioral marketing's potential. It promises the ability to reach an even tighter audience with more relevant ads than contextual marketing can achieve. In theory, this means advertisers can show (and pay for) fewer impressions of their ads, while enjoying a higher click-through rate - and more importantly, a higher conversion rate.

With this kind of potential, you would expect to see a lot of advertisers eager to try out this new form of online marketing. The truth is a little more mixed. According to figures quoted by Search Engine Watch, only eight percent of all online advertising is behaviorally targeted. That number seems a little low, but there are reasons for this, as I'll go into shortly. Some of them will become obvious when I explain more about how behavioral targeting actually works.