The Dances are gone now. Google uses a different strategy. There are billions of pages, and the indexing challenge for returning the good sites to a searcher was too big for “the old way”.

Google now tries to return only pages with good ranking that are relevant to the search. These are indexed every month or less - some indexed every day. The main page of this site was indexed less than a week ago. The more important your page, the more often Google will index it. Sites considered less relevant are banished to the supplemental index. These are only returned to the searcher if Google can’t find much matching the site. These pages are indexed much, much less frequently if at all. If one of these pages is returned in a search, it is marked supplemental. Here is an example from our business site:

Comments on: Not getting a good Google position?
http://www.netadventures.biz/wordpress/2005/07/19/not-getting-a-good-google-position/ Building Web Sites that work.. Tue, 30 Jan 2007 16:32:58 +0000 …
www.netadventures.biz/wordpress/2005/07/19/not-getting-a-good-google-position/feed/ - 1k - Supplemental Result - Cached - Similar pages
Don’t worry if some of your pages get into the supplemental index. We have thousands of pages in our site and a good number in the supplemental index. We just make sure the important pages aren’t there. Our book shows you how to get your pages out of the supplemental index.

To see if you have pages there, search your site on:

site:www.netadventures.biz *** -yuiopjkl

where the domain specified is your own. Use the three asterisks and any nonsense string with a minus sign in front of it. Avoid any special characters in the string. This is an undocumented feature, so don’t trust it too much.

PS - yes, we know there are some bad links in this site. We are working on that.

We had a massive spam load toward the end of February as some black botnet launched an attack on us. We’ve collected all the hosts involved and posted them at:
http://www.creatingnewworlds.org/badhosts.htm.

Please help us kill all of these hosts. Each one is doing illegal activity. Moreover, we’ve also posted this on digg.com at:
http://www.digg.com/search/page3?s=spam&area=all&type=both&search-buried=0&age=7&sort=new&section=news

Please “digg” this article to help move it to the first page.

Our goal is to move links to the badhosts listing and the larger list to over a 100 blogs to really kill the hosts involved, but this takes time and financial resources.

Magazines and the rest of the media is not doing much on this. Probably afraid of being sued by the hosts. The government has failed us in this - which means the Republicans are dead in the next election. It’s up to the millions of users to stop this. Take the hosts down.

This ranking was the result of what is popularly known as a Google Bomb. People set their websites with a link to the bio page with the phrase “miserable failure” in the visible part of the link. They get their friends to do the same thing, and their friends to…you get the idea. Soon you have thousands of links to the Bush bio site, all with the same visible link or variation of it. The practice is called Google bombing. It was used to push many sites to the top of the ranks.

No more. Google has changed their ranking algorithm to detect such Google bombs and direct you to sites that discuss the practice instead. Yahoo, MSN, and other search engines l will still give you that bio site at the top of the list. Has Google gone Republican?

http://www.mattcutts.com/blog/.

Check it out - search by topic or scan the archives.

A good recent posting is available at:

http://www.mattcutts.com/blog/infrastructure-status-january-2007/

This describes some of where Google is going in 2007. It’s a little big of technical stuff here, but those supplemental results he mentions are the listings Googe returns when it can’t find enough information on a search in its main database. These are labeled as such in the return from a search. Obviously, that isn’t a good place for your site to be listed. If you are there, it generally means you have a weak image to the search engine (too few links to your site?) or you are doing borderline spamming of the search engines. Matt says it basically means you have low PageRank.

A bit of terminology here. DMOZ is the directory name. It is the product of ODP, the Open Directory Project. The editors that keep it updated are ODP editors, not DMOZ edtors.

If you have followed our directions for getting listed in DMOZ in our book, you will notice these directions haven’t worked lately. The problem is that DMOZ crashed in late October. In addition, there wasn’t adequate backup. The directory was patched back together with clones from various sites (including Google’s clone) and is now operational again. The directions in our book for getting listed are still correct once DMOZ is fully operational.

Unfortunately, if you submitted a site back then and were waiting to see it listed, your request is probably lost. Check the DMOZ, and it you are not there try to submit it again. We’ve noticed in the categories we’ve tried they aren’t quite ready for submissions yet. Just keep watching for your category to get back up. Then submit again. Getting your site listed here is important.

They are also on our short list of the most serious offenders. This list is at:
http://www.creatingnewworlds.org/badhosts.htm

We use Comcast broadband services at the moment, but do not use their email because of these serious problems. We had our Comcast address deleted from our email program when we saw strong evidence that they had sold our address and we started getting spam on the Comcast address. Since we never used the address, the only way anyone could have gotten it was from Comcast.

Our advice to our clients: Don’t use the Comcast POP server for your email, and don’t use a Comcast email address on any other hosting system for people to contact you. You could very well never get that email from a potential client from Comcast blocking. And Comcast won’t tell you what they are doing. Nor can you recover damages.

Another one from Romania that causing a lot of problems is: rdsnet.ro. Here’s the documentation for those wishing to kill it:

Project HoneyPot

The users must pick up the war here. Our black list of illegal spamming hosts is at:
http://www.creatingnewworlds.org/stopspam.pdf.
We’ve also added a few wimpy registrars there that are part of the spam game.