tag:blogger.com,1999:blog-13196976.post8801232981798765945..comments2007-08-31T23:36:59.121-04:00Chrishttp://www.blogger.com/profile/01386406270744275223noreply@blogger.comBlogger3125tag:blogger.com,1999:blog-13196976.post-52350237617515908492007-08-31T22:55:00.000-04:002007-08-31T22:55:00.000-04:002007-08-31T22:55:00.000-04:00Reminds me of when I worked on the volunteer data entry project for the Illinois Pre-1916 Death Index. When Morse first added our index to his searches, the site came to a crashing halt. The poor webmaster would have to hurriedly bring the site back to life, which was especially unfortunate since we were still entering data and all work had to stop.kachttp://www.blogger.com/profile/17269203233353576287noreply@blogger.comtag:blogger.com,1999:blog-13196976.post-54589410932354044262007-08-31T14:21:00.000-04:002007-08-31T14:21:00.000-04:002007-08-31T14:21:00.000-04:00Yeah, there is a lot of duplication, but I noticed that in some cases Google indexed a message from one but not from the other. For instance, <A HREF="http://www.google.com/custom?hl=en&safe=off&client=pub-0684457556429384&cof=FORID%3A1%3BAH%3Aleft%3BCX%3AThe%2520New%2520Genealogy%2520Message%2520Searcher%3BL%3Ahttp%3A%2F%2Fgoogle.com%2Fcoop%2Fimages%2Fgoogle_custom_search_sm.gif%3BLH%3A55%3BLP%3A1%3BGFNT%3A%23666666%3BDIV%3A%23cccccc%3B&q=%22moses+dunham%22+%22Melinda+Hathaway%22&btnG=Search&cx=008603050331564176105%3Axbhj5maths0" REL="nofollow">this query</A> turns up one page from each without duplication.<BR/><BR/>Far fewer pages <A HREF="http://www.google.com/search?q=site%3Aboards.rootsweb.com" REL="nofollow">from RootsWeb</A> are indexed by Google than <A HREF="http://www.google.com/search?q=site%3Aboards.ancestry.com" REL="nofollow">from Ancestry</A>, so if I drop one it will be Rootsweb.Chrishttp://www.blogger.com/profile/01386406270744275223noreply@blogger.comtag:blogger.com,1999:blog-13196976.post-62459471614005013232007-08-31T14:11:00.000-04:002007-08-31T14:11:00.000-04:002007-08-31T14:11:00.000-04:00Chris, it may simplify your search design to use either boards.rootsweb.com or boards.ancestry.com, but not both. I think they're the same set of boards (just with two different ways in).<BR/><BR/>DrewDrew Smithhttp://www.blogger.com/profile/12537180168534039546noreply@blogger.com