Comments on: Questions for Tim Converse about Content Classification?

By: Ian Saunders

Ian Saunders — Sun, 14 Nov 2004 20:51:17 +0000

Hi Tim
Are your algorithms able to automatically recognise the context of a page?
Are the keywords that you retain, representative of the context or simply representative of being present on the page in question?

By: Paulo

Paulo — Thu, 04 Nov 2004 22:01:32 +0000

What about prank sites with wildcard subdomains, like IsGay and WasArrested, which repeatedly mangle the results for my name -- http://search.yahoo.com/search?p=ordoveza (which is an issue I've tried to raise with Yahoo before)? Aren't these artificially inflating their own rankings by making themselves appear to be more sites than they are? How do you plan to filter these?

By: eileen kowalski

eileen kowalski — Thu, 04 Nov 2004 01:05:59 +0000

Hi Tim and Jeremy,

Thanks for hosting an open Q&A session. I just have a few questions:

1. I noticed that you said “algorithmically classify web pages” above. What do you think about the new MSN Search’s Block Level Analysis? Do you believe that one page can contain content that is relevant to disparate categories or does there always need to be an overarching theme?

2. Is your categorization system based more on creating an ontology that lasts or being able to create an ontology that morphs along with user behavior?

3. In mid-October, I posted about the 301 redirect issue on Jeremy’s blog since I was seeing websites with 301 redirects being penalized for having “duplicate” content. Now, I’ve seen some websites with redirects regain their rankings, but the pages are ranking under the old URLs and the new URLs are not being indexed. Is there still work being done on the 301 issue? And do you have any idea on when it will be resolved?

Thanks again for your time and consideration. I look forward to reading the upcoming discussion.

By: Karl

Karl — Wed, 03 Nov 2004 19:07:01 +0000

Hello Tim,
A competitor of mine has 4 websites with identicle content. All 4 sites have a page ranked quite high on Yahoo! SERPs for “luray va cabin rentals”. The SERP pages are different from each other but again all 4 pages are on each site.

I have reported this to you as Index Spamming a couple of times but the 4 websites are still in business. IS HAVING MIRROR WEBSITES NOT CONSIDERED INDEX SPAMMING ANYMORE??

Thanks for your response,
Karl Baldwin

By: Will Fitzgerald

Will Fitzgerald — Wed, 03 Nov 2004 01:54:54 +0000

Hey Tim,

Does/will the content group make any use of the Yahoo! Directory? Or other human-created directories and/or ontologies?

By: david

david — Wed, 03 Nov 2004 00:55:40 +0000

Tim: Can you talk about how Y! sees spam versus ham? (The i’d tell you, but i’d have to kill you response works..)

Do you use any open source solutions in the process, perhaps SpamAssassin’s engine?

By: Nacho Hernandez

Nacho Hernandez — Tue, 02 Nov 2004 23:50:17 +0000

Great Blog Jeremy!

Hello Tim: Perhaps you can tell us a little bit more about how you guys are capable of spotting correlations between categories and how that can affect the classification of web pages within the software’s algorithms?

Thanks!

Nacho Hernandez