Spamfilter for Searchengines

Posted by muesli in Tech & Net
Saturday, August 23. 2003

Nowadays, everybody knows (at least everyone's supposed to) about spamfilters like Bogofilter or SpamAssassin. Their task is to parse incoming mails and rate their "value". The user's task is to train the filter by telling it what is spam and what's not. After a while, the filter knows pretty well to distinguish between spam and private mails just by analyzing their words.

Today I wondered, why there's no similiar system for searchengines? Google's users should be able to tell the system whether a website is spam or not. Just imagine: millions of users should be able to create an awesome spamfilter for websites.

The only problem I see so far: The users have to learn, that they are not supposed to vote for the content itself, but for spam, porn redirects & misleading content.

What do you think?

Comments (6) - Trackbacks (0)

Trackbacks

Trackback specific URI for this entry

No Trackbacks

Comments

Display comments as (Linear | Threaded)

Sounds good, but don't you think some spammers or porn site owners would find some technique to override or manipulate this filters to get not blacklisted or more whorst get more access through this? In addition some people perhaps really suggest to get this porn redirects? Also not really a successfull hope, but a pretty good idea would to vote for the keyword relevance to a site.

#1 retak on 2003-08-24 02:59 (Reply)

yeah, that's true, such techniques are hard to implement, but in my (software developer) eyes, it has to go like that:

google tracks users via cookies. that's more or less official

so, if google recognizes a long known user with many search requests (i simply assume that google has anything like a visit-o-meter for users), give HIM the chance to vote. once per website.

so, the mass of frequent googlers is building the intelligence.

#2 muesli (Homepage) on 2003-08-24 06:50 (Reply)

I think that's what the Semantic Web will be used for/is targetted at. Classifying spam-sites will come as a bonus side effect.

So let's push RDF-metadata distribution.

#3 Garvin (Homepage) on 2005-02-12 19:50 (Reply)

true, garvin. by now, i prefer akregator over konqueror for certain tasks like reading blogs, cvs commit logs, newspapers, .... etc. etc.

more n more stuff to come. the cool thing about it: it even informs you when these sites were updated. saves a lot of time

regards,
muesli

#3.1 muesli (Homepage) on 2005-02-15 01:55 (Reply)

Add Comment

Name
Email
Homepage
In reply to
Comment	Enclosing asterisks marks text as bold (word), underscore are made via _word_. Standard emoticons like :-) and ;-) are converted to images. To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly. Enter the string from the spam-prevention image above:
	Remember Information? Subscribe to this entry