looking for a PHP texte indexer

[Mihamina Rakotomandimby <mihamina@xxxxxxxxx>]

Hi all,

I have a small job ad website, where some poster tend to flood with the 
same ad, just in order to be on top of the recent sort.

To perturb the strict duplication detection (yes it's weak), they add 
one or two words that makes difference.

The result is a duplication of many ads.

I would like to search for duplicates by looking for ads with 80%-90% 
same words and decide they're the same, so that I can group them.

Of course, putting a limiting mecanism or even a moderation is 
scheduled, but I want to process existing first.

I dont want to use MySQL for indexing, I believe text indexers are best 
tools for this: Am I wrong?

What would you suggest me to process and lookup for duplicates in that 
situation?

--
RMA.

--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php