Collocations in text classification

1.1k Views Asked by At

Suppose i have trained my classifier and i want to find the right sense of a word in a sentence. One feature people use is called collocation where you consider words to the left/right of the confusing word and position is important . I am curious why this approach works? What information does considering collocations give us that helps us in text classification? Moreover, why is the position important

1

There are 1 best solutions below

0
On

Check some details on why word sense disambiguation using collocation works here: http://en.wikipedia.org/wiki/Yarowsky_algorithm It's basically a Bayesian network.