As for the algorithm words are tokens, when several tokens have a similar semantic context, they are generalized through a generalization tree (DAG) that we use. Eg: “fly” and “flying” probably have a similar context when talking about airlines. If the tokens have a very different context then they won’t be grouped. Eg: “stone” or “stoned” have a very different context.