Function classify_char 

pub fn classify_char(c: char) -> CharClass

Returns the CharClass of c. tokenize splits text wherever the class changes and at every CharClass::Other character.