Package org.apache.uima.conceptMapper.support.tokenizer

Class Summary
OffsetTokenizer Simple class to tokenize a string (similar to java.util.StringTokenizer), except that this tokenizer returns TokenAnnotation objects, which, in addition to the token text string, also contain the start and end offsets of the token in the original string.
TokenAnnotation offset tokenizer functionality Updated by JCasGen Tue Mar 25 16:39:54 EDT 2008 XML source: /OtherStuff/IBM/eclipse-apacheuima/conceptMapper/src/org/apache/uima/conceptMapper/support/tokenizer/TokenAnnotation.xml
TokenAnnotation_Type offset tokenizer functionality Updated by JCasGen Tue Mar 25 16:39:54 EDT 2008
 



Copyright © 2011. All Rights Reserved.