Class TokenizerOperation

    • Field Detail

      • TOKEN_OPERATIONS

        public static final java.lang.String TOKEN_OPERATIONS
        Parameter that determines the operations this operation will perform on the tokens.
        See Also:
        Constant Field Values
      • PHRASE_OPERATIONS

        public static final java.lang.String PHRASE_OPERATIONS
        Parameter that determines the operations this operation will perform on the phrases.
        See Also:
        Constant Field Values
      • DELIMITERS

        public static final java.lang.String DELIMITERS
        Parameter list that determines the delimiters this operation will use to concatanate tokens.
        See Also:
        Constant Field Values
      • _delimiters

        private java.lang.String[] _delimiters
    • Constructor Detail

      • TokenizerOperation

        public TokenizerOperation()
      • TokenizerOperation

        public TokenizerOperation​(java.lang.String[] delimiters)