Class Tokenizer


  • public class Tokenizer
    extends java.lang.Object
    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description
      (package private) static class  Tokenizer.TokenizerState  
    • Constructor Summary

      Constructors 
      Constructor Description
      Tokenizer​(java.lang.String pattern)  
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      private void addLiteralToken​(java.util.List<Token> tokenList, java.lang.StringBuilder stringBuilder)  
      private void handleDefaultValueState​(char c, java.util.List<Token> tokenList, java.lang.StringBuilder stringBuilder)  
      private void handleLiteralState​(char c, java.util.List<Token> tokenList, java.lang.StringBuilder stringBuilder)  
      private void handleStartState​(char c, java.util.List<Token> tokenList, java.lang.StringBuilder stringBuilder)  
      (package private) java.util.List<Token> tokenize()  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Field Detail

      • pattern

        final java.lang.String pattern
      • patternLength

        final int patternLength
      • pointer

        int pointer
    • Constructor Detail

      • Tokenizer

        public Tokenizer​(java.lang.String pattern)
    • Method Detail

      • handleDefaultValueState

        private void handleDefaultValueState​(char c,
                                             java.util.List<Token> tokenList,
                                             java.lang.StringBuilder stringBuilder)
      • handleStartState

        private void handleStartState​(char c,
                                      java.util.List<Token> tokenList,
                                      java.lang.StringBuilder stringBuilder)
      • handleLiteralState

        private void handleLiteralState​(char c,
                                        java.util.List<Token> tokenList,
                                        java.lang.StringBuilder stringBuilder)
      • addLiteralToken

        private void addLiteralToken​(java.util.List<Token> tokenList,
                                     java.lang.StringBuilder stringBuilder)