Class AnalyzedToken


  • public final class AnalyzedToken
    extends java.lang.Object
    A word (or punctuation, or whitespace) and its analysis (part-of-speech tag, lemma)
    • Constructor Summary

      Constructors 
      Constructor Description
      AnalyzedToken​(java.lang.String token, java.lang.String posTag, java.lang.String lemma)  
    • Field Detail

      • token

        private final java.lang.String token
      • posTag

        private final java.lang.String posTag
      • lemma

        private final java.lang.String lemma
      • lemmaOrToken

        private final java.lang.String lemmaOrToken
      • isWhitespaceBefore

        private boolean isWhitespaceBefore
      • hasNoPOSTag

        private boolean hasNoPOSTag
    • Constructor Detail

      • AnalyzedToken

        public AnalyzedToken​(java.lang.String token,
                             java.lang.String posTag,
                             java.lang.String lemma)
    • Method Detail

      • getToken

        public java.lang.String getToken()
      • getPOSTag

        @Nullable
        public @Nullable java.lang.String getPOSTag()
        Returns:
        the token's part-of-speech tag or null
      • getLemma

        @Nullable
        public @Nullable java.lang.String getLemma()
        Returns:
        the token's lemma or null
      • setWhitespaceBefore

        public void setWhitespaceBefore​(boolean whitespaceBefore)
      • isWhitespaceBefore

        public boolean isWhitespaceBefore()
      • matches

        public boolean matches​(AnalyzedToken an)
        Parameters:
        an - AnalyzedToken to test
        Returns:
        true if all of the non-null values (lemma, POS, token) of AnalyzedToken match this token
        Since:
        1.5
      • hasNoTag

        public boolean hasNoTag()
        Returns:
        true if the AnalyzedToken has no real POS tag (= is not null or a special tag)
        Since:
        1.5
      • setNoPOSTag

        public void setNoPOSTag​(boolean noTag)
        If other readings of the token have real POS tags, you can set the flag here that they do, so that the test in the Element class would be correct for all cases.
        Since:
        1.5
      • toString

        public java.lang.String toString()
        Overrides:
        toString in class java.lang.Object
      • hashCode

        public int hashCode()
        Overrides:
        hashCode in class java.lang.Object
      • equals

        public boolean equals​(java.lang.Object o)
        Overrides:
        equals in class java.lang.Object