Uses of Class
org.languagetool.AnalyzedTokenReadings
-
-
Uses of AnalyzedTokenReadings in org.languagetool
Fields in org.languagetool declared as AnalyzedTokenReadings Modifier and Type Field Description private AnalyzedTokenReadings[]
AnalyzedSentence. nonBlankPreDisambigTokens
private AnalyzedTokenReadings[]
AnalyzedSentence. nonBlankTokens
private AnalyzedTokenReadings[]
AnalyzedSentence. preDisambigTokens
private AnalyzedTokenReadings[]
AnalyzedSentence. tokens
Methods in org.languagetool that return AnalyzedTokenReadings Modifier and Type Method Description AnalyzedTokenReadings[]
AnalyzedSentence. getPreDisambigTokens()
AnalyzedTokenReadings[]
AnalyzedSentence. getPreDisambigTokensWithoutWhitespace()
AnalyzedTokenReadings[]
AnalyzedSentence. getTokens()
Returns theAnalyzedTokenReadings
of the analyzed text.AnalyzedTokenReadings[]
AnalyzedSentence. getTokensWithoutWhitespace()
Returns theAnalyzedTokenReadings
of the analyzed text, with whitespace tokens removed but with the artificialSENT_START
token included.Methods in org.languagetool that return types with arguments of type AnalyzedTokenReadings Modifier and Type Method Description private @NotNull java.util.List<AnalyzedTokenReadings>
AnalyzedSentence. getNonBlankReadings(AnalyzedTokenReadings[] tokens, int whCounter, int nonWhCounter, int[] mapping)
Methods in org.languagetool with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private java.util.Set<java.lang.String>
AnalyzedSentence. getLemmaSet(AnalyzedTokenReadings[] tokens)
private @NotNull java.util.List<AnalyzedTokenReadings>
AnalyzedSentence. getNonBlankReadings(AnalyzedTokenReadings[] tokens, int whCounter, int nonWhCounter, int[] mapping)
private java.util.Set<java.lang.String>
AnalyzedSentence. getTokenSet(AnalyzedTokenReadings[] tokens)
Constructors in org.languagetool with parameters of type AnalyzedTokenReadings Constructor Description AnalyzedSentence(AnalyzedTokenReadings[] tokens)
Creates an AnalyzedSentence from the givenAnalyzedTokenReadings
.AnalyzedSentence(AnalyzedTokenReadings[] tokens, int[] mapping, AnalyzedTokenReadings[] nonBlankTokens, AnalyzedTokenReadings[] nonBlankPreDisambigTokens)
AnalyzedSentence(AnalyzedTokenReadings[] tokens, AnalyzedTokenReadings[] preDisambigTokens)
AnalyzedTokenReadings(AnalyzedTokenReadings oldAtr, java.util.List<AnalyzedToken> newReadings, java.lang.String ruleApplied)
-
Uses of AnalyzedTokenReadings in org.languagetool.chunking
Method parameters in org.languagetool.chunking with type arguments of type AnalyzedTokenReadings Modifier and Type Method Description void
Chunker. addChunkTags(java.util.List<AnalyzedTokenReadings> sentenceTokenReadings)
-
Uses of AnalyzedTokenReadings in org.languagetool.noop
Method parameters in org.languagetool.noop with type arguments of type AnalyzedTokenReadings Modifier and Type Method Description void
NoopChunker. addChunkTags(java.util.List<AnalyzedTokenReadings> tokenReadings)
-
Uses of AnalyzedTokenReadings in org.languagetool.rules
Methods in org.languagetool.rules that return types with arguments of type AnalyzedTokenReadings Modifier and Type Method Description private java.util.Map<java.lang.String,AnalyzedTokenReadings>
AbstractCompoundRule. getStringToTokenMap(java.util.Queue<AnalyzedTokenReadings> prevTokens, java.util.List<java.lang.String> stringsToCheck, java.util.List<java.lang.String> origStringsToCheck)
protected abstract @Nullable java.util.List<AnalyzedTokenReadings>
PartialPosTagFilter. tag(java.lang.String token)
Methods in org.languagetool.rules with parameters of type AnalyzedTokenReadings Modifier and Type Method Description RuleMatch
AbstractDateCheckFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)
RuleMatch
AbstractFutureDateFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)
RuleMatch
AbstractNewYearDateFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)
@Nullable RuleMatch
DateRangeChecker. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)
RuleMatch
PartialPosTagFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)
@Nullable RuleMatch
ShortenedYearRangeChecker. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)
RuleMatch
WhitespaceCheckFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)
private void
AbstractCompoundRule. addToQueue(AnalyzedTokenReadings token, java.util.Queue<AnalyzedTokenReadings> prevTokens)
private void
AbstractSimpleReplaceRule2. addToQueue(AnalyzedTokenReadings token, java.util.Queue<AnalyzedTokenReadings> prevTokens)
protected RuleMatch
AbstractSimpleReplaceRule. createRuleMatch(AnalyzedTokenReadings tokenReadings, java.util.List<java.lang.String> replacements, AnalyzedSentence sentence)
private @Nullable java.lang.String
UppercaseSentenceStartRule. dutchSpecialCase(java.lang.String firstToken, java.lang.String secondToken, AnalyzedTokenReadings[] tokens)
private boolean
GenericUnpairedBracketsRule. fillSymbolStack(int startPosBase, AnalyzedTokenReadings[] tokens, int i, int j, UnsyncStack<SymbolLocator> symbolStack, AnalyzedSentence sentence)
protected java.util.List<RuleMatch>
AbstractSimpleReplaceRule. findMatches(AnalyzedTokenReadings tokenReadings, AnalyzedSentence sentence)
private boolean
GenericUnpairedBracketsRule. getFollowedByWhitespace(AnalyzedTokenReadings[] tokens, int i, int j)
private boolean
GenericUnpairedBracketsRule. getPrecededByWhitespace(AnalyzedTokenReadings[] tokens, int i, int j)
java.util.List<java.lang.String>
AbstractStyleRepeatedWordRule. getSynonyms(AnalyzedTokenReadings token)
get synonyms for a repeated wordprivate static boolean
AbstractStyleRepeatedWordRule. hasBreakToken(AnalyzedTokenReadings[] tokens)
boolean
WordRepeatRule. ignore(AnalyzedTokenReadings[] tokens, int position)
Implement this method to returntrue
if there's a potential word repetition at the current position that should be ignored, i.e.protected boolean
WordRepeatBeginningRule. isAdverb(AnalyzedTokenReadings token)
boolean
ParagraphRepeatBeginningRule. isArticle(AnalyzedTokenReadings token)
protected boolean
AbstractFillerWordsRule. isException(AnalyzedTokenReadings[] tokens, int num)
private static boolean
MultipleWhitespaceRule. isFirstWhite(AnalyzedTokenReadings token)
protected boolean
GenericUnpairedBracketsRule. isNoException(java.lang.String token, AnalyzedTokenReadings[] tokens, int i, int j, boolean precSpace, boolean follSpace, UnsyncStack<SymbolLocator> symbolStack)
Generic method to specify an exception.private static boolean
PunctuationMarkAtParagraphEnd. isPunctuationMark(AnalyzedTokenReadings tk)
private static boolean
PunctuationMarkAtParagraphEnd. isQuotationMark(AnalyzedTokenReadings tk)
private static boolean
MultipleWhitespaceRule. isRemovableWhite(AnalyzedTokenReadings token)
protected boolean
AbstractSimpleReplaceRule. isTagged(AnalyzedTokenReadings tokenReadings)
This method allows to override which tags will mark token as taggedprivate boolean
AbstractStyleRepeatedWordRule. isTokenInSentence(AnalyzedTokenReadings testToken, AnalyzedTokenReadings[] tokens)
private boolean
AbstractStyleRepeatedWordRule. isTokenInSentence(AnalyzedTokenReadings testToken, AnalyzedTokenReadings[] tokens, int notCheck)
protected abstract boolean
AbstractStyleRepeatedWordRule. isTokenPair(AnalyzedTokenReadings[] tokens, int n, boolean before)
protected abstract boolean
AbstractStyleRepeatedWordRule. isTokenToCheck(AnalyzedTokenReadings token)
private boolean
WhiteSpaceAtBeginOfParagraph. isWhitespaceDel(AnalyzedTokenReadings token)
private static boolean
CommaWhitespaceRule. isWhitespaceToken(AnalyzedTokenReadings token)
private static boolean
PunctuationMarkAtParagraphEnd. isWord(AnalyzedTokenReadings tk)
private int
ParagraphRepeatBeginningRule. numCharEqualBeginning(AnalyzedTokenReadings[] lastTokens, AnalyzedTokenReadings[] nextTokens)
protected java.net.URL
AbstractStyleRepeatedWordRule. setURL(AnalyzedTokenReadings token)
Method parameters in org.languagetool.rules with type arguments of type AnalyzedTokenReadings Modifier and Type Method Description private void
AbstractCompoundRule. addToQueue(AnalyzedTokenReadings token, java.util.Queue<AnalyzedTokenReadings> prevTokens)
private void
AbstractSimpleReplaceRule2. addToQueue(AnalyzedTokenReadings token, java.util.Queue<AnalyzedTokenReadings> prevTokens)
private java.util.Map<java.lang.String,AnalyzedTokenReadings>
AbstractCompoundRule. getStringToTokenMap(java.util.Queue<AnalyzedTokenReadings> prevTokens, java.util.List<java.lang.String> stringsToCheck, java.util.List<java.lang.String> origStringsToCheck)
private boolean
PartialPosTagFilter. partialTagHasRequiredTag(java.util.List<AnalyzedTokenReadings> tags, java.lang.String requiredTagRegexp, boolean negatePos)
-
Uses of AnalyzedTokenReadings in org.languagetool.rules.neuralnetwork
Methods in org.languagetool.rules.neuralnetwork with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private @NotNull RuleMatch
NeuralNetworkRule. createRuleMatch(AnalyzedTokenReadings token, Suggestion suggestion, float[] y, AnalyzedSentence sentence)
private @NotNull java.lang.String[]
NeuralNetworkRule. getContext(AnalyzedTokenReadings[] tokens, int center)
private static java.lang.String
NeuralNetworkRule. safeGetToken(AnalyzedTokenReadings[] arr, int i)
-
Uses of AnalyzedTokenReadings in org.languagetool.rules.patterns
Fields in org.languagetool.rules.patterns declared as AnalyzedTokenReadings Modifier and Type Field Description private AnalyzedTokenReadings
MatchState. formattedToken
private AnalyzedTokenReadings
MatchState. matchedToken
protected AnalyzedTokenReadings[]
AbstractPatternRulePerformer. unifiedTokens
Fields in org.languagetool.rules.patterns with type parameters of type AnalyzedTokenReadings Modifier and Type Field Description private java.util.List<AnalyzedTokenReadings>
Unifier. tokSequence
Methods in org.languagetool.rules.patterns that return AnalyzedTokenReadings Modifier and Type Method Description AnalyzedTokenReadings
MatchState. filterReadings()
@Nullable AnalyzedTokenReadings[]
Unifier. getFinalUnified()
Used for getting a unified sequence in case when simple test methodUnifier.isUnified(AnalyzedToken, Map, boolean)
} was used.@Nullable AnalyzedTokenReadings[]
Unifier. getUnifiedTokens()
Gets a full sequence of filtered tokens.Methods in org.languagetool.rules.patterns with parameters of type AnalyzedTokenReadings Modifier and Type Method Description abstract @Nullable RuleMatch
RuleFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)
Returns the original rule match or a modified one, ornull
if the rule match is filtered out.void
Unifier. addNeutralElement(AnalyzedTokenReadings analyzedTokenReadings)
Used to add neutral elements (AnalyzedTokenReadings
to the unified sequence.PatternToken
PatternToken. compile(AnalyzedTokenReadings token, Synthesizer synth)
Prepare PatternToken for matching by formatting its string token and POS (if the Element is supposed to refer to some other token).private java.lang.String[]
PatternRuleMatcher. concatMatches(int start, int index, int tokenIndex, AnalyzedTokenReadings[] tokens, int nextTokenPos, java.util.List<Match> suggestionMatches)
Concatenates the matches, and takes care of phrases (including inflection using synthesis).private @Nullable RuleMatch
PatternRuleMatcher. createRuleMatch(java.util.List<java.lang.Integer> tokenPositions, AnalyzedTokenReadings[] tokens, int firstMatchToken, int lastMatchToken, int firstMarkerMatchToken, int lastMarkerMatchToken, AnalyzedSentence sentence)
MatchState
Match. createState(Synthesizer synthesizer, AnalyzedTokenReadings token)
Creates a state used for actually matching a token.MatchState
Match. createState(Synthesizer synthesizer, AnalyzedTokenReadings[] tokens, int index, int next)
Creates a state used for actually matching a token.private void
PatternToken. doCompile(AnalyzedTokenReadings token, Synthesizer synth)
private java.lang.String
PatternRuleMatcher. formatMatches(AnalyzedTokenReadings[] tokenReadings, java.util.List<java.lang.Integer> positions, int firstMatchTok, java.lang.String errorMsg, java.util.List<Match> suggestionMatches)
Replace back references generated with <match> and \\1 in message using Match class, and take care of skipping.java.util.Map<java.lang.String,java.lang.String>
RuleFilterEvaluator. getResolvedArguments(java.lang.String filterArgs, AnalyzedTokenReadings[] patternTokens, int patternTokenPos, java.util.List<java.lang.Integer> tokenPositions)
Resolves the backref arguments, e.g.boolean
PatternToken. isMatchedByPreviousException(AnalyzedTokenReadings prevToken)
Checks whether an exception for a previous token matches all readings of a given token (in case the exception had scope == "previous").boolean
PatternTokenMatcher. isMatchedByPreviousException(AnalyzedTokenReadings token)
boolean
RuleFilter. matches(java.util.Map<java.lang.String,java.lang.String> arguments, AnalyzedTokenReadings[] patternTokens, int firstMatchToken)
(package private) void
PatternTokenMatcher. prepareAndGroup(int firstMatchToken, AnalyzedTokenReadings[] tokens, Language language)
void
PatternTokenMatcher. resolveReference(int firstMatchToken, AnalyzedTokenReadings[] tokens, Language language)
@Nullable RuleMatch
RuleFilterEvaluator. runFilter(java.lang.String filterArgs, RuleMatch ruleMatch, AnalyzedTokenReadings[] patternTokens, int patternTokenPos, java.util.List<java.lang.Integer> tokenPositions)
void
MatchState. setToken(AnalyzedTokenReadings token)
void
MatchState. setToken(AnalyzedTokenReadings[] tokens, int index, int next)
Sets the token to be formatted etc.protected int
AbstractPatternRulePerformer. skipMaxTokens(AnalyzedTokenReadings[] tokens, PatternTokenMatcher elem, int firstMatchToken, int prevSkipNext, PatternTokenMatcher prevElement, int m, int remainingElems)
protected boolean
AbstractPatternRulePerformer. testAllReadings(AnalyzedTokenReadings[] tokens, PatternTokenMatcher matcher, PatternTokenMatcher prevElement, int tokenNo, int firstMatchToken, int prevSkipNext)
Method parameters in org.languagetool.rules.patterns with type arguments of type AnalyzedTokenReadings Modifier and Type Method Description private void
Unifier. addTokenToSequence(java.util.List<AnalyzedTokenReadings> tokenSequence, AnalyzedToken token, int pos)
-
Uses of AnalyzedTokenReadings in org.languagetool.rules.spelling
Methods in org.languagetool.rules.spelling with parameters of type AnalyzedTokenReadings Modifier and Type Method Description protected boolean
SpellingCheckRule. ignoreToken(AnalyzedTokenReadings[] tokens, int idx)
Returns true iff the token at the given position should be ignored by the spell checker. -
Uses of AnalyzedTokenReadings in org.languagetool.rules.spelling.morfologik
Methods in org.languagetool.rules.spelling.morfologik with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private boolean
MorfologikSpellerRule. canBeIgnored(AnalyzedTokenReadings[] tokens, int idx, AnalyzedTokenReadings token)
protected java.util.List<RuleMatch>
MorfologikSpellerRule. getRuleMatches(java.lang.String word, int startPos, AnalyzedSentence sentence, java.util.List<RuleMatch> ruleMatchesSoFar, int idx, AnalyzedTokenReadings[] tokens)
-
Uses of AnalyzedTokenReadings in org.languagetool.tagging
Methods in org.languagetool.tagging that return AnalyzedTokenReadings Modifier and Type Method Description AnalyzedTokenReadings
BaseTagger. createNullToken(java.lang.String token, int startPos)
AnalyzedTokenReadings
Tagger. createNullToken(java.lang.String token, int startPos)
Create the AnalyzedToken used for whitespace and other non-words.Methods in org.languagetool.tagging that return types with arguments of type AnalyzedTokenReadings Modifier and Type Method Description java.util.List<AnalyzedTokenReadings>
BaseTagger. tag(java.util.List<java.lang.String> sentenceTokens)
java.util.List<AnalyzedTokenReadings>
Tagger. tag(java.util.List<java.lang.String> sentenceTokens)
Returns a list ofAnalyzedToken
s that assigns each term in the sentence some kind of part-of-speech information (not necessarily just one tag). -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.disambiguation
Methods in org.languagetool.tagging.disambiguation that return AnalyzedTokenReadings Modifier and Type Method Description private AnalyzedTokenReadings
MultiWordChunker. prepareNewReading(java.lang.String tokens, java.lang.String tok, AnalyzedTokenReadings token, boolean isLast)
protected AnalyzedTokenReadings
MultiWordChunker2. prepareNewReading(java.lang.String tokens, java.lang.String tok, AnalyzedTokenReadings token, java.lang.String tag)
private AnalyzedTokenReadings
MultiWordChunker. setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading)
private AnalyzedTokenReadings
MultiWordChunker2. setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading)
Methods in org.languagetool.tagging.disambiguation with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private MultiWordChunker2.MultiWordEntry
MultiWordChunker2. findMultiwordEntry(AnalyzedTokenReadings[] inputTokens, int startingPosition, java.util.List<MultiWordChunker2.MultiWordEntry> multiwordItems)
private boolean
MultiWordChunker2. isMatching(AnalyzedTokenReadings[] inputTokens, int startingPosition, MultiWordChunker2.MultiWordEntry multiWordEntry)
protected boolean
MultiWordChunker2. matches(java.lang.String matchText, AnalyzedTokenReadings inputTokens)
private AnalyzedTokenReadings
MultiWordChunker. prepareNewReading(java.lang.String tokens, java.lang.String tok, AnalyzedTokenReadings token, boolean isLast)
protected AnalyzedTokenReadings
MultiWordChunker2. prepareNewReading(java.lang.String tokens, java.lang.String tok, AnalyzedTokenReadings token, java.lang.String tag)
private AnalyzedTokenReadings
MultiWordChunker. setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading)
private AnalyzedTokenReadings
MultiWordChunker2. setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading)
-
Uses of AnalyzedTokenReadings in org.languagetool.tagging.disambiguation.rules
Methods in org.languagetool.tagging.disambiguation.rules that return AnalyzedTokenReadings Modifier and Type Method Description private AnalyzedTokenReadings[]
DisambiguationPatternRuleReplacer. executeAction(AnalyzedSentence sentence, AnalyzedTokenReadings[] whiteTokens, AnalyzedTokenReadings[] unifiedTokens, int firstMatchToken, int lastMatchToken, int matchingTokens, int[] tokenPositions)
Methods in org.languagetool.tagging.disambiguation.rules with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private AnalyzedTokenReadings[]
DisambiguationPatternRuleReplacer. executeAction(AnalyzedSentence sentence, AnalyzedTokenReadings[] whiteTokens, AnalyzedTokenReadings[] unifiedTokens, int firstMatchToken, int lastMatchToken, int matchingTokens, int[] tokenPositions)
private boolean
DisambiguationPatternRuleReplacer. keepDespiteFilter(AnalyzedTokenReadings[] tokens, int[] tokenPositions, int firstMatchToken, int lastMatchToken)
protected int
DisambiguationPatternRuleReplacer. skipMaxTokens(AnalyzedTokenReadings[] tokens, PatternTokenMatcher matcher, int firstMatchToken, int prevSkipNext, PatternTokenMatcher prevElement, int m, int remainingElems)
-
Uses of AnalyzedTokenReadings in org.languagetool.tagging.xx
Methods in org.languagetool.tagging.xx that return AnalyzedTokenReadings Modifier and Type Method Description AnalyzedTokenReadings
DemoTagger. createNullToken(java.lang.String token, int startPos)
Methods in org.languagetool.tagging.xx that return types with arguments of type AnalyzedTokenReadings Modifier and Type Method Description java.util.List<AnalyzedTokenReadings>
DemoTagger. tag(java.util.List<java.lang.String> sentenceTokens)
-