Uses of Class
org.languagetool.AnalyzedTokenReadings
Packages that use AnalyzedTokenReadings
Package
Description
-
Uses of AnalyzedTokenReadings in org.languagetool
Fields in org.languagetool declared as AnalyzedTokenReadingsModifier and TypeFieldDescriptionprivate final AnalyzedTokenReadings[]
AnalyzedSentence.nonBlankPreDisambigTokens
private final AnalyzedTokenReadings[]
AnalyzedSentence.nonBlankTokens
private final AnalyzedTokenReadings[]
AnalyzedSentence.preDisambigTokens
private final AnalyzedTokenReadings[]
AnalyzedSentence.tokens
Methods in org.languagetool that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionAnalyzedSentence.getPreDisambigTokens()
AnalyzedSentence.getPreDisambigTokensWithoutWhitespace()
AnalyzedSentence.getTokens()
Returns theAnalyzedTokenReadings
of the analyzed text.AnalyzedSentence.getTokensWithoutWhitespace()
Returns theAnalyzedTokenReadings
of the analyzed text, with whitespace tokens removed but with the artificialSENT_START
token included.Methods in org.languagetool that return types with arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate @NotNull List
<AnalyzedTokenReadings> AnalyzedSentence.getNonBlankReadings
(AnalyzedTokenReadings[] tokens, int whCounter, int nonWhCounter, int[] mapping) Methods in org.languagetool with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionAnalyzedSentence.getLemmaSet
(AnalyzedTokenReadings[] tokens) private @NotNull List
<AnalyzedTokenReadings> AnalyzedSentence.getNonBlankReadings
(AnalyzedTokenReadings[] tokens, int whCounter, int nonWhCounter, int[] mapping) AnalyzedSentence.getTokenSet
(AnalyzedTokenReadings[] tokens) Constructors in org.languagetool with parameters of type AnalyzedTokenReadingsModifierConstructorDescriptionAnalyzedSentence
(AnalyzedTokenReadings[] tokens) Creates an AnalyzedSentence from the givenAnalyzedTokenReadings
.private
AnalyzedSentence
(AnalyzedTokenReadings[] tokens, int[] mapping, AnalyzedTokenReadings[] nonBlankTokens, AnalyzedTokenReadings[] nonBlankPreDisambigTokens) AnalyzedSentence
(AnalyzedTokenReadings[] tokens, AnalyzedTokenReadings[] preDisambigTokens) AnalyzedTokenReadings
(AnalyzedTokenReadings oldAtr, List<AnalyzedToken> newReadings, String ruleApplied) -
Uses of AnalyzedTokenReadings in org.languagetool.chunking
Method parameters in org.languagetool.chunking with type arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionvoid
Chunker.addChunkTags
(List<AnalyzedTokenReadings> sentenceTokenReadings) -
Uses of AnalyzedTokenReadings in org.languagetool.noop
Method parameters in org.languagetool.noop with type arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionvoid
NoopChunker.addChunkTags
(List<AnalyzedTokenReadings> tokenReadings) -
Uses of AnalyzedTokenReadings in org.languagetool.rules
Methods in org.languagetool.rules that return types with arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate Map
<String, AnalyzedTokenReadings> AbstractCompoundRule.getStringToTokenMap
(Queue<AnalyzedTokenReadings> prevTokens, List<String> stringsToCheck, List<String> origStringsToCheck) protected abstract @Nullable List
<AnalyzedTokenReadings> Methods in org.languagetool.rules with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionAbstractDateCheckFilter.acceptRuleMatch
(RuleMatch match, Map<String, String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) AbstractFutureDateFilter.acceptRuleMatch
(RuleMatch match, Map<String, String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) AbstractNewYearDateFilter.acceptRuleMatch
(RuleMatch match, Map<String, String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) @Nullable RuleMatch
DateRangeChecker.acceptRuleMatch
(RuleMatch match, Map<String, String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) PartialPosTagFilter.acceptRuleMatch
(RuleMatch match, Map<String, String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) @Nullable RuleMatch
ShortenedYearRangeChecker.acceptRuleMatch
(RuleMatch match, Map<String, String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) WhitespaceCheckFilter.acceptRuleMatch
(RuleMatch match, Map<String, String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) private void
AbstractCompoundRule.addToQueue
(AnalyzedTokenReadings token, Queue<AnalyzedTokenReadings> prevTokens) private void
AbstractSimpleReplaceRule2.addToQueue
(AnalyzedTokenReadings token, Queue<AnalyzedTokenReadings> prevTokens) protected RuleMatch
AbstractSimpleReplaceRule.createRuleMatch
(AnalyzedTokenReadings tokenReadings, List<String> replacements, AnalyzedSentence sentence) private @Nullable String
UppercaseSentenceStartRule.dutchSpecialCase
(String firstToken, String secondToken, AnalyzedTokenReadings[] tokens) private boolean
GenericUnpairedBracketsRule.fillSymbolStack
(int startPosBase, AnalyzedTokenReadings[] tokens, int i, int j, UnsyncStack<SymbolLocator> symbolStack, AnalyzedSentence sentence) AbstractSimpleReplaceRule.findMatches
(AnalyzedTokenReadings tokenReadings, AnalyzedSentence sentence) private boolean
GenericUnpairedBracketsRule.getFollowedByWhitespace
(AnalyzedTokenReadings[] tokens, int i, int j) private boolean
GenericUnpairedBracketsRule.getPrecededByWhitespace
(AnalyzedTokenReadings[] tokens, int i, int j) AbstractStyleRepeatedWordRule.getSynonyms
(AnalyzedTokenReadings token) get synonyms for a repeated wordprivate static boolean
AbstractStyleRepeatedWordRule.hasBreakToken
(AnalyzedTokenReadings[] tokens) boolean
WordRepeatRule.ignore
(AnalyzedTokenReadings[] tokens, int position) Implement this method to returntrue
if there's a potential word repetition at the current position that should be ignored, i.e.protected boolean
WordRepeatBeginningRule.isAdverb
(AnalyzedTokenReadings token) boolean
ParagraphRepeatBeginningRule.isArticle
(AnalyzedTokenReadings token) protected boolean
AbstractFillerWordsRule.isException
(AnalyzedTokenReadings[] tokens, int num) private static boolean
MultipleWhitespaceRule.isFirstWhite
(AnalyzedTokenReadings token) protected boolean
GenericUnpairedBracketsRule.isNoException
(String token, AnalyzedTokenReadings[] tokens, int i, int j, boolean precSpace, boolean follSpace, UnsyncStack<SymbolLocator> symbolStack) Generic method to specify an exception.private static boolean
PunctuationMarkAtParagraphEnd.isPunctuationMark
(AnalyzedTokenReadings tk) private static boolean
PunctuationMarkAtParagraphEnd.isQuotationMark
(AnalyzedTokenReadings tk) private static boolean
MultipleWhitespaceRule.isRemovableWhite
(AnalyzedTokenReadings token) protected boolean
AbstractSimpleReplaceRule.isTagged
(AnalyzedTokenReadings tokenReadings) This method allows to override which tags will mark token as taggedprivate boolean
AbstractStyleRepeatedWordRule.isTokenInSentence
(AnalyzedTokenReadings testToken, AnalyzedTokenReadings[] tokens) private boolean
AbstractStyleRepeatedWordRule.isTokenInSentence
(AnalyzedTokenReadings testToken, AnalyzedTokenReadings[] tokens, int notCheck) protected abstract boolean
AbstractStyleRepeatedWordRule.isTokenPair
(AnalyzedTokenReadings[] tokens, int n, boolean before) protected abstract boolean
AbstractStyleRepeatedWordRule.isTokenToCheck
(AnalyzedTokenReadings token) private boolean
WhiteSpaceAtBeginOfParagraph.isWhitespaceDel
(AnalyzedTokenReadings token) private static boolean
CommaWhitespaceRule.isWhitespaceToken
(AnalyzedTokenReadings token) private static boolean
PunctuationMarkAtParagraphEnd.isWord
(AnalyzedTokenReadings tk) private int
ParagraphRepeatBeginningRule.numCharEqualBeginning
(AnalyzedTokenReadings[] lastTokens, AnalyzedTokenReadings[] nextTokens) protected URL
AbstractStyleRepeatedWordRule.setURL
(AnalyzedTokenReadings token) Method parameters in org.languagetool.rules with type arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate void
AbstractCompoundRule.addToQueue
(AnalyzedTokenReadings token, Queue<AnalyzedTokenReadings> prevTokens) private void
AbstractSimpleReplaceRule2.addToQueue
(AnalyzedTokenReadings token, Queue<AnalyzedTokenReadings> prevTokens) private Map
<String, AnalyzedTokenReadings> AbstractCompoundRule.getStringToTokenMap
(Queue<AnalyzedTokenReadings> prevTokens, List<String> stringsToCheck, List<String> origStringsToCheck) private boolean
PartialPosTagFilter.partialTagHasRequiredTag
(List<AnalyzedTokenReadings> tags, String requiredTagRegexp, boolean negatePos) -
Uses of AnalyzedTokenReadings in org.languagetool.rules.neuralnetwork
Methods in org.languagetool.rules.neuralnetwork with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate @NotNull RuleMatch
NeuralNetworkRule.createRuleMatch
(AnalyzedTokenReadings token, Suggestion suggestion, float[] y, AnalyzedSentence sentence) private @NotNull String[]
NeuralNetworkRule.getContext
(AnalyzedTokenReadings[] tokens, int center) private static String
NeuralNetworkRule.safeGetToken
(AnalyzedTokenReadings[] arr, int i) -
Uses of AnalyzedTokenReadings in org.languagetool.rules.patterns
Fields in org.languagetool.rules.patterns declared as AnalyzedTokenReadingsModifier and TypeFieldDescriptionprivate AnalyzedTokenReadings
MatchState.formattedToken
private AnalyzedTokenReadings
MatchState.matchedToken
protected AnalyzedTokenReadings[]
AbstractPatternRulePerformer.unifiedTokens
Fields in org.languagetool.rules.patterns with type parameters of type AnalyzedTokenReadingsMethods in org.languagetool.rules.patterns that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionfinal AnalyzedTokenReadings
MatchState.filterReadings()
final @Nullable AnalyzedTokenReadings[]
Unifier.getFinalUnified()
Used for getting a unified sequence in case when simple test methodUnifier.isUnified(AnalyzedToken, Map, boolean)
} was used.final @Nullable AnalyzedTokenReadings[]
Unifier.getUnifiedTokens()
Gets a full sequence of filtered tokens.Methods in org.languagetool.rules.patterns with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionabstract @Nullable RuleMatch
RuleFilter.acceptRuleMatch
(RuleMatch match, Map<String, String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) Returns the original rule match or a modified one, ornull
if the rule match is filtered out.final void
Unifier.addNeutralElement
(AnalyzedTokenReadings analyzedTokenReadings) Used to add neutral elements (AnalyzedTokenReadings
to the unified sequence.PatternToken.compile
(AnalyzedTokenReadings token, Synthesizer synth) Prepare PatternToken for matching by formatting its string token and POS (if the Element is supposed to refer to some other token).private String[]
PatternRuleMatcher.concatMatches
(int start, int index, int tokenIndex, AnalyzedTokenReadings[] tokens, int nextTokenPos, List<Match> suggestionMatches) Concatenates the matches, and takes care of phrases (including inflection using synthesis).private @Nullable RuleMatch
PatternRuleMatcher.createRuleMatch
(List<Integer> tokenPositions, AnalyzedTokenReadings[] tokens, int firstMatchToken, int lastMatchToken, int firstMarkerMatchToken, int lastMarkerMatchToken, AnalyzedSentence sentence) Match.createState
(Synthesizer synthesizer, AnalyzedTokenReadings token) Creates a state used for actually matching a token.Match.createState
(Synthesizer synthesizer, AnalyzedTokenReadings[] tokens, int index, int next) Creates a state used for actually matching a token.private void
PatternToken.doCompile
(AnalyzedTokenReadings token, Synthesizer synth) private String
PatternRuleMatcher.formatMatches
(AnalyzedTokenReadings[] tokenReadings, List<Integer> positions, int firstMatchTok, String errorMsg, List<Match> suggestionMatches) Replace back references generated with <match> and \\1 in message using Match class, and take care of skipping.RuleFilterEvaluator.getResolvedArguments
(String filterArgs, AnalyzedTokenReadings[] patternTokens, int patternTokenPos, List<Integer> tokenPositions) Resolves the backref arguments, e.g.boolean
PatternToken.isMatchedByPreviousException
(AnalyzedTokenReadings prevToken) Checks whether an exception for a previous token matches all readings of a given token (in case the exception had scope == "previous").boolean
PatternTokenMatcher.isMatchedByPreviousException
(AnalyzedTokenReadings token) boolean
RuleFilter.matches
(Map<String, String> arguments, AnalyzedTokenReadings[] patternTokens, int firstMatchToken) (package private) void
PatternTokenMatcher.prepareAndGroup
(int firstMatchToken, AnalyzedTokenReadings[] tokens, Language language) void
PatternTokenMatcher.resolveReference
(int firstMatchToken, AnalyzedTokenReadings[] tokens, Language language) @Nullable RuleMatch
RuleFilterEvaluator.runFilter
(String filterArgs, RuleMatch ruleMatch, AnalyzedTokenReadings[] patternTokens, int patternTokenPos, List<Integer> tokenPositions) void
MatchState.setToken
(AnalyzedTokenReadings token) final void
MatchState.setToken
(AnalyzedTokenReadings[] tokens, int index, int next) Sets the token to be formatted etc.protected int
AbstractPatternRulePerformer.skipMaxTokens
(AnalyzedTokenReadings[] tokens, PatternTokenMatcher elem, int firstMatchToken, int prevSkipNext, PatternTokenMatcher prevElement, int m, int remainingElems) protected boolean
AbstractPatternRulePerformer.testAllReadings
(AnalyzedTokenReadings[] tokens, PatternTokenMatcher matcher, PatternTokenMatcher prevElement, int tokenNo, int firstMatchToken, int prevSkipNext) Method parameters in org.languagetool.rules.patterns with type arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate void
Unifier.addTokenToSequence
(List<AnalyzedTokenReadings> tokenSequence, AnalyzedToken token, int pos) -
Uses of AnalyzedTokenReadings in org.languagetool.rules.spelling
Methods in org.languagetool.rules.spelling with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprotected boolean
SpellingCheckRule.ignoreToken
(AnalyzedTokenReadings[] tokens, int idx) Returns true iff the token at the given position should be ignored by the spell checker. -
Uses of AnalyzedTokenReadings in org.languagetool.rules.spelling.morfologik
Methods in org.languagetool.rules.spelling.morfologik with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate boolean
MorfologikSpellerRule.canBeIgnored
(AnalyzedTokenReadings[] tokens, int idx, AnalyzedTokenReadings token) MorfologikSpellerRule.getRuleMatches
(String word, int startPos, AnalyzedSentence sentence, List<RuleMatch> ruleMatchesSoFar, int idx, AnalyzedTokenReadings[] tokens) -
Uses of AnalyzedTokenReadings in org.languagetool.tagging
Methods in org.languagetool.tagging that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionfinal AnalyzedTokenReadings
BaseTagger.createNullToken
(String token, int startPos) Tagger.createNullToken
(String token, int startPos) Create the AnalyzedToken used for whitespace and other non-words.Methods in org.languagetool.tagging that return types with arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionReturns a list ofAnalyzedToken
s that assigns each term in the sentence some kind of part-of-speech information (not necessarily just one tag). -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.disambiguation
Methods in org.languagetool.tagging.disambiguation that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate AnalyzedTokenReadings
MultiWordChunker.prepareNewReading
(String tokens, String tok, AnalyzedTokenReadings token, boolean isLast) protected AnalyzedTokenReadings
MultiWordChunker2.prepareNewReading
(String tokens, String tok, AnalyzedTokenReadings token, String tag) private AnalyzedTokenReadings
MultiWordChunker.setAndAnnotate
(AnalyzedTokenReadings oldReading, AnalyzedToken newReading) private AnalyzedTokenReadings
MultiWordChunker2.setAndAnnotate
(AnalyzedTokenReadings oldReading, AnalyzedToken newReading) Methods in org.languagetool.tagging.disambiguation with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate MultiWordChunker2.MultiWordEntry
MultiWordChunker2.findMultiwordEntry
(AnalyzedTokenReadings[] inputTokens, int startingPosition, List<MultiWordChunker2.MultiWordEntry> multiwordItems) private boolean
MultiWordChunker2.isMatching
(AnalyzedTokenReadings[] inputTokens, int startingPosition, MultiWordChunker2.MultiWordEntry multiWordEntry) protected boolean
MultiWordChunker2.matches
(String matchText, AnalyzedTokenReadings inputTokens) private AnalyzedTokenReadings
MultiWordChunker.prepareNewReading
(String tokens, String tok, AnalyzedTokenReadings token, boolean isLast) protected AnalyzedTokenReadings
MultiWordChunker2.prepareNewReading
(String tokens, String tok, AnalyzedTokenReadings token, String tag) private AnalyzedTokenReadings
MultiWordChunker.setAndAnnotate
(AnalyzedTokenReadings oldReading, AnalyzedToken newReading) private AnalyzedTokenReadings
MultiWordChunker2.setAndAnnotate
(AnalyzedTokenReadings oldReading, AnalyzedToken newReading) -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.disambiguation.rules
Methods in org.languagetool.tagging.disambiguation.rules that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate AnalyzedTokenReadings[]
DisambiguationPatternRuleReplacer.executeAction
(AnalyzedSentence sentence, AnalyzedTokenReadings[] whiteTokens, AnalyzedTokenReadings[] unifiedTokens, int firstMatchToken, int lastMatchToken, int matchingTokens, int[] tokenPositions) Methods in org.languagetool.tagging.disambiguation.rules with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate AnalyzedTokenReadings[]
DisambiguationPatternRuleReplacer.executeAction
(AnalyzedSentence sentence, AnalyzedTokenReadings[] whiteTokens, AnalyzedTokenReadings[] unifiedTokens, int firstMatchToken, int lastMatchToken, int matchingTokens, int[] tokenPositions) private boolean
DisambiguationPatternRuleReplacer.keepDespiteFilter
(AnalyzedTokenReadings[] tokens, int[] tokenPositions, int firstMatchToken, int lastMatchToken) protected int
DisambiguationPatternRuleReplacer.skipMaxTokens
(AnalyzedTokenReadings[] tokens, PatternTokenMatcher matcher, int firstMatchToken, int prevSkipNext, PatternTokenMatcher prevElement, int m, int remainingElems) -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.xx
Methods in org.languagetool.tagging.xx that return AnalyzedTokenReadingsMethods in org.languagetool.tagging.xx that return types with arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescription