Package org.languagetool.tokenizers
Interface SentenceTokenizer
-
- All Superinterfaces:
Tokenizer
- All Known Implementing Classes:
SimpleSentenceTokenizer
,SRXSentenceTokenizer
public interface SentenceTokenizer extends Tokenizer
Tokenizes text into sentences.
-
-
Method Summary
All Methods Instance Methods Abstract Methods Modifier and Type Method Description void
setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)
boolean
singleLineBreaksMarksPara()
java.util.List<java.lang.String>
tokenize(java.lang.String text)
Tokenize the given string to sentences.
-
-
-
Method Detail
-
tokenize
java.util.List<java.lang.String> tokenize(java.lang.String text)
Tokenize the given string to sentences.
-
setSingleLineBreaksMarksParagraph
void setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)
- Parameters:
lineBreakParagraphs
- iftrue
, single line breaks are assumed to end a paragraph, withfalse
, only two ore more consecutive line breaks end a paragraph
-
singleLineBreaksMarksPara
boolean singleLineBreaksMarksPara()
-
-