public class PythonTokenMarker extends TokenMarker
TokenMarker.LineInfofirstToken, lastLine, lastToken, length, lineInfo, nextLineRequested| Constructor and Description |
|---|
PythonTokenMarker() |
| Modifier and Type | Method and Description |
|---|---|
static KeywordMap |
getKeywords() |
byte |
markTokensImpl(byte token,
Segment line,
int lineIndex)
An abstract method that splits a line up into tokens.
|
addToken, deleteLines, ensureCapacity, getLineCount, insertLines, isNextLineRequested, markTokens, supportsMultilineTokenspublic byte markTokensImpl(byte token,
Segment line,
int lineIndex)
TokenMarkeraddToken() to
add syntax tokens to the token list. Then, it should return
the initial token type for the next line.For example if the current line contains the start of a multiline comment that doesn't end on that line, this method should return the comment token type so that it continues on the next line.
markTokensImpl in class TokenMarkertoken - The initial token type for this lineline - The line to be tokenizedlineIndex - The index of the line in the document,
starting at 0public static KeywordMap getKeywords()