public class BatchFileTokenMarker extends TokenMarker
TokenMarker.LineInfo
firstToken, lastLine, lastToken, length, lineInfo, nextLineRequested
Constructor and Description |
---|
BatchFileTokenMarker() |
Modifier and Type | Method and Description |
---|---|
byte |
markTokensImpl(byte token,
Segment line,
int lineIndex)
An abstract method that splits a line up into tokens.
|
boolean |
supportsMultilineTokens()
Returns if the token marker supports tokens that span multiple
lines.
|
addToken, deleteLines, ensureCapacity, getLineCount, insertLines, isNextLineRequested, markTokens
public byte markTokensImpl(byte token, Segment line, int lineIndex)
TokenMarker
addToken()
to
add syntax tokens to the token list. Then, it should return
the initial token type for the next line.For example if the current line contains the start of a multiline comment that doesn't end on that line, this method should return the comment token type so that it continues on the next line.
markTokensImpl
in class TokenMarker
token
- The initial token type for this lineline
- The line to be tokenizedlineIndex
- The index of the line in the document,
starting at 0public boolean supportsMultilineTokens()
TokenMarker
markTokens()
method (in turn).The default implementation returns true; it should be overridden to return false on simpler token markers for increased speed.
supportsMultilineTokens
in class TokenMarker