int length
The number of lines in the model being tokenized.
void addToken(final int length, final byte id)
Adds a token to the token list.
static final byte LITERAL1
Literal 1 token id.
A TokenMarker for the message field of Crossfire objects allowing.
static final byte OPERATOR
Operator token id.
byte markTokensImpl(final byte token, final Segment line)
This package contains the other part of the script editor.
A token marker that splits lines of text into tokens.
static final byte KEYWORD1
Keyword 1 token id.
static final byte INVALID
Invalid token id.