This package contains the other part of the script editor.
void addToken(final int length, final byte id)
Adds a token to the token list.
byte markTokensImpl(final byte token, @NotNull final Segment line)
An abstract method that splits a line up into tokens.
A token marker that splits lines of text into tokens.