Function lex

Function Documentation

Lexeme *lex(LexerContext*, const byte *source)

Advances lexer, returns token. Setting the source pointer to Lexeme::end will let you step through the source token by token. Look-ahead is accomplished by setting it to Lexeme::start, or simply not changing the source pointer.

Note

Allocates memory.