Function lex¶
Defined in File lexer.h
Function Documentation¶
-
Lexeme *
lex
(LexerContext*, const byte *source)¶ Advances lexer, returns token. Setting the source pointer to Lexeme::end will let you step through the source token by token. Look-ahead is accomplished by setting it to Lexeme::start, or simply not changing the source pointer.
- Note
Allocates memory.