Create a lexer that separates tokens based on character transitions Note: this lexer produces no delimiters
Create a lexer that separates tokens based on character transitions Note: this lexer produces no delimiters
one or more (before regex,after regex) tuples
a lexer that separates tokens based on the token transitions defined by oomBeforeAfter