tegral-niwen-lexer/guru.zoroark.tegral.niwen.lexer/StateBuilder

StateBuilder

class StateBuilder : Buildable<LexerState>

This classed is used to build a lexer state (LexerState) using a DSL, and is used inside a lambda-with receiver. It also defines high level functions for constructing matchers, such as anyOf or matches, and using custom matchers with the + operator.

States themselves are only constructed when calling build, since LexerState objects are immutable and the goal of the DSL is to provide a way to configure them.

Constructors

StateBuilder

constructor()

Types

Default

object Default

Special object for using the default class in the Niwen Lexer DSL

Functions

build

open override fun build(): LexerState

isToken

infix fun Any.isToken(token: TokenType): MatchedMatcherBuilder

Add a matcher to this state that matches the recognizer (or pseudo-recognizer) on the left to the token type on the right.

matches

fun StateBuilder.matches(pattern: String): TokenRecognizer

Create a recognizer that recognizes the given regular expression. Use this before isToken to create a matcher that matches against a regular expression.

unaryPlus

operator fun TokenMatcher.unaryPlus()

Add an already defined matcher to this state

Properties

default

val default: StateBuilder.Default

State label for the default state.

ignore

val Any.ignore: IgnoringMatcherBuilder

Anything that matches the given recognizer (or pseudo-recognizer) exactly will be ignored when encountered. This would be equivalent to a isToken that does not actually create any token.