Gramur/net.archandle.gramur.parser/TokenElement

TokenElement

class TokenElement(val matcher: TokenElement.TokenMatcher) : PatternElement

A PatternElement that matches a single Token based on a matcher criterion.

TokenElement uses a TokenMatcher to determine whether a token at the current position should be matched. Different matcher implementations support matching by token type, lexeme, or custom predicate.

When this PatternElement matches, exactly 1 TokenNode is added to the current capture.

Constructors

TokenElement

constructor(matcher: TokenElement.TokenMatcher)

Types

LexemeMatcher

class LexemeMatcher(val lexeme: Lexeme<*>) : TokenElement.TokenMatcher

A matcher that matches tokens if they were produced by a specific lexeme.

PredicateMatcher

class PredicateMatcher<K : Token>(val type: KClass<K>, val predicate: (K) -> Boolean) : TokenElement.TokenMatcher

A matcher that matches tokens by type and a custom predicate.

TokenMatcher

sealed interface TokenMatcher

Defines a criterion for matching tokens.

TypeMatcher

class TypeMatcher<K : Token>(val type: KClass<K>) : TokenElement.TokenMatcher

A matcher that matches tokens by their runtime type. Returns true if the token is an instance of K (including any subclass of K).

Properties

matcher

val matcher: TokenElement.TokenMatcher

The matcher that determines whether a token should be matched

Functions

captureAt

open override fun captureAt(tokenIndex: Int, capture: Node.ParserCapture): Int