Gramur/net.archandle.gramur.lexer

Package-level declarations

Types

abstract class AbstractLexeme<out T : Token>(val name: String?) : Lexeme<T>

Abstract base class for Lexeme implementations that provides a name property in its constructor.

A collection of commonly used Lexeme implementations.

interface Lexeme<out T : Token>

Defines a pattern for recognizing and producing tokens from character input.

data class LexemeMatch<out T : Token>(val length: Int, val factory: () -> T? = null)

Represents a successful Lexeme match result.

class Lexer(val lexemes: List<Lexeme<*>>, val factoryOverrides: Map<Lexeme<*>, (value: CharSequence) -> Token> = emptyMap())

The Lexer transforms raw character input into a stream of tokens based on defined lexemes.

Provides context for Lexer matching operations.

abstract class Token

Represents a lexical token produced by matching a Lexeme against input.