Gramur/net.archandle.gramur.lexer/BasicLexemes

BasicLexemes

A collection of commonly used Lexeme implementations.

BasicLexemes provides predefined lexeme classes for matching common patterns such as individual characters, character ranges, strings, regular expressions, and whitespace.

All Lexemes in this object produce Token.Generic tokens unless otherwise specified.

Types

AnyChar

object AnyChar : AbstractLexeme<Token.Generic>

A Lexeme that matches 1 character, indiscriminately.

Char

open class Char(val c: Char, name: String? = null) : AbstractLexeme<Token.Generic>

A Lexeme that matches a single specific character c. Matches produced by this Lexeme always have a length of 1.

CharChoice

open class CharChoice(chars: Char, name: String? = null) : AbstractLexeme<Token.Generic>

A Lexeme that matches any one of several specified chars. Matches produced by this Lexeme always have a length of 1.

CharPredicate

open class CharPredicate(val predicate: (Char) -> Boolean, name: String? = null) : AbstractLexeme<Token.Generic>

A Lexeme that matches a single character satisfying a predicate. Matches produced by this Lexeme always have a length of 1.

CharRange

open class CharRange(val range: CharRange, name: String? = null) : AbstractLexeme<Token.Generic>

A Lexeme that matches any character within a specified range. Matches produced by this Lexeme always have a length of 1.

CharSequence

open class CharSequence(val str: CharSequence, name: String? = null) : AbstractLexeme<Token.Generic>

A Lexeme that matches a specific character sequence or String literal str.

CharSequencePredicate

open class CharSequencePredicate(name: String? = null, val predicate: (CharSequence) -> Int) : AbstractLexeme<Token.Generic>

A Lexeme that matches any character sequence satisfying predicate.

Regex

open class Regex(val regex: Regex, name: String? = null) : AbstractLexeme<Token.Generic>

A Lexeme that matches input against a regular expression regex.

Whitespace

object Whitespace : AbstractLexeme<Token.Generic.Discardable>

A Lexeme that matches a single kotlin.Char.isWhitespace character.