Gramur/net.archandle.gramur.lexer/Token/Generic

Generic

A generic Token implementation with no supplementary metadata and value-based equality.

Generic tokens are considered equal if their value properties are equal, regardless of their positional metadata. This class is used by most predefined Lexemes in BasicLexemes.

Inheritors

Discardable

Constructors

Generic

constructor()

Types

Discardable

open class Discardable : Token.Generic

A discardableisDiscardable.

Properties

column

var column: Int

The column number where this token begins in the source input.

isDiscardable

open val isDiscardable: Boolean

Indicates whether this token should be discarded during lexing (when discard mode is enabled).

lexeme

lateinit var lexeme: Lexeme<*>

The Lexeme that produced this token.

line

var line: Int

The line number where this token begins in the source input.

value

lateinit var value: CharSequence

The character sequence matched from the input that this token represents.

Functions

equals

open operator override fun equals(other: Any?): Boolean

hashCode

open override fun hashCode(): Int

toString

open override fun toString(): String