Parsek/org.kobjects.parsek.tokenizer/Token

Token

data class Token<T>(val localPos: Int, val pos: Int, val line: Int, val col: Int, val type: T, val text: String)

Tokens in parsek are represented by this class.

T Typically is an enum type, denoting the token type, mapped from regular expressions in the Lexer.

Constructors

constructor(localPos: Int, pos: Int, line: Int, col: Int, type: T, text: String)

Properties

val col: Int

val localPos: Int

val pos: Int

val text: String

val type: T

Functions

open override fun toString(): String