Options
All
  • Public
  • Public/Protected
  • All
Menu

Class Tokenizer

Hierarchy

  • Tokenizer

Index

Constructors

constructor

Properties

Readonly buffer

buffer: IToken[]

Readonly errorHandler

errorHandler: ErrorHandler

Readonly reader

reader: Reader

scanner

scanner: Scanner

Readonly trackLoc

trackLoc: boolean

Readonly trackRange

trackRange: boolean

Methods

errors

getNextToken

  • getNextToken(): IToken