Options
All
  • Public
  • Public/Protected
  • All
Menu

Hierarchy

  • Tokenizer

Index

Constructors

constructor

Properties

Private charStack

charStack: string[] = []

Private currentToken

currentToken: TokenBuilder

Private ended

ended: boolean = false

Private file

file: string

Private hasOpenParen

hasOpenParen: boolean = false

Private it

it: TextIterator = new TextIterator()

Private state

state: TokenizerState = this.state_text

Private tokens

tokens: Token[] = []

Methods

Private assertNotEOF

  • assertNotEOF(eof: boolean): void

Private assertNotEnded

  • assertNotEnded(): void

close

consume

  • consume(buf: string): void

Private flushToken

Private state_atChar

  • state_atChar(eof: boolean): void

Private state_atRuleAwaitData

  • state_atRuleAwaitData(eof: boolean): void
  • rule

    (some data) ^^^ Here

    Parameters

    • eof: boolean

    Returns void

Private state_atRuleBegin

  • state_atRuleBegin(eof: boolean): void
  • rule

    (some data) ^ Here

    Parameters

    • eof: boolean

    Returns void

Private state_atRuleData

  • state_atRuleData(eof: boolean): void
  • rule

    (some data) ^^^^^^^^^ Here

    Parameters

    • eof: boolean

    Returns void

Private state_atRuleEnd

  • state_atRuleEnd(eof: boolean): void
  • rule

    (some data) ^ Here

    simplerule
           ^
        or here

    Parameters

    • eof: boolean

    Returns void

Private state_atRuleName

  • state_atRuleName(eof: boolean): void
  • rule

    (some data) ^^^^ Here

    Parameters

    • eof: boolean

    Returns void

Private state_atRuleOpenParen

  • state_atRuleOpenParen(eof: boolean): void
  • rule

    (some() data) ^ Here

    Parameters

    • eof: boolean

    Returns void

Private state_text

  • state_text(eof: boolean): void

Legend

  • Module
  • Object literal
  • Variable
  • Function
  • Function with type parameter
  • Index signature
  • Type alias
  • Enumeration
  • Enumeration member
  • Property
  • Method
  • Interface
  • Interface with type parameter
  • Constructor
  • Property
  • Method
  • Index signature
  • Class
  • Class with type parameter
  • Constructor
  • Property
  • Method
  • Accessor
  • Index signature
  • Inherited constructor
  • Inherited property
  • Inherited method
  • Inherited accessor
  • Protected property
  • Protected method
  • Protected accessor
  • Private property
  • Private method
  • Private accessor
  • Static property
  • Static method

Generated using TypeDoc