A "manual" provider of tokens.

Hierarchy

  • TokensProvider

Index

Methods

getInitialState

  • The initial state of a language. Will be the state passed in to tokenize the first line.

    Returns IState

tokenize