Function tokenize

    • Tokenize source; concatenating tok.text recovers the input. Unknown language → one untyped token over the whole source.

      Parameters

      • source: string
      • language: string = "typescript"

      Returns Token[]

    Settings

    Member Visibility