ThinBASIC Modules > Tokenizer > Tokenizer Module Classes

cTokenizer

cTokenizer is a class that implements a fast string tokenizer.

How to use cTokenizer

Inside your script, before calling any module specific keyword, add the following:

USES "Tokenizer"

This directive will load the Tokenizer module. The module will add all the needed features into current script execution.

Then a variable must be declared and instantiated in this way:

'---Declare a new tokenizer engine

Dim MyParser As cTokenizer

'---Instantiate new tokenizer

MyParser = New cTokenizer()

Declaration just allocate a new variable in the stack.

Instantiation let new variable takes life calling it's internal creation method (if needed).