Added bracket [] parsing support in the tokenizer for complex data types.
Authored by: madanner 2002-11-17
Parent: [r222]
Child: [r224]