Jesse Beder
|
852e5b63e5
|
Instead of deriving different tokens from a base Token class, we now use an enumerated TOKEN_TYPE to distinguish types. This is so we don't have to cast all the time when parsing the resulting token stream.
Also, removed start/end stream tokens.
|
2008-06-30 21:47:21 +00:00 |
|
Jesse Beder
|
5f8252ee6f
|
Moved scalar scanning-related parameters to a struct.
Renamed the valid/possible tokens to a single variable status with enums valid, invalid, and unverified.
|
2008-06-29 17:39:33 +00:00 |
|
Jesse Beder
|
ff99f85a6d
|
Moved the input stream, together with line/column info, into its own class, which allowed some other stuff just to pass the stream, and not have to be a member of Scanner.
|
2008-06-29 06:32:13 +00:00 |
|
Jesse Beder
|
c63ebbd878
|
Moved the simple key validation to before each token scan (plus at newlines of scalars).
|
2008-06-28 16:46:37 +00:00 |
|
Jesse Beder
|
11706abbb7
|
Added simple keys.
There's a bug (and question): should we test simple keys' validity BEFORE stuff or AFTER stuff?
|
2008-06-28 06:36:59 +00:00 |
|