Class Syntax::Default
In: lib/syntax.rb
Parent: Object

A default tokenizer for handling syntaxes that are not explicitly handled elsewhere. It simply yields the given text as a single token.

Methods

tokenize  

Public Instance methods

Yield the given text as a single token.

[Validate]