Class Syntax::Ruby
In: lib/syntax/lang/ruby.rb
Parent: Tokenizer

A tokenizer for the Ruby language. It recognizes all common syntax (and some less common syntax) but because it is not a true lexer, it will make mistakes on some ambiguous cases.

Methods

setup   step  

Constants

KEYWORDS = %w{if then elsif else end begin do rescue ensure while for class module def yield raise until unless and or not when case super undef break next redo retry in return alias defined?}   The list of all identifiers recognized as keywords.

Public Instance methods

Perform ruby-specific setup

Step through a single iteration of the tokenization process.

[Validate]