Class | Ferret::Analysis::LetterAnalyzer |
In: |
ext/r_analysis.c
|
Parent: | Ferret::Analysis::Analyzer |
A LetterAnalyzer creates a TokenStream that splits the input up into maximal strings of characters as recognized by the current locale. If implemented in Ruby it would look like;
class LetterAnalyzer def initialize(lower = true) @lower = lower end def token_stream(field, str) return LetterTokenizer.new(str, @lower) end end
As you can see it makes use of the LetterTokenizer.
Create a new LetterAnalyzer which downcases tokens by default but can optionally leave case as is. Lowercasing will be done based on the current locale.
lower: | set to false if you don‘t want the field‘s tokens to be downcased |