Class Scrubyt::URIBuilder
In: lib/scrubyt/core/shared/u_r_i_builder.rb
Parent: Object

Build URIs from different parameters

When crawling to further pages which are machine-generated (most typically "next" pages) we need to detect the pattern and generate the next URI based on the edetected rule. This class provides methods to build URIs based on different criteria.

The other possibility is to use constant objects (‘Next’ links, or image links (like right arrow) pointing to the next page). URIBUilder supports both possibilities.

Methods

Attributes

current_uri  [R] 
increment  [R] 
limit  [R] 
next_increment  [R] 
next_page_example  [R] 
next_page_pattern  [R] 
next_param  [R] 

Public Class methods

Public Instance methods

Used when generating the next URI (as opposed to ‘clicking’ the next link)

[Validate]