Models
This section documents all data models in the project.
Base Models
model.base_models
model.base_crawling_models
model.base_direct_publisher_models
model.base_iterative_publisher_models
model.base_mapped_models
model.base_pagination_publisher_models
BasePaginationPublisherSource
Bases: BaseModel
Configuration model for the base pagination publisher scraper source. The landing_page_url is the URL to scrape to
get the initial pagination URL.
Variables
landing_page_url (str): The landing URL to scrape