web

web / lib/jobs/workflows/scraper-ingest

lib/jobs/workflows/scraper-ingest

Scraper ingest workflow — scraper execution + full pipeline.

Triggered by manual scraper run, schedule, or webhook. Executes the scraper, then if auto-import is enabled, runs dataset-detection and processes all sheets in parallel.

Variables

scraperIngestWorkflow

const scraperIngestWorkflow: WorkflowConfig<"scraper-ingest">