web / lib/jobs/handlers/url-fetch-job/scheduled-ingest-utils
lib/jobs/handlers/url-fetch-job/scheduled-ingest-utils
scheduled ingest utilities for URL fetch jobs.
Contains functions for managing scheduled ingest configurations, updating statistics, and handling execution history.
Functions
loadScheduledIngestConfig()
loadScheduledIngestConfig(
payload,scheduledIngestId):Promise<ScheduledIngest|null>
Loads scheduled ingest configuration.
Parameters
payload
BasePayload
scheduledIngestId
number | undefined
Returns
Promise<ScheduledIngest | null>
updateScheduledIngestSuccess()
updateScheduledIngestSuccess(
payload,scheduledIngest,importFileId,duration):Promise<void>
Updates scheduled ingest status on successful execution.
Parameters
payload
BasePayload
scheduledIngest
ScheduledIngest
importFileId
string | number
duration
number
Returns
Promise<void>
updateScheduledIngestFailure()
updateScheduledIngestFailure(
payload,scheduledIngest,error):Promise<void>
Updates scheduled ingest status on failed execution.
Parameters
payload
BasePayload
scheduledIngest
ScheduledIngest
error
Error
Returns
Promise<void>
checkForDuplicateContent()
checkForDuplicateContent(
payload,catalogId,dataHash,skipDuplicateChecking):Promise<{ isDuplicate: boolean; existingFile?: \{ id: string; filename: string; }; }>
Checks for duplicate content based on hash.
Parameters
payload
BasePayload
catalogId
string | number | undefined
dataHash
string
skipDuplicateChecking
boolean
Returns
Promise<{ isDuplicate: boolean; existingFile?: \{ id: string; filename: string; }; }>