Renderowana dokumentacja
Ta strona renderuje Markdown i Mermaid modulu bezposrednio z publicznego zrodla dokumentacji.
Overview#
The Ingestion domain provides job management for data ingestion pipelines. It handles the creation, tracking, and retry logic for ingestion jobs that process data from various sources into the platform, supporting multiple source types with automatic retry and error capture.
Key Features#
- Ingestion job creation with source identification and payload configuration
- Job status tracking through lifecycle states (pending, running, completed, failed, cancelled)
- Automatic retry logic with configurable maximum attempts and exponential backoff
- Error message capture for failed jobs
- Multi-tenant job isolation per organization
- Support for multiple source types (blockchain ETL, CSV import, API sync, streaming, file upload)
Use Cases#
- Importing blockchain transaction data for financial investigations
- Bulk importing CSV data files into the platform
- Synchronizing data from third-party APIs on schedule
- Processing user-uploaded evidence files through ingestion pipelines
Integration#
The Ingestion domain integrates with Ingestion Pipeline for pipeline definitions, Data Source for configuration, Connector for data connectors, Transform for data transformation, and Monitor for job monitoring.
Last Reviewed: 2026-02-05