➕Create Compare Job

Compare jobs validate and identify differences between two data sources.

Step 1: Job Type Selection

• Select Job Type as Compare.

• Enter a Description for the job.

• Click Next.

Select Job Type

Step 2: Connection Configuration

1. Select the Source Data Source Connector from the dropdown.

2. Enter the required Configuration Details for the Source.

3. Click Verify to test the connection.

4. Select the Target Data Source Connector from the dropdown.

5. Enter the required Configuration Details for the Target.

6. Click Verify to test the connection.

7. Once both connections are verified successfully, click Next.

Source Configuration

Target Configuration

Step 3: Column Code Transformation & Column Mapping

Column Code Transformation

Apply column-level transformations to source and target data before comparison.

1. Save the job first.

2. Create the required functions for this job. Create Fucntions

3. Reopen the job in Edit Mode.

4. Click Fetch to load available functions.

5. Select and apply the desired transformation functions.

Apply Column Transformations

Column Mapping

Column mapping is required when source and target have different column names but represent the same data.

Example: Source transaction_id maps to target transaction_number.

• Map columns in the Mapping Table by referencing source and target column metadata.

• Use AutoMapping to automatically identify potential mappings, then review and verify results manually.

• To ignore unwanted columns:

  • With AutoMapping: Disable the respective rows in the mapping table.

  • With Manual Mapping: Enter unwanted column names in the provided fields for both Source and Target.

Column Mapping

Note: AutoMapping and Data Source Information are supported only for database connectors. For non-database connectors (API, SFTP, S3, ADLS), use manual mapping.

Step 4: Primary or Composite Key Selection

Define a primary key or composite key for record comparison.

• Primary Key (Single Column): Select Single column, enter the column name, and press Enter.

• Composite Key (Multiple Columns): Select Composite Key, enter multiple column names separated by commas, and press Enter.

Primary Key Selection

Step 5: Save or Run the Job

Choose an execution option:

• Save – Saves job configuration for later execution.

• Save and Start – Saves and immediately starts the comparison.

• Quick Run – Optimized execution for faster processing (supports up to 500,000 records).

Start Job

Demo:

• DB-to-DB Compare Demo

• API-to-File Compare Demo