Azure Data Lake Storage Gen2 (ADLS Gen2)

The Azure Data Lake Storage (ADLS) Gen2 Connector is a file-based data source connector for reading and validating files stored in Azure Data Lake Storage Gen2.

Configuration Parameters

  • Account Name – Azure storage account name.

  • Account Key – Storage account access key.

  • Connection String – Complete connection string (overrides other authentication parameters).

  • SAS Token – Shared Access Signature token.

  • Tenant ID – Azure AD tenant ID (for OAuth).

  • Client ID – Azure AD application client ID (for OAuth).

  • Client Secret – Azure AD application secret (for OAuth).

  • Filesystem/Container Name – Target container name (required).

  • File Path – Path to the specific file.

  • Rules File Path – Path to rules or configuration file (optional).

ADLS Configuration

Authentication Options

  • Account Key authentication

  • SAS Token authentication

  • Azure AD authentication (Tenant ID, Client ID, Client Secret)

File Size Limitation: Maximum supported file size is 5 GB per file.

Last updated