> For the complete documentation index, see [llms.txt](https://docs.qyrus.com/data-testing/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.qyrus.com/data-testing/data-sources/index.md).

# Data Source Connectors

> The Data Testing platform supports a wide variety of data source connectors, enabling seamless integration with your entire data ecosystem.

## Overview

Data sources are the foundation of any validation job. Each connector requires specific configuration details such as:

* 🔐 Authentication & Credentials
* 🖥️ Host Information & Connection Details
* 📝 Query Configuration
* 🔑 Optional Access Keys & Parameters

{% hint style="info" %}
Before creating a job, ensure you have the necessary connection information for your target data source. Consult your database administrator or cloud provider for exact credentials and endpoint details.
{% endhint %}

***

## 🌐 APIs & Webhooks

Connect to REST APIs and webhook endpoints for real-time data validation.

| Connector         | Use Case                                        |
| ----------------- | ----------------------------------------------- |
| **API Connector** | Real-time API validation, REST endpoint testing |

[Configure API Connector →](/data-testing/apis-and-webhooks/api-connector.md)

***

## 🗄️ SQL Databases

Connect to traditional relational SQL databases for structured data validation.

{% tabs %}
{% tab title="Cloud Platforms" %}
**Managed cloud SQL services:**

* **Amazon Redshift** - Data warehouse on AWS
* **Snowflake** - Cloud data platform

[Browse Cloud SQL →](/data-testing/sql-databases/index.md)
{% endtab %}

{% tab title="Enterprise Databases" %}
**Enterprise-grade databases:**

* **Oracle Database** - Industry-standard enterprise database
* **Microsoft SQL Server** - Windows-native SQL database
* **IBM DB2** - Enterprise database solution

[Browse Enterprise SQL →](/data-testing/sql-databases/index.md)
{% endtab %}

{% tab title="Open Source" %}
**Community and open-source databases:**

* **MySQL** - Most popular open-source relational database

[Browse Open Source SQL →](/data-testing/sql-databases/index.md)
{% endtab %}
{% endtabs %}

[View All SQL Connectors →](/data-testing/sql-databases/index.md)

***

## 🚀 NoSQL Databases

Connect to modern multi-model and document databases for flexible data validation.

| Connector     | Type                 | Best For                            |
| ------------- | -------------------- | ----------------------------------- |
| **MongoDB**   | Document Database    | Document-based validation           |
| **SurrealDB** | Multi-Model Database | Complex, multi-type data validation |

[View All NoSQL Connectors →](/data-testing/nosql-databases/index.md)

***

## 💾 Blob Storage & File Systems

Connect to cloud storage and file systems for batch data validation.

| Connector                        | Platform        | Use Case                      |
| -------------------------------- | --------------- | ----------------------------- |
| **Amazon S3**                    | AWS             | S3 bucket data validation     |
| **Azure Data Lake Storage Gen2** | Microsoft Azure | ADLS Gen2 file validation     |
| **SFTP**                         | Any SFTP Server | Remote file system validation |

[View All Storage Connectors →](/data-testing/blob-storage-and-file-systems/index.md)

***

## 🔐 Security Considerations

{% hint style="warning" %}
**Important Security Practices:**

1. ✅ Store credentials securely using environment variables or secrets management
2. ✅ Use read-only database users when possible
3. ✅ Restrict network access to your data sources
4. ✅ Regularly audit and rotate credentials
5. ✅ Enable encryption in transit (TLS/SSL)
6. ✅ Never commit credentials to version control
   {% endhint %}

***

## 📋 Connector Comparison

| Feature              | SQL               | NoSQL        | APIs           | Blob Storage      |
| -------------------- | ----------------- | ------------ | -------------- | ----------------- |
| **Real-time Access** | ✅                 | ✅            | ✅              | ⚠️ Limited        |
| **Authentication**   | Username/Password | Various      | API Keys/OAuth | Cloud Credentials |
| **Query Language**   | SQL, SurrealQL    | Native Query | REST           | File Paths        |
| **Large Data**       | ✅                 | ✅            | ⚠️ Paginated   | ✅                 |
| **Streaming**        | ⚠️ Limited        | ✅            | ✅              | ⚠️ Limited        |

***

## Getting Started

1. **Choose your connector type** based on where your data resides
2. **Gather connection details** from your IT/DevOps team
3. **Configure the connector** in your Data Testing job
4. **Validate the connection** before running validations
5. **Create your first validation job** using the configured source

{% hint style="info" %}
Need help? Check out our [Demo Configurations](/data-testing/demo-walkthroughs/index.md) to see real-world connector setups!
{% endhint %}

***

## Quick Links

* [API Connector Setup](/data-testing/apis-and-webhooks/api-connector.md)
* [SQL Connectors Guide](/data-testing/sql-databases/index.md)
* [NoSQL Connectors Guide](/data-testing/nosql-databases/index.md)
* [Blob Storage Guide](/data-testing/blob-storage-and-file-systems/index.md)
* [Demo: DB to DB](/data-testing/demo-walkthroughs/index/db-to-db.md)
* [Demo: API Integration](/data-testing/demo-walkthroughs/index/api-to-file.md)