# Data Source Connectors

> The Data Testing platform supports a wide variety of data source connectors, enabling seamless integration with your entire data ecosystem.

## Overview

Data sources are the foundation of any validation job. Each connector requires specific configuration details such as:

* 🔐 Authentication & Credentials
* 🖥️ Host Information & Connection Details
* 📝 Query Configuration
* 🔑 Optional Access Keys & Parameters

{% hint style="info" %}
Before creating a job, ensure you have the necessary connection information for your target data source. Consult your database administrator or cloud provider for exact credentials and endpoint details.
{% endhint %}

***

## 🌐 APIs & Webhooks

Connect to REST APIs and webhook endpoints for real-time data validation.

| Connector         | Use Case                                        |
| ----------------- | ----------------------------------------------- |
| **API Connector** | Real-time API validation, REST endpoint testing |

[Configure API Connector →](/data-testing/apis-and-webhooks/api-connector.md)

***

## 🗄️ SQL Databases

Connect to traditional relational SQL databases for structured data validation.

{% tabs %}
{% tab title="Cloud Platforms" %}
**Managed cloud SQL services:**

* **Amazon Redshift** - Data warehouse on AWS
* **Snowflake** - Cloud data platform

[Browse Cloud SQL →](/data-testing/sql-databases/index.md)
{% endtab %}

{% tab title="Enterprise Databases" %}
**Enterprise-grade databases:**

* **Oracle Database** - Industry-standard enterprise database
* **Microsoft SQL Server** - Windows-native SQL database
* **IBM DB2** - Enterprise database solution

[Browse Enterprise SQL →](/data-testing/sql-databases/index.md)
{% endtab %}

{% tab title="Open Source" %}
**Community and open-source databases:**

* **MySQL** - Most popular open-source relational database

[Browse Open Source SQL →](/data-testing/sql-databases/index.md)
{% endtab %}
{% endtabs %}

[View All SQL Connectors →](/data-testing/sql-databases/index.md)

***

## 🚀 NoSQL Databases

Connect to modern multi-model and document databases for flexible data validation.

| Connector     | Type                 | Best For                            |
| ------------- | -------------------- | ----------------------------------- |
| **MongoDB**   | Document Database    | Document-based validation           |
| **SurrealDB** | Multi-Model Database | Complex, multi-type data validation |

[View All NoSQL Connectors →](/data-testing/nosql-databases/index.md)

***

## 💾 Blob Storage & File Systems

Connect to cloud storage and file systems for batch data validation.

| Connector                        | Platform        | Use Case                      |
| -------------------------------- | --------------- | ----------------------------- |
| **Amazon S3**                    | AWS             | S3 bucket data validation     |
| **Azure Data Lake Storage Gen2** | Microsoft Azure | ADLS Gen2 file validation     |
| **SFTP**                         | Any SFTP Server | Remote file system validation |

[View All Storage Connectors →](/data-testing/blob-storage-and-file-systems/index.md)

***

## 🔐 Security Considerations

{% hint style="warning" %}
**Important Security Practices:**

1. ✅ Store credentials securely using environment variables or secrets management
2. ✅ Use read-only database users when possible
3. ✅ Restrict network access to your data sources
4. ✅ Regularly audit and rotate credentials
5. ✅ Enable encryption in transit (TLS/SSL)
6. ✅ Never commit credentials to version control
   {% endhint %}

***

## 📋 Connector Comparison

| Feature              | SQL               | NoSQL        | APIs           | Blob Storage      |
| -------------------- | ----------------- | ------------ | -------------- | ----------------- |
| **Real-time Access** | ✅                 | ✅            | ✅              | ⚠️ Limited        |
| **Authentication**   | Username/Password | Various      | API Keys/OAuth | Cloud Credentials |
| **Query Language**   | SQL, SurrealQL    | Native Query | REST           | File Paths        |
| **Large Data**       | ✅                 | ✅            | ⚠️ Paginated   | ✅                 |
| **Streaming**        | ⚠️ Limited        | ✅            | ✅              | ⚠️ Limited        |

***

## Getting Started

1. **Choose your connector type** based on where your data resides
2. **Gather connection details** from your IT/DevOps team
3. **Configure the connector** in your Data Testing job
4. **Validate the connection** before running validations
5. **Create your first validation job** using the configured source

{% hint style="info" %}
Need help? Check out our [Demo Configurations](/data-testing/demo-walkthroughs/index.md) to see real-world connector setups!
{% endhint %}

***

## Quick Links

* [API Connector Setup](/data-testing/apis-and-webhooks/api-connector.md)
* [SQL Connectors Guide](/data-testing/sql-databases/index.md)
* [NoSQL Connectors Guide](/data-testing/nosql-databases/index.md)
* [Blob Storage Guide](/data-testing/blob-storage-and-file-systems/index.md)
* [Demo: DB to DB](/data-testing/demo-walkthroughs/index/db-to-db.md)
* [Demo: API Integration](/data-testing/demo-walkthroughs/index/api-to-file.md)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.qyrus.com/data-testing/data-sources/index.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.