What is a Databricks SQL warehouse?
This article introduces SQL warehouses (formerly SQL endpoints) and describes how to work with them using the Databricks SQL UI. A SQL warehouse is a compute resource that lets you run SQL commands on data objects within Databricks SQL. Compute resources are infrastructure resources that provide processing capabilities in the cloud.
SQL endpoints name changed to SQL warehouses
Databricks changed the name from SQL endpoint to SQL warehouse because it is more than just an API entry point for running SQL commands. A SQL warehouse is a compute resource for all your data warehousing needs, an integral part of the Lakehouse Platform.
Other compute resource types include Azure Databricks clusters. To work with SQL warehouses using the API, see SQL Warehouses APIs 2.0.
Cluster size
The table in this section maps SQL warehouse cluster sizes to Azure Databricks cluster driver size and worker counts. The driver size only applies to Classic SQL warehouses.
Cluster size | Instance type for driver (applies only to Classic warehouses) | Worker count |
---|---|---|
2X-Small | Standard_E8ds_v4 | 1 |
X-Small | Standard_E8ds_v4 | 2 |
Small | Standard_E16ds_v4 | 4 |
Medium | Standard_E32ds_v4 | 8 |
Large | Standard_E32ds_v4 | 16 |
X-Large | Standard_E64ds_v4 | 32 |
2X-Large | Standard_E64ds_v4 | 64 |
3X-Large | Standard_E64ds_v4 | 128 |
4X-Large | Standard_E64ds_v4 | 256 |
The instance size of all workers is Standard_E8ds_v4.
Each driver and worker has eight 128 GB Standard LRS managed disks attached. Attached disks are charged hourly.