In Azure Databricks you can create two different types of clusters: standard and high concurrency. Standard clusters are the default and can be used with Python, R, Scala, and SQL. High-concurrency clusters are tuned to provide the efficient resource utilization, isolation, security, and the best performance for sharing by multiple concurrently active users. High concurrency clusters support only SQL, Python, and R languages. See High Concurrency Clusters to learn more.
You must have permission to create a cluster. See Configure cluster creation permission.
To create a cluster:
Click the clusters icon in the sidebar.
Click the Create Cluster button at the top of the page.
If you are using a Trial workspace and the trial has expired, the Create Cluster button will be disabled and you will not be able to create a cluster.
Provide the desired cluster configuration.
The cluster configuration includes an auto terminate setting whose default value depends on whether you choose to create a standard or high concurrency cluster:
- Standard clusters are configured to automatically terminate after 120 minutes.
- High concurrency clusters are configured to not terminate automatically.
Click the Create button. The cluster list page shows the status of the new cluster. You will notice the
Pendingstate for the new cluster in the cluster list page.
Once the cluster state changes to
Running, you can attach notebooks and start running commands and queries.
To create a cluster using REST API, see the Clusters API documentation.