In Azure Databricks, you can create two different types of resources:
- Standard Clusters: Standard clusters have many configuration options to customize and fine tune your Spark jobs.
- Serverless Pools (Beta): With serverless pools, Azure Databricks manages all the resources and you provide a range of instances and instance types for the pool. See Serverless Pools to learn more.
You must have permission to create a cluster. See Configure cluster creation permission.
To create a cluster:
Click the clusters icon in the sidebar.
Click the Create Cluster button at the top of the page.
Provide the desired cluster configuration.
Click the Create button. The cluster list page shows the status of the new cluster. You will notice the
Pendingstate for the new cluster in the cluster list page.
Once the cluster state changes to
Running, you can attach notebooks and start running commands and queries.
To create a cluster using REST API, see the Clusters API documentation.