Cluster Log Delivery

When creating a cluster, you can specify a location to deliver driver and Spark worker logs. Logs are delivered every five minutes to your chosen destination. The final destination depends on the cluster ID. If the specified destination is dbfs:/cluster-log-delivery, cluster logs for 0630-191345-leap375 are delivered to dbfs:/cluster-log-delivery/0630-191345-leap375.



This feature is also available in the REST API. More information can be found at Clusters API and Cluster log delivery examples.