Sometimes accessing data requires that you authenticate to external data sources, like Azure Data Lake Store through JDBC. Instead of directly typing your credentials into a notebook, use Azure Databricks secret management to store and reference your credentials in notebooks and jobs. To manage secrets, you must use the Secrets API (Preview).
To set up secrets you must:
This guide shows you how to perform these setup tasks and manage secrets using the Secrets API.
For an end-to-end example of how to use secret management in your workflows, see Secret Management Workflow Example.
For detailed reference information, see Secrets API (Preview).
For information about using Databricks Utilities (dbutils) to reference secrets in notebooks and jobs, see Databricks Utilities.
In this guide:
- Secret Scopes
- Secret Access Control
- Notebook Secret Redaction
- Secret Management Workflow Example