I'm exploring the use of the Databricks REST API to access data from underlying tables without relying on generating personal access tokens (PATs) through the web UI. Imagine I have Platform A, from which I obtain an "Authorization token," and I aim to use this token to authenticate in Databricks (Platform B). Both platforms are connected via the same identity provider (IDP) and employ single sign-on.
I have a couple of questions:
- Can I authenticate in Databricks using the token obtained from Platform A and then generate a PAT using an API call?
- Are there alternative methods to programmatically generate this token?
Despite consulting Databricks documentation, I couldn't find guidance on these aspects. Most examples focus on generating personal access tokens through the web UI.
Additionally, when I attempted to use Postman to include the Authorization header with a JWT token, I encountered an error stating "unable to load OAuth config."
I appreciate any insights or suggestions. Thank you.