Working with Databricks Compute on Azure
Note
For creating Databricks compute connection for no-Spark deployment, add Storage blob data contributor permission to the service principal on the storage account.
For No-Spark, if Catalog is disabled for the Databricks workspace, you must create Databricks compute connection. In case, the catalog is enabled, create Databricks SQL Warehouse connection.
Prerequisites for OAuth Connection
To create Databricks Compute connection with OAuth, you need to complete the following prerequisites.
Create a Service Principal
Go to the user profile, click Settings, then Identity and Access. Under Service Principal [Manage], click Add Service Principal, and note generated Application ID or Client ID; this will be OAuth2ClientId.
Generate a secret for this Service Principal and note it down as it is OAuth2Secret.
Grant required permissions for Databricks compute cluster: Add the service principal with the permission "CAN MANAGE".
Prepare the JDBC URL:
Get the JDBC URL from the cluster's JDBC tab. For example, if the JDBC URL is:
jdbc:databricks://adb-346948531508790.10.azuredatabricks.net:443/default;transportMode=http;ssl=1;httpPath=sql/protocolv1/o/346948531508790/0603-063832-6r36ca4x;AuthMech=3;UID=token;PWD=<personal-access-token>Change the URL as follows (change AuthMech=11 and add Auth_Flow=1 to the parameters):
jdbc:databricks://adb-650081446221384.4.azuredatabricks.net:443/default;transportMode=http;ssl=1;AuthMech=11;httpPath=sql/protocolv1/o/650081446221384/0809-080132-67
1a9aak;Auth_Flow=1Working with Databricks compute connection with Personal Token and OAuth
Kyvos supports Databricks compute connection to enable the execution of multidimensional model and relational multidimensional model queries.
Creating Databricks compute connection with Personal Token
From the Toolbox, click Setup, then choose Connections.
From the Actions menu ( ⋮ ), click Add Connection.
Enter a Name for the connection.
From the Category drop-down list, select the Warehouse option.
From the Provider list, select the DatabricksCompute option.
The Driver Class field is prepopulated.
Enter Databricks Compute JDBC URL. For more information, see Microsoft documentation.
Change the URL as follows:
jdbc:databricks://adb-346948531508790.10.azuredatabricks.net:443/default;httpPath=sql/protocolv1/o/346948531508790/0617-065358-ijzzqhl3;Select Authentication type as Personal Access Token list.
Enter Username as token.
Enter Databricks Personal Access Token for the Databricks SQL workspace in the Password field.
The Use as Source checkbox is disabled as this is a source connection.
To use this connection as the default SQL engine, select the Is Default SQL Engine checkbox.
Keep the Catalog Enabled checkbox unselected.
Click the Properties link to view or set properties.
After configuring the settings, click the Save button.
To refresh connections, click the Actions menu ( ⋮ ) at the top of the Connections column and select Refresh.
Creating Databricks Compute connection with OAuth
You can create Databricks compute connection with OAuth machine-to-machine (M2M) authentication type. See Prerequisites for more details.
From the Toolbox, click Setup, then choose Connections.
From the Actions menu ( ⋮ ), click Add Connection.
Enter a Name for the connection.
From the Category drop-down list, select the Warehouse option.
From the Provider list, select the DatabricksCompute option.
The Driver Class field is prepopulated.
Enter Databricks Compute JDBC URL. For more information, see Microsoft documentation.
Change the URL as follows (change AuthMech=11 and add Auth_Flow=1 to the parameters):
jdbc:databricks://adb-650081446221384.4.azuredatabricks.net:443/default;transportMode=http;ssl=1;AuthMech=11;httpPath=sql/protocolv1/o/650081446221384/0809-080132-671a9aak;Auth_Flow=1Select OAuth from the Authentication Type list. Upon selecting this option, the Client ID and Client Secret fields are displayed.
In the Client ID field, enter the value of the service principal’s Application ID, Client ID, or OAuth2ClientId.
In the Client Secret field, enter the value of the secret created for the above service principal or the OAuth2ClientId.
The Use as Source checkbox is disabled as this is a source connection.
To use this connection as the default SQL engine, select the Is Default SQL Engine checkbox.
Keep the Catalog Enabled checkbox unselected.
Click the Properties link to view or set properties.
After configuring the settings, click the Save button.
To refresh connections, click the Actions menu ( ⋮ ) at the top of the Connections column and select Refresh.