Using azure-native databricks with logic

Question

Pulumi · Accepted Answer

To use Azure Databricks with Azure Logic Apps, you will typically perform the following steps:

1. Create an Azure Databricks workspace.
2. Set up an Azure Logic App.
3. Create a trigger and an action in your Logic App that interacts with Azure Databricks.

Below you'll see a Pulumi program that will create an Azure Databricks workspace using the `azure-native.databricks.Workspace` resource. This workspace is the environment for running your data analytics workloads. After setting up the workspace, you'd then use the Azure portal or another method to configure a Logic App to trigger or manage Databricks jobs, as Pulumi doesn't directly define Logic App workflows.

Here's a sample program that sets up a Databricks workspace:

```typescript
import * as pulumi from "@pulumi/pulumi";
import * as azure_native from "@pulumi/azure-native";

const resourceGroupName = "my-resource-group"; // Replace with your resource group name
const location = "West US 2"; // Replace with the location you want to deploy resources in
const workspaceName = "my-databricks-workspace"; // Replace with the desired name of your Databricks workspace

// Create an Azure Resource Group if you don't have one already
const resourceGroup = new azure_native.resources.ResourceGroup("myResourceGroup", {
    resourceGroupName: resourceGroupName,
    location: location,
});

// Create the Databricks workspace
const databricksWorkspace = new azure_native.databricks.Workspace("myWorkspace", {
    resourceGroupName: resourceGroupName,
    workspaceName: workspaceName,
    location: resourceGroup.location,
    sku: {
        name: "standard", // Use other SKU if needed, like "premium" or "trial"
    },
    tags: {
        "Environment": "Development",
    },
});

export const workspaceUrl = pulumi.interpolate`https://${databricksWorkspace.workspaceName}.azuredatabricks.net`;

```

This program sets up a basic Databricks workspace that you can use to run analytics jobs.

### Explanation:

1. **Resource Group**: Resources in Azure are grouped into resource groups, which are containers that hold related resources for an Azure solution. I've assumed you might be creating a new one for this setup.
   
2. **Workspace**: The Databricks Workspace is where you can collaborate with others, manage access to notebooks, clusters, jobs, and data. The setup here uses a standard SKU, which you can change based on your needs.

3. **Exports**: In the end, the program exports the workspace URL. This is a helpful piece of information you'll need to access the Databricks workspace after it's been provisioned.

To proceed with setting up an Azure Logic App that connects to this workspace:

- Go to the [Azure Portal](https://portal.azure.com/).
- Search for Logic Apps and go through the process of creating one.
- Create a trigger, such as an HTTP request or a schedule.
- Add an action to interact with the Azure Databricks workspace you just created. There are built-in actions available for starting or stopping jobs.

Remember, any specific Logic App definitions are not set within Pulumi. Once your Databricks workspace is created with Pulumi, you'll define the workflows manually in Azure Portal. The exported workspace URL will be crucial when configuring the Databricks connection within your Logic App workflow.