What capabilities does Azure Purview offer for cataloging data and gaining insights in TypeScript

Question

Pulumi · Accepted Answer

Azure Purview is a unified data governance service that helps you manage and govern your on-premises, multicloud, and software-as-a-service (SaaS) data. With Azure Purview, you can automate the discovery of data and catalog it, classify data using built-in classifiers, and establish a data governance policy across your entire data estate.

In Pulumi, you can create an Azure Purview account and configure it to enable your data governance capabilities. Here’s a TypeScript program that illustrates how to provision a Purview Account using Pulumi with the `azure-native` package, which is the preferred way to work with Azure resources using Pulumi:

```typescript
import * as pulumi from "@pulumi/pulumi";
import * as azure_native from "@pulumi/azure-native";

// Create an Azure resource (Resource Group)
const resourceGroup = new azure_native.resources.ResourceGroup("myResourceGroup");

// Create an Azure Purview Account in the given resource group.
const purviewAccount = new azure_native.purview.Account("myPurviewAccount", {
    resourceGroupName: resourceGroup.name,
    accountName: "my-purview-account",
    location: resourceGroup.location,
    identity: {
        type: "SystemAssigned",
    },
    publicNetworkAccess: "Enabled", // This allows the Purview Account to be accessible over the public internet.
    managedResourceGroupName: "my-managed-resources",
    sku: {
        name: "Standard", // Choose the appropriate SKU for your needs here.
        capacity: 4, // Choose the capacity as needed.
    },
});

// Export the primary key of the Purview Account
const pulumiOutput = pulumi.all([purviewAccount.name, resourceGroup.name]);
pulumiOutput.apply(([accountName, rgName]) => 
    azure_native.purview.listAccountKeys({
        resourceGroupName: rgName,
        accountName: accountName,
    }).then(keys => keys.atlasKafkaPrimaryEndpoint)
).apply(primaryEndpoint => {
    pulumi.export("purviewAtlasKafkaPrimaryEndpoint", primaryEndpoint);
});
```

Here's what each part of the program does:

- Imports the necessary Pulumi modules.
- Creates a new Azure resource group to hold all of your resources.
- Creates an Azure Purview account within the resource group that you created. A Purview account is the fundamental container where your data assets will be cataloged.
  - `identity`: Specifies that the Purview Account will use a system-assigned managed identity for access to other Azure services. This type of identity is managed by Azure and is tied to the lifecycle of the resource.
  - `publicNetworkAccess`: This property is set to "Enabled" meaning the Purview Account can be accessed over the internet.
  - `sku`: The SKU determines the pricing tier and capacity of the Purview account.

Lastly, the script uses the `pulumi.all()` function to combine multiple outputs, resource name and resource group name in this case, and then applies another function to retrieve the primary key of the Purview Account using the `listAccountKeys` function. This key is necessary to connect and interact with the Purview Account programmatically.

The final `apply` call exports the primary Kafka endpoint of the Purview Account which you can use to push logs or events from Kafka into Purview for data cataloging.

This code provides a foundational example of how to use Pulumi to configure Azure Purview for data cataloging and insights. Additional configurations and resource associations may be required based on specific use cases or advanced governance requirements.

For more information about the `Account` resource, please visit the [Pulumi Azure Native Account documentation](https://www.pulumi.com/registry/packages/azure-native/api-docs/purview/account/).