Useful things I know about building data platform in Azure and Power BI
SQL Saturday Oslo is approaching and I’m giving a session where I compare SSIS, Databricks and Mapping Data Flows for data transformation in Data Factory. One of the problems I got when setting this up is that when running SSIS in Data Factory you must handle the Integration Runtime and start (and stop) this efficiently. […]
This post gives you everything you need to set up a pipeline in Data Factory so that your Power BI datasets can be refreshed as soon as the data is available. It builds on this post where we have set up some Azure Functions to use the Power BI APIs. The obvious reason for setting […]
Microsoft have just announced support for PowerShell in Azure functions runtime 2. The examples I have shown here earlier used the experimental support in runtime 1. This blogpost will show how to use Azure Functions runtime 2 with PowerShell and KeyVault to use the Power BI REST API. Related posts:Connecting Azure Functions to Key VaultRefresh […]
Azure Functions is really nice when you want to run some code, and this post shows how to connect your Function to Key Vault so that you don’t have to store secrets in your Azure Function. In this example I’ll be using PowerShell and with that runtime version 1 of Azure Functions. Next, you can […]
Azure Functions is a great way to do the things Data Factory can’t. In this example I want to use it to get a Oauth token from Strava, and I want all my secret stuff to be stored in Azure Key Vault. Data Factory can’t lookup values in the Key Vault and build a header […]