DataHelge – Page 2 – Useful things I know about building data platform in Azure and Power BI

Custom pagination when copying data from REST APIs

June 8, 2019 at 3:57 pm

Azure Data Factory has native support for copying data from REST APIs. There are some pagination rules supported (listed here), but what to do when the API you are using does not support this? In my example I do not have any information in the header or body of my requests, but rather use the […]

Refresh Power BI datasets with Data Factory

54 Helge Rege Gårdsvoll

May 3, 2019 at 2:36 pm

This post gives you everything you need to set up a pipeline in Data Factory so that your Power BI datasets can be refreshed as soon as the data is available. It builds on this post where we have set up some Azure Functions to use the Power BI APIs. The obvious reason for setting […]

Using Azure Functions for Power BI REST API

52 Helge Rege Gårdsvoll

May 3, 2019 at 2:36 pm (last edited May 28, 2019 at 12:08 pm)

Microsoft have just announced support for PowerShell in Azure functions runtime 2. The examples I have shown here earlier used the experimental support in runtime 1. This blogpost will show how to use Azure Functions runtime 2 with PowerShell and KeyVault to use the Power BI REST API. Related posts:Connecting Azure Functions to Key VaultRefresh […]

Connecting Azure Functions to Key Vault

36 Helge Rege Gårdsvoll

April 21, 2019 at 8:09 am (last edited April 21, 2019 at 9:56 am)

Azure Functions is really nice when you want to run some code, and this post shows how to connect your Function to Key Vault so that you don’t have to store secrets in your Azure Function. In this example I’ll be using PowerShell and with that runtime version 1 of Azure Functions. Next, you can […]

Calling Azure Functions from Data Factory with authentication

29 Helge Rege Gårdsvoll

April 20, 2019 at 9:32 pm (last edited April 21, 2019 at 9:57 am)

Azure Functions is a great way to do the things Data Factory can’t. In this example I want to use it to get a Oauth token from Strava, and I want all my secret stuff to be stored in Azure Key Vault. Data Factory can’t lookup values in the Key Vault and build a header […]

Do you want your reports available for anyone?

20 Helge Rege Gårdsvoll

April 12, 2019 at 3:05 pm (last edited April 12, 2019 at 4:27 pm)

Here is a security tip to check before you go home for the weekend. Can you do this for reports in Power BI? Publishing to web can be a great feature. One example from NVE (the Norwegian Water Resources and Energi Directorate, or Norges Vassdrags- og Energidirektorat) have published open statistics on water leves of […]