Azure-Data-Factory on Mark Allison

Which ADF Integration Runtime for my workload?

Wed, 29 Mar 2023 08:26:42 +0000

Self Hosted or Managed Virtual Network for ADF?

I was recently asked which runtime would be better to run ADF pipelines in Azure; use Private Managed Endpoints with the Managed Virtual Network, or provision a Self-Hosted Integration Runtime on a Virtual Machine?

PaaS vs. IaaS

My default position on which technology to use is PaaS where possible. Organisations should focus on providing value to their business, not micro-managing infrastructure. PaaS reduces the operational burden of managing infrastructure in most cases.

Adf Failed To Deactivate Trigger

Mon, 09 Jan 2023 13:21:56 +0000

A colleague had an issue this week with Azure Data Factory (ADF) in that a change to a trigger could not be published. “Ah, I know what this is”, I thought. Those of you familiar with ADF will know that changes to published triggers cannot be made if the trigger is enabled.

Troubleshooting Steps

I began troubleshooting by first of all disabling the trigger. This also resulted in failure. I then proceeded to detach the trigger from the pipeline, copy out the JSON definition and then save and publish, but also got the same error.

ADF HTTP/3 Issue

Tue, 30 Nov 2021 07:44:13 +0000

One of my ADF pipelines started failing recently where a Generic REST API Linked Service gave the following error:

525: SSL handshake failed

Digging deeper into the logs, I see a message from Cloudflare.

It appears that the SSL configuration used is not compatible with Cloudflare. This could happen for a several reasons, including no shared cipher suites.

HTTP/3 QUIC

There had been no code changes in ADF, but something on the source side had changed. After working with the data provider, it turns out that Cloudflare was using HTTP/3 which causes the ADF connection to fail.