THE SQL Server Blog Spot on the Web

Welcome to SQLblog.com - The SQL Server blog spot on the web Sign in | |
in Search

Jorg Klein

Microsoft Data Platform MVP from the Netherlands

Orchestrate Azure Data Factory pipelines and other Azure Data Platform management tasks using Azure Automation

You can read this blog post at this link: https://jorgklein.com/2016/11/14/orchestrate-azure-data-factory-pipelines-and-other-azure-data-platform-management-tasks-using-azure-automation

This blog has moved to www.jorgklein.com There will be no further posts on sqlblog.com. Please update your feeds accordingly.

You can follow me on twitter: http://twitter.com/jorg__klein

Published Monday, November 14, 2016 12:18 PM by jorg

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

 

AndrewvR said:

That is really helpful, thank you.  I am aware of the Automation piece, but had not looked at it and so had not brought it into my daily processes/workflows.  But now I will!

November 18, 2016 2:31 AM
 

Valter said:

Hi ..

thanks for this great post..

unfortunately i think that this method only works when calling the pipeline for the first time.. than the "second time" setting  active period to "yesterday" does not force to run the pipeline again. This period got to be set as a date before the date of the last pipeline success run (if last pipeline forced run was yesterday to re run again i got to set active time period to 2 day ago).

Neither setting the active date period in the future at the end of the powershell script solve the problem.

Regards

January 26, 2017 8:55 AM
 

Man said:

There is workaround to make it work for "second time", but the df can only trigger once in every 15 mins:

1. The df pipeline schedule should be "every 15 minutes" instead of daily

2. Updated the “TriggerAdfPipeline.ps1” to make it work for "second time":

$sdt = [System.DateTime]::Today.AddDays(-1) #Yesterday 12:00:00 AM

$edt = [System.DateTime]::Today.AddSeconds(-1) #Yesterday 11:59:59 PM

to

$sdt = Get-Date

$sdt = $sdt.AddMinutes(-2)

$edt = Get-Date

$edt = $edt.AddMinutes(-1)

February 2, 2017 12:35 AM
 

Sri said:

Super.

February 24, 2017 10:02 PM
 

Vishy said:

How to accomplish it, if you have multiple copy activities in a pipeline?

April 21, 2017 1:56 PM
 

Shibu said:

How to get runtime of a dataset or a pipeline ?

If im looping thru each dataset or apipeline, then how to subtraact he processing start time and Processing End Time. ?

August 8, 2017 12:52 AM

Leave a Comment

(required) 
(required) 
Submit

About jorg

Jorg Klein, Microsoft Data Platform MVP from the Netherlands.
Privacy Statement