Variables and Parameters in Azure Data Factory?

azure azure-data-factory
Ruben Maldonado picture Ruben Maldonado · Nov 13, 2018 · Viewed 10k times · Source

Im just learning ADF, can you explain to me the difference between Variables and Parameters? I cant find a good explanation about it.

Answer

Nicolas Zhang picture Nicolas Zhang · Nov 14, 2018

Parameters are something that can be set to model (dataset, pipeline, etc) at runtime. Without parameters, you model is fixed, for example, without parameters you can only write query like "select * from order where timestamp > '11/01/2018'" in dataset, with parameter 'TS' you can write query like "select * from order where timestamp > '@dataset.TS'" so that your activity run will query and copy data in different time window.

Variables are something that contain real value at runtime and can be assigned to those parameters in app model(dataset, pipeline, etc) to get real things done.

Here are some examples:

https://docs.microsoft.com/en-us/azure/data-factory/control-flow-expression-language-functions#examples

Related questions

The client with object id does not have authorization to perform action 'Microsoft.DataFactory/datafactories/datapipelines/read' over scope

I was trying to invoke data factory pipeline from azure function programmatically. Its throwing following error. link: http://eatcodelive.com/2016/02/24/starting-an-azure-data-factory-pipeline-from-c-net/ AuthorizationFailed: The client 'XXXX-XXXXX-XXXX' with object id 'XXX829e05'XXXX-XXXXX' does not have authorization to perform action 'Microsoft.DataFactory/…

Read More
The subscription is not registered to use namespace 'Microsoft.DataFactory error

Going through this tutorial "Create a pipeline with Copy Activity using Visual Studio" and recieving this error when i hit publish. Error not mentioned anywhere on net and very little help/knowledge on azure generally on web.

Read More
Using Azure Data Factory to get data from a REST API

Is it possible to use Azure Data Factory to get data from a REST API and insert it to a Azure database table?

Read More