Exploring how to use and deploy Azure Data Factory

In the previous blog, we have prepared 3 basic things that are enough for Data Factory to work on. Now I will continue with deploying them to Data Factory through Azure portal.

Create Data Factory

After logging in to Azure portal, just follow these steps to create a new Data Factory

In the create popup, fill in the information and click Create

And we have it created.

Click the action Author and deploy to go to the deployment editor with nothing here yet.

Deploy Data Factory Resources

To create a Linked service, click New data store and select a type of service. In this case, I will choose Azure SQL Database

Now, the editor will show the template for AzureSqlLinkedService, but we have it already, just copy the prepared json in ProdSQLLinkedService.json file to the editor and click Deploy

When it’s deployed successfully, we will see it in the Linked services list

Just follow 3 steps to deploy other resources

  1. Select the correct type of resource, click ... More to select dataset or pipeline
  2. Copy the prepared json to the editor
  3. Click Deploy and check the resource on the resources list

After deploying everything, we will see something like this

Data Factory Resource Explorer

Click Monitor & Manage at the Data factory information screen

Now we are in the Data Factory’s resource explorer to verify our task is set up correctly, and check the running activity status as well.

To rerun a failed activity or just for debugging if you have a change on the resources, use the rerun button on an activity.