Log In
Or create an account ->
Imperial Library
Home
About
News
Upload
Forum
Help
Login/SignUp
Index
Azure Data Factory Cookbook
Why subscribe?
Contributors
About the authors
About the reviewers
Packt is searching for authors like you
Preface
Who this book is for
What this book covers
To get the most out of this book
Download the example code files
Download the color images
Conventions used
Sections
Getting ready
How to do it…
How it works…
There's more…
See also
Get in touch
Reviews
Chapter 1: Getting Started with ADF
Introduction to the Azure data platform
Getting ready
How to do it...
How it works...
Creating and executing our first job in ADF
Getting ready
How to do it...
How it works...
There's more...
See also
Creating an ADF pipeline by using the Copy Data tool
Getting ready
How to do it...
How it works...
There's more...
Creating an ADF pipeline using Python
Getting ready
How to do it...
How it works...
There's more...
See also
Creating a data factory using PowerShell
Getting ready
How to do it…
How it works...
There's more...
See also
Using templates to create ADF pipelines
Getting ready
How to do it...
How it works...
See also
Chapter 2: Orchestration and Control Flow
Technical requirements
Using parameters and built-in functions
Getting ready
How to do it…
How it works…
There's more…
See also
Using Metadata and Stored Procedure activities
Getting ready
How to do it…
How it works…
There's more…
Using the ForEach and Filter activities
Getting ready
How to do it…
How it works…
Chaining and branching activities within a pipeline
Getting ready
How to do it…
There's more…
Using the Lookup, Web, and Execute Pipeline activities
Getting ready
How to do it…
How it works…
There's more…
See also
Creating event-based triggers
Getting ready
How to do it…
How it works…
There's more…
See also
Chapter 3: Setting Up a Cloud Data Warehouse
Technical requirements
Connecting to Azure Synapse Analytics
Getting ready
How to do it…
How it works…
There's more…
Loading data to Azure Synapse Analytics using SSMS
Getting ready
How to do it…
How it works…
There's more…
Loading data to Azure Synapse Analytics using Azure Data Factory
Getting ready
How to do it…
How it works…
There's more…
Pausing/resuming an Azure SQL pool from Azure Data Factory
Getting ready
How to do it…
How it works…
There's more…
Creating an Azure Synapse workspace
Getting ready
How to do it…
There's more…
Loading data to Azure Synapse Analytics using bulk load
Getting ready
How to do it…
How it works…
Copying data in Azure Synapse Orchestrate
Getting ready
How to do it…
How it works…
Using SQL on-demand
Getting ready
How to do it…
How it works…
Chapter 4: Working with Azure Data Lake
Technical requirements
Setting up Azure Data Lake Storage Gen2
Getting ready
How to do it...
Connecting Azure Data Lake to Azure Data Factory and loading data
Getting ready
How to do it...
How it works...
Creating big data pipelines using Azure Data Lake and Azure Data Factory
Getting ready
How to do it...
How it works
Chapter 5: Working with Big Data – HDInsight and Databricks
Technical requirements
Setting up an HDInsight cluster
Getting ready
How to do it…
How it works…
Processing data from Azure Data Lake with HDInsight and Hive
Getting ready
How to do it…
How it works…
Processing big data with Apache Spark
Getting ready
How to do it…
How it works…
Building a machine learning app with Databricks and Azure Data Lake Storage
Getting ready
How to do it…
How it works…
Chapter 6: Integration with MS SSIS
Technical requirements
Creating a SQL Server database
Getting ready
How to do it…
How it works…
Building an SSIS package
Getting ready
How to do it…
How it works…
Running SSIS packages from ADF
Getting ready
How to do it…
How it works…
Chapter 7: Data Migration – Azure Data Factory and Other Cloud Services
Technical requirements
Copying data from Amazon S3 to Azure Blob storage
Getting ready
How to do it…
How it works…
Copying large datasets from S3 to ADLS
Getting ready
How to do it…
How it works…
See also
Copying data from Google Cloud Storage to Azure Data Lake
Getting ready
How to do it…
How it works…
See also
Copying data from Google BigQuery to Azure Data Lake Store
Getting ready
How to do it…
Migrating data from Google BigQuery to Azure Synapse
Getting ready
How to do it…
See also
Moving data to Dropbox
Getting ready
How to do it…
How it works…
There's more…
See also
Chapter 8: Working with Azure Services Integration
Technical requirements
Triggering your data processing with Logic Apps
Getting ready
How to do it…
How it works…
There's more…
Using the web activity to call an Azure logic app
Getting ready
How to do it…
How it works…
There's more…
Adding flexibility to your pipelines with Azure Functions
Getting ready…
How to do it…
How it works…
There's more…
Automatically building ML models with speed and scale
Getting ready
How to do it...
How it works…
There's more...
Transforming and preparing your data via Azure Databricks
Getting ready
How to do it…
How it works…
There's more…
Chapter 9: Managing Deployment Processes with Azure DevOps
Technical requirements
Setting up Azure DevOps
Getting ready
How to do it...
How it works...
Publishing changes to ADF
Getting ready
How to do it...
How it works...
Deploying your features into the master branch
Getting ready
How to do it...
How it works...
Getting ready for the CI/CD of ADF
Getting ready
How to do it...
How it works...
Creating an Azure pipeline for CD
Getting ready
How to do it...
How to do it...
There's more...
Chapter 10: Monitoring and Troubleshooting Data Pipelines
Technical requirements
Monitoring pipeline runs and integration runtimes
Getting ready
How to do it…
How it works…
Investigating failures – running in debug mode
Getting ready
How to do it…
How it works…
There's more…
See also
Rerunning activities
Getting ready
How to do it…
How it works…
Configuring alerts for your Data Factory runs
Getting ready
How to do it…
How it works…
There's more…
See also
Other Books You May Enjoy
Leave a review - let other readers know what you think
← Prev
Back
Next →
← Prev
Back
Next →