azuredatafactory

Examples of Flink on Azure

Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization

An end to end ETL Solution using Azure

Local SQL Database ---> Azure ---> Power BI

Project Y is a straightforward Landing Zones automated deployment tool dedicated to data processing.

Everything you need to know about cloning, importing and using the Profisee Azure Data Factory templates.

This project demonstrates the development of a scalable end-to-end data pipeline for processing and reporting retail order data using Azure Cloud services, Delta Lake architecture, and Databricks.

This solution performs analytics and outlier detections on Apache compliant web server logs. This is based on Microsoft Azure technologies & PowerBI.

Designed and implemented an end-to-end Azure Data Engineering platform using Azure Data Factory, ADLS Gen2, Databricks, Synapse Analytics, and Power BI. Built metadata-driven pipelines and Medallion Architecture (Bronze, Silver, Gold) to ingest, transform, and serve analytics-ready data.

Code samples as published on blog

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2022LT Database.

This project extracts data having 800k records from CSV in the data factory and convert it to parquet based data and finally create a PowerBI report of that parquet based data.

A Re-do of Perth City Properties project using Azure Data Engineering technologies such as Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Blob Storage, Azure Databricks.

Azure-based solution for ingesting and analyzing Formula 1 data using Azure Data Lake Storage Gen2 and Databricks

ETL Pipeline using ADF, Delta Lake, Databricks, Spark, Data Governance (UnityCatalog).

Azure projects - End to End Data Engineering Project with medallion architecture using Azure Data Factory & Azure Databricks. Azure Serverless/Logical DataWarehouse using Azure Synapse Analystics to demo CETAS, Data Modeling, Incremental loading, CDC and Sql Monitoring the data processing connected to Power BI

This repository is designed for a data science project aimed to education, wich uses a public database from brazilian educational research institute about the nationam highschool exam and applies ETL and datamining association rules to this dataset.

Framework de ingestão de dados com Azure Data Factory, compatível com Synapse Analytics e Microsoft Fabric

ETL/ELT of Grocery Sales data by Azure Data Factory (ADF)

ETL pipeline using Azure Data Factory & Data Flow to process raw sales data, calculate total revenue per order, and load enriched results into Azure Blob Storage.