Synapse Hackathon

Exercise 0: Environment Setup:

For this workshop you need to have access to an Azure Synapse instance. To create an instance you can either choose from Microsoft Analytics end-to-end with Azure Synapse ARM template which deploys full set of services related to Analytics including Synapse.

Or create a single Synapse workspace via Azure Portal.

End-To-End Solution Architecture:

Exercise 1: Data ingestion

At this exercise you connect to different data sources that WWI needs to collect data and create a pipeline to move data into a centralized data lake. No transformation over data is required. The solution should cover delta load for big tables.

Exercise 2: Data preparation and transformation

At this exercise you get to explore different flavors of Synapse runtime. Do ad-hoc data wrangling and use Azure Synapse Lake databse patterns.

Exercise 3: Datawarehouse

Star schema transformation:

• Data flows
• Spark Pools

Save data as Delta files

Exercise 4: Power BI

PowerBI integration with Synapse Push data marts to PowerBI

Good to have Exercises:

Exercise 5: Machine Learning

Exercise 6: Purview

Exercise 7: Data Mesh