My Recent Works
Here are a few projects I have worked on recently.
Spotify Wrapped
SpotifyWrapped analyzes and tracks your Spotify statistics and listening habits. It replicates the real SpotifyWrapped but in a narrower interval. A data pipeline that is scheduled to get data from your Spotify, extract the data, load the raw data and perform transformation (ELT).
Azure VMDockerAirflowDatabricksADLS Gen2
Logistics Tracking Analytics
An integrated DE + DA project building an automated data pipeline to power scalable analytics and executive-ready dashboards for logistics operations.
PythonDuckDBAirflowApache Supersetdbt
Formula1 Racing Pipeline
A data pipeline that processes F1 races (2021) in medallion architecture. Eventually, dashboards and charts are generated to provide visualization.
DatabricksPySparkADLS Gen2Data VaultAzure Data Factory