Shilpa Patel
EnglishAustralia/Melbourne Australia/Melbourne
About
I’m a Data Engineering and Analytics professional with 7 years of experience in designing and delivering end-to-end data solutions. I specialize in building scalable ETL/ELT pipelines, data lakes, and modern data warehouses, and have a strong foundation in statistical analysis, KPI development, and data visualization. I’m passionate about mentoring aspiring data professionals and helping them bridge the gap between technical skills and real-world application through practical guidance and insight-driven thinking.
Skills & Expertise
Work Experience
Research Engineer
RMIT University
Education
As a Data Engineer and Analyst, I designed and optimized end-to-end data pipelines using Azure Data Factory, Databricks, and Snowflake, enhancing performance and reducing costs. I built structured data lakes, implemented scalable ETL/ELT workflows, and modeled data to support 15+ key research KPIs. My work involved integrating and securing data across platforms like Power BI, Microsoft Purview, and Azure Synapse, ensuring governance and trust in analytics. I also developed dynamic dashboards, automation apps, and budgeting tools that streamlined decision-making, improved efficiency, and delivered measurable business impact.
Analytics Engineer
IFFA
Retail
As a Data Engineer, I led the migration of legacy movie submission data to Azure Data Lake, streamlining data accessibility and reducing manual errors. I built and maintained scalable data ingestion pipelines using Azure Data Factory and Databricks, and contributed to data modeling and warehousing in Azure Synapse. Using PySpark, SQL, and Python, I developed transformation logic to curate clean metadata. I also implemented role-based access controls and built Power BI dashboards to uncover trends, guide ad strategies, and promote event diversity. Additionally, I supported front-end enhancements using React.js and collaborated with cross-functional teams using JIRA for efficient project delivery.
Data Analytics Engineer
Dotdash Meredith
E-commerce
As a Data and Software Engineer, I designed robust ETL solutions using SSIS and created insightful reports with SSRS and Power BI to analyze retail trends and performance metrics. I developed machine learning models for customer churn and recommendation systems, achieving measurable business outcomes. My work also involved containerizing applications with Docker, documenting workflows in Confluence, and adhering to Agile and SDLC practices. On the front end, I built dynamic, reusable components using React.js and JavaScript, integrated MongoDB for real-time updates, and implemented drag-and-drop features to enhance user experience. I ensured code quality with unit testing and collaborated via GitHub for CI/CD and version control.
