Talend Retirement:

• Led the DBT migration phase of the Talend Retirement Project, transitioning ETL processes.
• Played a pivotal role in the Airflow migration by designing re-usable DAG for enhanced orchestration and supported HVR migration by standardizing extraction and loading processes.
• Managed and guided a team of 5 members throughout the DBT migration process, ensuring proper data governance and timely delivery.
• Designed and established the repository structure, implemented a formatting check file for CI/CD, and set up GitLab CI pipelines for seamless integration and deployment.

End-to-End Data Management Solution Project:

• Created custom data pipelines to load data into Snowflake DB using Theobald Xtractor and Talend Studio from sources like SAP (S4HANA, PLM), SharePoint, and AWS S3.
• Designed and developed an optimized Talend job to split data extraction into parallel processes, extracting over 60 million records in less than 2.5 hours.
• Collaborated with the Python team to develop and deploy a probabilistic model, enhancing data-driven decision-making capabilities.
• Designed AWS Glue ETL jobs for IIoT data.
• Participated in project planning, estimation, and delivery activities using Agile methodology.

POC for MDM Solution Development:

• Collaborated with React frontend developers to develop the backend for a POC to replace Riversand MDM with a custom web application using Python and Flask.
• Integrated Snowflake DB for structured data warehousing and retrieval, ensuring seamless integration with existing systems.
• Ensured smooth data integration with existing systems, enhancing overall data workflows.