The Cegedim Data Warehouse migration took place because of the current solution being outdated, Pharma data was built upon a SQL server 2000 database managed by DTS packages On-Premise.
The aim was to migrate all of the workflows and data flows from DTS to use SSIS within Azure to optimise its usage and allow its execution from the cloud.
This project was delivered using the Scrum Agile Methodology using Jira as the main requirement monitoring software and documentation was delivered on Confluence (Atlassian).
My role as the senior data engineer was to migrate the DTS packages to SSIS within Azure, ensuring the same functionality and identifying potential optimisations.Â
It consisted of a team of 5 data team developers and a Scrum Master.
The development environment for this was built within Azure and transitioning the DTS packages that existed within a SQL server management studio.
The SQL server DB was 2000 at the time which was outdated, there were plans for this to be upgraded.
All procedures that were carried out using DTS packages had been successfully migrated to using SSIS packages within Azure.