Refactoring, shift and new development of Data Services in Google Cloud
Retail
Solving data and knowledge silos which have been built up over time
Substituted black boxes with transparent data products in a data mesh like environment
INITIAL SITUATION
The customers challenge was to solve data and knowledge silos which have been built up over time. While reverse engineering those silos we enabled the customer’s team in developing their own data products and taking responsbility at ease. Basis is a standardized data platform with automated processes that provide a data mesh like environment with a high degree of guidance for developing data products by business-biased data team.
The original data products were deployed in several technologies like SAS, SQL-Server stored procedures, Java /Python-Applications or Apache Spark.
SOLUTION
Enablement of several data teams to develop data products by themselves while implementing entreprise-ready data products in parallel
BUSINESS VALUE
Substituted black boxes with transparent data products in a data mesh like environment – around 20 operational data products have been set live
FRAMEWORK & TOOLS
Data Mesh, Data Governance, CI / CD, Google BigQuery, Google Cloud Composer, Google Cloud SQL, Google Cloud Storage Google Compute Engine, Google DataProc, Google DataFlow, GDPR, SQL, Python
Visit our YouTube Channel
