DATA AS A SERVICE
BI & BIG DATA CC
Industry:
Automotive
Providing the capability
to the client and brands
to access high volumes of
disparate data formats,
in a scalable and secure way
Data available on request,
effort to build data-related products
reduced by 50%
INITIAL SITUATION
Our client, a German car manufacturer, had a lot of different data sources from different departments and locations (10000+).
The vision has been to design a method through which this data can be made available to any requester by considering the following points: availability of data, business understanding of data, technical metadata understanding/availability, and decentralization.
The goal is to create a high-level solution of the “Data As a Service” concept, defining the next steps to accomplish the below mission statement.
SOLUTION
We designed a solution using open-source software through which the relevant data can be made available to any requester by considering the following points:
• availability of data
• business understanding of data
• technical metadata understanding/availability
• decentralization.
BUSINESS VALUE
Our customer achieved its vision through making all cc in order to get faster, better, and optimized predictions for all data-related products.
It was estimated that manual effort to build data-related products was reduced by 50%. This was accomplished by making it possible to access useful data simply by subscribing to “Data as a Service”.
FRAMEWORK & TOOLS
The entire design has been developed using Apache projects/technologies.
Monitoring: Elasticsearch, Solr, Zabbix, Nagios, Sensu.
Data Catalog: Elasticsearch, Neo4j, OrientDB, MarkLogic.
Cache: Apache Ignite, Memcached, GemFire, Hazelcast.
Deployment management: Kubernetes, Docker, Apache Mesos.
Data Services: API, JDBC, RESTful, JBoss, Spring.
Federation: Oracle Big Data SQL.
Messaging: Kafka, IBM MQ, RabbitMQ.
Security: Hashicorp Vault, Custom made