DATA AS A SERVICE

BI & BIG DATA CC

image
image

Industry:
Automotive

image

Providing the capability
to the client and brands
to access high volumes of
disparate data formats,
in a scalable and secure way

image

Data available on request,
effort to build data-related products
reduced by 50%

INITIAL SITUATION

Our client, a German car manufacturer, had a lot of different data sources from different departments and locations (10000+).

The vision has been to design a method through which this data can be made available to any requester by considering the following points: availability of data, business understanding of data, technical metadata understanding/availability, and decentralization.

The goal is to create a high-level solution of the “Data As a Service” concept, defining the next steps to accomplish the below mission statement.

SOLUTION

We designed a solution using open-source software through which the relevant data can be made available to any requester by considering the following points:

• availability of data

• business understanding of data

• technical metadata understanding/availability

• decentralization.

BUSINESS VALUE

Our customer achieved its vision through making all cc in order to get faster, better, and optimized predictions for all data-related products.

It was estimated that manual effort to build data-related products was reduced by 50%. This was accomplished by making it possible to access useful data simply by subscribing to “Data as a Service”.

FRAMEWORK & TOOLS

The entire design has been developed using Apache projects/technologies.

Monitoring: Elasticsearch, Solr, Zabbix, Nagios, Sensu.

Data Catalog: Elasticsearch,  Neo4j, OrientDB, MarkLogic.

Cache: Apache Ignite, Memcached, GemFire, Hazelcast.

Deployment management: Kubernetes, Docker, Apache Mesos.

Data Services: API, JDBC, RESTful, JBoss, Spring.

Federation: Oracle Big Data SQL.

Messaging:  Kafka, IBM MQ, RabbitMQ.

Security: Hashicorp Vault, Custom made

USE CASES

img img