Melexis: building a real-time manufacturing data platform with Databricks on GCP
GCP
Databricks
Qlik
As a crown jewel in the Belgian tech industry, Melexis is world leader in microelectronics & semi-conductors esp. They operate from their headquarters in Belgium & employ about 1.500 people worldwide. They rely heavily on data in their day to day operations through all layers of the organization: product development, production efficiency & waste management, quality control, etc.
The challenge
- Data integration: Integrating diverse data systems from various international operations and external suppliers leads to data silo’s.
- Real-time data processing: To enhance operational efficiency and timely decision-making, real-time data processing is required.
- Data access and governance: Secure and efficient access for the right personnel is crucial for maintaining operational efficiency and compliance.
Our solution
Data Platform on GCP combined with Databricks & integrated with existing Qlik platform
Control Data Access via Unity Catalog in Databricks
Use cases in manufacturing:
- Processing & real-time visualization of test results on the shop floor
- Quality prediction via ML models on test logs
Use cases in sales: Sales forecasting, sales probability &potential sales estimations on heterogenous sources of data
State of the art Infrastructure setup (Infrastructure as Code, CICD integration with Gitlab, automated code optimazation &documentation generation…)
The business value
A data platform has been set-up that supports the overall Melexis data strategy:
- Streaming enables real-time insights into the tests being done in the manufacturing domain
- Data from multiple sources is being combined to do sales forecasting
- The platform is cloud-based and scales to meet the further needs of Melexis
