Introducing Smart Data Management to Mining Operations
Authors: Konstantina Tsioli, Nikolaos Gevrekis, Konstantinos Plessas
February 13th 2025
The CORE Innovation Centre team has developed a key backend platform for the MASTERMINE project, which aspires to become the go-to ecosystem for mines that envision digitalisation, environmental sustainability, productivity monitoring and public acceptance.
A key module of the MASTERMINE project is Cybermine, which serves as the access point to the physical world managing the field data for all components, connecting the physical and digital world through technologies like IIoT, the cloud, edge computing and machine learning ensuring the smart mine design and predictive maintenance of equipment and vehicles.
Our team has developed a backend platform within the Cybermine module, which seamlessly integrates and manages data from various sources across the mining industry. As a smart data management system, it automates data collection, storage, and access, ensuring flexibility, scalability and efficiency in the use of data.
Here’s a look at the ingredients that make this platform innovative.
An overview of the back-end platform developed by the CORE IC team
Collecting Data from Different Sources
Everything begins with data sources, which can include sensors, devices, or systems in the mining industry that generate information. However, not all data is the same - different sources provide data in different formats, structures, and transmission methods. Some data is received in real-time, while other data arrives in scheduled batches. In some cases, end users may even need to manually upload files. The platform uses a multi-layered storage approach, enabling it to secure and organise data types like real-time updates, historical records, and large files. Tools such as S3 buckets, InfluxDB, and PostgreSQL ensure both speed and reliability.
Making the Data Available to Users
Once stored, the data needs to be easily accessible. This is where the Consumption Layer comes in. This layer allows users to retrieve any data they need, whether it’s raw data straight from the source, processed insights, real-time feeds, or historical records. Through this layer, users can access raw or processed data quickly and efficiently, tailored to their specific needs, such as real-time monitoring or historical analysis.
Innovation: Making Data Collection Smarter
Traditionally, integrating data from different devices and sensors required custom-built services for each type of data source, making the process slow and complicated. The platform developed by our team eliminates this challenge by offering an automated, intelligent system that dynamically adapts to any new data source. Consequently, the effort needed to integrate new data sources is significantly reduced.
Significance for the Mining Industry
Mining operations are known for their harsh conditions, making it challenging to collect and manage data effectively. A platform like the one developed by CORE IC is critical because it simplifies data integration and enables the seamless collection of data from diverse sources, even in environments where traditional methods struggle. Its robust architecture ensures data reliability and accessibility, even in remote or extreme locations.
The ability to interpret data ahead of time is crucial for mining operations, particularly regarding heavy machinery, where real-time insights can prevent breakdowns, enhance maintenance schedules, and ensure operational continuity. By transforming raw data into actionable insights, the platform empowers decision-makers — whether managers, operators, or engineers — to make informed decisions, improving safety, productivity, and efficiency. Ultimately, the platform supports innovation, sustainability, and operational resilience in the demanding context of the modern mining industry.
