i4Q Data Integration and Transformation Services (i4Q DIT)
I4Q DIT provides integrated datasets with homogenous structure of different recordings and measurements from multiple sources to prepare the data for further analysis.
Project: i4Q
Publisher: CERTH
Technology: Data Management, Data cleaning, Machine Learning, Time Series Analysis
Industry: Industry, Metal machining, Wood Equipment, Metal Equipment
INTRODUCTION
This solution will solve the technical issues of the initial stages of an analytics pipeline and will handle the task of importing data from various sources as well as preparing them for analysis. This initial preparation includes cleaning and transforming the data according to the requirements of each application. Furthermore, i4Q DIT will deal with fusion of data being produced by different sources. The solution will be a distributed server-based platform that will contain other microservices for conducting all the preparation and decision-making actions.
FEATURES/BENEFITS
- Features:
- License
- Customisation
- Training
- Benefits:
- Faster and easier data cleaning and transformation
TECHNICAL INFORMATION
Code | i4Q DIT | ||
Type | Process | ||
Technology Topic | Data cleaning, Machine learning, Time Series Analysis | ||
Development | Python | ||
RESOURCES
How it works | Component | Interact | Identifying technical relationships |
Import Sensor Data | Pre-process Data | The incoming raw sensor data that are being imported by the first component need to be preprocessed (e.g. mostly cleaned at this stage) | |
Pre-process Data | Transform Data | After the initial data cleaning more processing is required so the data can be moulded into integrated datasets. Transforming and harmonizing the data will bring them in a homogenous structure. | |
Harmonize Data | |||
Transform Data | Aggregate Data | Data aggregation is required so the pre-processed and transformed data can be utilized by other solutions or pilots | |
USE CASE
SERVICES LINKED
PUBLISHERS
CERTH - The Centre for Research and Technology Hellas was fοunded in March 2000, it is a legal entity governed by private law with non-profit status, supervised by the General Secretariat for Research and Innovation (GSRI) of the Greek Ministry of Development. CERTH suggests one of the most important Research Centers in Greece with a main mission: The promotion of innovative research for the benefit of society. Dedicated to this purpose, CERTH lies at the forefront of basic, applied and technological research to provide solutions to society’s modern challenges.
