Context Presentation
neOCampus is a large operation with different kinds of projects and actors. Started in 2013, its goal is to improve the university campus user’s everyday life through data analysis for people, fluid consummation reduction, reduce building environmental footprint, etc.… Overall, it tends to make the campus smarter. All those projects have one common point: data. Including images, sensor logs, administrative data, configurations, we can find every kind of data and each must be stored somewhere.
This project is centered around this problem with a data management system architecture which is the data lake.The conception of this kind of solution must include handling every kind of data and making it possible to follow the life of a data from the input to the usage in a project. It does not only have to store every kind of data, it is needed to know what is stored, where and in the proper format to use it in the easiest way. When a new data has arrived, the system will automatically rawly store it, find the more valuable format, extract information from this data and make this knowledge available for any purpose.
Keywords
Data Lake, Data Driven Project, Big Data, Data Management, Data Analysis
Scientific goal
• To develop a datalake architecture to change the architecture of the data management system in neOCampus.
Contacts
dang.vincentnam@gmail.com, françois.thiebolt@irit.fr, olivier.teste@irit.fr