Design Guidelines for Apache Kafka Driven Data Management and Distribution in Smart Cities

by   Theofanis P. Raptis, et al.

Smart city management is going through a remarkable transition, in terms of quality and diversity of services provided to the end-users. The stakeholders that deliver pervasive applications are now able to address fundamental challenges in the big data value chain, from data acquisition, data analysis and processing, data storage and curation, and data visualisation in real scenarios. Industry 4.0 is pushing this trend forward, demanding for servitization of products and data, also for the smart cities sector where humans, sensors and devices are operating in strict collaboration. The data produced by the ubiquitous devices must be processed quickly to allow the implementation of reactive services such as situational awareness, video surveillance and geo-localization, while always ensuring the safety and privacy of involved citizens. This paper proposes a modular architecture to (i) leverage innovative technologies for data acquisition, management and distribution (such as Apache Kafka and Apache NiFi), (ii) develop a multi-layer engineering solution for revealing valuable and hidden societal knowledge in smart cities environment, and (iii) tackle the main issues in tasks involving complex data flows and provide general guidelines to solve them. We derived some guidelines from an experimental setting performed together with leading industrial technical departments to accomplish an efficient system for monitoring and servitization of smart city assets, with a scalable platform that confirms its usefulness in numerous smart city use cases with different needs.


On Computational Infraestruture Requirements to Smart and Autonomic Cities Framework

Smart cities are an actual trend being pursued by research that, fundame...

A Reo Based Solution for Engineering the Coordination Protocols for Smart Cities

Smart Cities, with their problems and challenges, is an emerging smart p...

BIS- A Blockchain-based Solution for the Insurance Industry in Smart Cities

Insurance is one of the fundamental services offered to the citizens to ...

Challenges related to system-of-systems for greening and climate adaptation in smart cities

This paper presents the results of interviews conducted as part of the D...

An Application of Ubiquitous Video Services and Management Systems in Civil Defense

This paper proposes a model of ubiquitous video services and management ...

Design of a Smart Waste Management System for the City of Johannesburg

Every human being in this world produces waste. South Africa is a develo...

Km4City Ontology Building vs Data Harvesting and Cleaning for Smart-city Services

Presently, a very large number of public and private data sets are avail...

Please sign up or login with your details

Forgot password? Click here to reset