Mining in the Middle of the City: The needs of Big Data for Smart Cities

•

0 gostou•2,460 visualizações

Institute of Information Systems (HES-SO)

Smart Cities are presenting new challenges for Big Data. The emerging amount of data needs to be processed to make feasible its analysis (data fusion to avoid noise and apparently random behaviors, correlation in order to see hidden behaviors, focused on insight and integration into business models, needs from the market to define the questions that are expecting to answer for the Smart Cities).

Tecnologia Negócios

Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Mining in the Middle of the City: The
needs of Big Data for Smart Cities
A Real Experience in the SmartSantander Testbed
Antonio J. Jara, Dominique Genoud, Yann Bocchi
HES-SO, Switzerland
Palo Alto, USA
19th June 2014

Problem statement
• Smart Cities are presenting new challenges for Big Data.
• The emerging amount of data needs to be processed to
make feasible its analysis.
• First step, data fusion to avoid noise and apparently
random behaviors.
• Second step, correlation in order to see hidden
behaviors.
• Next steps more focused on insight, and integration into
business models.
• Needs from the market to define the questions that are
expecting to answer for the Smart Cities.
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Big Data / Smart Cities ecosystem
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

SmartSantander Testbed
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

SmartSantander Testbed (Traffic)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

SmartSantander Testbed (Temperature)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Data Fusion
• Temperature area totally insolated from the traffic
monitoring zones.
• Not required fine-grain analysis of temperature, since
not influenced by traffic.
• Traffic sensors needs to be aggregated by highways and
lanes.
• Data fusion feasible due to the nature of the problem.
• This simplify and makes feasible the correlation between
Temperature and Traffic
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Traffic (without data fusion)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Traffic vs Temperature in April (with data fusion)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Traffic vs Temperature in July (with data fusion)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
57,4 % Line Correlated

Traffic vs Temperature in December (with data fusion)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Modelling of Temp / Traffic in April
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Modelling of Temp / Traffic in July
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Modelling of Temp / Traffic in December
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

KNIME workflow
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

KNIME workflow for visualization
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Conclusions
• Data Fusion is required for Smart Cities analysis.
• Correlation of non-aggregated data is non-feasible.
• Data Fusion has demonstrated the similarity among the
temperature and traffic trends.
• KNIME offers an intuitive tool to works with Data.
• In addition, it offers correlation tools, characterization
tools, and classification tools from Weka and R, and
finally with Hadoop.
• Current works focused on human dynamics analysis
over the data; Burst vs Poisson.
• An extended / advanced version of this work avaiable
under request to jara@ieee.org
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Mais conteúdo relacionado

Semelhante a Mining in the Middle of the City: The needs of Big Data for Smart Cities

Doing the Numbers: Getting the other 50% of the story

J T "Tom" Johnson

Eduworks kick-off presentation: USAL

Eduworks Network

Presentation: How can Plan Ceibal Land into the Age of Big Data?

@cristobalcobo

Overview of Big Data, Data Science and Statistics, along with Digitalisation,...

Prof. Dr. Diego Kuonen

Presentation given by Dr. Diego Kuonen, CStat PStat CSci, on October 1, 2015, at the `Joint SCITAS and Statistics Seminar' of the EPFL in Lausanne, Switzerland. ABSTRACT There is no question that big data have hit the business, government and scientific sectors. The demand for skills in data science is unprecedented in sectors where value, competitiveness and efficiency are driven by data. However, there is plenty of misleading hype around the terms 'big data' and 'data science'. This presentation gives a professional statistician's 'big tent' view on these terms, illustrates the connection between data science and statistics, and highlights some challenges and opportunities from a statistical perspective. The presentation is also available at http://www.statoo.com/BigDataDataScience/.

A Statistician's 'Big Tent' View on Big Data and Data Science (Version 9)

Prof. Dr. Diego Kuonen

Presentation given by Dr. Diego Kuonen, CStat PStat CSci, on November 21, 2014, at the 'Research Seminar in Statistics' of the University of Geneva in Geneva, Switzerland. ABSTRACT There is no question that big data have hit the business, government and scientific sectors. The demand for skills in data science is unprecedented in sectors where value, competitiveness and efficiency are driven by data. However, there is plenty of misleading hype around the terms 'big data' and 'data science'. This presentation gives a professional statistician's 'big tent' view on these terms, illustrates the connection between data science and statistics, and highlights some challenges and opportunities from a statistical perspective. The presentation is also available at http://www.statoo.com/BigDataDataScience/.

A Statistician's 'Big Tent' View on Big Data and Data Science (Version 5)

Prof. Dr. Diego Kuonen

Demystifying Big Data, Data Science and Statistics, along with Machine Intell...

Prof. Dr. Diego Kuonen

Presentation given by Dr. Diego Kuonen, CStat PStat CSci, on April 23, 2015, at the 'ZüKoSt: Seminar on Applied Statistics' of the ETH Zurich in Zurich, Switzerland. ABSTRACT There is no question that big data have hit the business, government and scientific sectors. The demand for skills in data science is unprecedented in sectors where value, competitiveness and efficiency are driven by data. However, there is plenty of misleading hype around the terms 'big data' and 'data science'. This presentation gives a professional statistician's 'big tent' view on these terms, illustrates the connection between data science and statistics, and highlights some challenges and opportunities from a statistical perspective. The presentation is also available at http://www.statoo.com/BigDataDataScience/.

A Statistician's 'Big Tent' View on Big Data and Data Science (Version 6)

Prof. Dr. Diego Kuonen

Big Data, Data-Driven Decision Making and Statistics Towards Data-Informed Po...

Prof. Dr. Diego Kuonen

Big Data as the Fuel and Analytics as the Engine of the Digital Transformation

Prof. Dr. Diego Kuonen

"Data as the Fuel and Analytics as the Engine of the Digital Transformation -...

Prof. Dr. Diego Kuonen

Keynote talk given by Dr. Diego Kuonen, CStat PStat CSci, on October 21, 2015, at the `Austrian Statistics Days 2015' in Vienna, Austria. ABSTRACT There is no question that big data have hit the business, government and scientific sectors. The demand for skills in data science is unprecedented in sectors where value, competitiveness and efficiency are driven by data. However, there is plenty of misleading hype around the terms 'big data' and 'data science'. This presentation gives a professional Swiss statistician's 'big tent' view on these terms, illustrates the connection between data science and statistics, and highlights some challenges and opportunities from a statistical perspective. The presentation is also available at http://www.statoo.com/BigDataDataScience/.

A Swiss Statistician's 'Big Tent' View on Big Data and Data Science (Version 10)

Prof. Dr. Diego Kuonen

The digital reflection of our cities is sharpening and it is tracking their evolution with a decreasing delay. However, we risk that data piles up without easing decision making. This key note, which I gave at the 12th Semantic Web Summer School, presents how stream reasoning (an approach to tame simultaneously the variety and velocity dimensions of Big Data) and advance visual analytics can support decision makers and discusses the lesson learnt.

Listening to the pulse of our cities with Stream Reasoning (and few more tech...

Emanuele Della Valle

Production Processes of Official Statistics & Data Innovation Processes Augme...

Prof. Dr. Diego Kuonen

Sight, Sound, Numbers & Us: Data Visualization + Data Sonification = Data Acc...

University of Michigan Taubman Health Sciences Library

Presentation given by Prof. Dr. Diego Kuonen, CStat PStat CSci, on April 18, 2016, at the `Nestlé Institute of Health Sciences' in Lausanne, Switzerland. ABSTRACT There is no question that big data have hit the business, government and scientific sectors, as well as health sciences. The demand for skills in data science is unprecedented in sectors where value, competitiveness and efficiency are driven by data. However, there is plenty of misleading hype around the terms 'big data' and 'data science'. This presentation gives a professional Swiss statistician's 'big tent' view on these terms in health sciences, illustrates the connection between data science and statistics, and highlights some challenges and opportunities from a statistical perspective. The presentation is also available at http://www.statoo.com/BigDataDataScience/.

A Statistician's `Big Tent' View on Big Data and Data Science in Health Scien...

Prof. Dr. Diego Kuonen

Big Data as the Fuel and Visual Analytics as the Engine Mount of the Digital ...

Prof. Dr. Diego Kuonen

Data as the Fuel and Analytics as the Engine of the Digital Transformation: D...

Prof. Dr. Diego Kuonen

Presentation given by Dr. Diego Kuonen, CStat PStat CSci, on October 13, 2014, at `F. Hoffmann-La Roche' in Basel, Switzerland. ABSTRACT There is no question that big data have hit the business, government and scientific sectors, as well as the pharmaceutical industry. The demand for skills in data science is unprecedented in sectors where value, competitiveness and efficiency are driven by data. However, there is plenty of misleading hype around the terms `big data' and `data science'. This presentation gives a professional statistician's view on these terms in pharmaceutical development, illustrates the connection between data science and statistics, and highlights some challenges and opportunities from a statistical perspective. The presentation is also available at http://www.statoo.com/BigDataDataScience/.

A Statistician's View on Big Data and Data Science in Pharmaceutical Developm...

Prof. Dr. Diego Kuonen

Webinar presentation given by Prof. Dr. Diego Kuonen, CStat PStat CSci, on March 15, 2018, within the TIBCO webinar entitled "Demystifying the Hype: [Big] Data as Fuel and Analytics as the Engine of Digital Transformation"; see https://www.tibco.com/events/demystifying-hype-big-data-fuel-and-analytics-engine-digital-transformation --------------- ABSTRACT --------------- The digital revolution is truly underway: terms such as big data, cloud, internet of things, internet of everything, the fourth industrial revolution, smart cities and data economy are no longer just concepts - they are changing our lives in new and exciting ways. Digital Transformation started with a first wave of digitalisation, which resulted in the (big) data revolution. But now a second wave of digitalisation is needed to enable learning from (big) data and to generate increased value for both business and society as a whole. This presentation discusses how analytics, the science of "learning from data" or of "making sense out of data", becomes the engine of a new wave of Digital Transformation, and illustrates that the biggest challenge therein is the veracity of the "data pedigree", i.e. the trustworthiness of the data, including the reliability, capability, validity, and related quality of the data. This presentation looks at demystifying concepts and terms surrounding Digital Transformation and big data. Along with machine intelligence and learning, the connection between data science and statistics is illustrated, and trends, challenges, opportunities, and the related digital skills and principles needed to succeed at Digital Transformation are highlighted.

(Big) Data as the Fuel and Analytics as the Engine of the Digital Transformation

Prof. Dr. Diego Kuonen

Semelhante a Mining in the Middle of the City: The needs of Big Data for Smart Cities (20)