How to maximize the value through a comprehensive approach

How to maximize the value
of Big Data with the open source SpagoBI suite
through a comprehensive approach
Monica Franceschini - SpagoBI Architect
SpagoBI Competency Center - Engineering Group
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
COMPREHENSIVE APPROACH
vis u a liz a tio
n
for BIG DATA
in fo rm a tio n b u ild in g
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
DATASET
Independent object to collect data from
different sources, used by visualization
tools.
schedulation
d a ta s e
t
visualization
Follows SpagoBI
behavioural model
database
in-memory
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
DATA SOURCES
SpagoBI data sources are defined as
connections towards different
databases both from the Hadoop
ecosystem and NoSql db
visualization
d a ta s e
t
SQL-like queries :
HiveQL
● HBQL
● CQL
● Cypher...
●
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
IN-MOTION DATA
Continuously running data can be
processed by stream processors or
CEPs and collected by SpagoBI
dataset
visualization
d a ta s e
t
Dataset as an Event
Handler notified by
SpagoBI Adapter of newly
available data
+
Stream processors/CEPs
SpagoBI
Adapter
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
SEMANTIC DATA
Classify and categorize
unstructured and
heterogeneous data through
semantic annotations, using
domain ontologies.
visualization
d a ta s e
t
Semantic information can
be stored in NoSql Graph
databases and extracted
by SpagoBI dataset
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
INFORMATION BUILDING
Cooperation of visualization
tools and free enquiry engine to
produce information
visualization
d a ta s e
t
Ad hoc reporting
FILE
QbE
Self Service
DATA
SOURCES
DATASET
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
AGILE DEVELOPMENT
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
SELF SERVICE
QbE engine allows to
create new datasets and
refine analysis in a
graphical way
FILE
DATA
SOURCES
DATASET
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
AD HOC REPORTING
Worksheet engine
provides an instant
graphical meaning to
datasets
DATASET
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
DASHBOARDS
Cockpit engine allows aggregating
different documents, interacting one
with each other, to get information at a
glance
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
JUST A USE CASE
Open Data + Big Data = Value
VALUE
for BIG DATA
BIG DATA
Te le c o m m u n ic a tio n c o m p a n ie s :
need to extract value from mobile data traffic
information to improve services and advance
new solutions
OPEN
DATA
Pu b lic a d m in is tra tio n : need to extract
value from information gathered from different
sources (consumption, highway traffic, voice
traffic) in order to improve the supply of tourist,
environmental, social services
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
INFORMATION CYCLE
SpagoBI tools cooperating together
produce NEW VALUE from
information
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
WHAT NEXT?
Data mining
Text mining
Sentiment analysis
Predictive analysis
...
Ex tra c t
va lu e fro m
in fo rm a tio n
d a ta s e
t
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con
Find out all information
(demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:
w w w.s p a g o b i.o rg
Contact us
s p a g o b [email protected] n g .it @tw ittm o n iq u e – m o n ic a .fra n c e s c h in [email protected] n g .it
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con