H DEV & TEST & PROD O

HOW TO HANDLE DEV & TEST & PROD FOR
ORACLE DATA INTEGRATOR
Gürcan Orhan
Principal Datawarehouse Consultant
Global Maksimum Data & Information Tech. Ltd.
8 August 2014
WHO AM I?
+20 years of IT experience.
+11 years of DWH experience.
+8 years of Oracle Data Integrator experience.
+6 years of Oracle Warehouse Builder experience.
Sybase Power Designer, ERwin Data Modeler, SQL Developer
OBIEE, Cognos, Microstrategy, Business Objects, Tableau.
Oracle Excellence Awards - Technologist of the Year 2011 : Enterprise Architect
(Oracle Magazine Editors’ Choice of Awards, Enterprise Architect)
DWH & BI Chair : TROUG (Turkish Oracle User Group)
Published Customer Snapshot for NODI @Oracle.com
Published video about ODI @Oracle.com (Oracle Media Network)
Published OTN Podcast about “Data Warehousing and ODI”
Articles in OTech Magazine, SearchSoftwareQuality.com
Annual panelist for ODTUG “Ask the Experts Panel : ODI”
Presenter
Presenter
Presenter
Presenter
in
in
in
in
Oracle Open World since 2010
ODTUG Kscope’11-13
UKOUG, other OUGs
various universities in Turkey
First time in Latin America & México... 
08 AUGUST 2014 / #LAOTNTOUR
http://gurcanorhan.wordpress.com
gurcan_orhan
http://tr.linkedin.com/in/gurcanorhan
Global Maksimum!
Data & Information Technologies
Data Visualization
Big & Fast Data Processing
Data Science
MY DEFINITION OF ODI
ODI (Oracle Data Integrator) is a tool,
that can talk,
or learn how to talk,
with any database system,
or any operating system,
in its own language.
This is the power of ODI.
08 AUGUST 2014 / #LAOTNTOUR
AGENDA
08 AUGUST 2014 / #LAOTNTOUR
ODI REPOSITORY ARCHITECTURE
MASTER REPOSITORY
­  Information related to DB/OS connections
Contexts, Repositories, Logical Architecture
­  Information related to ODI internal security
­  Versions
08 AUGUST 2014 / #LAOTNTOUR
ODI REPOSITORY ARCHITECTURE
WORK REPOSITORY (DEVELOPMENT)
­  Source / Staging / Target metadata
Models in Designer Navigator
­  Projects and beneath : Folders, Interfaces,
Packages, Procedures, Variables, Sequences,
Knowledge Modules, User Functions
­  Scenarios, Load Plans, Schedules
­  All the logs related to execution
08 AUGUST 2014 / #LAOTNTOUR
ODI REPOSITORY ARCHITECTURE
WORK REPOSITORY (EXECUTION)
­  Scenarios
­  Load Plans
­  Schedules
­  Execution Logs
08 AUGUST 2014 / #LAOTNTOUR
CONTEXTS
KEY TO JOIN PHYSICAL ARCHITECTURE AND LOGICAL ARCHITECTURE
SRC A
(dev)
Source-A
SRC A
(prod)
SRC B
(dev)
Source-B
SRC B
(prod)
Source-C
SRC C
(prod)
08 AUGUST 2014 / #LAOTNTOUR
AGENDA
08 AUGUST 2014 / #LAOTNTOUR
START-UP PROJECT : INITIAL ARCHITECTURE
MASTER
Topology
Versioning
Security
SRC A
(dev)
DEV WORK
SRC B
(dev)
Execution
SRC B
(prod)
Models
Projects
SRC A
(test)
Execution
SRC B
(test)
DEV & TEST
08 AUGUST 2014 / #LAOTNTOUR
EXEC WORK
SRC A
(prod)
SRC C
(prod)
PROD
START-UP PROJECT : MANUAL EXPORT-IMPORT
08 AUGUST 2014 / #LAOTNTOUR
START-UP PROJECT : MANUAL EXPORT-IMPORT
08 AUGUST 2014 / #LAOTNTOUR
START-UP PROJECT : MANUAL EXPORT-IMPORT
08 AUGUST 2014 / #LAOTNTOUR
AGENDA
08 AUGUST 2014 / #LAOTNTOUR
WE’RE ON PRODUCTION
We need to
make some
changes…
08 AUGUST 2014 / #LAOTNTOUR
ADMINS AT WORK
MASTER
* New
Topology
Versioning
Security
DEV WORK
EXEC WORK
Models
Projects
Execution
Execution
DEV Context
08 AUGUST 2014 / #LAOTNTOUR
TEST & PROD* Context
ADMINS AT WORK
* New
MASTER
Topology
Versioning
Security
EXEC WORK
DEV WORK
IMPORT
Models
Projects
Execution
DEV Context
08 AUGUST 2014 / #LAOTNTOUR
EXPORT
Execution
TEST & PROD* Context
ADMINS AT WORK
MASTER
Insert
manually
Insert
manually
MASTER
Topology
Topology
Versioning
Versioning
Security
Security
DEV WORK
EXEC WORK
Models
Projects
Execution
DEV & TEST Context
08 AUGUST 2014 / #LAOTNTOUR
IMPORT
EXPORT
Execution
PROD* Context
AGENDA
08 AUGUST 2014 / #LAOTNTOUR
MORE TESTERS IN TEAM
MASTER
MASTER
Topology
Topology
Versioning
Versioning
Security
Security
DEV WORK
DEV WORK
Models
Models
Projects
Projects
Execution
Execution
EXEC WORK
IMPORT
EXPORT
DEVDEV
Context
TEST Context
& TEST Context
08 AUGUST 2014 / #LAOTNTOUR
Execution
PROD* Context
EXPORT-IMPORT WITH A PACKAGE
http://sonra.io/odi-automating-deployment-of-scenarios-in-oracle-data-integrator/
08 AUGUST 2014 / #LAOTNTOUR
EXPORT-IMPORT WITH A PACKAGE
08 AUGUST 2014 / #LAOTNTOUR
EXPORT-IMPORT WITH A PACKAGE
08 AUGUST 2014 / #LAOTNTOUR
EXPORT-IMPORT WITH THE ODI SDK
For(Object interface : interfaces) {
OdiInterface odiInt = (OdiInterface) interface;
String scenName = odiInt.getName();
OdiScenario newScen = gene.generateScenario(odiInt, scenName, newVersion);
}
for (Object scen : scenarioCollection) {
OdiScenario odiscen =(OdiScenario)scen ;
export.exportToXml(odiscen, ExportPath, OverWrite, RecursiveExport, Encoding);
}
for (String filename : XMLFiles) {
import.importObjectFromXml( import.IMPORT_MODE_SYNONYM_INSERT_UPDATE,
filename, true);
}
08 AUGUST 2014 / #LAOTNTOUR
AGENDA
08 AUGUST 2014 / #LAOTNTOUR
ENTERPRISE ARCHITECTURE
MASTER
MASTER
Topology
Topology
Topology
Versioning
Versioning
Versioning
Security
Security
Security
EXEC WORK
EXEC WORK
Execution
Execution
PRE-PROD* Context
PROD* Context
MASTER
* New
DEV WORK
DEV WORK
Models
Models
Projects
Projects
Execution
Execution
DEV Context
TEST Context
08 AUGUST 2014 / #LAOTNTOUR
ENTERPRISE ARCHITECTURE
MASTER
MASTER
MASTER
Topology
Topology
Topology
Versioning
Versioning
Versioning
Security
Security
Security
DEV WORK
DEV WORK
Models
Models
Projects
Projects
Execution
Execution
DEV
TEST
08 AUGUST 2014 / #LAOTNTOUR
EXEC WORK
EXEC WORK
DEV WORK
EXEC WORK
Models
Execution
Execution
Projects
Execution
Execution
SMOKE
PRE-PROD*
HOTFIX*
PROD*
http://gurcanorhan.wordpress.com
gurcan_orhan
http://tr.linkedin.com/in/gurcanorhan
08 AUGUST 2014 / #LAOTNTOUR