Managing Multiple Database Roles and Platforms

1© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2020 IDERA, Inc. All rights reserved. 1
Doing More with Less:
Managing Multiple Database
Roles and Platforms
Lisa Waugh
Senior Product Manager

© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2020 IDERA, Inc. All rights reserved. 2
THE 8 BUSINESS PROCESSES
1. Determine how a hybrid strategy fits the requirements of the business an
organization.
2. Consider the implications of data governance. link to registration page
3. Enhance business organizational continuity. link to registration page
4. Don’t outsource security. link to registration page
5. Ensure the flexibility of data movement link to registration page
6. Embrace the range of tools.
7. Expand the scope of service-level agreements.
8. Prepare for new skill sets.
Download the PDF: 8 Rules for Managing Hybrid Cloud Environments by
Database Trends and Applications
2

ORGANIZATIONS ARE STRIVING TO STORE AND
MANAGE MORE AND MORE DATA
▪ It is rare to have an organization that uses a single platform anymore, so
organizations and IT teams must adapt
▪ The days of different disciplines for different roles are gone
▪ Multiple disciplines must work together
▪ The lack of the appropriate skill sets can slow the process down
3

EXAMPLE OF CLOUD INFRASTRUCTURE

EXAMPLE OF HYBRID INFRASTRUCTURE

COMPLEXITY OF NOSQL AND DISTRIBUTIONS
Clients Hive Services Hive Storage and Compute
Impala JDBC
Spark JDBC
Hive JDBC
Impala Server
Spark Server
Hive Server
Meta Store
File System
Job Client
Hive
Metadata
Store
Base
Hadoop
Cluster
Apache Hive Architecture
Driver
6

RELATIONAL VS NOSQL PLATFORMS
▪ Relational (SQL) databases like MySQL, PostgreSQL, and SQLite
represent and store data in tables and rows. They're based on a branch of
algebraic set theory known as relational algebra.
▪ Meanwhile, non-relational (NoSQL) databases like MongoDB represent
data in collections of JSON documents.
7

IN SOME OF THESE COMPLEX ENVIRONMENTS
THERE ARE NO MORE WELL-DEFINED ROLES
Read article: Role of DBAs changing but NOT going away by Database Trends and Applications

AQUA DATA STUDIO
▪ Universal database IDE and visual analytics tool for IT Professionals
working with data and databases
▪ Allows you to develop and manage your databases, and access, import,
export, and visually analyze data
▪ Supports over 30 database platforms, and works on all major operating
systems (Windows, macOS, Linux)
▪ Supports relational, NoSQL, and cloud databases, making your data
easily and quickly accessible
9

© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2020 IDERA, Inc. All rights reserved.
30+ DATABASE SUPPORTED
▪ Amazon Redshift
▪ Apache Cassandra
▪ Apache Derby
▪ DB2 iSeries
▪ DB2 LUW
▪ DB2 z/OS
▪ Excel
▪ Generic JDBC
▪ Generic ODBC
▪ Google BigQuery
▪ Greenplum
▪ Hive, Impala, and Spark connectors
within these distributions
• Amazon EMR, Cloudera,
HortonWorks, Impala, MapR
▪ Informix
▪ InterBase
▪ MariaDB
▪ Microsoft Azure SQL Database
▪ Microsoft SQL Server
▪ MongoDB
▪ MySQL
• Amazon Aurora MySQL
• Google SQL Cloud MySQL
▪ Netezza
▪ Oracle
▪ ParAccel
▪ PostgreSQL
• Amazon Aurora PostgreSQL
• Google SQL Cloud PostgreSQL
▪ SAP HANA
▪ Snowflake
▪ SQLite
▪ Sybase Anywhere
▪ Sybase ASE
▪ Sybase IQ
▪ Teradata Aster
▪ Teradata
▪ Vertica
▪ VoltDB
▪ MariaDB
▪ Microsoft Azure SQL Database
▪ Microsoft SQL Server
▪ MongoDB
▪ MySQL
• Amazon Aurora MySQL
• Google SQL Cloud MySQL
▪ Netezza
▪ Oracle
▪ ParAccel
▪ PostgreSQL
• Amazon Aurora PostgreSQL
• Google SQL Cloud PostgreSQL
▪ SAP HANA
▪ Snowflake
▪ SQLite

30+ DATA PLATFORM SUPPORTED

QUERIES, QUERIES, AND MORE QUERIES
▪ Different kinds of queries: There are a few differences between the two
dialects, including syntax, functions, data types
• Legacy such as Google BigQuery
- COUNT(DISTINCT x) returns an approximate count
• Standard
- It returns an exact count
▪ Single query
▪ Multi-database instance query
▪ Scripts – Multiple queries to be saved, scheduled, etc.
12

RELATIONAL VS NOSQL PLATFORMS
SQL Term/Concepts
database
table
row
column
index
table joins
primary key
NoSQL/MongoDB Terms/Concepts
database
collection
document of BSON (binary JSON) document
field
index
$lookup, embedded documents
primary key
Note: Specify a unique column or column combination as a primary
Key.
The primary key is automatically set to the _id field.
MongoDB documentation: SQL to Aggregation Mapping Chart
13

AQUA DATA STUDIO’S PRIMARY FEATURES
▪ Register Servers/Databases
▪ Database Navigator/Explorer
▪ Query Analyzer (SQL/JSON Editor)
▪ Query Builder
▪ Table Data Editor
▪ Visual Analytics
▪ Import/Export Data and DDL
▪ Schema/Data/File Compare
▪ ER Modeler
▪ Database Administration
14

GET TO ALL YOUR SERVERS WITH ONE INTERFACE
15

SERVER REGISTRATION/PROPERTIES

SERVER REGISTRATION/PROPERTIES CONT.

OPTIONS ALLOW FOR DIFFERENT SYNTAX CHANGES

MY WORKSPACE - SERVERS, WORK AREA, FILES

OPTIONS ALLOW FOR DIFFERENT SYNTAX CHANGES

HOW DO WE QUERY THE DATA?

AUTOMATE COMMANDS IN THE QUERY ANALYZER

QUERY THE DATA WITH AQUA DATA STUDIO

RESULTS SET CLIENT STATS

QUERY MONGODB WITH MONGOJS

SQL HISTORY

MULTI-SERVER QUERY – MEANING SAME VENDOR QUERY

SCRIPTS AND MORE SCRIPTS

ENTITY RELATIONSHIP DIAGRAM

USING THE PROJECTS TAB
▪ Projects are comprised of AquaScripts, Server Connections, and User Files.
▪ They provide a self-contained programming unit that allows users to create a set of
AquaScripts that work on a specific set of database servers that you identify with the
ability to store and access configuration files.
▪ Once a project is completed, it may be exported and shared with other users.
See blog: Using Projects for Multi-Environments Scripting
30

WHAT APPEARS IN THE QUERY ANALYZER - TEMPLATE
▪ //*************************************************
******************
// Create and Email Excel File
//
// Creates an Excel file from a user-specified
SQL query and
// emails the Excel file to the specified
recipients.
//
// For more information about Aqua Open
API visit link:
http://docs.aquafold.com/ads/19.5/openapi/
//*************************************************
******************
//*************************************************
******************
// Input parameters.
//*************************************************
******************
var server ="Lisa SQL Server 2016";
var database = "Healthcare";
var schema = "dbo";
var sqlQuery = "select * from dbo.doctors";
var filePathtoStore = "C:/Users/Lisa
Waugh/build/create_and_email_excel_file.xl
s";
var toRecipient =
"Lisa_Waugh@company.net";
var from = "Lisa.Waugh@company.com";
var subject = "Test Excel email";
var message = "This is a test of the create
email Excel file in project";
▪ try {
var conn =
aqua.project.getServerConnection(server
);
conn.connect();
conn.changeDatabase(database);
if (schema !== null || schema != "") {
conn.changeSchema(schema);
}
var resultset =
conn.executeQuery(sqlQuery);
var sheet =
aqua.data.excelSpreadsheet(filePathtoSt
ore);
sheet.clear();
sheet.insert(resultset.columnStructure);
while (resultset.next()) {
sheet.insert(resultset.getRow())
}
sheet.save();
sendEmail();
conn.disconnect();
aqua.console.println("E-mail sent!");
}
catch(err) {
aqua.console.println(err.lineNumber +
": " + err);
}
▪ //*******************************************
************************
// This function is used to send the
email.
//*******************************************
************************
function sendEmail() {
/**
Use the default SMTP information
configured in Aqua Data Studio.
In Aqua Data Studio, go to File--
>Options-->Email to configure email
settings.
**/
var smtpServer =
aqua.mail.getDefaultSmtpServer();
var msg = aqua.mail.newMessage();
msg.addToRecipient(toRecipient);
msg.setFrom(from);
msg.setSubject(subject);
msg.setText(message);
msg.addFileAttachment(filePathtoStor
e);
smtpServer.sendMail(msg);
}

DIRECTORY STRUCTURE/PROJECT CREATED

SOURCE CONTROL: SVN, CVS, GIT, AND PERFORCE

TOOLS TO HELP MANAGE THESE COMPLEX ENVIRONMENTS

SYNCHRONIZE SCHEMA

THE SOLUTION OF BUSINESS ANALYTICS
CHALLENGES
Support the citizen analyst’s data storytelling and intelligent
decisioning with a tool that addresses the key challenges
▪ Broaden access to a wide variety of data sources
▪ Simplify query and analysis tasks
▪ Provide a robust palette of graphs and charts for effective visualizations
▪ Provide an environment for development, collaboration, and integration
36

BUSINESS INTELLIGENCE VS ANALYTICS

BUSINESS ANALYTICS: HOW DO YOU TELL A STORY?
▪ Provide the datasheet as a package with the data and the worksheet, therefore, linking
parameters across different data sources
▪ Export as an image
38

VISUAL ANALYTICS

SUMMARY
▪ Today’s database environments are often more complicated
• Not just a single type of data store
• Relational, NoSQL, cloud
▪ Database professionals must perform multiple tasks across them all
• Managing different platforms
• Running queries
• Creating data analytics
▪ Aqua Data Studio makes it easier
• 14-day free trial
• Learn more at aquafold.com

THANKS!
Any questions?

Managing Multiple Database Roles and Platforms

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Managing Multiple Database Roles and Platforms

Semelhante a Managing Multiple Database Roles and Platforms (20)

Mais de IDERA Software

Mais de IDERA Software (20)

Último

Último (20)

Managing Multiple Database Roles and Platforms