Dev Dives: Streamline document processing with UiPath Studio Web
Microsoft Cloud Database & Cloud BI
1. Microsoft Cloud Database Solutions Mark Kromer Microsoft Certified Technology Specialist mkromer@microsoft.com http://www.sqlmag.com/blogs/sql-server-bi.aspx http://mssqldude.wordpress.com http://twitter.com/mssqldude
2. Microsoft Cloud Database Products SQL Azure Part of Windows Azure platform SQL Server in the cloud Use same SQL Server tools Cloud BI Mostly hybrid solutions today Very near to reaching full cloud enablement Azure Reporting Services, Crescent, mobile, PowerPivot, DM in the Cloud Windows Azure Platform to build Cloud & mobile solutions Azure Marketplace
3. SQL Server Platform Options Platform (as a Service) Infrastructure (as a Service) Software (as a Service) Platform (Self Managed) Applications Applications Applications Applications Data Data Data Data Runtime Runtime Runtime Runtime Middleware Middleware Middleware Middleware Managed services Managed services Database Database Database Database O/S O/S O/S O/S Managed services Virtualization Virtualization Virtualization Virtualization Servers Servers Servers Servers Storage Storage Storage Storage Networking Networking Networking Networking
4. Cloud Impact REDUCED MANAGEMENT NEW ECONOMICS INCREASED OPPORTUNITIES Pay for what you use Lower and predictable costs Shift from capex and opex Accelerate speed to value No patching, maintenance Faster deployment Robust multi-layered security Reliability and fault-tolerance Latest software for users Internet collaboration Anywhere access Instant self-provisioning
5. “By 2012, 80% of Fortune 1000 enterprises will be using some cloud computing services, 20% of businesses will own no IT assets.” “The bottom line: Early adopters are finding serious benefits, meaning that cloud computing is real and warrants your scrutiny as a new set of platforms for business applications.”
6. Windows Azure Platform GENERAL PURPOSE PROGRAMMING LANGUAGES Windows Azure Platform App Fabric Compute Management Relational database CDN Storage Data Sync Marketplace
7. Data and Storage Options in Azure Relational Database SQL Azure Structured Storage Windows Azure Tables Unstructured Storage Windows Azure Blobs NTFS Drive Windows Azure Drive Asynchronous Service Communication Windows Azure Queues
8. Application Topologies From Windows Azure From Outside Microsoft Datacenter From Windows Azure & Outside Microsoft Datacenter SQL Server App Code / Tools App Code / Tools Application / Browser SQL Azure Data Sync Microsoft Datacenter MicrosoftDatacenter Microsoft Datacenter Windows Azure Windows Azure SQL Azure SQL Azure SQL Azure Code Near Code Far Hybrid
9. Extending SQL Server to the Cloud Distributed “scale-out” database service Abstracts OS and hardware management Low-friction provisioning, multi-tenant Automatic high-availability and data replication Pay-as-you-go and commitment offers Enterprise-class “scale-up” data platform Multiple hardware platforms and deployment options Deploy as dedicated server in customer datacenter, VM or 3rd party Typically licensed per-server or per processor Symmetry with Traditional RDBMS Familiar T-SQL relational model Support existing code libraries and protocols Ecosystem of familiar development and management tools Current offerings: core RDBMS capabilities with SQL Azure Database and SQL Azure Data Sync Service Regular updates approx every 3 months. Future offerings include BI capabilities and richer database capabilities
10. Microsoft SQL Azure Information Platform as a Service Scale on Demand Innovate Faster Managed Service Platform capabilities delivered as a service (Database, Data Sync, Reporting…) Reduced complexity, greater flexibility Easy provisioning and deployment Auto High availability and fault tolerant Database as a utility with pay as you grow scaling Rely on Business-ready SLAs Enable multi-tenant solutions Manage multiple servers Innovate with new data application patterns Build cloud-based data solutions on a familiar relational model Build on existing developer skills and familiar Transact-SQL syntax
11. SQL Azure Database Single Logical Database Multiple PhysicalReplicas Replica 1 Single Primary Based on SQL Server 2008 R2 engine Use same tools and data access frameworks Six global datacenters High Availability & Redundancy Reads are completed at the primary Writes are replicated to a quorum of secondaries Replica 2 DB Replica 3 Multiple Secondaries
12. SQL Azure Data Sync No-Code Sync Configuration Easily define data to be synchronized with out coding Choose how often data is synchronized Handle issues where same data is changed in multiple locations Administration capabilities for tracking data and monitoring potential issues Sync Between SQL Azure Databases Geo-Replication, Read/Write Scale out Sync From On–Premises to Cloud Extend enterprise data to cloud Build offline cached experiences Sync with branch offices and mobile devices CDC, Change Tracking, Replication for SQL Azure
13. Advancing Sharding in SQL Azure Elastic Provisioning of Databases CREATE DATABASE and go Pay-as-you-go business model Don’t need it --- DROP it Zero Physical Administration Built-in High Availability, patching, maintenance Improved Developer Experience Robust connection management Improved Administration Online repartitioning operations Fan-out Queries Covered by SQL Azure today Coming up in SQL Azure: Federations CREATE FEDERATION federation_name { <federation_distribution_scheme> }
14. Sharding Databases 1 x 20 GB database = 1 Machine 20 x 1 GB databases = 20 Machines
15. SQL Azure Scenarios Scale-out Enterprise Applications Cloud Hub Data Collaboration SQL Azure Departmental Applications Business Intelligence Software-as-a-Service
16. Migrate Applications to Cloud (Azure) CodePlexDataConnector: http://dataconnector.codeplex.com
17. Microsoft Cloud BI PivotViewer blog: http://petcu40.blogspot.com PivotViewerCTP1 Download: http://www.microsoft.com/downloads/en/details.aspx?displaylang=en&FamilyID=d31f609d-a353-41ad-a1a4-f81456e3a6c4
18. SQL Azure Reporting CTP Features: Based on SQL Server Reporting Services Interactive and tabular reporting Data visualizations: charts, graphs, mapping, gauges SQL Azure Database data sources Utilizes BI Developer Studio (free) to author reports Export to Excel, PDF, CSV formats Core scenarios: Operational reporting on SQL Azure data Embed reports into Windows Azure or on-premises applications Web Role Reporting
19. Current State of the BI market place SaaS Good data, Pivotlink, LogiXML, Pentaho PaaS Business Objects, SAS, Microsoft Azure, Vertica, Greenplum, Google apps
20. Current State of the BI market place IaaS Infrastructure AWS, Rackspace, GoGrid Cloud Management Elastra, Rightscale DB/DW MySQL, Oracle, SQL server, BI JasperReports, Pentaho
21. SQL Server 2008 R2 PowerPivot Publish your PowerPivots as Web applications for your team with SharePoint 2010 Schedule data refreshes to keep your analysis up-to-date Manage security just like a document Out-of-the-box connectors to SQL Azure and Azure Marketplace
22. Microsoft BI Dashboard Designers:PerformancePoint, SSRS, Report Builder, Crescent (Denali)
43. Thank you Mark Kromer Microsoft CertifiedTechnology Specialist SQL Server Data Platform mkromer@microsoft.com
Notas do Editor
Slide Objectives:Explain the differences and relationship between IaaS, PaaS, and SaaS in more detail.Speaking Points:Here’s another way to look at the cloud services taxonomy and how this taxonomy maps to the components in an IT infrastructure. Packaged SoftwareWith packaged software a customer would be responsible for managing the entire stack – ranging from the network connectivity to the applications. IaaSWith Infrastructure as a Service, the lower levels of the stack are managed by a vendor. Some of these components can be provided by traditional hosters – in fact most of them have moved to having a virtualized offering. Very few actually provide an OSThe customer is still responsible for managing the OS through the Applications. For the developer, an obvious benefit with IaaS is that it frees the developer from many concerns when provisioning physical or virtual machines. This was one of the earliest and primary use cases for Amazon Web Services Elastic Cloud Compute (EC2). Developers were able to readily provision virtual machines (AMIs) on EC2, develop and test solutions and, often, run the results ‘in production’. The only requirement was a credit card to pay for the services.PaaSWith Platform as a Service, everything from the network connectivity through the runtime is provided and managed by the platform vendor. The Windows Azure Platform best fits in this category today. In fact because we don’t provide access to the underlying virtualization or operating system today, we’re often referred to as not providing IaaS.PaaS offerings further reduce the developer burden by additionally supporting the platform runtime and related application services. With PaaS, the developer can, almost immediately, begin creating the business logic for an application. Potentially, the increases in productivity are considerable and, because the hardware and operational aspects of the cloud platform are also managed by the cloud platform provider, applications can quickly be taken from an idea to reality very quickly.SaaSFinally, with SaaS, a vendor provides the application and abstracts you from all of the underlying components.
Key Points:The cloud can help save money, increase productivity and reduce management complexitiesThis can create new business opportunitiesScript:This ability to move things to the cloud, use the cloud for extra compute or storage or expose or share your services with others leads to some benefits:First, it offers a new set of economic opportunities. Gain better control over your money (New economics)from saving money by not having to run and maintain large datacenters yourselfin some cases moving to IT as a subscription so that you only pay for what you use, when you use itby giving you the opportunity to shift from capital expenses to operational expensesReduced management:No patching and maintenanceFaster deploymentRobust multi-layered securityReliability and fault-toleranceRedefining Productivity: by increasing access to information and applicationsby increasing collaboration because many of the tools they use are now connected togetherby helping your IT staff focus more on business and less on plumbing and hardware (no patching and maintenance, faster deployment, etc) quickly adapt to changing business needs New EconomicsReduced ManagementRedefining Productivity
Key Points:Script:Businesses are moving to the cloud. Analysts predict that the vast majority of large businesses will be using some type of cloud services in the next few years and that many will drastically be cutting the IT assets that they run and maintain in favor of pushing it to others to run for them. If you’re looking at a new IT project or you’re facing some new business challenges, it’s worth taking a look to see if the cloud can help you.This all probably sounds good from a theoretical standpoint but whose actually doing this today?
Introduce SQL Azure as part of Microsoft’s Cloud PlatformWhen SQL Azure section expands, talk to the key platform capabilities provided by SQL Azure (Database, Reporting and DataSync)These capabilities and why and how we developed them will be covered in subsequent slides.
Slide ObjectiveDiscusses various SQL Azure data access topologiesSpeaking notesAccess from within Microsoft Datacenter (Code near scenario)Connect a Windows Azure Compute application to SQL AzureExecuting Asp.NET code, PHP, other managed code, native codeSimple familiar programming modelAccess from on premise applications (Code far)Solve the DB under the desk issue.NET, native or other platform supportMicrosoft access as a front end offers interesting scenarioNeed to be conscious of query frequency and/or payloadAccess from both Cloud and On PremiseE.g. application with browser front and AND a need to sync to mobile devicesCloud provides an always up rendezvous point for data consumersWindows Azure runs the browser based applicationOther applications connect remotely- TDS, Odata, SncNotesMSDN on topology optionshttp://msdn.microsoft.com/en-us/library/ee336239.aspxSQL Azure + MS Accesshttp://blogs.msdn.com/b/access/archive/2010/06/07/access-2010-and-sql-azure.aspx
Initial services – core RDBMS capabilities as a service SQL Azure Database(SADB), Data SyncFuture OfferingsAdditional data platform capabilities as a service: BI/DSS, DWNew services: Reference Data, Secure Data HubSQL Azure is an umbrella brand that covers all the services we intend to offer over time. Post v1 services are in grey. Data sync will be in CTP.Key takeaway: Start with core RDBMS features and expand from there. Integrate with on-premise SQL.High-Value Database ServicesRich data platform capabilities as a service: Reporting, Analytics, Integration, DW, … New services: Data Hub, DataPlex, Association Hub (Data->Information), …Extending our Data Platform to the cloud, generating a network effect:Benefit cloud business with Enterprise connectionsBenefit Enterprise business with cloud connectionsEnable new uses of data to drive additional business value – e.g. “Federated data”
Self-ManagedCore data capabilities as a ServiceReduce complexity and innovate faster by quickly consuming data capabilities as ServiceBuilt for the cloud – not porting on-premises VMs More than a DB - Relational Database as a Service, Reporting, Data SyncNo physical AdministrationEasy Provisioning and DeploymentWizard-based provisioningSimple database deploymentNo hardware, physical DB or file management requiredSelf-healing platformAuto High AvailabilityBuilt-in fault-tolerantAutomated maintenanceElastic ScaleDatabase as a service Easy to Scale –out across multiple database. Pay-as-you-grow databasesMulti-tenant data hostingLogical schema per tenant with isolated physical storageProvision new tenants quickly and easily Business-Ready SLAsReliability Security management across multiple databasesDeveloper Agility – Symmetry with on-premisesLeverage familiar T-SQL based relational database model Transact-SQL ADO.NET OLE DB, ODBC, and JDBC LINQ Entity Framework ADO.NET Data ServicesIntegration with existing tools to ensure rapid development and symmetry with on-premises DBVisual StudioSQL Server Management Studio Innovate with new data application patternsBuild for new scenarios that extend the reach of your data to a large audience – customers, partners, branch offices and devices.Try new cloud scenarios with SQL Azure Reporting, Data Sync and the Dallas Marketplace
Slide ObjectiveUse this slide to transition into an explanation of SQL Azure Database (Reporting and Data Sync will be covered later)Explain at a high level how SQL Azure worksSpeaker NotesDesign Principle of SQL Azure: Focus on combining the best features of SQL Server running at scale with low frictionSQL Azure is a high availability databaseAlways three transaction consistent replicas of the databaseOne primary replica; two slave replicasFailure of a replica will result in another replica being spun up immediately by the fabricFailure of the primary replica means a slave replica will become the primary and a new slave will spin upMinimal down timeTypically just a few dropped connectionsEasy to code for the failover scenario- if you are ding god connection management and error handling will be fineClustered index required on all tables to allow replicationNotesUseful article from SQL Azure teamhttp://msdn.microsoft.com/en-us/magazine/ee321567.aspx
Elastic ScaleService scales as resources requirements growNo-Code Sync ConfigurationEasily define data to be synchronizedSchedule SyncChoose how often data is synchronizedConflict HandlingHandle issues where same data is changed in multiple locationsLogging and MonitoringAdministration capabilities for tracking data and monitoring potential issues
Sharded Databases ProvidesUnlimited Scalability Throughput not possible with a single scale-up nodeBest price/performanceSQL Azure Provides the FoundationHighly available on top of commodity hardwareZero admin of cluster, HW, & SWElastic pool of resources with Pay-as-you-go Model
Cloud Hub – Data CollaborationCustomer ChallengesExtending data trapped within firewalls to partners and branch officesExtending reach of data to new devices and applicationsOrganizational silos resulting in multiple copies of data Consolidating and streamlining data for multiple parties collaborationSQL Azure BenefitsSecure and easy extension or consolidation of data into cloudAbility to expose data from SQL Azure with existing frameworksData Sync keeps on-premises and cloud database synchronizedScenario CasesB2B Supply/Value chain collaboration using information hubEasy data sharing to public and partnersMobile applications and remote workers accessing data that is extended to the cloud Scale-out Enterprise ApplicationsCustomer ChallengesEfficiently utilizing resources for predictable business patternsDifficult to roll out extra capacity quicklyEnable new solutions at scale without additional investmentSQL Azure BenefitsFully managed, highly scalable, cloud-based relational database as a service with pay as you go modelBuilt-in high availability, fault tolerance and automated management (no VMs)Ability to handle spikes in demand and scale up or scale down on demandScenariosEnterprise building scalable web application in cloud to benefit from greater flexibility.Enterprise uses cloud database to handle unpredictable variations in demand Departmental ApplicationsCustomer ChallengesData loss or compliance concerns due to data scattered across organizationLack of agility in provisioning databases for departmental needsSQL Azure BenefitsSelf –managing, highly scalable relational database as a service built on SQL Server technologyEasy web-based provisioning and fully automated relational database as a serviceAbility to connect from existing Access front-end applications to data stored in SQL AzureFamiliar programming model and tools to build, migrate and manage databases.Scenario CasesMigration/consolidation of data into a more managed cloud environment.Allowing central IT to “upsize” data into more managed scalable cloud databases.Departmental applications created to be quickly and efficiently provisioned. Software-as-a-Service (SaaS applications)Customer ChallengesGeo-expansion and reaching new markets fasterMonetizing IP more effectively and expanding reachReliably and efficiently scaling to meet customer and business needsFlexibility to pay as you grow without large upfront hardware investmentsSQL Azure BenefitsCreate multi-tenant service with easy scale up and scale downSelf-managed, highly available and fault tolerant service with a pay-as-you-go modelFamiliar programming model and toolsScenario CasesEnhancing traditional on-premises deployments.Building multi-tenant offering to scale and compete with more options to customers.Enabling solutions to provide more options to customers and partners for different needs and deployment. Business IntelligenceCustomer ChallengesQuickly building solutions that enable analysis of internal and external information.Integrate 3rd party data to provider deeper and richer analysis in a seamless manner.SQL Azure BenefitsNative data connectivity from SQL Azure to Office.Ability to combine data in SQL Azure with third partyScenario CasesAn enterprise using data in SQL Azure and integrating with on-premises tools.Multi-party solution provides opportunity for end-to-end visibility and analysis.Enterprise leveraging SQL Azure BI to create reports and perform analysis over their data
Purpose of the slideHighlight the benefits of SharePoint Server 2010 to facilitate seamless and secure sharing and collaboration on user-generated BI solutions. Key Points: SharePoint 2010 makes it safe and easy for users to work together and boosts the productivity of project teams and business unitsStandard SharePoint permissions and workflows enable IT departments to coordinate how users share their solutionsAutomatic data refresh even for source systems over the Internet ensures accurate analysis and decision-makingReuse of workbooks and reports accelerates solution delivery, cuts development costs, and facilitates timely decisionsConclusion: To exploit all the BI capabilities available with PowerPivot for Excel 2010, deploy SQL Server 2008 R2 in a SharePoint 2010 environment.
This is current as of March 7, 2011Pricing table - http://www.microsoft.com/windowsazure/pricing/#sqlWeb Edition: Up to 1 GB relational database = $9.99 / month Up to 5 GB relational database = $49.95 / month** Business Edition: Up to 10 GB relational database = $99.99 / month Up to 20 GB relational database = $199.98 / month** Up to 30 GB relational database = $299.97 / month** Up to 40 GB relational database = $399.96 / month** Up to 50 GB relational database = $499.95 / month** Data transfers = $0.10 in / $0.15 out / GB - ($0.30 in / $0.45 out / GB in Asia)* * No charge for inbound data transfers during off-peak times through October 31, 2010** SQL Azure 50 GB Business Edition Database and 5 GB Web Edition Database will be available starting on June 28, 2010.