Open Source ETL

TechFest – Open Source ETL Software David Morris Fort Worth, TX October, 2008 * For Internal Use Only *

Table of Contents ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

This presentation will attempt to clarify misconceptions about open source software and discuss how it can benefit IT organizations in many different ways ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The idea of open source or free software has a rich history that began in the 1960s ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

“ Free as in speech, not beer.” – Richard Stallman ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Open source doesn't just mean access to the source code. The distribution terms of open-source software must comply with the following criteria ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Open source doesn't just mean access to the source code. The distribution terms of open-source software must comply with the following criteria (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

There are many different types of hard costs associated with leveraging open source software for enterprise IT projects ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

There are many different types of hard costs associated with leveraging open source software for enterprise IT projects (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

There are also soft or intangible costs associated with enterprise open source software projects and are typically harder to calculate than hard costs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Many organizations do not have a formal process in place to do a comprehensive financial analysis of software commitments ,[object Object],451 CAOS Report 2 - Cost Conscious A practical guide for understanding and calculating the financial benefits of open source for enterprise IT projects The 451 Group Calculator - Example A Open Source Option Proprietary/Existing Option Initial Investment Year 1 Year 2 Year 3 TOTALS Initial Investment Year 1 Year 2 Year 3 TOTALS HARD COSTS $76,250.00 $41,200.00 $111,150.00 $49,100.00 $277,700.00 HARD COSTS $296,250.00 $99,200.00 $176,150.00 $104,100.00 $675,700.00 Software Licenses - - - - $0.00 Software Licenses $200,000.00 $50,000.00 $50,000.00 $50,000.00 $350,000.00 Hardware $25,000.00 $3,000.00 $3,000.00 $3,000.00 $34,000.00 Hardware $25,000.00 $3,000.00 $3,000.00 $3,000.00 $34,000.00 Support - $25,000.00 $30,000.00 $35,000.00 $90,000.00 Support - $30,000.00 $35,000.00 $40,000.00 $105,000.00 Development $22,000.00 $2,500.00 $5,000.00 $2,500.00 $32,000.00 Development $22,000.00 $2,500.00 $5,000.00 $2,500.00 $32,000.00 Professional Services $12,500.00 $3,000.00 - - $15,500.00 Professional Services $25,000.00 $6,000.00 - - $31,000.00 Training $7,500.00 - - - $7,500.00 Training $15,000.00 - - - $15,000.00 Testing $3,000.00 $3,000.00 $3,000.00 $3,000.00 $12,000.00 Testing $3,000.00 $3,000.00 $3,000.00 $3,000.00 $12,000.00 Operations $2,500.00 $500.00 $500.00 $500.00 $4,000.00 Operations $2,500.00 $500.00 $500.00 $500.00 $4,000.00 Staffing - - $65,000.00 - $65,000.00 Staffing - - $75,000.00 - $75,000.00 Maintenance Contracts $3,750.00 $4,200.00 $4,650.00 $5,100.00 $17,700.00 Maintenance Contracts $3,750.00 $4,200.00 $4,650.00 $5,100.00 $17,700.00 SOFTS COSTS - SOFTS COSTS - INTERNAL COSTS - INTERNAL COSTS - REVENUE $250,000.00 $500,000.00 $800,000.00 $1,550,000.00 REVENUE $250,000.00 $500,000.00 $800,000.00 $1,550,000.00 CASHFLOW CASHFLOW Period -$76,250.00 $208,800.00 $388,850.00 $750,900.00 Period -$296,250.00 $150,800.00 $323,850.00 $695,900.00 Cumulative (Payback) -$76,250.00 $132,550.00 $521,400.00 $1,272,300.00 Cumulative (Payback) -$296,250.00 -$145,450.00 $178,400.00 $874,300.00 RATE OF RETURN 607% 450% 1629% RATE OF RETURN 252% 284% 768% PAYBACK PERIOD Year 1 PAYBACK PERIOD Year 2 NPV $954,643.20 NPV $591,891.97 IRR 340% IRR 82% cost of capital % 12.00% cost of capital % 12.00% NOTES: Use this spreadsheet to consider Cost Avoidance and Opportunity Costs… May add an additional "COST SAVINGS" column above the REVENUE column to account for existing sunk costs Not covered in this spreadsheet: Depreciation, Amortization, Capital and Expense Budgets, etc… Dave's Attempt at saving $3,750 by not buying the spreadsheet from the 451 group

There are a variety of business models that have proven to work for companies who want to make money using open source software ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

There are many barriers to open source adoption in IT organizations, most of which are risk related ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Enterprise open source adoption offers many benefits to IT organizations within any type of business ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

There are many different open source licenses and it can be difficult to distinguish one license from another ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Open source software licenses can range from very simple to relatively complex ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Another great benefit of open source software is the ability to download and try it out for free, and even learn about the development history and statistics ,[object Object]

Open source software websites offer free downloads, documentation SSIS Informatica Ab Initio Blender Talend Pentaho Proprietary Open Source

The concept of business intelligence has been around since the 1950s and became popularized in the software industry in the late 1980s and early 1990s ,[object Object],[object Object],[object Object],[object Object]

There are many “big players” in the business intelligence software space that have been around for much longer than their open source counterparts ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Open source business intelligence solutions started coming onto the scene in 2000, but the space began to explode in 2005

There are a variety of open source business intelligence products that are beginning to compete against proprietary alternatives after only a few years of development ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Companies that sponsor and develop open source projects or offer many different types of tools and support options that vary in cost ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

There are often a wider variety of support options available when using open source software, but they tend to be less mature than with proprietary software ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Most companies providing support for open source projects offer different support levels such as Bronze, Silver, Gold, and Platinum Company Support Level Description Type Price Talend Silver Support Three incidents per year Web support Guaranteed response times Access to a certified version of Talend´s products Automatic notification of updates and bug fixes Access to the support forum and bug tracker 1 user for 1 year $1,150.00 Talend Silver Support Same as above 5 users for 1 year $4,950.00 Talend Gold Support Unlimited incidents Web and email support 24 hour access on business days Guaranteed response times Guaranteed diagnostic turnaround times Access to a certified version of Talend´s products Automatic notification of updates and bug fixes Access to the support forum and bug tracker 1 user for 1 year $2,150.00 Talend Gold Support Same as above 3 users for 1 year $5,750.00 Talend Gold Support Same as above 5 users for 1 year $8,350.00 Talend Platinum Support Unlimited incidents Web, email and phone support 24 hour access (email and Web) on business days Guaranteed response times Guaranteed diagnostic turnaround times Access to a certified version of Talend´s products Automatic notification of updates and bug fixes Access to the support forum and bug tracker 1 user for 1 year ? Talend Platinum Support Same as above 3 users for 1 year ? Talend Platinum Support Same as above unlimited users ?

Talend claims to be the “first provider of open source data integration software”, and while that is not really the case, their software does provide some unique functionality ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Talend’s software is written in Java and has a user interface built around the Eclipse IDE, and it includes a basic business modeler tool and real-time debugging capabilities Advanced Lookup/Join Editor Familiar Eclipse Interface Real-Time Debugger Basic Business Modeler

Pentaho Kettle provides a full spectrum of business intelligence capabilities including reporting, analysis, dashboards, data mining, and data integration ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Pentaho Kettle provides a full spectrum of business intelligence capabilities including reporting, analysis, dashboards, data mining, and data integration Debugger with Pause/Resume User Friendly Job Designer GUI Web-based Dashboards/Mashups Advanced Logging/Statistics

“ Yahoo Pipes is a powerful composition tool to aggregate, manipulate, and mashup content from around the web.” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

This Yahoo Pipes Demo uses data exported from the DeepBlue Employee List and transforms the data into a georss and kml feed ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Thank you for attending, please let me know if you have any questions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Open Source ETL

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (6)

Semelhante a Open Source ETL

Semelhante a Open Source ETL (20)

Último

Último (20)

Open Source ETL

Notas do Editor