CHAOS Report 2015Apr 21, 2015
Today, we released the “CHAOS Report 2015” report. The CHAOS Report 2015 is a model for future CHAOS Reports. There have only been two previous CHAOS Reports, the original in 1994 and the 21st edition of 2014. This new type of CHAOS Report focuses on presenting the data in different forms with many charts. Most of the charts come from the new CHAOS database from the fiscal years 2011 to 2015. The CHAOS fiscal year starts March 1 and runs until the end of February. A few of the charts are from the new SURF database to highlight certain information. The purpose of this report is to present the data in the purest form without much analysis and little thought leadership. Analysis and thought leadership are offered in the CHAOS Manifesto series of reports. This is outline of the report:
Page 1: Introduction: where we introduce the six data points of success. On this page we display 3 pie charts and one table: OnBudget, OnTime OnTarget and Traditional Resolution for All Projects.
Page 2: Modern Resolution is defined as OnTime, OnBudget, with a satisfactory result. On this page we display 3 pie charts and one table: Valuable, OnGoal, Satisfactory and Modern Resolution for All Projects.
Page 3: Project Size: has always been a major element in the CHAOS research. On this page we display 2 pie charts and 2 tables: Value for Large Projects, Value for Small Projects, Project Size by CHAOS Resolution and CHAOS Resolution by Project Size.
Page 4: Resolution by Industry: provides another view of the CHAOS database. On this page we display 2 pie charts and one table: satisfaction level for banking projects, satisfaction level for retail projects and CHAOS Resolution by Industry.
Page 5: Areas of the World shows project resolution of the 4 major geographical areas of the world. On this page we display 2 pie charts and one table: Budget Process, Project Selection Process, and CHAOS Resolution by each Area of the World.
Page 6: Project Type: has a major effect on resolution. On this page we display 2 pie charts and one table: ROI for Requirements, Gain versus Risk Metrics, and CHAOS Resolution by Project Type.
Page 7: Agile versus Waterfall: compares the resolution of all software projects segmented by the agile process and waterfall method by size. On this page we display a pie chart and one table: Time Boxes and CHAOS Resolution by Agile versus Waterfall.
Page 8: Complexity: discusses how we determine and appraise complexity. On this page we display 2 pie charts and one table: Complexity Appraisal, Large, Complex Projects, and CHAOS Resolution by Complexity.
Page 9: Goal: as one of the seven constraints. On this page we display 2 pie charts and one table: Low-Value Business Processes, Cost/Benefit Analysis, and CHAOS Resolution by Goal.
Page 10: Skilled Staff: is a look at project resolution by capability. On this page we display 2 pie charts and one table: Gifted Agile Teams, Unskilled Agile Teams, and CHAOS Resolution by Capability.
Page 11: Factors of Success: reflects our opinion of the importance of each attribute and our recommendation of the amount of effort and investment that should be considered to improve project success. On this page we display a table of 2015 CHAOS Factors of Success with investment recommendation.
Page 12: shows additional resources and research and Resolution Benchmark benefits.
New CHAOS 2015 CHARTSMar 18, 2015
The Standish Group has replaced and updated the primary 12 CHAOS Charts in the chart section with the following charts. All the charts are from the new CHAOS Database from fiscal years 2011 to 2015. Fiscal year runs from March 1st to the end of February of the following year. Unless otherwise noted the total number of software projects is over 25,000 with an average of 5,000 per yearly period. In addition, all charts, except for the first chart, use our modern definition of success. Modern Resolution is defined as OnTime, OnBudget with a satisfactory result.
Chart 1: Traditional Resolution for All Projects
Traditional Resolution is defined as OnTime, OnBudget and OnTarget.
Chart 2: Modern Resolution for All Projects
Modern Resolution is defined as OnTime, OnBudget with a satisfactory result.
Chart 3: Project Size by CHAOS Resolution
The chart shows the size of the software projects by the modern resolution definition.
Chart 4: CHAOS Resolution by Project Size
The chart shows the resolution of all software projects by size.
Chart 5: CHAOS Resolution by Industry
The chart shows the resolution of all software projects by industry.
Chart 6: CHAOS Resolution by Project Type
The chart shows the resolution of all software projects by project type. Project type is the development method used to create the application or system.
Chart 7: CHAOS Resolution by Agile versus Waterfall
The chart compares the resolution of all software projects from Fiscal 2011 to 2015 within the new CHAOS database is segmented by the agile process and waterfall method. The Standish Group took great care to code each project by true agile and true waterfall. The total number of software projects in these two segments is over 10,000.
Chart 8: CHAOS Resolution by Area of the World
The chart shows the resolution of all software projects by the four major areas of the world.
Chart 9: CHAOS Resolution by Complexity
The chart shows the resolution of all software projects by complexity.
Chart 10: CHAOS Resolution by Goal
The chart shows the resolution of all software projects by goal.
Chart 11: CHAOS Resolution by Capability
The chart shows the resolution of all software projects by capability.
Chart 12: 2015 CHAOS Factors of Success
Chart shows the 2015 Factors of Success. This chart reflects our opinion of the importance of each attribute and our recommendation of the amount of effort and investment that should be considered to improve project success.
CHAOS Members just need to click the chart icon on the membership dashboard to review the information. Not member check out our membership: http://www.standishgroup.com/Membership
Modernization in PlaceFeb 26, 2015
Today we are pleased to announce that we have released The Standish Group’s Modernization in Place Report. Modernization in Place report recommends ways to modernize and update critical applications. A highlight of the Modernization in Place report is the use rate and value of features and functions by the age of the application. The Modernization in Place report suggests a concrete path to a successful resolution of a modernization project. Modernization in Place report outlines the six steps to a successful completion of a modernization project. The Modernization in Place Report is 6 pages:
Page 1: Introduction outlines the concept of modernizing applications while they are fully functional and in use. On page one we introduce the six steps of modernization and how to prepare for modernization. There is one chart on page one and the title is “Percentage of features and functions by frequency use". This table represents The Standish Group’s opinion of how frequently features and functions are used over the age of the application.
Page 2: Introduces the concept of Crapola and how it affects modernization in place efforts. On this page we also discuss the laws of Manny Lehman. There is one chart on page two and the title is “Percent of Features and Functions by Value. This table represents The Standish Group’s opinion of the value of features and functions over the age of the application.
Page 3: Presents and explains the first three steps in the six steps of Modernization. There is one chart on page three and the title is Satisfaction by Type of Project. This table represents the level of satisfaction of projects by types from the CHAOS database, covering projects from 2010 to 2014.
Page 4: Presents and explains the last three steps in the six steps of Modernization. There is one chart on page four and the title is Skill Levels of Successful Modernization Projects. This table represents the skill levels of successful modernization projects, measured by on time, on budget, and with a satisfactory outcome, from fiscal 2010 to 2014.
Page 5: Presents and explains the benefits of modernizing critical older applications. We also discuss the risks of not modernizing them. There is one chart on page five and the title CHAOS Resolution by Project Type. This table represents the project resolutions by type, measured by on time, on budget, and with a satisfactory outcome, from fiscal 2010 to 2014.
Page 6: Recommendation on additional research and resources.
Members can find this report in the reports section of the dashboard. Non-members must join to read this report.
Dragon2DragonFeb 13, 2015
“Dragon2Dragon” is a special story for Saint Valentine’s Day. Saint Valentine’s Day celebrates love and is a day dedicated for lovers. Dragon2Dragon is a love story and it is our gift to lovers. Lovers around the world can rejoice in the knowledge that love conquers all hardships. For the wantabe lover the lesson is there is a mate for everyone. Dragon2Dragon is also our gift to the children of world. Dragon2Dragon is written as a children’s story. In Dragon2Dragon we explore:
- Three basic physics lessons
- Perseverance pays off
- There is a friend for everyone
- Opposites are attracted to each other
- Being different is not the end of the world
Read on: Cafe CHAOS
Listen on: CHAOS Tuesday
View on: YouTube
Dragon2Dragon was written by Jim Johnson
Mike Johnson created the illustrations
Jennifer Drake Ford narrates Dragon2Dragon
Colleen Frye and Jim Crear edited the story
Joe Piccione did the video, audio, editing & production
Music from Shutterstock.com
Factors of SuccessFeb 2, 2015
Today we are pleased to announce that have released the Standish Group Factors of Success 2015 report. The report is 8 pages:
Page 1: Introduction: outlines the paper and the methodology of developing the factors of success. It also discusses the traditional definition of success and our new modern definition of success. The table on this page depicts both versions of CHAOS project resolutions, successful, challenged and failed from fiscal 2010 to 2014.
Page 2: Traditional success presents the Factors of Success for successful projects as measured by the PMI traditional definition of success on time, on budget and on target. Page 2 table shows the skill levels of 10 Factors of Success by their score and rank.
Page 3: Modern Success presents the Factors of Success for successful as measured by the Standish modern definition of success on time, on budget with a satisfactory result. Page 3 table shows the skill levels of10 Factors of Success by their score and rank.
Page 4: Challenged presents the Factors of Success for challenged as measured by the Standish modern definition of late, over budget with an unsatisfactory result. Page 4 table shows the skill levels of 10 Factors of Success by their score and rank.
Page 5: Failed presents the Factors of Success for failed as measured by canceled or not used. Page 5 table shows the 10 Factors of Success by their score and rank.
Page 6: Trump Cards presents a discussion on attributes that create a project winning hand, Page 6 table is skill levels of agile teams by project resolution as calculated from the modern success metrics, from fiscal 2010 to 2014.
Page 7: Moderation presents the 2015 Factors of Success as reflected by our opinion of the importance of each attribute and our recommendation of the amount of effort and investment that should be considered to improve project success. Page 7 table presents the latest point values and investment considerations.
Page 8: Recommendation on additional research and resources.
Members can find this report in the reports section of the dashboard. Non-members must join to read this report.
Haze ProjectJan 12, 2015
The Standish Group is launching a new initiative called the “Haze” project. The Haze Project starts with a series of reports and posts. The next steps are workshops to dig down deeper to find real solutions that will provide value to government software projects. The current activities can be found on the Haze webpage: http://www.standishgroup.com/haze
These activities and reports include:
Haze report adds value to “Rethinking the Public Spending on ICT projects” report. The report considers the current state of software developed and innovation as a comparison to the current state of government projects.
Rethinking the Public Spending on ICT projects report was written by Hans Mulder and Ilias Kontakos. The focus of this serious report is a commentary on the findings of the Dutch temporary committee on government ICT projects.
Conclusions and recommendations of the Dutch temporary committee on government ICT projects.
If you have any questions or wish to provide feedback, please contact us using the Tell Me form on our website.
CHAOS Report 2014Dec 4, 2014
Twenty-one years ago we published the “CHAOS Report”. Every year since we have published a variant of the original CHAOS Report, but never calling it the CHAOS Report. We have called new CHAOS reports: CHAOS Rising, Extreme CHAOS, CHAOS Chronicle, CHAOS: A Recipe for Success CHAOS Manifesto, and CHAOS Knowledge Center. That changes now and this year we are publishing a new traditional CHAOS Report. The title of the new traditional report is CHAOS Report: Twentieth First Anniversary Edition. We also plan to publish a new CHAOS report each year. Each CHAOS Report has the latest CHAOS numbers and information. Each report presents the12 most important charts from the CHAOS research. The 12 charts are:
- Chart 1 CHAOS Resolution for All Projects
- Chart 2 Cost, Time, and Target
- Chart 3 Project Size by CHAOS Resolution
- Chart 4 CHAOS Resolution by Project Size
- Chart 5 CHAOS Resolution by Industry
- Chart 6 CHAOS Resolution by Area of the World
- Chart 7 CHAOS Resolution by Project Type
- Chart 8 CHAOS Resolution by Agile versus Waterfall
- Chart 9 CHAOS Resolution by Complexity
- Chart 10 CHAOS Resolution by Goal
- Chart 11 CHAOS Resolution by Capability
- Chart 12 CHAOS Factors of Success
The new CHAOS report: Twentieth First Anniversary Edition is available to members in our report sections of our new website and available to non-members in our store.
New Membership OptionsNov 10, 2014
The Standish Group is offering four types of membership to our research on project performance.
Report Only Membership is perfect for the casual researcher or a passive library. The Report Only Membership offers a convenient and economical way to get access to the latest Standish research reports. The Standish Group produces one new or updated research report per month including a yearly CHAOS Manifesto, CHAOS Report, Modernization in Place, and nine other new and updated research reports. Please see list of reports for 2015.
Professional Membership is perfect for the adept researcher or active library. Professional Membership provides access to the Standish Group Member research website. The Member research website has three major parts: research reports, SURF database, and CHAOS Knowledge Center. The Professional Membership includes 12 hours of virtual research and advice.
Skills Appraisals Membership is perfect for the Project Management Office (PMO). The Skills Appraisals Membership provides a platform for the monthly meeting to run internal workshops. Membership includes all things needed to create and execute 11 workshops with up to 10 people in each session. The membership includes a detailed instruction manual with suggested meeting format, agendas, meeting tips, and questions.
Resolution Benchmark Membership is perfect for IT executive management that wants to measure the organization against 1,000 other organizations. Resolution Benchmark measures your closed projects against our CHAOS Database. Your projects are profiled and segmented by industry, project size, organization size, methodology, types, geographic area, skill levels, and other attributes. Resolution Benchmark measures the six success metrics (individually and in combination): on time, on budget, on target, on goal, valuable, and customer satisfaction.
CHAOS Manifesto 2014Nov 5, 2014
This week we officially released the CHAOS Manifesto 2014: Value versus Success & orthogonal. This CHAOS Manifesto is unlike previous CHAOS Manifestos. It is not just a subset of the online version of the CHAOS Chronicles, known as the CHAOS Knowledge Center (CKC). Rather, CHAOS Manifesto 2014 offers an orthogonal view of the CHAOS Knowledge Center and focuses on project value versus project success. The Standish Group is very excited about changing the conversation from success to value. While the last 21 years CHAOS research successful project as on time, on budget, and on target, also known as the “triple constraints” or the “iron triangle.”
For the last five years, however, we have also been studying a parallel track that turns out to be orthogonal to success. Rather than measure projects by the expected triple constraints (cost, time, and quality) we came up with a value measurement system. We have learned that much of what we do to ensure a successful project outcome is counter to creating value from your project investments. This is called the Success versus Value Orthogonal. In the report we show a graphic of a compass with relationship between value, success, failure and worthless. Value is at the top of the compass (north) and success is at the right side of the compass (east) or 90 degrees from value. This is the meaning of orthogonal.
CHAOS Manifesto 2014 details why success is often in conflict with true value, and describes a better way to increase the value of your project investments. In this value-based approach to project management we recommend SAFE projects, not because they are without risk (and some will fail, but that’s OK), but because they are simple, absorbent, fast, and economical. As part of our Value-based PM approach, CHAOS Manifesto 2014 highlights 20 “rules” based on the Success versus Value Orthogonal. In CHAOS Manifesto 2014 we are exploring other measurements of project success to consider value and other metrics. We have spent the last several months coding our CHAOS database with these new metrics.
The current CHAOS database is coded with the following attributes: on time, on budget, on target (% requirements), and satisfied (very high to very low). We already coded the database with value (very high to very low) and how closely it meets the strategic corporate goal (precise to distant). The CHAOS Manifesto 2014 includes the Success Value Comparison Table. The Success Value Comparison Table compares the success driven approach against the value driven approach. Some of the key attributes are scope of measurement, how they are managed, compliance/governance, budget process, project types, and project mix.
Last CHAOS Activity NewsletterNov 1, 2014
Yesterday we e-mailed our last CHAOS Activity Newsletter. We published the CHAOS Activity Newsletter for almost a decade. The CHAOS Activity News is now a section on our new website. We will update the CHAOS Activity News page every weekday. The Monthly editorials that were part of the CHAOS Activity News have been replaced by weekly editorials in the cafe CHAOS. Daily mini blogs are issued from PM2GO and the latest five are currently listed and linked on the CHAOS Activity News page. The CHAOS Activity News page also has the latest CHAOS Tuesday program. Upcoming CHAOS Tuesday programs and other events are listed on the Events page. If have any comments or suggestions for improvement please either use the Tell Me Link or e-mail Jennifer Lynch @ Jennifer@standishgroup.com
We just launched our new website. The new website is totally new outside and inside. Outside we have new graphics, a new video, and new links to our various services such as Cafe CHAOS, CHAOS Tuesday, PM2GO and Dezider. We have a new sample research page without the need to register. On this page we will display a few sample reports that reflect the types of reports and services within the various Standish memberships. You can add yourself to our mailing list to get news and announcements. You can also become a Standish member by going to our store and buying a membership. The store also has some special individual reports.
Inside, the new website is streamlined for you to be able to find things quicker. For example we have created a new improved dashboard. The dashboard has six quick links:
1. Charts: This link brings you to the current 12 most important CHAOS charts including project resolution by size, industry, project type, current factors of success and agile versus waterfall resolutions.
2. Reports: The new report section displays the 12 most current and important research reports. These reports include the current CHAOS Manifesto, CHAOS research, Factors of success, and other software project research reports. The Standish Group, with this new website is focused more on providing one new or updated report per month.
3. SURF Database: We have taken the 20 most popular and important project management questions from the DARTS and other research data to create a dynamic database. Members can query the database by selecting on any question items and selected analysis. Currently the link is grayed out because we are still collecting our initial surveys.
4. CHAOS Knowledge Center: This link brings you to the various services within the Knowledge Center, such as case studies, checklists, book reviews and commentaries. You can also get to the Best Practices and How Tos through this link.
5. Best Practice: This link brings you to the 100 best practices segmented by the CHAOS Factors of Success. Each best practice has three elements for a total of 300 elements. You can also get to the Best Practices through the CHAOS Knowledge Center link.
6. How Tos: This link brings you to the 100 How Tos to implement the best practices also segmented by the CHAOS Factors of Success. Each How To has four suggestions for a total of 400. You can also get to the How Tos through the CHAOS Knowledge Center link.
The website is designed to be more mobile friendly and easy to navigate. At Standish Group our main focus is to provide you, our customer, with the latest in innovative thinking and publishing its results. We hope this new website design and its contents will do that. Your opinions are important to us. Please let us know what you think by going to the “Tell Me” section.