A friend was telling me the other day that there is a pyramid for the costs of fixing a problem in the software development life cycle. Where could I find this?
He was referring to the cost of fixing a problem.
For example,
To fix a problem at the requirements stage costs 1.
To fix a problem at the development stage costs 10.
To fix a problem at the testing stage costs 100
To fix a problem at the production stage costs 1000.
(These numbers are just examples)
Most Expensive Cad Software
I would be interested in seeing more about this if anyone has references.
Tshepang
6,3591818 gold badges7474 silver badges114114 bronze badges
Matt McCormickMatt McCormick
7,3132020 gold badges6565 silver badges7878 bronze badges
closed as off-topic by Kara, gunr2171, azurefrog, Web_Designer, DeRaganFeb 21 '17 at 23:28
5 Answers
(Stefan Priebsh: OOP and Design Patterns: Codeworks DC in September 2009)
Melebius
3,28033 gold badges2424 silver badges3636 bronze badges
Dave AndersonDave Anderson
9,07911 gold badge4343 silver badges7171 bronze badges
This is a well-known result in empirical software engineering that has been replicated and verified over and over again in countless studies. Which is very rare in software engineering, unfortunately: most software engineering 'results' are basically hearsay, anecdotes, guesses, opinions, wishful thinking or just plain lies. In fact, most software engineering probably doesn't deserve the 'engineering' brand.
Unfortunately, despite being one of the most solid, most scientifically and statistically sound, most heavily researched, most widely verified, most often replicated results of software engineering, it is also wrong.
The problem is that all of those studies do not control their variables properly. If you want to measure the effect of a variable, you have to be very careful to change only that one variable and that the other variables don't change at all. Not 'change a few variables', not 'minimize changes to other variables'. 'Only one' and the others 'not at all'.
Or, in the brilliant Zed Shaw's words: if you want to measure shit, don't measure other shit.
In this particular case, they did not just measure in which phase (requirements, analysis, architecture, design, implementation, testing, maintenance) the bug was found, they also measured how long it stayed in the system. And it turns out that the phase is pretty much irrelevant, all that matters is the time. It's important that bugs be found fast, not in which phase.
This has some interesting ramifications: if it is important to find bugs fast, then why wait so long with the phase that is most likely to find bugs: testing? Why not put the testing at the beginning?
The problem with the 'traditional' interpretation is that it leads to inefficient decisions. Because you assume you need to find all bugs during the requirements phase, you drag out the requirements phase unnecessarily long: you can't run requirements (or architectures, or designs), so finding a bug in something that you cannot even execute is freaking hard! Basically, while fixing bugs in the requirements phase is cheap, finding them is expensive.
If, however, you realize that it's not about finding the bugs in the earliest possible phase, but rather about finding the bugs at the earliest possible time, then you can make adjustments to your process, so that you move the phase in which finding bugs is cheapest (testing) to the point in time where fixing them is cheapest (the very beginning).
Note: I am well aware of the irony of ending a rant about not properly applying statistics with a completely unsubstantiated claim. Unfortunately, I lost the link where I read this. Glenn Vanderburg also mentioned this in his 'Real Software Engineering' talk at the Lone Star Ruby Conference 2010, but AFAICR, he didn't cite any sources, either.
If anybody knows any sources, please let me know or edit my answer, or even just steal my answer. (If you can find a source, you deserve all the rep!)
Jörg W MittagJörg W Mittag
299k6464 gold badges365365 silver badges565565 bronze badges
See pages 42 and 43 of this presentation (pdf).
Unfortunately the situation is as Jörg depicts, in fact somewhat worse: most of the references cited in this document strike me as bogus, in the sense that the paper cited either is not original research, or does not contain words supporting the claim being made, or - in the case of the 1998 paper about Hughes (p54) - contains measurements that in fact contradict what is implied by the curve in p42 of the presentation: different shape of the curve, and a modest x5 to x10 factor of cost-to-fix between the requirements phase and the functional test phase (and actually decreasing in system test and maintenance).
MorendilMorendil
Never heard of it being called a pyramid before, and that seems a bit upside-down to me! Still, the central thesis is widely considered to be correct. just thick about it, the costs of fixing a bug in alpha stage are often trivial. By beta stage it might take a bit more debugging and user reports. After shipping it could be very expensive. a whole new version has to be created, you have to worry about breaking in-production code and data, there may also be lost sales due to the bug?
winwaedwinwaed
6,44666 gold badges2525 silver badges7474 bronze badges
Try this article. It uses the 'cost pyramid' argument (no naming it), among others.
Raúl C.Raúl C.
Not the answer you're looking for? Browse other questions tagged software-quality or ask your own question.
Many software bugs are merely annoying or inconvenient but some can have extremely serious consequences â either financially or as a threat to human well-being. The following is a list of software bugs with significant consequences.
Space[edit]
Medical[edit]
Tracking years[edit]
Electric power transmission[edit]
Administration[edit]
Telecommunications[edit]
Military[edit]The Most Expensive Software Bug Bites
Media[edit]
Video gaming[edit]
Encryption[edit]
Most Expensive Editing SoftwareTransportation[edit]
Finance[edit]
See also[edit]External links[edit]References[edit]
Retrieved from 'https://en.wikipedia.org/w/index.php?title=List_of_software_bugs&oldid=904668174'
What is the most expensive software bug / defect you've seen in practice.
There are some famous cases like the Therac 25, but I'm interested to know what issues you've seen yourself or heard of directly. We all have 'a friend who used to work at an old company' and would never admit to accidently charging peoples credit cards ourselves.
What problem was caused and why was it caused?
closed as primarily opinion-based by Dukeling, josliberâ¦, rink.attendant.6, ayaio, ChubasJun 26 '15 at 21:25
Many good questions generate some degree of opinion based on expert experience, but answers to this question will tend to be almost entirely based on opinions, rather than facts, references, or specific expertise. If this question can be reworded to fit the rules in the help center, please edit the question.
7 Answers
Well, I can share a story:
Long long time ago, I worked for a company that got a contract on maintaining an application that was basically written in Oracle SP's. I had to migrate one of those, and it turns out that I didn't understand the business, so I migrated it as is.
The problem was that the SP didn't do a commit at the end, but returned some data, and the migrated Java code was exactly the same. What the sp did was to write some data to a table, return a document that contained some billing information, but the billing information was never wrote to the database.
What happened next was that we received alot of payments but didn't know how to correlate them with the database data, so we had to do alot of magick to try and associate the payments.
I guess this one (more info) is probably the most costly single failure (500 million USD).
Tim Cooper
124k3232 gold badges252252 silver badges233233 bronze badges
Skizz
44.8k88 gold badges6060 silver badges102102 bronze badges
flodinflodin
4,17822 gold badges2121 silver badges3535 bronze badges
I once shut down CNA's entire risk management system because I didn't understand what an index was on a database field. CNA approved no new Insurance policies for about four hours because the system ground to a halt. I don't know what the financial cost was, but my managers had to engage in some serious damage control.
I will never again ignore the difference between a table scan and an index seek.
If I recall correctly there was once a small software bug that multiplied a certain value by a thousand if a , instead of a . was used. Not that big of a deal unless it is the radiation dosis of a cancer treatment device. People died.
I recently did some survey on the cost of technical debt and found two cases:
These cases show that it could be very expensive when technical debt is out of control.
Well.. Heartbleed is probably still racking up millions. I'm sure there are still a lot of servers that haven't patched it yet.
Not the answer you're looking for? Browse other questions tagged language-agnostic or ask your own question.
Instabug provides in-app feedback and bug reporting to mobile apps looking for bug tracking. A hat in time concept art. After integrating the SDK, it allows you to have a seamless two-way communication with users or testers, while providing detailed environment report for developers. The integration process takes less than a minute and the results are outstanding! The top apps in the world rely on Instabug. We provide exceptional support 24/7 and is constantly rated highly as a bug reporting & tracking tool. Learn more about Instabug
A solution focusing on bug reporting, for customer & beta testing feedback, user engagement, crash reporting, and more. Integrate now! Learn more about Instabug
Instabug provides in-app feedback and bug reporting to mobile apps looking for bug tracking. After integrating the SDK, it allows you to have a seamless two-way communication with users or testers, while providing detailed environment report for developers. The integration process takes less than a minute and the results are outstanding! The top apps in the world rely on Instabug. We provide exceptional support 24/7 and is constantly rated highly as a bug reporting & tracking tool.
Earlier this year a man lost a $57 million jackpot when a casino alleged a 'software glitch' on the slot machine. Well, that's nothing compared to the backlog of $9 billion in unprocessed payments that happened in Japan in March.
Casino Denies $57 Million Jackpot Because of 'Software Glitch'
Have you ever imagined how would it feel to hit a $57 million slot machine jackpot? It must be anâ¦
Read more Read
Advertisement
Here are the top five worserest, most expensive computer glitches of 2011, according to SQS, a UK company specialized in software quality assurance:
1. Financial firm services AXA Rosenberg lost $217 million of its investors' money because of a software glitch in its investment model. The company hid the bug from its clients, so they had to pay back that amountâplus a $25 million fineâto the US Securities and Exchange Commission. Oh you cheeky 1% bastards you.
Advertisement
2. Car manufacturer Honda had to recall 2.5 million cars because of a bug that allowed vehicles to shift out of park or simply stall out. That's a lot of dope for some bad lines of code.
3. Japanese bank Mizuho Financial Group's clients experienced a software glitch that collapsed its ATM network and internet banking systems. The result was $1.5 billion in salary payment delays and $9 billion in unprocessed payments. Nine billion. With B.
Advertisement
4. A $2.7 billion US Army cloud computing network failed miserably, leaving troops unable to perform simple operations like sharing data with other users, which, incidentally, is one of the network's main intended functions. You have to wonder how much time and money was ultimately lostânot to mention the number of lives endangered. Not surprisingly, nobody will say; maybe their computers are down.
5. Here's a good oneâfor those who were able to enjoy the glitch. A Commonwealth Bank ATM network bug caused the machines to dispense large amounts of money to random people. Police actually arrested two people who took the mistakenly spit-out money, saying that it was a crime. No word about the hundreds who took the money and ranâand got away.
Advertisement
Image by Lenetstan/Shutterstock Ucla olive view fellowship match.
Comments are closed.
|
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |