{"id":1855,"date":"2024-06-11T12:25:15","date_gmt":"2024-06-11T12:25:15","guid":{"rendered":"https:\/\/janbosch.com\/blog\/?p=1855"},"modified":"2024-06-11T12:25:16","modified_gmt":"2024-06-11T12:25:16","slug":"from-agile-to-radical-define-outcomes-quantitatively","status":"publish","type":"post","link":"https:\/\/janbosch.com\/blog\/index.php\/2024\/06\/11\/from-agile-to-radical-define-outcomes-quantitatively\/","title":{"rendered":"From Agile to Radical: define outcomes quantitatively"},"content":{"rendered":"\n
\"\"
Image by Gerd Altmann from Pixabay<\/figcaption><\/figure>\n\n\n\n

Humans are belief-driven storytelling machines who post-rationalize their, often irrational, behavior. This is at odds with our self-image of rational beings who make measured, balanced choices between well-reasoned alternatives. While this image may hold up in some contexts, research in psychology and elsewhere shows that unless there\u2019s a non-negotiable yardstick holding us accountable, we easily resort to rationalizing unexpected outcomes after the fact as well as taking decisions beforehand on internally consistent but overall flawed lines of reasoning.<\/p>\n\n\n\n

There are few more wonderful examples of this than all the news around the stock market. The explanations in the evening news of why shares moved up or down are often hilarious and mostly intended to give confused viewers and readers an explanation that resolves their cognitive dissonance while having little bearing on reality. Really funny are the people who are predicting developments in individual stocks or the market as a whole. All research shows that the accuracy of these so-called experts is about as good as rolling dice, ie completely random. The stock market, as well as many other systems involving humans, is a complex phenomenon for which we simply don\u2019t have the models to make any prediction of reasonable accuracy. However, we feel the need to explain things and rather have incorrect explanations than admit that we simply don\u2019t know.<\/p>\n\n\n\n

Of course, as companies are made up of humans, the same patterns appear there. Various people inside the company predict the impact of actions, such as R&D investments. Especially in the planning of product development efforts, individuals argue for getting certain functionalities prioritized, claiming particular beneficial outcomes. These outcomes can be very concrete, eg \u201cWe\u2019ll close the sale to this customer if we offer the requested functionality,\u201d but they often are much less specific, eg \u201cThis will increase customer loyalty.\u201d In practice, we seldom look back to evaluate the accuracy of these predictions. Instead, we\u2019ve already moved on and are working on the next features to push for development while promising the most amazing benefits.<\/p>\n\n\n\n

The best way I know to get around this problem is to define quantitative outcomes that we\u2019re looking to accomplish with our investment in R&D. In SaaS companies, especially in e-commerce, this is often an easy problem: the only thing that matters and that we measure is conversion, ie the percentage of people coming to our site who actually buy something or otherwise do something beneficial. In companies where the offering includes mechanical, electronic and software parts, things often become more difficult. For instance, when asking a company providing commercial vehicles what the set of KPIs is that it\u2019s optimizing for, the list easily gets very long. Of course, there\u2019s uptime (or rather, unscheduled downtime), fuel efficiency, tire usage, driver comfort, gearbox effectiveness, average speed in hilly environments, and so on.<\/p>\n\n\n\n

My experience is that most companies fall into the \u201cworthwhile many versus vital few\u201d trap: it\u2019s not that these KPIs aren\u2019t worthwhile to pursue, they are; it\u2019s simply that there are so many of them that you can do anything and come up with a story on how it supports a relevant KPI. In addition, it provides no guidance on the relative priority of these factors. How much fuel efficiency do we need to achieve to allow for a 1 percent lowering of the vehicle\u2019s uptime? In practice, many companies either have no explicitly stated KPIs or they have so many that it doesn\u2019t offer a clear focus.<\/p>\n\n\n\n

The D in Radical is concerned with data: we need to use data for our decision-making and prioritization. However, before we can do that, we first need to agree and decide on the vital few KPIs we\u2019re pursuing as a business. And once we\u2019ve done that, we can measure the impact of each activity as either impacting some of the vital KPIs positively without jeopardizing others or having no or negative impact.<\/p>\n\n\n\n

To achieve this, we need to accomplish three milestones: define a value model, quantify each initiative and act on outcomes. The first step, as discussed, is to agree on the few vital KPIs that the company as a whole is pursuing. Although this may seem trivial in theory, getting everyone to agree on this proves to be surprisingly difficult in practice. However, to know that you\u2019re making progress requires that you know where you\u2019re trying to get to.<\/p>\n\n\n\n

Second, every initiative, R&D or otherwise, should in some way quantitatively specify the expected impact on one or more of the few vital KPIs. This includes the primary KPIs that are intended to be affected as well as guardrail metrics representing aspects of the offering that can\u2019t be affected negatively or aren\u2019t allowed to sink below a certain threshold.<\/p>\n\n\n\n

Third, we need to use the predictions and the actual outcomes as valuable input that allows us to learn and improve our ability over time. However, every initiative that doesn\u2019t deliver sufficient impact should be stopped with the effects, such as code, removed from the system as soon as possible. Functionality that lives in the system but isn\u2019t used only complicates the system, increases maintenance cost and may easily cause complicated quality issues.<\/p>\n\n\n\n

Most companies don\u2019t quantitatively specify the intended value delivery of their products. As a result, we fall back on our storytelling capabilities causing every initiative to, qualitatively, contribute in some way, shape or form to some worthwhile aspect of the system. We have no prioritization and we can\u2019t measure the impact of our efforts. Instead, we need to quantitatively define the few, vital KPIs we pursue, express the intended impact of each R&D initiative in terms of these few KPIs and then measure the actual impact and compare it to the prediction. As Elbert Hubbard said: \u201cIt doesn\u2019t take much strength to do things, but it requires a great deal of strength to decide what to do.\u201d<\/p>\n\n\n\n

Want to read more like this? Sign up for my newsletter at\u00a0jan@janbosch.com<\/a>\u00a0or follow me on\u00a0janbosch.com\/blog<\/a>, LinkedIn (linkedin.com\/in\/janbosch<\/a>) or Twitter (@JanBosch<\/a>).<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Humans are belief-driven storytelling machines who post-rationalize their, often irrational, behavior. This is at odds with our self-image of rational beings who make measured, balanced choices between well-reasoned alternatives. While this image may hold up in some contexts, research in psychology and elsewhere shows that unless there\u2019s a non-negotiable yardstick holding us accountable, we easily … Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"generate_page_header":"","footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1855"}],"collection":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=1855"}],"version-history":[{"count":2,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1855\/revisions"}],"predecessor-version":[{"id":1858,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1855\/revisions\/1858"}],"wp:attachment":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=1855"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=1855"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=1855"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}