{"id":619,"date":"2018-10-19T17:58:15","date_gmt":"2018-10-19T17:58:15","guid":{"rendered":"http:\/\/janbosch.com\/blog\/?p=619"},"modified":"2018-10-19T17:58:15","modified_gmt":"2018-10-19T17:58:15","slug":"what-are-you-optimizing-for","status":"publish","type":"post","link":"https:\/\/janbosch.com\/blog\/index.php\/2018\/10\/19\/what-are-you-optimizing-for\/","title":{"rendered":"What Are You Optimizing For?"},"content":{"rendered":"
\"\"
Image credit: Pixabay<\/figcaption><\/figure>\n

Over the last weeks, I have been in several group conversations where we had to agree on the relative priority of multiple factors. For instance, are we optimizing for the total number of users or are we optimizing for maximizing revenue per user? Should we prioritize fuel efficiency or is minimizing exhaust waste more important? Should we seek to get as much value from the initial sale of the system or should we aim to optimize the service and maintenance fees during the lifetime of the system? In all these situations, it rapidly became obvious that there were very different opinions in the room and that even individual participants were far from clear themselves.<\/p>\n

Not being entirely clear on the relative priority of different relevant factors used to be fine as R&D was mostly driven by requirements provided by product management. And the product managers would have, sometimes extensive, discussions on the relative importance of different requirements and prioritize the backlog accordingly.<\/p>\n

More recently, however, we\u2019re increasingly moving towards outcome-driven and AI-driven development (as discussed in a blog post<\/a> from earlier this year). Outcome-driven development uses techniques such as A\/B\/n testing to determine which alternative for achieving a certain outcome performs better. However, in that case you need to be crystal clear to define in quantitative terms what the desired outcome is. Similarly, AI-driven development typically uses large (often labeled) data-sets to train a machine- or deep-learning model to classify, predict, etc. new data based on a training data-set. However, again it is critically important to precisely define what constitutes success.<\/p>\n

The point I am trying to make is that most companies that are new to data-driven R&D practices fail to conduct the exercise to clearly express quantitatively what they are optimizing for. There are several reasons why this is the case. It requires a significant amount of confrontation and transparency to call out team members who seem to be optimizing for other factors than what we agreed upon. Deciding on the relative priority of factors requires the organization to make hard choices. In my experience, when decision makers are asked to choose between alternative A and B, the typical response is \u201cI want both\u201d.<\/p>\n

Failing to get clear on relative priorities and making real choices, however, results in several dysfunctions and inefficiencies in organizations. For example, in one company, one team worked on improving the security of the product and another team was looking to improve performance. The actions of both teams cancelled out each others efforts and the result was a lot of activity but no progress whatsoever.<\/p>\n

Concluding, as we\u2019re increasingly adopt data-driven practices such as outcome- and AI-driven development, we can no longer afford to be vague and imprecise on what we\u2019re optimizing for. Instead, we need to engage in the hard discussions in the company to define clear relative priorities for the various factors that matter for the company and then engage in experiments to accomplish quantitatively validated improvements. In short, know what you\u2019re optimizing for or pay the price!<\/p>\n

To get more insights earlier, sign up for my mailing list at <\/i>jan@janbosch.com<\/i><\/a> or follow me on<\/i> janbosch.com\/blog<\/i><\/a>, LinkedIn (<\/i>linkedin.com\/in\/janbosch<\/i><\/a>) or Twitter (<\/i>@JanBosch<\/i><\/a>).<\/i><\/p>\n","protected":false},"excerpt":{"rendered":"

Over the last weeks, I have been in several group conversations where we had to agree on the relative priority of multiple factors. For instance, are we optimizing for the total number of users or are we optimizing for maximizing revenue per user? Should we prioritize fuel efficiency or is minimizing exhaust waste more important? … Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"generate_page_header":"","footnotes":""},"categories":[4,8,10],"tags":[],"_links":{"self":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/619"}],"collection":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=619"}],"version-history":[{"count":1,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/619\/revisions"}],"predecessor-version":[{"id":621,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/619\/revisions\/621"}],"wp:attachment":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=619"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=619"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=619"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}