{"id":1497,"date":"2022-06-08T13:51:19","date_gmt":"2022-06-08T13:51:19","guid":{"rendered":"https:\/\/janbosch.com\/blog\/?p=1497"},"modified":"2022-06-11T13:15:41","modified_gmt":"2022-06-11T13:15:41","slug":"boost-your-digitalization-data-driven-ways-of-working","status":"publish","type":"post","link":"https:\/\/janbosch.com\/blog\/index.php\/2022\/06\/08\/boost-your-digitalization-data-driven-ways-of-working\/","title":{"rendered":"Boost your digitalization: data-driven ways of working"},"content":{"rendered":"\n
\"\"
Photo by Franki Chamaki on Unsplash<\/figcaption><\/figure>\n\n\n\n

There\u2019s more data in the world than ever before. According to some sources, the world stores over 50 zettabytes of data. A zettabyte is 2 to the power of 70, or one billion terabytes. So, one would assume that the entire world has moved to data-driven ways of working.<\/p>\n\n\n\n

As we all know, this is far from the truth. The vast majority of decisions in the world are based on opinions, potentially outdated beliefs, expired experiences and politics. In many cases, data is used as a mechanism to reinforce the points one is looking to make to convince others and there\u2019s little interest in starting from the beginner\u2019s mind as advocated in Zen.<\/p>\n\n\n\n

Although it\u2019s easy to blame ill-intended leaders, the fact is that humans are simply wired to take mental shortcuts as a resource efficiency strategy. Much of our survival over the millennia depended on taking immediate, almost instinctive action in response to threats. Those deeply ingrained behaviors are as much present in modern humans as they were on the African savanna. Anyone who has been in a contentious meeting where things turned from factual to personal has seen evidence of that behavior and experienced it first-hand.<\/p>\n\n\n\n

As humans, we\u2019re wired to ignore 99 percent or more of everything that reaches our senses. This causes a strong information bias as we typically note that which we agree with and ignore, even subconsciously, that which doesn\u2019t match our beliefs. As an example, in some of the company boards I\u2019ve been part of, there\u2019s a very strong tendency towards groupthink. Humans want to be liked and respected by each other and therefore disagreement is often suppressed. I then take it upon myself to be the dissenting voice to avoid groupthink, but I\u2019ve realized that this isn\u2019t to my advantage. Although others will treat me with respect, it doesn\u2019t help me build rapport with my fellow board members.  <\/p>\n\n\n\n

Because we\u2019re ill-designed to employ data-driven practices, we need to put mechanisms in place to ensure that we operate based on data instead of opinions, beliefs and politics. In my view, there are at least four mechanisms to consider. First, we need to ensure the availability of data. There are numerous cases where companies were drowning in data except for the data needed for a business-critical decision. This means that we need to be very careful and considerate in the type of data we collect and start collecting it long before we see its use become prevalent. As discussed in an earlier post<\/a>, we need to architect our offering portfolio to make it as easy as possible to add instrumentation to systems in order to start collecting data that we didn\u2019t predict we needed.<\/p>\n\n\n\n

Second, many companies operate in the realm of requirements. This is prevalent in software development organizations, but also contracts between companies and agreements between departments in companies are typically specified in terms of requirements. In my experience, every requirement is described as a means to achieve a specific set of outcomes. Earlier, we didn\u2019t have the data to establish that the outcome was achieved and consequently, we used requirements. However, focusing on desired outcomes leads to a much healthier and much more data-driven way of operating and avoids the tendency of many to dictate solutions in areas where they have little to no domain knowledge.<\/p>\n\n\n\n

Third, planning is a big topic in most companies. However, with fast feedback cycles through, for instance, DevOps, we can let go of planning as the coordination mechanism and adopt experimentation instead. The problem with planning is that it makes assumptions, many of which are simply incorrect. We tend to operate in a complex belief structure that\u2019s largely unfounded and disconnected from reality. By defining hypotheses and conducting experiments to confirm or disprove these hypotheses, we can develop an open-minded, learning-oriented organizational culture that\u2019s much better connected to reality.<\/p>\n\n\n\n

Finally, even when experimenting, we tend to rely on humans to define the topics for experimentation. Where feasible, this should be complemented or even replaced with automated experimentation and optimization. Approaches such as reinforcement learning and multi-armed bandits allow for fully automated exploration of solution spaces and may result in solutions that no human would have ever conceived.<\/p>\n\n\n\n

Data-driven ways of working are often agreed to in theory but seldomly followed in practice. This isn\u2019t ill-intended but rather a natural consequence of the way we\u2019re wired as humans. To address this, we need to put mechanisms in place to ensure that we use data-driven ways of working instead of opinions, beliefs and politics. These mechanisms include ensuring data availability, focusing on outcomes, experimentation and automated exploration of solution spaces. Einstein famously said that not everything that can be counted counts and not everything that counts can be counted. However, when it counts and it can be counted, we better do so!<\/p>\n\n\n\n

Like what you read? Sign up for my newsletter at <\/em>jan@janbosch.com<\/em><\/a> or follow me on<\/em> janbosch.com\/blog<\/em><\/a>, LinkedIn (<\/em>linkedin.com\/in\/janbosch<\/em><\/a>), Medium<\/a> or Twitter (<\/em>@JanBosch<\/em><\/a>).<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

There\u2019s more data in the world than ever before. According to some sources, the world stores over 50 zettabytes of data. A zettabyte is 2 to the power of 70, or one billion terabytes. So, one would assume that the entire world has moved to data-driven ways of working. As we all know, this is … Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"generate_page_header":"","footnotes":""},"categories":[4,10],"tags":[],"_links":{"self":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1497"}],"collection":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=1497"}],"version-history":[{"count":3,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1497\/revisions"}],"predecessor-version":[{"id":1501,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1497\/revisions\/1501"}],"wp:attachment":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=1497"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=1497"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=1497"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}