Why Agile matters

Image by Dirk Wouters from Pixabay

Recently, I got an e-mail asking me why we should care about Agile if the overall product development process, including mechanics and electronics, is measured in years and is completely waterfall. The question took me by surprise. I’ve been working with Agile practices for the better part of two decades now and for me, it’s a given that fast feedback loops are better than slow ones.

However, after more careful reflection, I realized that the question is based on a few assumptions that, in turn, are founded on our beliefs around our ability to predict. The first assumption is concerned with our ability to optimally predict requirements for our products months, quarters or years down the line. In many industries where products contain mechanical and electronic components, the production pipeline requires long lead times. Consequently, the product requirements are formulated long before the start of production. The fallacy is, of course, that requirements change all the time due to new technologies becoming available, changing customer preferences, actions taken by competitors and so on. One rule of thumb in software says that requirements change with 1 percent per month – a very conservative estimate if you ask me.

So, how to respond to constantly changing requirements? There are fundamentally two approaches. Either you adopt agility and continuously respond to changes or you resist requirement changes, reject all that you can and grudgingly accept those that you really can’t ignore. The result of the latter approach is, of course, an inferior product as it’s based on the best insights from years ago.

The second assumption is that we can predict the effect of our requirements. These are defined as we hope to achieve a specific outcome as a consequence of realizing the requirement. We see this most often with usability requirements, but it basically extends to any quality attribute of the system. Online companies use A/B testing of solutions to determine the effects of different realizations of functions and features on users. These companies don’t do that because they’re so poor at requirements engineering, but because the effect of features and functions is fundamentally unknown when it comes to the way humans respond to software functions.

Traditional engineering companies pride themselves on their ability to predict the capabilities of systems before they build them as engineering offers a set of mathematical tools for modeling, simulating and predicting. These models are typically then confirmed by lab tests and in some cases small-scale tests in real-world contexts before fully committing to a specific design. Although this works quite well in many circumstances, it remains the case that measuring in real-world deployments provides much higher validity than mathematical models and lab tests. As I’ve shared in earlier posts, research by us and others shows that at least half of all the functions in a typical system are never used or used so seldomly that the R&D investment is a waste. So, wherever we can use techniques to deploy slices of functionality or features and measure the effect before building more, we should as it allows for a major improvement in the effectiveness of our R&D.

Although many understand that real-world experimentation concerning usability and user behavior is a necessity, the same is true for all quality attributes. Think of all the security fixes that we need to roll out. Often these concern vulnerabilities to threats that were known before the design of the system was finished. It just turned out that the mitigation strategies that engineers designed into the system didn’t suffice. Similarly, do we know for a fact that the current system design gives us the highest performance, the best robustness, the highest energy efficiency? Of course not! Rather than relying on models and lab tests, we need real-world experiments with our products at customers in the field to continuously improve. The models and lab tests are still needed, but mostly to protect us from the downside of less successful experiments before deployment.

Concluding, if you’re able to perfectly predict the optimal set of requirements for a system or product years ahead of the start of production or deployment and if you’re able to accurately predict the effect of each requirement on the user, the customer and the quality attributes of the system, then you don’t need Agile. In all other cases, Agile (both pre-deployment and post-deployment – DevOps) offers the opportunity for a massive improvement in the effectiveness of your R&D (as measured in value created for each unit of R&D). It’s not that we can’t build products using traditional waterfall processes – of course we can as we’ve done so for decades. The challenge is that we’re much less efficient doing so, which increases the risk of disruption for our company.

To get more insights earlier, sign up for my newsletter at jan@janbosch.com or follow me on janbosch.com/blog, LinkedIn (linkedin.com/in/janbosch) or Twitter (@JanBosch).

152 thoughts on “Why Agile matters

  1. I’ve been surfing on-line greater than 3 hours nowadays, but I never found any
    interesting article like yours. It’s pretty value sufficient for me.

    Personally, if all webmasters and bloggers made good content material as you probably did,
    the net will probably be a lot more helpful than ever before.

    Reply
  2. Have you ever considered about adding a little bit more than just your articles?
    I mean, what you say is important and everything. But imagine if you added some great photos or videos to give
    your posts more, “pop”! Your content is excellent but with
    images and clips, this blog could definitely be one of the most beneficial
    in its niche. Very good blog!

    Reply
  3. Hey there just wanted to give you a quick heads up. The text in your article seem to be running
    off the screen in Chrome. I’m not sure if this is
    a format issue or something to do with internet browser compatibility but I thought I’d post to let you know.
    The design and style look great though! Hope you get the problem resolved soon. Thanks

    Reply
  4. Unquestionably believe that which you stated. Your
    favorite justification seemed to be on the net the
    easiest thing to be aware of. I say to you, I certainly get irked while people think about worries that they plainly don’t know about.

    You managed to hit the nail upon the top as well as defined out the whole
    thing without having side effect , people can take a signal.
    Will probably be back to get more. Thanks

    Reply
  5. Wow that was odd. I just wrote an extremely long comment but after
    I clicked submit my comment didn’t appear. Grrrr…
    well I’m not writing all that over again. Anyways, just
    wanted to say superb blog!

    Reply
  6. I would like to thank you for the efforts you’ve put in penning this website.
    I am hoping to view the same high-grade content by
    you later on as well. In truth, your creative writing abilities has
    encouraged me to get my own, personal site now 😉

    Reply
  7. You actually make it seem so easy with your presentation but I find this matter to be actually something which I think I would never understand.
    It seems too complicated and very broad for me.
    I’m looking forward for your next post, I’ll try to get the hang of it!

    Reply
  8. Every weekend i used to pay a visit this web site, because i wish for
    enjoyment, for the reason that this this website conations
    truly nice funny stuff too.

    Reply
  9. I’m really inspired with your writing skills and also with the format for your weblog.
    Is that this a paid subject or did you modify it
    yourself? Either way stay up the excellent high quality writing, it is uncommon to
    look a great weblog like this one nowadays..

    Reply
  10. Hi, I do think this is an excellent website. I stumbledupon it
    😉 I may come back once again since I book marked it.

    Money and freedom is the greatest way to change, may you be rich and continue to guide other people.

    Reply
  11. This design is incredible! You definitely know how to keep
    a reader entertained. Between your wit and your videos, I was almost moved to
    start my own blog (well, almost…HaHa!) Fantastic job. I really enjoyed what
    you had to say, and more than that, how you presented it.

    Too cool!

    Reply
  12. Its such as you learn my thoughts! You appear to understand so much
    about this, like you wrote the guide in it
    or something. I think that you could do with a few percent to
    pressure the message home a little bit, but instead
    of that, that is wonderful blog. An excellent read.

    I’ll certainly be back.

    Reply
  13. Hello there! This post could not be written any better!
    Reading this post reminds me of my previous
    room mate! He always kept chatting about this. I will forward this write-up to him.
    Pretty sure he will have a good read. Thanks for sharing!

    Reply
  14. An outstanding share! I’ve just forwarded this onto a friend
    who was doing a little research on this. And he actually ordered me dinner because I found
    it for him… lol. So let me reword this….
    Thanks for the meal!! But yeah, thanks for spending the time to discuss
    this issue here on your web page.

    Reply
  15. What’s Going down i’m new to this, I stumbled upon this I’ve discovered It absolutely helpful and it
    has aided me out loads. I hope to contribute & help other customers like its aided me.

    Good job.

    Reply
  16. Hello, i think that i saw you visited my website thus i came to “return the favor”.I am attempting to find things to
    improve my web site!I suppose its ok to use a few of your ideas!!

    Reply
  17. You are so awesome! I don’t suppose I’ve read a single thing like
    that before. So nice to discover somebody with some original
    thoughts on this subject matter. Seriously..
    thanks for starting this up. This site is something that is required on the
    web, someone with a bit of originality!

    Reply
  18. Magnificent goods from you, man. I have understand your stuff previous to and you’re just extremely excellent.
    I really like what you have acquired here, really
    like what you are stating and the way in which you say it.
    You make it entertaining and you still care for to keep it smart.
    I cant wait to read far more from you. This is actually a terrific site.

    Reply
  19. Hi, i believe that i saw you visited my blog thus i got here to go back
    the favor?.I’m trying to in finding issues to improve my site!I
    suppose its ok to make use of a few of your concepts!!

    Reply
  20. It’s a pity you don’t have a donate button! I’d definitely donate to
    this fantastic blog! I guess for now i’ll settle for bookmarking and adding your RSS feed to my Google account.
    I look forward to fresh updates and will share this website with my Facebook group.
    Talk soon!

    Reply
  21. I absolutely love your blog and find a lot of your post’s to
    be exactly what I’m looking for. Does one offer guest writers
    to write content for you personally? I wouldn’t mind producing a post or
    elaborating on a number of the subjects you write in relation to here.
    Again, awesome weblog!

    Reply
  22. Woah! I’m really loving the template/theme of this blog.
    It’s simple, yet effective. A lot of times it’s
    tough to get that “perfect balance” between usability and appearance.
    I must say you’ve done a awesome job with this.
    Also, the blog loads very quick for me on Firefox.

    Outstanding Blog!

    Reply
  23. I know this if off topic but I’m looking into starting my own weblog
    and was curious what all is needed to get setup?
    I’m assuming having a blog like yours would cost a pretty penny?

    I’m not very web smart so I’m not 100% positive. Any recommendations or advice would be
    greatly appreciated. Thanks

    Reply
  24. Hey! I realize this is somewhat off-topic but I had to ask.
    Does operating a well-established blog like yours take a massive amount
    work? I’m completely new to operating a blog but I do write in my
    journal daily. I’d like to start a blog so I can easily share my own experience and thoughts online.
    Please let me know if you have any ideas or tips for brand new aspiring bloggers.
    Appreciate it!

    Reply
  25. Wow, fantastic blog format! How lengthy have you ever been running a blog for?

    you made blogging look easy. The entire look of your web site is wonderful, as well as the content material!

    Reply
  26. Definitely believe that which you said. Your favorite justification appeared to
    be on the internet the easiest thing to be aware of.
    I say to you, I certainly get annoyed while people think about worries that they plainly do not
    know about. You managed to hit the nail upon the top and defined
    out the whole thing without having side effect , people can take a signal.
    Will probably be back to get more. Thanks

    Reply
  27. My partner and I absolutely love your blog and find
    nearly all of your post’s to be just what I’m looking for.
    Do you offer guest writers to write content for yourself?
    I wouldn’t mind producing a post or elaborating
    on many of the subjects you write concerning here. Again,
    awesome blog!

    Reply
  28. Thanks on your marvelous posting! I genuinely enjoyed reading it,
    you’re a great author. I will make certain to bookmark
    your blog and will eventually come back sometime soon. I want to encourage you to definitely continue your great posts, have a
    nice day!

    Reply
  29. Hello! I realize this is kind of off-topic but I had to ask.
    Does managing a well-established blog like yours take a massive amount work?
    I’m completely new to blogging however I do write
    in my diary on a daily basis. I’d like to start
    a blog so I can share my experience and feelings online.
    Please let me know if you have any recommendations or
    tips for brand new aspiring blog owners. Appreciate it!

    Reply
  30. Do you mind if I quote a few of your articles as
    long as I provide credit and sources back to your webpage? My blog site is in the
    very same area of interest as yours and my users would really benefit
    from some of the information you provide here. Please let me know
    if this okay with you. Thanks a lot!

    Reply
  31. My spouse and I stumbled over here by a different web page and thought I might as well check things out.
    I like what I see so now i’m following you. Look forward to finding out about your web
    page yet again.

    Reply
  32. I loved as much as you’ll receive carried out right here.
    The sketch is attractive, your authored material stylish.
    nonetheless, you command get got an impatience over that you wish be delivering the following.
    unwell unquestionably come more formerly again since exactly the same nearly a lot often inside
    case you shield this hike.

    Reply
  33. Hi! I know this is kinda off topic however , I’d figured
    I’d ask. Would you be interested in exchanging links or maybe guest writing a blog article or vice-versa?
    My site addresses a lot of the same subjects as yours and I
    think we could greatly benefit from each other. If you might be interested feel free to shoot me an email.
    I look forward to hearing from you! Great blog by the way!

    Reply
  34. An impressive share! I’ve just forwarded this onto a coworker who was doing a little research on this.
    And he in fact ordered me dinner because I stumbled upon it for him…
    lol. So let me reword this…. Thank YOU for the meal!!
    But yeah, thanx for spending time to talk about this matter here on your internet site.

    Reply
  35. I’m really loving the theme/design of your
    blog. Do you ever run into any internet browser compatibility issues?

    A few of my blog readers have complained about my blog not operating correctly in Explorer but
    looks great in Firefox. Do you have any recommendations to help fix this problem?

    Reply
  36. Hey this is kind of of off topic but I was wondering if blogs use WYSIWYG
    editors or if you have to manually code with HTML. I’m starting
    a blog soon but have no coding skills so I wanted to get advice from someone with experience.
    Any help would be enormously appreciated!

    Reply
  37. Amazing! This blog looks exactly like my old one! It’s on a completely different
    topic but it has pretty much the same page layout and
    design. Great choice of colors!

    Reply
  38. Undeniably consider that which you stated. Your favourite reason seemed to be at the internet the
    easiest thing to remember of. I say to you, I certainly get
    irked whilst folks think about worries that they just don’t realize about.
    You controlled to hit the nail upon the highest and defined
    out the whole thing without having side effect ,
    other folks could take a signal. Will probably be back
    to get more. Thanks

    Reply
  39. Hey there! I realize this is somewhat off-topic but
    I needed to ask. Does managing a well-established blog such as yours
    require a lot of work? I am completely new to blogging but I do write
    in my journal daily. I’d like to start a blog so I will be able to share my
    own experience and views online. Please let me know if you
    have any kind of suggestions or tips for new aspiring bloggers.

    Thankyou!

    Reply
  40. Thanks on your marvelous posting! I certainly enjoyed reading it,
    you happen to be a great author.I will ensure that I bookmark your blog and will come
    back very soon. I want to encourage yourself to continue your great work, have a nice weekend!

    Reply
  41. Do you mind if I quote a few of your posts as long as I provide credit and sources
    back to your webpage? My blog is in the very same area of interest as yours and my users
    would truly benefit from a lot of the information you present here.
    Please let me know if this okay with you. Many thanks!

    Reply
  42. Appreciating the hard work you put into your website and detailed information you offer.
    It’s nice to come across a blog every once in a while that isn’t the same out of date rehashed information. Great read!
    I’ve bookmarked your site and I’m adding your RSS feeds to my Google account.

    Reply
  43. First off I would like to say great blog! I had a quick question which I’d like to ask if you don’t mind.
    I was interested to find out how you center yourself and clear
    your mind before writing. I’ve had a difficult time clearing my mind in getting my ideas out.
    I do enjoy writing however it just seems like the first 10 to 15
    minutes tend to be wasted simply just trying to
    figure out how to begin. Any ideas or tips? Kudos!

    Reply
  44. Awesome website you have here but I was wondering if you knew of any message boards that cover the
    same topics talked about in this article? I’d really like to be a part of online community where I can get feedback from other experienced people that share the same interest.
    If you have any recommendations, please let me know. Appreciate it!

    Reply
  45. Thanks for your personal marvelous posting!

    I truly enjoyed reading it, you could be a great author.
    I will make certain to bookmark your blog and will eventually come back later in life.
    I want to encourage you to continue your great
    job, have a nice morning!

    Reply
  46. I am curious to find out what blog platform you’re using?
    I’m experiencing some minor security issues with my latest website and I’d like to find something more safeguarded.
    Do you have any solutions?

    Reply
  47. Hmm is anyone else encountering problems with the pictures on this blog loading?
    I’m trying to determine if its a problem on my end or if it’s the blog.
    Any suggestions would be greatly appreciated.

    Reply
  48. A person necessarily lend a hand to make critically posts I would state.

    That is the first time I frequented your website page and so far?
    I amazed with the analysis you made to make this actual put up extraordinary.
    Fantastic activity!

    Reply
  49. I do not even know how I ended up here, but I thought this post was
    great. I do not know who you are but definitely you’re going to a famous blogger if you are
    not already 😉 Cheers!

    Reply
  50. Write more, thats all I have to say. Literally,
    it seems as though you relied on the video to make your point.

    You clearly know what youre talking about, why
    throw away your intelligence on just posting videos to your blog when you could
    be giving us something informative to read?

    Reply
  51. Hello there! This post couldn’t be written any better!
    Going through this article reminds me of my previous roommate!
    He constantly kept preaching about this. I am going to send this post to
    him. Fairly certain he will have a great read.

    I appreciate you for sharing!

    Reply
  52. Excellent goods from you, man. I have understand your stuff previous to
    and you’re just extremely fantastic. I actually like what
    you have acquired here, certainly like what you’re stating and the way in which you say it.
    You make it enjoyable and you still take care of to keep it sensible.
    I cant wait to read far more from you. This is actually a great web site.

    Reply
  53. Great beat ! I would like to apprentice while you amend your website,
    how could i subscribe for a blog website? The account
    helped me a acceptable deal. I had been a little bit acquainted of this your broadcast
    provided bright clear concept

    Reply
  54. My brother suggested I may like this website. He was once entirely right.
    This submit actually made my day. You can not believe just how a
    lot time I had spent for this info! Thanks!

    Reply
  55. I do believe all of the ideas you have presented to your post.

    They are really convincing and can definitely work.
    Nonetheless, the posts are very short for novices. Could you please
    lengthen them a bit from subsequent time? Thanks for the post.

    Reply

Leave a Comment