{"id":1070,"date":"2020-04-22T07:54:11","date_gmt":"2020-04-22T07:54:11","guid":{"rendered":"http:\/\/janbosch.com\/blog\/?p=1070"},"modified":"2020-04-22T07:54:21","modified_gmt":"2020-04-22T07:54:21","slug":"ai-engineering-making-ai-real","status":"publish","type":"post","link":"https:\/\/janbosch.com\/blog\/index.php\/2020\/04\/22\/ai-engineering-making-ai-real\/","title":{"rendered":"AI engineering: making AI real"},"content":{"rendered":"\n
\"\"
Image by Gerd Altmann from Pixabay<\/figcaption><\/figure>\n\n\n\n

Few technologies create a level of hype, excitement and fear these days as artificial intelligence (AI). The uninitiated believe that general AI is around the corner and worry that Skynet will take over soon. Even among those that understand the technology, there\u2019s amazement and excitement about the things we\u2019re able to do now and lots of prediction about what might happen next.<\/p>\n\n\n\n

The reality is, of course, much less pretty as the beliefs we all \nwalk around with. Not because the technology doesn\u2019t work, as it does in\n several or even many cases, but because rolling out a machine learning \n(ML) or deep learning (DL) model in production-quality, \nindustry-strength deployments remains a significant engineering \nchallenge. Companies such as Peltarion help address some of these and do\n a great job at it.<\/p>\n\n\n\n

Taking an end-to-end perspective, in our research we\u2019ve developed an agenda that aims to provide a comprehensive overview of the topics that need to be addressed when transitioning from the experimentation and prototyping stage to deployment. This agenda is based on more than 15 case studies we\u2019ve been involved with and over 40 problems and challenges we\u2019ve identified.<\/p>\n\n\n\n

\"\"
The AI Engineering research agenda developed in Software Center<\/figcaption><\/figure>\n\n\n\n

The research agenda follows the typical four-stage data science \nprocess of getting the data, creating and evolving the model, training \nand evaluating and then deployment. For generic AI engineering, we \nidentify, for each of the stages, the primary research challenge related\n to architecture, development and process. These challenges are mostly \nconcerned with properly managing data, federated solutions, ensuring the\n various quality attributes, integrating ML\/DL models in the rest of the\n system, monitoring during operations and infrastructure.<\/p>\n\n\n\n

In addition to the generic AI engineering challenges, we recognize \nthat different domains have their own unique challenges. We identify the\n key challenges for cyber-physical, safety-critical and autonomously \nimproving systems. For cyber-physical systems, as one would expect, \nthey\u2019re concerned with managing many instances of a system deployed out \nin the field at customers. For safety-critical systems, explainability, \nreproducibility and validation are key concerns. Finally, autonomously \nimproving systems require the ability to monitor and observe their own \nbehavior, generate alternative solutions for experimentation and balance\n exploration versus exploitation.<\/p>\n\n\n\n

Concluding, building and deploying production-quality, industry-strength ML\/DL systems require AI engineering as a discipline. I\u2019ve outlined what we, in our research group, believe are the key research challenges that need to be addressed to allow more companies to transition from experimentation and prototyping to real-world deployment. This post is just a high-level summary of the work we\u2019re engaged in in Software Center, but you can watch and read or contact me if you want to learn more.<\/p>\n\n\n\n

To get more insights earlier, sign up for my newsletter at <\/em>jan@janbosch.com<\/em><\/a> or follow me on<\/em> janbosch.com\/blog<\/em><\/a>, LinkedIn (<\/em>linkedin.com\/in\/janbosch<\/em><\/a>) or Twitter (<\/em>@JanBosch<\/em><\/a>).<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Few technologies create a level of hype, excitement and fear these days as artificial intelligence (AI). The uninitiated believe that general AI is around the corner and worry that Skynet will take over soon. Even among those that understand the technology, there\u2019s amazement and excitement about the things we\u2019re able to do now and lots … Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"generate_page_header":"","footnotes":""},"categories":[15,8,10],"tags":[],"_links":{"self":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1070"}],"collection":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=1070"}],"version-history":[{"count":1,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1070\/revisions"}],"predecessor-version":[{"id":1073,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1070\/revisions\/1073"}],"wp:attachment":[{"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=1070"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=1070"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/janbosch.com\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=1070"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}