Recently, I got the opportunity to speak at the initiative seminar on AI organized by the Chalmers AI Research Centre (CHAIR). The key message in my presentation (see video here) was that working with artificial intelligence (AI), more specifically machine and deep learning (ML/DL), constitutes a major software engineering challenge that is severely underestimated by companies that start to experiment with machine and deep learning.
Machine and deep learning: Experimentation stage
Although I have discussed some of the challenges in a previous blog post, we have continued to conduct research in this area and have collected additional data concerning the specific challenges. In addition, we have developed a model that captures how companies typically evolve in their adoption of AI/ML/DL. In the figure below, the steps that companies typically evolve through are illustrated. In this blog series, I intend to discuss the challenges associated with each step, with supporting research from an article that was recently accepted for publication in the proceedings of the XP 2019 conference.
As the figure illustrates, the first step that most companies engage in is experimentation and prototyping. In this case, the work on machine and deep learning models is conducted purely in-house and without any connection to the products and services that the company offers to its customers. The work with basically any ML/DL approach follows the process shown in the figure below. In the simplest view, here are four stages: assemble datasets (or data pipes), create models, train and evaluate and deployment. There are two iterative processes represented by the inner loop and the outer loop. The inner loop is concerned with the typical activity of creating a model, training it, evaluating it and then tweaking the model with the intent of increasing accuracy and reducing error rates. The outer loop illustrates the periodic or continuous retraining of models based on the most recent data and the subsequent continuous deployment of models into operation.
02/ More on Business & AI
The AI struggle is real: Thoughts from Web Summit 2019
Getting unstuck: How to adopt a creative mindset around AI challenges
How NLP and BERT will change the language game
Taking the pulse on global AI industry: Almedalen 2019
The value-add of deep learning in predictive maintenance
In a time when manufacturing companies are under intense pressure to improve efficiency and productivity, every gain is valuable
AI is not a silver bullet
Towards operational AI
10 applicable areas for AI: Beyond chatbots and customer recommendations
Machine and deep learning: Non-critical deployment
You will never understand AI if you only try to understand AI
In every "AI story," there are five main chapters. You need to start from the end.
Reducing the skills gap in deep learning
Five reasons why you are not data-driven
Peltarion rocks Slush – the leading startup event in Europe
Increasing the deep learning footprint: From niche to mass adoption
How to get your business AI-ready
Shifting the 90/10 factor to elevate AI project productivity
Tallinn Digital Summit 2018 highlights
As part of the Swedish expert delegation at Tallinn Digital Summit, our Anders Arpteg summarizes key takeaways from presentations and discussions with government officials and AI experts from around the world.
Mapping the challenges of deep learning for a strategic approach
The dangers of AI purgatory for any new project
Three takeaways on trust in AI from the Almedalen Week 2018