top of page

Automotive A.I

When most of us hear the phrase “Automotive A.I” it’d be a safe bet that the first item to pop into our heads is one of self driving cars. Who could blame us, when there are some extraordinary companies out there making headlines every week (both good and bad) in this domain, such as Uber, Zoox, and Tesla. For those who have had their fill of these headlines, fear not, this article is not about that particular intersection of the automotive world and Artificial Intelligence. Instead, I would like to focus on an easily overlooked area of the industry; Supply Chain and Replenishment.

Starting with Supply Chain, there are three broad areas that stand to benefit most from A.I;

Automotive Manufacturing:

Firstly: Robotics. The GIF below shows a Tesla robotics factory (Again, I promise that I won’t mention autonomous driving here). The level of automation in this factory is hyper-advanced, with nothing coming close to the scale of this that this particular author knows of. Its development has not come without issues, however, with a very public about-face on the efficacy of robots versus human workers from Elon Musk in 2018 (more on that here). Even so, robotics, which can incorporate multiple domains of A.I such as computer vision, reinforcement learning, and natural language processing, has the potential to add significant value to the automotive manufacturing process through time and cost saving.


The good people at McKinsey and Company put out a research report in 2017 (read that here) which suggested that a holistic approach will be required to increase the chances of a successful implementation. Such an approach requires executives to put a project in the context of their business and strategy, allowing a major technology initiative such as a robotic factory to “align closely with the current and future needs of the business” - to avoid a feeling amongst the general staff of tech for the sake of tech. We agree wholeheartedly with this, and think that this advice can be transplanted to many other technology transformation domains. The McKinsey article also shows the decreasing cost of robotics, making scenes like the one above more and more available to smaller manufacturers.

Secondly, Predictive Maintenance. Whilst not a new concept, the advent of mainstream A.I combined with better quality machine data (thanks largely to IOT) has seen an improvement in the methods with which companies can predict machine failure. We wrote a blog post on one such method early in 2019 which can be found here for reference, so we won’t rehash that here.

We will instead discuss some of the challenges that must be overcome for a successful predictive maintenance implementation.

  • Data quality: as with almost all A.I approaches, the Garbage In Garbage Out (GIGO) effect applies. When asking an A.I to produce an output such as a prediction of machine failure, if the data is of poor quality, it is folly to expect better than poor results. There are ways of managing this via feature engineering and early analysis (though this does increase the project workload and therefore cost).

  • Integrations: consider the case of an automotive manufacturer wishing to predict when its machinery may break down. One way to attack this problem is to analyse live machine data to assess the likelihood of a failure ‘event’ occurring at any given point, prompting a preventative action to be taken once the likelihood of a failure event passes a threshold. Such an approach would potentially require integrations with many systems, ranging from ERPs, WMSs, CRMs, and any specific machine software. These integrations typically add a significant amount of time to the project and must be planned for.

  • Change Management: “I’m supposed to trust a new piece of technology that is telling me that there is a 95% chance that my machine will fail soon, rather than following my tried and tested preventative maintenance schedule?”. If your answer to this question is “yes, and don’t ask any more questions”, your predictive maintenance endeavour is on a path to certain doom. Your people are the ones who will act on your shiny new predictive maintenance technology, and must be brought along for the journey. Collective buy-in is imperative for ongoing success.

Finally, to Quality Control. Computer vision has advanced greatly in the 30 years since the foundational research paper on convolutional neural networks by Yann LeCun in 1989. The domain is advanced to the point that a conveyer belt or large machined panel can be scanned by a camera, analysed for defects by a computer vision method, and accepted or rejected based on the result. What was once a repetitive job for humans, can now be done with impressive accuracy and at a fraction of the cost.

Data Tracking:

The second domain of interest for automotive A.I centres around data tracking, and the previously unused datasets that are becoming available to businesses today.

Firstly, the previous section introduced the use of computer vision in quality systems, and this can be extended to include analysis of movement through space. Consider an automotive retailer with hundreds of locations around a nation. Such a wide network could facilitate experimentation in store layout using data collected via computer vision methods. Using relatively simple object detection (e.g. a YOLO Network), an understanding of customer behaviour can be built to include insights such as:

  1. Length of time spent at each shelf

  2. Path through the store

  3. Time taken until first item found

Using the above, retailers can optimise the designs of their stores to suit their goals, something that would have been far more difficult without this data.


Secondly, language data in customer interactions such as customer service calls is likely an untapped resource for many businesses in the automotive world. If you are in automotive sales, chances are you have plenty of back and forth with customers preparing quotes and negotiating. Consider a classification engine that could predict the likelihood that a deal will close based only on the chat transcript of your sales calls. This would no doubt prove to be a useful tool for those in sales looking to streamline their time, devoting the most energy to the opportunities most likely to convert (or the obverse if you’re competitive?). Analyses of this nature would again not be possible without a Natural Language Processing and classification system that could transcribe speech to text, before making a prediction on the likelihood of the conversion.