Skip to content
Tom Leggett is lead research engineer for Automated Driving at Thatcham Research
Tom Leggett is lead research engineer for Automated Driving at Thatcham Research

Blog post -

ALKS Project: Consumer Confidence Safety Framework

Tom Leggett is Lead Research Engineer for Automated Driving at Thatcham Research. This is his final blog in a series providing behind the scenes insights into his work developing a world-first consumer rating framework for Automated Driving Systems.

This final blog will summarise our work creating a Consumer Safety Confidence Rating Framework for automated vehicle technologies, such as Automated Lane Keeping Systems (ALKS). The project aimed at ensuring the full societal benefits of such systems can be fully achieved through widespread consumer adoption.

As mentioned in previous posts, we recognise the important role that virtual testing will play in thoroughly exercising systems in a safe environment in order to provide confidence in the technology. The complex nature of ALKS and other automated systems require a uniquely broad approach to testing, and virtual testing can provide part of the solution, if used properly.

The key philosophy of the ALKS Consumer Safety Confidence Framework is that the safety rating of the vehicle under test must be a function of its Operational Design Domain (ODD). Where the ODD represents the operating environment within which ALKS can perform the driving task. This could be a geographical operational limit such as motorways, or a functional one such as a maximum speed of 60 km/h.


The framework begins with the Automation Claims, where the driving domain of the vehicle, as provided by the carmaker, is compared against various assessment criteria. This ODD “checklist” will inform which tests are to be carried out virtually and validated physically. In addition to the checklist, further information such as marketing media will be procured and assessed. In this way, we can ensure the advertising claims made regarding the technology match the actual measured performance.

It is proposed that virtual tests are executed by the vehicle manufacturer, who is provided with the scenarios to test, using an opensource format Scenario Description Language. You can read more about this in my previous post. Upon the generation and formatting of scenarios, they are then stored within the SafetyPoolTM scenario database, where they can be easily assessed by all relevant groups.

However, as stressed previously, the results of the virtual tests must then be spot-checked using independent physical testing, performed at CAM Testbed UK sites. The method by which the select verification tests are chosen is not fully defined within this framework, but it will involve a combination of random selection, edge case identification, failure point validation and other specifically recognised scenarios. This allows us to comprehensively review the claimed performance against the measured performance, which informs the overall rating of the automated vehicle.

Vehicle manufacturers should be rewarded for providing not only a wide-ranging ODD, but also an accurately described one with effective performance within it. This balance between claimed capability and the measured assessment performance will feed into the three sections: User-in-Charge Engagement, Automation Competence and Safety Backup. These sections will in turn generate the overall rating.


To find out more about the Framework, including the three sections within it, download the complete framework document from the Zenzic website

Thank you for joining me along this journey towards safe automation, and please keep an eye out for information about the work Thatcham Research is planning in this space.

Read Tom’s previous posts here:

A safe journey along the road to Automation – Thatcham

ALKS: Utilising the virtual and physical worlds of vehicle testing – Thatcham

ALKS: Difficulties of Independent Virtual Testing Part 1 – Thatcham

ALKS: Difficulties of Independent Virtual Testing Part 2 – Thatcham



Tom Flisher

Tom Flisher

Press contact PR Manager 07876 755 615

Thatcham Research

Safer cars, fewer crashes...

As the UK's only insurer funded automotive research centre, Thatcham Research enjoy a wide remit at the forefront of the latest vehicle technology. Thatcham's leading work in vehicle safety and security has a vital role in shaping the designs of new vehicles, whilst the centre is also seen as a key industry player at the forefront of driving standards in vehicle body repair.

Thatcham's Crash Laboratory is the only official UK crash testing centre for consumer safety body Euro NCAP and are viewed as a centre of excellence when it comes to active vehicle safety, particularly the evaluation of new Advanced Driver Assist Systems (ADAS) which provide the foundation for future vehicle autonomy.

Enjoying an increasingly global influence in both the insurance and automotive sectors, Thatcham Research expertise is in great demand with a range of opinion leaders being regularly asked to provide their experience and know-how at high profile events and in the media, living up to their reputation as ‘Experts in Safety, Security and Crash Repair’.

Thatcham Research
Colthrop Way
RG19 4NR Thatcham
United Kingdom