Dutourdumonde - stock.adobe.com

UK facial recognition project to identify hidden faces

A research project being conducted by UK universities in collaboration with the Home Office and Metropolitan Police could produce facial recognition systems that allows users of the technology to identify people with their faces covered

The Home Office and Metropolitan Police Service (MPS) are collaborating with researchers on a live facial recognition (LFR) project that could identify people wearing masks or other face coverings.

According to the project’s website, face matching for automatic identity retrieval, recognition, verification and management (FACER2VM) will “develop unconstrained face recognition” with the goal of delivering a “step change” in the technology and making it “ubiquitous” by 2020.

While LFR has been used operationally by the MPS since February 2020, the new technology would allow the force to identify people whose faces are obscured by masks, scarves, sunglasses or other face coverings for the first time.

The MPS, which is part of the FACER2VM user group, confirmed its part in the project, but said no technology developed from it had been introduced yet.

The purpose of the user group, the project website states is to “create a forum where the results of the project will be disseminated, and pathways to impact discussed and identified”. The five-year-long programme received initial grant funding of more than £6.1m from the Engineering and Physical Sciences Research Council (EPSRC) in January 2016.

“In the past, when the majority of people were born, lived and died in the same locality where everybody knew each other, there was no need for biometrics,” said the summary on the grant application form, which added that automatic biometric identification is “emerging as an essential requirement” for the digital economy, national security and monitoring demographic change.

“In this context, face biometrics is a preferred biometric modality, as it can be captured unobtrusively, even without subjects being aware of being monitored and potentially recognised,” it said.


The FACER2VM project has brought together experts from the University of Surrey, Imperial College London and the University of Stirling, as well as collaborators from a range of companies and public sector bodies.

Companies include IBM, Digital Barriers and Cognitec Systems, while public sector actors include the Home Office (an official project partner) and the MPS.

According to information listed on UK Research and Innovation (UKRI), the project coordinators expect their research to have a substantial impact.

“The societal impact is anticipated to be multifaceted. Unconstrained face biometrics capability will significantly contribute to the government’s security agenda in the framework of smart cities and national security. It can effectively facilitate access to public services,” it said.

It added that its impact would be maximised by the Home Office Centre for Applied Science and Technology (Cast), as well as its user group.  

However, while the tech could have a number of potential uses, the EPSRC has classified the project’s work as being for the “aerospace, defence and marine” industrial sector, according to the research grant application form.

Potential use against protestors

In response to previous questions from Computer Weekly, the MPS neither confirmed nor denied that its LFR technology would be used in a protest setting.

However, the technology has already been used against protestors in the UK by South Wales Police, and officers across Britain now routinely film gatherings and demonstrations.

The Network for Police Monitoring (Netpol), which monitors and resists policing that is excessive, discriminatory or threatens civil liberties, told Computer Weekly at the time that individuals who seek to conceal their identities to evade LFR on privacy grounds could unwittingly garner more attention from police who may assume they are “troublemakers”.

It could also dissuade them from participating in political action all together, it added.

Due to FACER2VM’s focus on “image degradation phenomena”, the research will actively seek to produce LFR technology that combats “noise, blur and occlusion”, which, if successful, would allow the systems to identify people with covered faces.

According collaboration information on UKRI, the Home Office is interested in the surveillance capabilities of FACER2VM, and contributed to the project through Cast, providing a “proprietary database of videos representative of the types of surveillance scenarios of interest to Home Office”.

Read more about police technology

For some, the involvement of Jiangnan University has sparked fears the project could enhance the Chinese government’s ability to identify masked protesters in Hong Kong, as well as Uighur Muslims in Xinjiang.

Commenting directly on the FACEER2VM project, Netpol coordinator Kevin Blowe said there are numerous reasons why protestors may choose to cover their faces, ranging from resisting authoritarian governments that want to build up a profile of opposition to its policies, to people worrying about their employment or education opportunities.

“These concerns are far from unique to the conduct of regimes like China: all have been features of policing in Britain over the past decade, from spying on protest movements to the use of Prevent to target Muslim communities,” he said. “That’s all the more important to remember at a moment, when the government in Britain is planning the most sweeping new emergency powers in 70 years.”

“When it comes to speaking out, anonymity may represent the main deciding factor for many about whether they are able to exercise their rights or not,” said Blowe. “What is apparently missing, however, is enough academics involved in this kind of research asking what the ethics of our work are. Should we be doing this?”

The FACER2VM project will run until 30 September 2021.

Read more on Technology startups

Data Center
Data Management