Practice of face recognition in masks. Does it work or not? - FACETER Облачное видеонаблюдение

Practice of face recognition in masks. Does it work or not?

20.05.2021
Денис Артемьев
Video Surveillance Industry

Practice of face recognition in masks. Does it work or not?

Can a CCTV camera recognize the face of a masked person? Every person asked this question. There is no consensus, despite the unequivocal statements of the developers of innovative technologies and the authorities. Let’s understand what a modern face recognition system is.

Statements by developers and authorities  

From open Russian sources, such as TASS, you can learn about the statements of the Ministry of Internal Affairs that the mandatory wearing of medical masks does not have a negative impact on facial recognition in the capital. In the middle of last year, the city authorities deployed a large-scale network of video cameras with face recognition functions from the NtechLab company.

One of the company’s founders, A. Kabakov, confirmed that the technology aims to form “black” lists of violators of the quarantine regime (persons +65 years of age go outside, shaking hands). At the same time, the entrepreneur claims that the recognition algorithm is accurate even when using medical masks.

Prerequisites for successful mask face recognition

So, what are the technology developers’ claims based on? How effective are developments in actual urban conditions? Let’s analyze.

50-60% of the face is sufficient

How does face recognition work if about 1/2 of the face is covered by a mask? According to the program’s creators, 50-60% of an open face is enough for successful recognition.

However, human faces vary in size based on the classic head size grid (54 cm, which corresponds to the marking “XXS” and up to 65 cm, which corresponds to “XXXXL”). The masks themselves differ in shape and size.

For some people, the mask covers less than 1/2; for others, up to 60% of the face. For the rest, the percentage is much more.

CONCLUSION: During the wearing of masks, the percentage of an open face differs for people. The system cannot accurately recognize faces that are covered more than 50-60%.

Lack of other accessories

If we talk about the percentage of visible parts of the face, then the software developers assume the absence of other accessories, things, facial hair (long bangs, glasses, scarves, hats, hoods).

Using the above reduces the percentage of visible face to a minimum.

Picture quality

Only if high-quality images of parts of the face not covered by the mask get into the recognition system, the percentage of identification is relatively high. At the same time, as shown by independent US studies, depending on the algorithms used, lighting conditions, and other factors, the result will vary from 5 to 50%.

What’s in practice? The domestic system receives personnel that even the most loyal participants in the process cannot call high-quality. Can facial recognition be accurate with and without masks? The obvious answer is no.

Read the article “What Should You not Expect from Legacy Video Monitoring Systems?”

Looking directly into the camera

The developers acknowledge that the height of the camera installation, the angle of tilt, and rotation of the head concerning the camera lens affect the quality of the video material and, accordingly, face recognition in the mask. In most cases, city dwellers are unlikely to get a direct look at the camera.

What does Apple say?

The largest developer and seller of facial recognition devices is Apple. The company spent about $ 2.0 billion on development.

At the same time, when a flurry of disgruntled users faced the need for a mask mode and turned to the company to resolve issues of identifying masked persons. An Apple spokesman said that “Face ID is designed to work with visible eyes, nose, and mouth. Mask verification is not effective enough. Therefore company representatives recommend using the PIN-code on the keyboard.”

It is essential to understand that we are comparing one photo of one user in Apple’s Face ID database. At the same time, the developers of domestic mask face recognition systems claim that the system operates on a stream of people.

For example, let’s talk about the passenger traffic of the Moscow metro (which is about 5 million people per day), then for identification by the face of even half of the people. This is a comparison of one face with 2.5 million photos.

Is it real? Why does a global company that can buy up all Russian development companies together without much effort take responsibility for such statements?

Practice of application in Russia

The most effective face recognition function is used in business (in trade, banking, manufacturing). Those businesses that have opted for the innovative Faceter service get 99.8% research accuracy (officially confirmed by the University of Washington).

The system has hearing, vision, and intelligence. It helps businesses to collect and automate marketing data, create black and white lists, and quickly notify the owner about events at the facility.

Details are on the website.

Results

Face recognition by photo is a relevant solution for business and the public sector. In 2020-21, due to the problematic epidemiological situation, identifying masked people came to the fore. How effective are domestic algorithms? The question is complex.

Еще больше обзоров, кейсов и полезной информации о видеонаблюдении в нашем официальном Telegram-канале. Подписывайтесь, чтобы оставаться в курсе важных событий.

Денис Артемьев
Денис Артемьев
Специалист в области видеонаблюдения, видеоаналитики, облачных систем хранения данных. Консультант по вопросам интеграции систем и средств видеонаблюдения в различные сферы бизнеса. Опыт работы в отрасли более 10 лет.
Video Surveillance Industry
Опубликовано: 20.05.2021

интересное от Faceter

Silhouette Recognition: 3 Reasons for Implementing the System in the Moscow Region
In many public places in the Moscow region, the video surveillance systems began to introduce the function of “recognition of silhouettes of people.” Video surveillance in medical institutions, passenger transport,...
The level of responsibility of buildings and structures and video surveillance
Video surveillance performs the tasks of ensuring security in a particular territory. The more dangerous the object of observation, the more detailed it is necessary to approach the issue of...
Video surveillance of animals in the zoo: 6 reasons + live broadcasts
Watching wildlife is always an exciting activity. But sometimes, video surveillance of animals becomes vital for them. It’s about zoos. Yes, there is the staff who feed and look after...
Watch out! 7 unexpected places with hidden video surveillance
The installation of CCTV cameras is strictly regulated by Russian law. Violation of the laws is punishable by a fine and criminal liability. However, there are places where video surveillance...
Video surveillance at a construction site + crane video surveillance
The areas of objects covered by video surveillance are becoming wider. Cloud-based construction video surveillance has become accessible and relevant nowadays. There are many issues that video surveillance at the...
How to display the camera image on a monitor? 4 ways + Faceter
Users of the video surveillance system don’t always need to record a video file from a recorder. Sometimes it is enough to display the image from the camera on the...
Election surveillance cameras. 98% coverage at 50,000 polling stations.
Video surveillance is expanding its position. More and more often video surveillance is used not only by businesses, and private individuals in-home surveillance, but also by government agencies. No one...
Video surveillance repair. Common problems and 5 sources of breakdown
Any equipment, either simple or complex, eventually needs repairing. It is also true for video surveillance systems. Considering its functionality and the tasks performed, you need to have the surveillance...
Poor image of a video camera: 5 reasons and 12 solutions
The image of a video camera is one of the main points of a surveillance system. It is important to pay close attention to its condition. Why the picture from...
6 situations in life when a video camera is simply necessary
We are used to the fact that there are surveillance cameras in public places, in trading facilities. The need for video surveillance has also become relevant for private life. Affordability,...
Voltage drop and quality of video surveillance: 3 countermeasures
There are different indicators that affect the effectiveness of a video surveillance system. Today let’s talk about the voltage drop in the cable line of CCTV equipment. How to determine...
Cameras for computer vision: review and selection criteria
Computer vision (CV) is increasingly taking a position in the video surveillance market. This activity is justified because video monitoring systems with computer vision cameras are more accurate in their...
What is the computer vision technology? 2 tasks and self-study
It is already difficult to imagine a business facility, a territory, and dwellings without video surveillance. The need to install surveillance cameras in public places is established by law. Electronic...
Video surveillance and the Internet speed: 6 options for reducing consumption
It is extremely difficult to imagine one’s life without the Internet. Almost all human activity relies on the capabilities of the World Wide Web. It is often necessary to look...
Video recording of road accidents in the stream of vehicles. The solution for everyone.
It is not always possible to fairly understand who was at fault in the accident. Fear, desire to hide the details, and the lack of witnesses prevent a full-fledged proceeding....