DRDO develops a facial recognition system that can penetrate masks and disguise

When Covid forced everyone to hide behind masks, one lot was happy: the criminals.

Now they could disappear in the crowd as identifying a person became more difficult even for those manning high-resolution surveillance cameras.

With such a threat, there was talk about deploying a facial recognition system to detect faces with masks or disguises during the pandemic.

The National Crime Records Bureau had floated a tender for it last year, but no announcement was made on whether this technology was developed or deployed.

However, it turns out that Defence Research and Development Organisation (DRDO), India’s premier defense laboratory, has indeed developed such a system.

The system, dubbed ‘Face Recognition System under Disguise,’ or FRSD, claims to detect faces through several “disguises like face masks, beard, mustache, wigs, sunglasses, head-scarves, monkey-caps, hats, etc.”.

The Ministry of Defence (MoD) recently released a report called ‘AI in Defence,’ which revealed FRSD and other three facial recognition systems developed by organizations under MoD for the Indian Army.

Since these technologies may not just be reserved for military activities but also deployed in public places, it is necessary to determine how and why they are being used.


Instead of human eyes, the FRSD relies on algorithms to identify the person from patchy, low-resolution surveillance camera feeds.

“Security agencies can also use the algorithm for robust face search across large repositories,” the MoD report said.

The system can be deployed in restricted/ secure zones for live video surveillance. The report said it could also be deployed publicly to recognize anti-social elements.

It considers different lighting conditions, shadows on the face, crowd occlusions, and so on for identification.

“‘Face recognition in the wild’ on surveillance camera feeds is a difficult problem due to the low-resolution images captured from the cameras. This problem becomes even more challenging to solve with the added complexity of various facial disguises, crowd occlusions, and various illuminations,” the MoD report said.

DRDO has developed the system in mind that it should be scalable across servers and graphic processing units.

“The system has a flexible video analytics suite with several additional surveillance applications like people counting, geo-fencing, fire detection, and collision detection.”

Project Seeker

Project Seeker is a facial recognition system developed by entities under the MoD.

Developed and deployed by the Indian Army, it has been designed for population monitoring, surveillance, and garrison security, according to the MoD report.

It doesn’t require internet connectivity, can accrue intelligence data from multiple sources, and be set up remotely with a field-ready system anywhere.

It can be deployed in ‘disturbed’ areas for continuous surveillance and monitoring and at civilian establishments to ensure state-of-the-art security.

“The Seeker system is a self-contained, AI-based facial recognition, surveillance, monitoring, and analysis system for identification & tracking of threats for counter-terrorism, continuous surveillance, and monitoring of disturbed areas,” the report said.

It said the system could be deployed in ‘critical military’ or ‘civilian establishments’ for added security.

Using intelligence data from various sources, the Army aims to track the movement of terrorists and ‘anti-national’ elements.

The report said that the Army aims to achieve “psychological dominance on threats and anti-national elements,” explaining how the technology will serve the nation.

It is important to note that no legal definition for the term ‘anti-national’ has not been defined in Statutes.

Robot at the border

Apart from Project Seeker, the Indian Army has also developed Silent Sentry, a fully facial recognition capable, a 3D-printed rail-mounted robot that slides on a rail and can be installed on fences and anti-filtration obstacle system (AIOS).

The robot communicates through WiFi and is embedded with artificial intelligence for detecting human beings and faces.

“The video feed received from the robot is analyzed by an AI software utilizing object recognition. The software detects movement and human presence automatically, generates an audio alarm, and stores the photographs with time and date log,” the report said.

On detection of a human, a background facial recognition algorithm is activated, which tries to determine a person’s identity from a stored database. The facial feature information is then stored in the database.

Driver fatigue monitoring system

BEML Ltd, a public sector company under the MoD, has developed a driver fatigue monitoring system that uses facial recognition.

“Assessing driver fatigue in critical conditions is an indispensable tool, especially in the Armed Forces,” the report said.

The report said that the system detects the onset of drowsiness in a driver while the vehicle is in motion.

A camera inside the cabin films the driver continuously, and an algorithm analyses the footage frame by frame and determines whether the driver’s eyes are open or closed.

“Detection is done by continuously looking out for symptoms of drowsiness while considering physical cues including yawning, drooping eyelids, closed eyes, and increased blink durations by using the percentage of eyelid closure over the pupil over time (PERCLOS) algorithm,” it added.


As dazzling as these technologies may sound, at the end of the day, these are all based on algorithms and the software that is being deployed.

So how reliable are these systems, given that they are documented to be prone to error?

There are concerns over misidentification due to poor accuracy in correctly identifying faces.

“Facial recognition technology is inaccurate. It throws up faulty results. And now, with masks, which can cover half the face, the accuracy will go even lower,” said Anushka Jain, associate counsel at Internet Freedom Foundation (IFF).

For instance, in a test conducted in 2018, Amazon’s facial recognition tech known as Rekognition incorrectly matched 28 members of US Congress, identifying them as other people who have been arrested for a crime.

Jain gave the example of two siblings who can be wrongly identified while wearing masks.

“Two siblings wearing masks can very well have similar looking upper-half of the face. They can be wrongly identified. This can even lead to communities being targeted,” Jain said.

The report does not mention the accuracy of the FRSD technology. Moneycontrol has reached out to the DRDO for comments in this regard, and the copy will be updated when a response is received.

“Any decision taken on account of misinformation might lead to dire consequences. Facial recognition, as a practice, in its application, can also have shortcomings of its own. Therefore, the data thus received needs to be subject to a process where the Armed Forces need to scan further and filter the retrieved data,” Kritika Seth, Founding Partner at Victoriam Legalis – Advocates & Solicitors.


Over the years, state governments’ deployment of facial recognition technology and the Centre for governance and policing has been under the scanner of civil society groups and digital rights activists, who worry about privacy infringement.

Although the usage of the system will be more concentrated on foreigners, Seth from Victorian Legalis raised queries on the data collection practices and whether its use aligns with the Right to Privacy judgment.

“There is no legal framework which mandates transparency in data collection for the above purpose. The opacity regarding the use of personal data can violate the right to privacy as given in the case of Justice K.S. Puttaswamy (Retd.) versus Union of India,” Seth said.

“Furthermore, the Army is also keen to monitor social media pages. She added that such surveillance will intersect with existing state surveillance and might not fall within the purview of the Armed Forces,” she added.

Moneycontrol has reached out to the Indian Army with queries in this regard, and the story will be updated when a response is received.


Siddharth Suresh, the partner at DSK Legal, explains that facial recognition currently comes under the Information Technology (Reasonable security practices and procedures and sensitive personal data or information) Rules, 2011 (“SPDI Rules”).

“Data collected by facial recognition solutions comes within the purview of “Biometric Data” and is classified as “sensitive personal data,” he said.

However, he said, regulations have carved out exemptions for government agencies to collect and use such data without the data subject’s consent, with the underlying presumption being that such use of data is for the general public good and national security.

The recent notification of the Criminal Procedure (Identification) Act, 2022 also allows authorities to collect and share biometric information.”

Leave a Comment

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

error: Unauthorized Content Copy Is Not Allowed
Scroll to Top
%d bloggers like this: