Impacts of Image Obfuscation on Fine-grained Activity Recognition in Egocentric Video


Automated detection and validation of fine-grained human activities from egocentric vision has gained increased attention in recent years due to the rich information afforded by RGB images. However, it is not easy to discern how much rich information is necessary to detect the activity of interest reliably. Localization of hands and objects in the image has proven helpful to distinguishing between hand-related fine-grained activities. This paper describes the design of a hand-object-based mask obfuscation method (HOBM) and assesses its effect on automated recognition of fine-grained human activities. HOBM masks all pixels other than the hand and object in-hand, improving the protection of personal user information (PUI). We test a deep learning model trained with and without obfuscation using a public egocentric activity dataset with 86 class labels and achieve almost similar classification accuracies (2% decrease with obfuscation). Our findings show that it is possible to protect PUI at smaller image utility costs (loss of accuracy).

Example image


Soroush Shahi

Rawan Alharbi

Yang Gao

Sougata Sen

Aggelos K Katsaggelos

Josiah Hester

Nabil Alshurafa

Software & Projects

Let’s Talk

680 N. Lakeshore Dr., Suite 1400, Chicago, IL 60611

Have a question? let us now and we’ll get back to you ASAP!