CosPGD

Accepted at ICML2024

Introduction

While neural networks allow highly accurate predictions in many tasks, their lack of robustness towards even slight input perturbations hampers their deployment in many real-world applications. Recent research towards evaluating the robustness of neural networks such as the seminal projected gradient descent (PGD) attack and subsequent works have drawn significant attention, as they provide an effective insight into the quality of representations learned by the network. However, these methods predominantly focus on image classification tasks, while only a few approaches specifically address the analysis of pixel-wise prediction tasks such as semantic segmentation, optical flow, disparity estimation, and others, respectively.

Thus, there is a lack of a unified adversarial robustness benchmarking tool (algorithm) that is applicable to all such pixel-wise prediction tasks. In this work, we close this gap and propose CosPGD, a novel white-box adversarial attack that allows optimizing dedicated attacks for any pixel-wise prediction task in a unified setting. It leverages the cosine similarity between the distributions over the predictions and ground truth (or target) to extend directly from classification tasks to regression settings. We outperform the SotA on semantic segmentation attacks in our experiments on PASCAL VOC2012. Further, we set a new benchmark for adversarial attacks on optical flow displaying the ability to extend to any pixel-wise prediction task.

For more details please see our Arxiv paper (NOT ANONYMOUS).

Contents

In this repository, we provide sample code for comparing CosPGD to other adversarial attacks on different networks and downstream tasks.

The functions for the benchmarking tool are present in the cospgd folder

A sample use of the CosPGD benchmarking tool is provided with instructions in the unet_backbones folder

Referece

If you use our work, we would appreciate it if you cite the following BibTeX citation:

@InProceedings{pmlr-v235-agnihotri24b,
  title =      {{C}os{PGD}: an efficient white-box adversarial attack for pixel-wise prediction tasks},
  author =       {Agnihotri, Shashank and Jung, Steffen and Keuper, Margret},
  booktitle =      {Proceedings of the 41st International Conference on Machine Learning},
  pages =      {416--451},
  year =      {2024},
  editor =      {Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix},
  volume =      {235},
  series =      {Proceedings of Machine Learning Research},
  month =      {21--27 Jul},
  publisher =    {PMLR},
  pdf =      {https://raw.githubusercontent.com/mlresearch/v235/main/assets/agnihotri24b/agnihotri24b.pdf},
  url =      {https://proceedings.mlr.press/v235/agnihotri24b.html},  
}

Or the following plain text citation:

Agnihotri, S., Jung, S. &; Keuper, M.. (2024). CosPGD: an efficient white-box adversarial attack for pixel-wise prediction tasks. Proceedings of the 41st International Conference on Machine Learning, in Proceedings of Machine Learning Research 235:416–451 Available from proceedings.mlr.press/v235/agnihotri24b.html.