Contribution analysis of TrojanZoo.

Summary in a word

Aim to bridge the gap the current situation: the lack of evaluation on exsiting attacks and defenses.

The first open-source platform for evaluating neural backdoor attacks/defenses in a unified, holistic, and practical manner.
arch-trojanzoo

Main contribution

  1. Open-source framework, includes attacks, defenses and plenty of evaluation metrics.
  2. Systematic study on existing attaks/defenses, and unveiling their complex design spectrum.
  3. Further explored existing attacks/defenses, and got intersting findings.

Experiments

  1. Analysed different attacks manifest intricate trade-offs among effectiveness, evasiveness, transferability.
  2. Analysed different defenses on the topic below:
    • robustness vs. utility
    • detection accuracy of different attaks
    • detection accuracy vs. recovery capability
    • execution time

Conclusion

It’s an open-source framework for attacks/defenses research, and main contribution of the paper is the analysis of attacks and defenses.

It reveals several important findings in the experiment.