Neural networks can be vulnerable to adversarial noise. We demonstrate the remarkable effectiveness of interval bound propagation in training provably robust image classifiers:
Lest I come off as too negative and aggressive in this thread, I should also point out that many other people interested in adversarial robustness are pursuing more rigorous and theory-driven approaches. Interval Bound Propagation comes to mind