[深度学习论文笔记][Adversarial Examples] Intriguing properties of neural networks

Szegedy, Christian, et al. “Intriguing properties of neural networks.” arXiv preprint arXiv:1312.6199 (2013). (Citations: 251).

1 Representation of High Level Neurons

1.1 Motivation

Previous works analyzed the semantic meaning of various neurons by finding the set of inputs that maximally activate a given unit. The inspection of individual units makes the

implicit assumption that the neurons in high level layers form a distinguished basis which is particularly useful for extracting semantic information.

1.2 Observation

We found that random linear combinations of activations are semantically indistinguishable from the activations themselves. This puts into question the notion that neural networks disentangle variation factors across activations. It suggests that it is the space, rather than the individual neurons, that contains the semantic information in the high