I can't believe I haven't read this until now. This is mind-provoking, and the result is an important step towards understanding neural networks.
The culmination of this blog post is the exciting work of Activation Addition, which I believe is one important work that inspired the recently Representation Engineering work.