All of these images were computer generated!
All of these images were computer generated!
For the last few weeks, Googlers have been obsessed with a internal visualization tool that Alexander Mordvintsev in our Zurich office created to help us visually understand some of the things happening inside our deep neural networks for computer vision. The tool essentially starts with an image, runs the model forwards and backwards, and then makes adjustments to the starting image in weird and magnificent ways.
In the same way that when you are staring at clouds, and you can convince yourself that some part of the cloud looks like a head, maybe with some ears, and then your mind starts to reinforce that opinion, by seeing even more parts that fit that story ("wow, now I even see arms and a leg!"), the optimization process works in a similar manner, reinforcing what it thinks it is seeing. Since the model is very deep, we can tap into it at various levels and get all kinds of remarkable effects.
Alexander, Christopher Olah, and Mike Tyka wrote up a very nice blog post describing how this works:
http://googleresearch.blogspot.com/2015/06/inceptionism-going-deeper-into-neural.html
There's also a bigger album of more of these pictures linked from the blog post:
https://goo.gl/photos/fFcivHZ2CDhqCkZdA
I just picked a few of my favorites here.
For the last few weeks, Googlers have been obsessed with a internal visualization tool that Alexander Mordvintsev in our Zurich office created to help us visually understand some of the things happening inside our deep neural networks for computer vision. The tool essentially starts with an image, runs the model forwards and backwards, and then makes adjustments to the starting image in weird and magnificent ways.
In the same way that when you are staring at clouds, and you can convince yourself that some part of the cloud looks like a head, maybe with some ears, and then your mind starts to reinforce that opinion, by seeing even more parts that fit that story ("wow, now I even see arms and a leg!"), the optimization process works in a similar manner, reinforcing what it thinks it is seeing. Since the model is very deep, we can tap into it at various levels and get all kinds of remarkable effects.
Alexander, Christopher Olah, and Mike Tyka wrote up a very nice blog post describing how this works:
http://googleresearch.blogspot.com/2015/06/inceptionism-going-deeper-into-neural.html
There's also a bigger album of more of these pictures linked from the blog post:
https://goo.gl/photos/fFcivHZ2CDhqCkZdA
I just picked a few of my favorites here.
Comments
Post a Comment