|
@AdamMarblestone | |||||
|
Or the fact that the "action" from time t-1 is both encoded and decoded in from arxiv.org/abs/1803.10760 pic.twitter.com/kWDnvjg3fo
|
||||||
|
||||||
|
Blake Richards
@tyrell_turing
|
22. tra 2018. |
|
Great thread. My personal take: this “non-visual” activity reflects the internal generative model of the animal, i.e. the visual cortex is sampling from a distribution conditioned on motor activity. twitter.com/marius10p/stat…
|
||
|
|
||
|
Marius Pachitariu
@marius10p
|
24. tra 2018. |
|
The neurons are representing actions, not the sensory consequences of those actions. The latter would have looked very different. For example in darkness, the sensory consequences of movement are still darkness, so there should be no response! Read the paper for the fine details.
|
||
|
|
||
|
Adam Hantman
@AdamHantman
|
24. tra 2018. |
|
Not sure this makes sense, in darkness the sensory consequences of movement are proprioception.
|
||
|
|
||
|
Marius Pachitariu
@marius10p
|
24. tra 2018. |
|
@tyrell_turing is talking about visual predictive coding in V1
|
||
|
|
||
|
Adam Hantman
@AdamHantman
|
24. tra 2018. |
|
How do you know it is predictive coding in v1 and not proprioception in v1
|
||
|
|
||
|
David Schoppik
@schoppik
|
24. tra 2018. |
|
or vestibular-driven?
c.f. cat primary visual cortex (after caudal medulla section)
ac.els-cdn.com/S0079612308639… pic.twitter.com/U4eOCOKzYk
|
||
|
|
||
|
Marius Pachitariu
@marius10p
|
24. tra 2018. |
|
All good hypotheses. What I think doesn't work is predictive coding of visual inputs, which is a popular theory in neuroscience.
|
||
|
|
||
|
Blake Richards
@tyrell_turing
|
24. tra 2018. |
|
1/ I’ll have more to say after I read the paper, but want to clarify that I don’t necessarily advocate for Rao & Ballard predictive coding here.
|
||
|
|
||
|
Blake Richards
@tyrell_turing
|
24. tra 2018. |
|
2/ My intuition, though, is that motor/vestibular/proprioceptive input to V1 would provide conditioning variables for a generative model of visual input.
|
||
|
|
||
|
Adam Marblestone
@AdamMarblestone
|
24. tra 2018. |
|
Yeah! See "efference copy" on left hand side of below picture from youtube.com/watch?v=P0yVuo… for an example, building from their earlier paper arxiv.org/abs/1511.06380 pic.twitter.com/fF1BzhNGGR
|
||
|
|
||