Twitter | Pretraživanje | |
David Pfau 15. pro
Odgovor korisniku/ci @AdamMarblestone @xaqlab
Graphical models got cool because Microsoft Research decided to specialize in them. Deep learning got a boost from Jeff Dean creating Google Brain in 2011. Lots of these shifts in zeitgeist have to do with the funding decisions of a few big tech companies.
Reply Retweet Označi sa "sviđa mi se"
Adam Marblestone 15. pro
Odgovor korisniku/ci @pfau @xaqlab
You could alternatively say "when someone pushes them hard enough to show that [some of them] can scale to real problems" -- which makes it seem at least somewhat more reasonable, less contingent/sociological
Reply Retweet Označi sa "sviđa mi se"
David Pfau 15. pro
Odgovor korisniku/ci @AdamMarblestone @xaqlab
Why should scaling to optimizing ads on large datacenters be a cue for neuroscientists?
Reply Retweet Označi sa "sviđa mi se"
Adam Marblestone 15. pro
Odgovor korisniku/ci @pfau @xaqlab
Better something than nothing
Reply Retweet Označi sa "sviđa mi se"
David Pfau 15. pro
Odgovor korisniku/ci @AdamMarblestone @xaqlab
Probably better to be driven by actual experimental observations from neuroscience
Reply Retweet Označi sa "sviđa mi se"
Adam Marblestone 15. pro
Odgovor korisniku/ci @pfau @xaqlab
Reply Retweet Označi sa "sviđa mi se"
Adam Marblestone 15. pro
Odgovor korisniku/ci @pfau @xaqlab
Seriously though, approximate backprop seems simpler than approximate PGM inference... and many probabilistic inference problems can be re-framed as neural nets as the field is doing now
Reply Retweet Označi sa "sviđa mi se"
Adam Marblestone 15. pro
Odgovor korisniku/ci @pfau @xaqlab
And there are things like:
Reply Retweet Označi sa "sviđa mi se"
Adam Marblestone 15. pro
Odgovor korisniku/ci @pfau @xaqlab
And PGMs have been heavily explored, while backprop was ignored for a long time... so I think things are OK
Reply Retweet Označi sa "sviđa mi se"
Adam Marblestone 15. pro
Odgovor korisniku/ci @pfau @xaqlab
But yes... basing as directly as possible in ground truth neuro observations would be very nice...
Reply Retweet Označi sa "sviđa mi se"