Twitter | Pretraživanje | |
Facebook AI
1/4: The lottery ticket hypothesis suggests that by training DNNs from “lucky” initializations, we can train networks which are 10-100x smaller with minimal performance losses. In new work, we extend our understanding of this phenomenon in several ways...
Reply Retweet Označi sa "sviđa mi se" More
Facebook AI 25. stu
Odgovor korisniku/ci @facebookai
2/4: Do lottery tickets contain generic inductive biases or are they overfit to the particular dataset and optimizer used to find them? Encouragingly, we found that lottery tickets generalize across related, but distinct datasets and across optimizers:
Reply Retweet Označi sa "sviđa mi se"
Facebook AI 25. stu
Odgovor korisniku/ci @facebookai
3/4: Is the lottery ticket phenomenon a general property of DNNs or merely an artifact of supervised image classification? We show that the lottery ticket phenomenon is a general property which is present in both and :
Reply Retweet Označi sa "sviđa mi se"
Facebook AI 25. stu
Odgovor korisniku/ci @facebookai
4/4: Can we begin to explain lottery tickets theoretically? We introduce a new theoretical framework on the formation of lottery tickets to help researchers advance toward a better understanding of lucky initializations:
Reply Retweet Označi sa "sviđa mi se"
Jorge 26. stu
Odgovor korisniku/ci @facebookai @CyrusMaher
Reply Retweet Označi sa "sviđa mi se"
Aldo Santiago Leon 25. stu
Odgovor korisniku/ci @facebookai
Thanks Ari Morcos & Yuandong Tian 😉
Reply Retweet Označi sa "sviđa mi se"