Practical Advice for Building Deep Neural Networks

In our machine learning lab, we’ve accumulated tens of thousands of training hours across numerous high-powered machines. The computers weren’t the only ones to learn a lot in the process, though: we ourselves have made a lot of mistakes and fixed a lot of bugs. Here we present some practical tips for training deep neural … More Practical Advice for Building Deep Neural Networks