Maximum Likelihood Estimation, Cross Entropy and Deep Learning Network

Reading Ian Goodfellow's Deep Learning Book recently, the 5th chapter (Machine Learning Basics) is really great. Comparing to Bishop's Pattern Recognition and Machine Learning, it includes less mathematics and formulas which is good for a casual read. Today I want to share the topic of maximum likelihood estimation (MLE) which might not be straightforward to … Continue reading Maximum Likelihood Estimation, Cross Entropy and Deep Learning Network

Deep understand locality in CapacityScheduler and how to control it.

Locality settings in CapacityScheduler looks straightforward but it is not so simple in reality. We have two level of locality delays: node->rack (delay1), rack->off-switch (delay2).  As of now, delay in CapacityScheduler is based on missed-opportunity (abbr. MO, how many skipped node allocation) instead of wall clock time. Let’s start with an example. We have a … Continue reading Deep understand locality in CapacityScheduler and how to control it.