YARN

An updated feature comparison between Capacity Scheduler and Fair Scheduler

leftnoteasy YARN , ,

INTRODUCTION As every Hadoop YARN user knows, YARN has two schedulers: fair scheduler and capacity scheduler (Actually there's a 3rd scheduler, called Fifo scheduler, but not that widely adopted). "Which scheduler to use?" is one of the most common questions asked by YARN user. I want to write this blogpost to help you understand the … Continue reading An updated feature comparison between Capacity Scheduler and Fair Scheduler

Suggestions About How To Better Use YARN Node Label

leftnoteasy YARN

Introduction Node label is an attractive feature of YARN, which is available since Apache Hadoop 2.6. It can solve problems in different scenarios. However, from Hadoop JIRA and mail lists, many users encounter issues to setup and use node label. As major designer and maintainer of this feature, I would highly recommend you to read … Continue reading Suggestions About How To Better Use YARN Node Label