Hadoop YARN

What Does Hadoop YARN Mean?

Hadoop YARN is a specific component of the open source Hadoop platform for big data analytics, licensed by the non-profit Apache software foundation.

Advertisements

Major components of Hadoop include a central library system, a Hadoop HDFS file handling system, and Hadoop MapReduce, which is a batch data handling resource. In addition to these, there’s Hadoop YARN, which is described as a clustering platform that helps to manage resources and schedule tasks. The Apache software foundation, the license holder for Hadoop, describes Hadoop YARN as ‘next-generation MapReduce’ or ‘MapReduce 2.0.’

Techopedia Explains Hadoop YARN

Experts explain that the key concept of YARN involves setting up both global and application-specific resource management components. This helps to allocate resources to particular applications and manage other kinds of resource monitoring tasks. In YARN, an application submission client submits an application to the YARN resource manager. YARN ‘schedules’ applications in order to prioritize tasks and maintain big data analytics systems. This is just one part of a greater architecture for aggregating and sorting data, conducting specific queries to retrieve data, and otherwise using Hadoop and related tools to manipulate big data for business intelligence and much more. Businesses use these kinds of platforms to look at supply chains, document product and service operations, keep track of customer information, and for many other kinds of powerful data-driven and automated business processes.

Advertisements

Related Terms

Latest Emerging Technology Terms

Related Reading

Margaret Rouse

Margaret Rouse is an award-winning technical writer and teacher known for her ability to explain complex technical subjects to a non-technical, business audience. Over the past twenty years her explanations have appeared on TechTarget websites and she's been cited as an authority in articles by the New York Times, Time Magazine, USA Today, ZDNet, PC Magazine and Discovery Magazine.Margaret's idea of a fun day is helping IT and business professionals learn to speak each other’s highly specialized languages. If you have a suggestion for a new definition or how to improve a technical explanation, please email Margaret or contact her…