in Hadoop by
Q:
What happens when a node running a map task fails before sending the output to the reducer?

▼ Show 1 Answer

0 votes
by
What happens when a node running a map task fails before sending the output to the reducer?

If this ever happens, map tasks will be assigned to a new node, and the entire task will be rerun to re-create the map output. In Hadoop v2, the YARN framework has a temporary daemon called application master, which takes care of the execution of the application. If a task on a particular node failed due to the unavailability of a node, it is the role of the application master to have this task scheduled on another node.

map-task
Learn More with Madanswer

Related questions

0 votes
asked Jun 24, 2020 in Azure by anonymous
...