0 votes
in Hadoop by
What happens when a node running a map task fails before sending the output to the reducer?

1 Answer

0 votes
by
What happens when a node running a map task fails before sending the output to the reducer?

If this ever happens, map tasks will be assigned to a new node, and the entire task will be rerun to re-create the map output. In Hadoop v2, the YARN framework has a temporary daemon called application master, which takes care of the execution of the application. If a task on a particular node failed due to the unavailability of a node, it is the role of the application master to have this task scheduled on another node.

map-task

Related questions

+1 vote
asked Dec 20, 2022 in Hadoop by john ganales
+2 votes
asked Jul 2, 2021 in Apache Storm by rajeshsharma
...