User logs of Hadoop jobs serve multiple purposes. First and foremost, they can be used to debug issues while running a MapReduce application – correctness problems with the application itself, race conditions when running on a cluster, and debugging task/job failures due to hardware or platform bugs

http://hortonworks.com/blog/simplifying-user-logs-management-and-access-in-yarn/

Advertisements