Problem scenario
Your Python MR (mapreduce) job is failing. You do not know why.
You may or may not get an error like this: “Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1”
Other symptoms you may experience is the MapReduce job takes a great deal of time. It seems to hang. What should you do?
Solution
- Determine which map .py file you are using and which reduce .py file that you are using.
…