java – org. apache. hadoop. mapreduce. counters. Limitexceededexception: too many counters: 121 max = 120

• Java

I'm running a Hadoop job (from oozie) with few counters and multiple outputs

I got the following error: org apache. hadoop. mapreduce. counters. Limitexceededexception: too many counters: 121 max = 120

Then I deleted all the code with counters and put mount Setcountersenabled is set to false The maximum counter is also set to 240 in Hadoop configuration

Now I still get the same error org apache. hadoop. mapreduce. counters. Limitexceededexception: too many counters: 241 max = 240

How can I solve this problem? Is there any possibility of hiding counters? How can I find out that there are more than 240 counters there? (the process seems to stop before I print anything?)

Thank you, Xinsong

Solution

I solved the problem in the following ways:

<property>
    <name>mapreduce.job.counters.limit</name>
    <!--<value>120</value>-->
   <value>20000</value>
    <description>Limit on the number of counters allowed per job. The default value is 200.</description>
</property>
The content of this article comes from the network collection of netizens. It is used as a learning reference. The copyright belongs to the original author.
THE END
分享
二维码
< <上一篇
下一篇>>