wtorek, 24 lutego 2015

Hadoop How to

How to disable "speculative execution"?
configuration.setBoolean("mapred.map.tasks.speculative.execution", false);
configuration.setBoolean("mapred.reduce.tasks.speculative.execution", false);
How to set notification url?
configuration.set("job.end.notification.url", request.getNotificationUrl());
How to attach all required jars to the job? configuration.set("tmpjars", StringUtils.join(request.getJars(), ","));

Brak komentarzy:

Prześlij komentarz