-
Notifications
You must be signed in to change notification settings - Fork 20
Description
Tried to run Wordcount program using prebuild Nativetask it ran successfully though it produced the
IO error (ERROR nativeio.NativeIO: Unable to initialize NativeIO libraries
java.lang.NoSuchFieldError: workaroundNonThreadSafePasswdCalls
)
,but when I tried to build Native task source file locally and used to run the Wordcount program it is giving the IO error (ERROR nativeio.NativeIO: Unable to initialize NativeIO libraries
java.lang.NoSuchFieldError: workaroundNonThreadSafePasswdCalls
) and MapReduce job got failed by giving the below error
java.lang.UnsatisfiedLinkError: org.apache.hadoop.mapred.nativetask.NativeRuntime.JNIConfigure([[B)V
16/09/28 16:34:32 INFO mapred.JobClient: map 0% reduce 0%
16/09/28 16:34:32 INFO mapred.JobClient: Job complete: job_local_0001
16/09/28 16:34:32 INFO mapred.JobClient: Counters: 0
16/09/28 16:34:32 INFO mapred.JobClient: Job Failed: NA
Exception in thread "main" java.io.IOException: Job failed!
Can anyone help with this issue.
Note: we had to change the below in order to build the source locally.
- Included unistd.h in couple of files
- Commented the below in file BatchHandler.cc
#ifndef QUICK_BUILD
#include "org_apache_hadoop_mapred_nativetask_NativeBatchProcessor.h"
#endif
because org_apache_hadoop_mapred_nativetask_NativeBatchProcessor.h file is not existing. - Commented the below in file NativeRuntimeJniImpl.cc
#ifndef QUICK_BUILD
#include "org_apache_hadoop_mapred_nativetask_NativeRuntime.h"
#endif
because org_apache_hadoop_mapred_nativetask_NativeRuntime.h file is not existing.