Skip to content

Hadoop NativeTask Runtime Error #7

@veenasreegajula

Description

@veenasreegajula

Tried to run Wordcount program using prebuild Nativetask it ran successfully though it produced the

IO error (ERROR nativeio.NativeIO: Unable to initialize NativeIO libraries
java.lang.NoSuchFieldError: workaroundNonThreadSafePasswdCalls
)

,but when I tried to build Native task source file locally and used to run the Wordcount program it is giving the IO error (ERROR nativeio.NativeIO: Unable to initialize NativeIO libraries
java.lang.NoSuchFieldError: workaroundNonThreadSafePasswdCalls

) and MapReduce job got failed by giving the below error

java.lang.UnsatisfiedLinkError: org.apache.hadoop.mapred.nativetask.NativeRuntime.JNIConfigure([[B)V
16/09/28 16:34:32 INFO mapred.JobClient: map 0% reduce 0%
16/09/28 16:34:32 INFO mapred.JobClient: Job complete: job_local_0001
16/09/28 16:34:32 INFO mapred.JobClient: Counters: 0
16/09/28 16:34:32 INFO mapred.JobClient: Job Failed: NA
Exception in thread "main" java.io.IOException: Job failed!

Can anyone help with this issue.

Note: we had to change the below in order to build the source locally.

  1. Included unistd.h in couple of files
  2. Commented the below in file BatchHandler.cc
    #ifndef QUICK_BUILD
    #include "org_apache_hadoop_mapred_nativetask_NativeBatchProcessor.h"
    #endif

    because org_apache_hadoop_mapred_nativetask_NativeBatchProcessor.h file is not existing.
  3. Commented the below in file NativeRuntimeJniImpl.cc
    #ifndef QUICK_BUILD
    #include "org_apache_hadoop_mapred_nativetask_NativeRuntime.h"
    #endif

    because org_apache_hadoop_mapred_nativetask_NativeRuntime.h file is not existing.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions