Replies: 1
Env – HDP2.2 installed from ambari-server.
On HDP2.2 Sanbox it is working fine and not on hdp2.2 cluster which is installed from ambari-server which is bizarre
.
When trying to read a hdfs file inside a mapreduce program it is pointing to local file system(file:///) though value of fs.defaultFS in /etc/hadoop/conf/core-site.xml is pointing to hdfs.
Also when tried to read hdfs file just before the mapper is created (means inside main method itself), for this scenario it is pointing to hdfs and as execution starts it points to local file system and so getting file not found exception.
Container exited with a non-zero exit code 143
14/12/11 11:34:40 INFO mapreduce.Job: Task Id : attempt_1418323359240_0008_m_000000_1, Status : FAILED
Error: java.io.FileNotFoundException: File /user/root/vsconfig.properties does not exist
at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:534)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:747)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:524)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:409)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:140)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:341)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766)