Replies: 0
Hello guys
I have a Single-Node HDP 2.1 installed via Ambari on my Centos 6.5. I also followed the instructions to install spark on my server. The spark-shell works very fine but I would like to test something. I startet a Spark Master with:
./bin/spark-class org.apache.spark.deploy.master.Master
Then I started the Worker wth:
./bin/spark-class org.apache.spark.deploy.worker.Worker spark://hadoop.hortonworks:7077
Now i wanted to start the Spark hive server2 in thrift mode:
./sbin/start-thriftserver.sh
But i’m getting this error:
java.lang.ClassNotFoundException: org.apache.spark.sql.hive.thriftserver.HiveThriftServer2
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:318)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Failed to load Hive Thrift server main class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.
You need to build Spark with -Phive.
I don’t have any idea how to build spark using -Phive. I thought it’s a prebuilt version? I already downloaded maven. Are there any instructions how to build Spark wit -Phive?
Thanks in advance