SparkContext._ensure_initialized(self, gateway=gateway, conf=conf)įile "/Users/karanalang/PycharmProjects/Python2/venv/lib/python2.7/site-packages/pyspark/context.py", line 316, in _ensure_initialized : key not found: _PYSPARK_DRIVER_CALLBACK_HOSTĪt $fault(MapLike.scala:228)Īt (Map.scala:59)Īt $class.apply(MapLike.scala:141)Īt (Map.scala:59)Īt .python.PythonGatewayServer$$anonfun$main$1.apply$mcV$sp(PythonGatewayServer.scala:50)Īt .Utils$.tryOrExit(Utils.scala:1262)Īt .python.PythonGatewayServer$.main(PythonGatewayServer.scala:37)Īt .(PythonGatewayServer.scala)Īt 0(Native Method)Īt (NativeMethodAccessorImpl.java:62)Īt (DelegatingMethodAccessorImpl.java:43)Īt .invoke(Method.java:497)Īt .SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:755)Īt .SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)Īt .SparkSubmit$.submit(SparkSubmit.scala:205)Īt .SparkSubmit$.main(SparkSubmit.scala:119)Īt .SparkSubmit.main(SparkSubmit.scala)įile "/Users/karanalang/PycharmProjects/Python2/karan/python2/falcon/py_createDF.py", line 55, in įile "/Users/karanalang/PycharmProjects/Python2/venv/lib/python2.7/site-packages/pyspark/sql/session.py", line 173, in getOrCreateįile "/Users/karanalang/PycharmProjects/Python2/venv/lib/python2.7/site-packages/pyspark/context.py", line 367, in getOrCreateįile "/Users/karanalang/PycharmProjects/Python2/venv/lib/python2.7/site-packages/pyspark/context.py", line 133, in _init_ Sparkdf = spark.createDataFrame(d, )ĮRROR (when i create the SparkSession object) 19/05/15 16:58:06 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread Spark = ("local").appName("CreatingDF").getOrCreate() # ERROR OBTAINED WHEN I CREATE SaprkSession object
Os.environ = "-master spark://Karans-MacBook-Pro-4.local:7077 pyspark-shell" Print(" PYSPARK_SUBMIT_ARGS -> ", os.environ) i'm using P圜harm 2019, python 2.7.6, Apache Spark 2.2.0įor pyspark development, and running into issues when i try to run any spark code.įrom pyspark import SparkConf, SparkContextįrom import col, lit
0 kommentar(er)
