: .AnalysisException: : : The root scratch dir: /tmp/hive on HDFS should be writable. Py4JJavaError: An error occurred while calling o24.applySchemaToPythonRDD. ~\spark\python\lib\py4j-0.10.7-src.zip\py4j\protocol.py in get_return_value(answer, gateway_client, target_id, name)ģ27 "An error occurred while calling. ~\spark\python\pyspark\sql\utils.py in deco(*a, **kw)Ħ4 except 4JJavaError as e: Which results in the error: Py4JJavaError Traceback (most recent call last) Based on my research I am fairly certain this has to do with my installation.
DOWNLOAD SPARK WITHOUT HADOOP CODE
However, the following code keeps breaking.
![download spark without hadoop download spark without hadoop](https://miro.medium.com/max/1200/0*LhaU8WgF81bU8ujS.png)
![download spark without hadoop download spark without hadoop](https://i.pinimg.com/736x/b4/ff/c6/b4ffc60c20e23e7e665feaf2e3584fb9.jpg)
When I run pyspark in the terminal, Jupyter starts fine and runs code. I created folder C:\tmp\hive and ran command winutils.exe chmod -R 777 \tmp\hive.Set up enviornment variables as follows:.\Hadoop\bin\ (outside of this one file the rest of the Hadoop folder is empty-I was told I did not need Hadoop) Downloaded winutils.exe from here and placed it in.I have researched thoroughly but I am still running into issues, here is what I have done:
![download spark without hadoop download spark without hadoop](https://i.stack.imgur.com/36ufx.png)
DOWNLOAD SPARK WITHOUT HADOOP WINDOWS 10
I am trying to get Spark running on Windows 10 but I keep running into errors.