如何解决py4j.protocol.Py4JJavaError：在Cloudera CDH 5.5.0 VM，Spark 2.4.7，JDK1.8.0_181中调用o27.partitions时发生错误
我正在学习在具有能够运行Hadoop的硬件的个人计算机上使用Spark。这是配置：
带有Cloudera Quickstart，Spark 2.4.7，JDK1.8.0_181，Hadoop 2.6.0，Python 3.6.9的Cloudera CDH 5.5.0。
运行Python脚本（从YouTube上的Udemy视频复制）时，我遇到并修复了多个错误，但找不到以下解决方案：
java.io.IOException：HDFS URI不完整，没有主机：hdfs：/ user / cloudera / Spark / ml-100 k / u.data
回溯（最近通话最近一次）：
File "/home/cloudera/Spark/LowestRatedMovieDataFrame.py",line 75,in < module >
movieDataset = spark.createDataFrame(movies)
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/sql/session.py",line 746,in createDataFrame
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/sql/session.py",line 390,in _createFromrDD
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/sql/session.py",line 361,in _inferSchema
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/rdd.py",line 1378,in first
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/rdd.py",line 1327,in take
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/rdd.py",line 2517,in getNumPartitions
File "/usr/local/spark/python/lib/py4j-0.10.7-src.zip/py4j/java_gateway.py",line 1257,in __call__
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/sql/utils.py",line 63,in deco
File "/usr/local/spark/python/lib/py4j-0.10.7-src.zip/py4j/protocol.py",line 328,in get_return_value
py4j.protocol.Py4JJavaError: An error occurred
while calling o27.partitions.: java.io.IOException: Incomplete HDFS URI,no host: hdfs: /user/cloudera / Spark / ml - 100 k / u.data
版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 dio@foxmail.com 举报，一经查实，本站将立刻删除。