如何解决SparkException:作业因阶段失败而中止:
同时进行火花深度学习。 有这个问题。
featurizer = DeepImageFeaturizer(inputCol="image",outputCol="features",modelName="InceptionV3")
lr = LogisticRegression(maxIter=1,regParam=0.03,elasticNetParam=0.5,labelCol="label")
sparkdn = Pipeline(stages=[featurizer,lr])
spark_model = sparkdn.fit(train)
出错
/usr/spark/spark-2.4.7-bin-hadoop2.7/python/lib/py4j-0.10.7-src.zip/py4j/protocol.py in get_return_value(answer,gateway_client,target_id,name)
326 raise Py4JJavaError(
327 "An error occurred while calling {0}{1}{2}.\n".
--> 328 format(target_id,".",name),value)
329 else:
330 raise Py4JError(
Py4JJavaError: An error occurred while calling o371.collectToPython.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 21.0 failed 1 times,most recent failure: Lost task 0.0 in stage 21.0 (TID 700,localhost,executor driver): org.apache.spark.SparkException:
Error from python worker:
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py",line 185,in _run_module_as_main
mod_name,mod_spec,code = _get_module_details(mod_name,_Error)
File "/usr/lib/python3.8/runpy.py",line 111,in _get_module_details
__import__(pkg_name)
尝试安装 JDK-8 以便 conda 重新安装 py4j
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。