使用 sparklyr 包安装 spark 时出错

如何解决使用 sparklyr 包安装 spark 时出错

我正在尝试在 Mac 系统 (macOS Catalina) 上安装 sparklyr；在运行 spark_install() 时，它开始下载软件包，然后失败。复现请看以下代码。

> library(sparklyr)
> packageVersion("sparklyr")
[1] ‘1.5.2’
> system("java -version")
java version "15.0.2" 2021-01-19
Java(TM) SE Runtime Environment (build 15.0.2+7-27)
Java HotSpot(TM) 64-Bit Server VM (build 15.0.2+7-27,mixed mode,sharing)
> spark_install("3.0")
Installing Spark 3.0.1 for Hadoop 3.2 or later.
Downloading from:
- 'https://archive.apache.org/dist/spark/spark-3.0.1/spark-3.0.1-bin-hadoop3.2.tgz'
Installing to:
- '~/spark/spark-3.0.1-bin-hadoop3.2'
trying URL 'https://archive.apache.org/dist/spark/spark-3.0.1/spark-3.0.1-bin-hadoop3.2.tgz'
Content type 'application/x-gzip' length 224062525 bytes (213.7 MB)
===========
downloaded 50.0 MB

Error in download.file(installInfo$packageRemotePath,destfile = installInfo$packageLocalPath,: 
  download from 'https://archive.apache.org/dist/spark/spark-3.0.1/spark-3.0.1-bin-hadoop3.2.tgz' Failed

解决方法

我也在 sparklyr GitHub 页面上发布了这个问题。李一涛给出了如下回答：

https://github.com/sparklyr/sparklyr/issues/2936

我在这里重复一下答案，它可能会帮助其他人。

运行 options(timeout=300) 然后重新安装软件包。