sparklyr: R Interface to Apache Spark

R interface to Apache Spark, a fast and general engine for big data processing, see <>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.

Version: 0.9.4
Depends: R (≥ 3.2)
Imports: assertthat, base64enc, broom, config (≥ 0.2), DBI (≥ 0.6-1), dplyr (≥ 0.7.2), dbplyr (≥ 1.1.0), digest, httr (≥ 1.2.1), jsonlite (≥ 1.4), lazyeval (≥ 0.2.0), methods, openssl (≥ 0.8), r2d3, rappdirs, rlang (≥ 0.1.4), rprojroot, rstudioapi (≥ 0.6), shiny (≥ 1.0.1), withr, xml2, tibble, tidyr, purrr, forge
Suggests: ggplot2, glmnet, janeaustenr, Lahman, mlbench, nnet, nycflights13, RCurl, reshape2, testthat
Published: 2019-01-09
Author: Javier Luraschi [aut, cre], Kevin Kuo ORCID iD [aut], Kevin Ushey [aut], JJ Allaire [aut], Samuel Macedo [ctb], RStudio [cph], The Apache Software Foundation [aut, cph]
Maintainer: Javier Luraschi <javier at>
License: Apache License 2.0 | file LICENSE
NeedsCompilation: no
SystemRequirements: Spark: 1.6.x or 2.x
Materials: README NEWS
In views: ModelDeployment
CRAN checks: sparklyr results


Reference manual: sparklyr.pdf
Package source: sparklyr_0.9.4.tar.gz
Windows binaries: r-devel:, r-release:, r-oldrel:
OS X binaries: r-release: sparklyr_0.9.4.tgz, r-oldrel: sparklyr_0.9.4.tgz
Old sources: sparklyr archive

Reverse dependencies:

Reverse imports: graphframes, mleap, rsparkling, spark.sas7bdat, sparkavro, sparkbq, sparklyr.nested, sparkwarc
Reverse suggests: parsnip, replyr, vip


Please use the canonical form to link to this page.