apache-spark-2.4 (java/apache-spark) Updated: 1 day, 1 hour ago Add to my watchlist

Engine for large-scale data processing

Apache Spark is a lightning-fast unified analytics engine for big data and machine learning. It was originally developed at UC Berkeley in 2009. Apache Spark is a fast and general-purpose cluster computing system. It provides high-level APIs in Java, Scala and Python, and an optimized engine that supports general execution graphs. It also supports a rich set of higher-level tools including Spark SQL for SQL and structured data processing, MLlib for machine learning, GraphX for graph processing, and Spark Streaming.

Version: 2.4.8 License: Apache-2 GitHub
Maintainers No Maintainer
Categories devel databases lang java parallel
Homepage https://spark.apache.org/
Platforms darwin
Variants -

Subport(s) (11)


"apache-spark-2.4" depends on

lib (1)
run (4)
build (1)

Ports that depend on "apache-spark-2.4"

No ports


Port notes

The Spark Home environment variable requires the environment variables to be exported and
set as well as the PySpark Python version. Please add the following lines to your .profile
or export in your shell session to make apache-spark-2.4 work:

export SPARK_HOME=${prefix}/share/apache-spark-2.4
export PYSPARK_PYTHON=${prefix}/bin/python3


Port Health:

Loading Port Health

Installations (30 days)

0

Requested Installations (30 days)

0

Livecheck error

Error: cannot check if apache-spark-2.4 was updated (regex didn't match)

last updated: 15 hours ago