apache-spark-3.4 (java/apache-spark) Updated: 1 day, 1 hour ago Add to my watchlist
Engine for large-scale data processingApache Spark is a lightning-fast unified analytics engine for big data and machine learning. It was originally developed at UC Berkeley in 2009. Apache Spark is a fast and general-purpose cluster computing system. It provides high-level APIs in Java, Scala and Python, and an optimized engine that supports general execution graphs. It also supports a rich set of higher-level tools including Spark SQL for SQL and structured data processing, MLlib for machine learning, GraphX for graph processing, and Spark Streaming.
Version: 3.4.4 License: Apache-2
GitHub
| Maintainers | No Maintainer |
| Categories | devel databases lang java parallel |
| Homepage | https://spark.apache.org/ |
| Platforms | darwin |
| Variants | - |
Subport(s) (11)
"apache-spark-3.4" depends on
lib (1)
run (4)
build (1)
Ports that depend on "apache-spark-3.4"
No ports
Port notes
The Spark Home environment variable requires the environment variables to be exported and
set as well as the PySpark Python version. Please add the following lines to your .profile
or export in your shell session to make apache-spark-3.4 work:
export SPARK_HOME=${prefix}/share/apache-spark-3.4
export PYSPARK_PYTHON=${prefix}/bin/python3
Port Health:
Loading Port Health
Installations (30 days)
0
Requested Installations (30 days)
0
Livecheck error
Error: cannot check if apache-spark-3.4 was updated (regex didn't match)
last updated: 15 hours ago