BSD Portsdevel/spark 4.2.0 FreeBSD
Fast big data processing engine
- System
- FreeBSD
- Repository
- FreeBSD ports
- Maintainer
- [email protected]
- Last update
- Commit
8017e59ed4- License
- APACHE20
- Categories
- devel, java
- Package size
- 250929.3 KiB, 289652.5 KiB installed
Description
Apache Spark is a fast and general-purpose cluster computing system. It provides high-level APIs in Java, Scala and Python, and an optimized engine that supports general execution graphs. It also supports a rich set of higher-level tools including Spark SQL for SQL and structured data processing, MLlib for machine learning, GraphX for graph processing, and Spark Streaming.
In the other systems
| System | Port | Version |
|---|---|---|
| FreeBSD | devel/spark | 4.2.0 |
| DragonFly | devel/spark | 3.3.4 |
Install
Binary package:
pkg install apache-sparkFrom the ports tree:
cd /usr/ports/devel/spark/ && make install cleanTo depend on this port in another port's Makefile:
RUN_DEPENDS= apache-spark>0:devel/sparkPackages
The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.
| Repository | aarch64 | amd64 | armv6 | armv7 | i386 |
|---|---|---|---|---|---|
| FreeBSD:14:latest | 3.3.4_4 | 4.2.0 | - | - | - |
| FreeBSD:14:quarterly | 3.3.4_4 | 3.3.4_4 | n/a | - | - |
| FreeBSD:15:latest | 4.2.0 | 4.2.0 | n/a | - | - |
| FreeBSD:15:quarterly | 3.3.4_4 | 3.3.4_4 | n/a | n/a | n/a |
| FreeBSD:16:latest | 3.3.4_4 | 4.2.0 | n/a | n/a | n/a |
| FreeBSD:16:quarterly | n/a | n/a | n/a | n/a | n/a |
Dependencies
As this port's Makefile names them.
Build 3
${LOCALBASE}/lib/libsnappyjava.so: archivers/snappy-javabash: shells/bashmaven39>0: devel/maven39
Runtime 1
bash: shells/bash
The full lists below include those, and their dependencies in turn.
Build dependencies 65
- archivers/brotli
- archivers/libdeflate
- archivers/liblz4
- archivers/snappy-java
- archivers/zstd
- audio/alsa-lib
- converters/libiconv
- devel/cmake-core
- devel/gettext-runtime
- devel/glib20
- devel/jsoncpp
- devel/libffi
- devel/libinotify
- devel/libunistring
- devel/libuv
- devel/maven-wrapper
- devel/maven39
- devel/ninja
- devel/pcre2
- devel/py-packaging
- devel/readline
- dns/libidn2
- graphics/giflib
- graphics/graphite2
- graphics/jbigkit
- graphics/jpeg-turbo
- graphics/lcms2
- graphics/lerc
- graphics/png
- graphics/tiff
- java/javavmwrapper
- java/openjdk21
- lang/python312
- lang/python315
- math/mpdecimal
- ports-mgmt/pkg
- print/freetype2
- print/harfbuzz
- print/indexinfo
- security/rhash
- shells/bash
- textproc/expat2
- x11-fonts/dejavu
- x11-fonts/encodings
- x11-fonts/font-bh-ttf
- x11-fonts/font-misc-ethiopic
- x11-fonts/font-misc-meltho
- x11-fonts/fontconfig
- x11-fonts/libfontenc
- x11-fonts/mkfontscale
- x11-fonts/xorg-fonts-truetype
- x11-toolkits/libXt
- x11/libICE
- x11/libSM
- x11/libX11
- x11/libXau
- x11/libXdmcp
- x11/libXext
- x11/libXfixes
- x11/libXi
- x11/libXrandr
- x11/libXrender
- x11/libXtst
- x11/libxcb
- x11/xorgproto
Run dependencies 54
- archivers/brotli
- archivers/libdeflate
- archivers/liblz4
- archivers/zstd
- audio/alsa-lib
- converters/libiconv
- devel/gettext-runtime
- devel/glib20
- devel/libffi
- devel/libinotify
- devel/pcre2
- devel/py-packaging
- devel/readline
- graphics/giflib
- graphics/graphite2
- graphics/jbigkit
- graphics/jpeg-turbo
- graphics/lcms2
- graphics/lerc
- graphics/png
- graphics/tiff
- java/javavmwrapper
- java/openjdk21
- lang/python312
- lang/python315
- math/mpdecimal
- print/freetype2
- print/harfbuzz
- print/indexinfo
- shells/bash
- textproc/expat2
- x11-fonts/dejavu
- x11-fonts/encodings
- x11-fonts/font-bh-ttf
- x11-fonts/font-misc-ethiopic
- x11-fonts/font-misc-meltho
- x11-fonts/fontconfig
- x11-fonts/libfontenc
- x11-fonts/mkfontscale
- x11-fonts/xorg-fonts-truetype
- x11-toolkits/libXt
- x11/libICE
- x11/libSM
- x11/libX11
- x11/libXau
- x11/libXdmcp
- x11/libXext
- x11/libXfixes
- x11/libXi
- x11/libXrandr
- x11/libXrender
- x11/libXtst
- x11/libxcb
- x11/xorgproto
No port depends on this one.
Configuration
No options to configure.
- USES
- cmake:indirect compiler:c++17-lang cpe java ninja:build python shebangfix
- Service scripts
spark_master,spark_worker
Files
pkg-plist 2302
- share/apache-spark/RELEASE
- share/apache-spark/bin/beeline
- share/apache-spark/bin/docker-image-tool.sh
- share/apache-spark/bin/find-spark-home
- share/apache-spark/bin/load-spark-env.sh
- share/apache-spark/bin/pyspark
- share/apache-spark/bin/run-example
- share/apache-spark/bin/spark-class
- share/apache-spark/bin/spark-connect-shell
- share/apache-spark/bin/spark-pipelines
- share/apache-spark/bin/spark-shell
- share/apache-spark/bin/spark-sql
- share/apache-spark/bin/spark-submit
- share/apache-spark/bin/sparkR
- share/apache-spark/conf/fairscheduler.xml.template
- share/apache-spark/conf/log4j2-json-layout.properties.template
- share/apache-spark/conf/log4j2.properties.template
- share/apache-spark/conf/metrics.properties.template
- share/apache-spark/conf/spark-defaults.conf.template
- share/apache-spark/conf/spark-env.sh.template
- share/apache-spark/conf/workers.template
- share/apache-spark/examples/jars/scopt_2.13-3.7.1.jar
- share/apache-spark/examples/jars/spark-examples_-.jar
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/JavaHdfsLR.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/JavaLogQuery.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/JavaPageRank.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/JavaSparkPi.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/JavaStatusTrackerDemo.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/JavaTC.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/JavaWordCount.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaAFTSurvivalRegressionExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaALSExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaBinarizerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaBisectingKMeansExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaBucketedRandomProjectionLSHExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaBucketizerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaChiSqSelectorExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaChiSquareTestExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaCorrelationExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaCountVectorizerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaDCTExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaDecisionTreeClassificationExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaDecisionTreeRegressionExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaDocument.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaElementwiseProductExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaEstimatorTransformerParamExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaFMClassifierExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaFMRegressorExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaFPGrowthExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaFeatureHasherExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaGaussianMixtureExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaGeneralizedLinearRegressionExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaGradientBoostedTreeClassifierExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaGradientBoostedTreeRegressorExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaImputerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaIndexToStringExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaInteractionExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaIsotonicRegressionExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaKMeansExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaLDAExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaLabeledDocument.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaLinearRegressionWithElasticNetExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaLinearSVCExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaLogisticRegressionSummaryExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaLogisticRegressionWithElasticNetExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaMaxAbsScalerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaMinHashLSHExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaMinMaxScalerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaModelSelectionViaCrossValidationExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaModelSelectionViaTrainValidationSplitExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaMulticlassLogisticRegressionWithElasticNetExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaMultilayerPerceptronClassifierExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaNGramExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaNaiveBayesExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaNormalizerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaOneHotEncoderExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaOneVsRestExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaPCAExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaPipelineExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaPolynomialExpansionExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaPowerIterationClusteringExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaPrefixSpanExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaQuantileDiscretizerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaRFormulaExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaRandomForestClassifierExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaRandomForestRegressorExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaRobustScalerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaSQLTransformerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaStandardScalerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaStopWordsRemoverExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaStringIndexerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaSummarizerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaTargetEncoderExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaTfIdfExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaTokenizerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaUnivariateFeatureSelectorExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaVarianceThresholdSelectorExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaVectorAssemblerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaVectorIndexerExample.java
- share/apache-spark/examples/src/main/java/org/apache/spark/examples/ml/JavaVectorSizeHintExample.java
The first 100 are listed.
distinfo 5
| File | Size | SHA256 |
|---|---|---|
| spark-4.2.0.tgz | 5.0578388e+07 | 6e7be4c3eee79903ed6c413f434fb2526b7ccd031f1f99a8db5c24cc5f66e8cd |
| protobuf-29.6.tar.gz | 9.340881e+06 | 877bf9f880631aa31daf2c09896276985696728137fcd43cc534a28c5566d9ba |
| abseil-cpp-20250127.1.tar.gz | 2.267282e+06 | b396401fd29e2e679cace77867481d388c807671dc2acc602a0259eeb79b7811 |
| spark-4.2.0-deps.tgz | 1.389906598e+09 | 48fa0cc807182144e394f2cca223e54d53771924c98b403fc63654cc879bdbc5 |
| grpc-grpc-java-v1.76.0_GH0.tar.gz | 3.306002e+06 | 8c7ec45c35b0956044041799f7a028ccf76eb6c1fc8bde7bb3fcd8d896eb7b70 |
Master sites 3
- https://archive.apache.org/dist/spark/spark-4.2.0/
- https://github.com/protocolbuffers/protobuf/releases/download/v29.6/:protobuf
- https://github.com/abseil/abseil-cpp/releases/download/20250127.1/:abseil
Commit history 2
| Date | Commit | Credits | Log message |
|---|---|---|---|
8017e59ed4 |
Martin Filla | devel/spark: Update 3.3.4 => 4.2.0 Release Notes:
https://spark.apache.org/releases/spark-release-4-2-0.html
PR: 299311
Sponsored by: UNIS Labs (vvd, commit patch) |
|
e1a98853b2 |
Martin Filla | devel/spark: Update Enable only for java 8 and 11 Spark with Java 17 has a lot of build crashes on FreeBSD.
While here replace PORTVERSION with DISTVERSION.
PR: 296715
Sponsored by: UNIS Labs
Co-authored-by: Vladimir Druzenko <[email protected]>
MFH: 2026Q3 |