wip/py-pyspark 3.0.1 NetBSD

Apache Spark Python API

System: NetBSD
Repository: pkgsrc-wip
Maintainer: [email protected]
License: apache-2.0
Categories: wip, devel, python

Description

Spark is a unified analytics engine for large-scale data processing. It provides high-level APIs in Scala, Java, Python, and R, and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing.

Install

From pkgsrc-wip (no binary package):

cd /usr/pkgsrc/wip/py-pyspark && make install clean

Dependency graph

Ports that need it on the left, what it needs to run on the right; at most 8 of each. "Dependencies" below lists them all.

graph LR
  me["wip/py-pyspark"]
  me --> d0["math/py-numpy"]
  me --> d1["math/py-pandas"]
  me --> d2["wip/py-py4j"]
  classDef this fill:#ab2b28,color:#ffffff,stroke:#ab2b28
  class me this

Dependencies

Run dependencies 3

No port depends on this one.