package java
Spark Java programming APIs.
- Alphabetic
- By Inheritance
- java
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Type Members
- class JavaDoubleRDD extends AbstractJavaRDDLike[Double, JavaDoubleRDD]
- trait JavaFutureAction[T] extends Future[T]
-
class
JavaHadoopRDD[K, V] extends JavaPairRDD[K, V]
- Annotations
- @DeveloperApi()
-
class
JavaNewHadoopRDD[K, V] extends JavaPairRDD[K, V]
- Annotations
- @DeveloperApi()
- class JavaPairRDD[K, V] extends AbstractJavaRDDLike[(K, V), JavaPairRDD[K, V]]
- class JavaRDD[T] extends AbstractJavaRDDLike[T, JavaRDD[T]]
-
trait
JavaRDDLike[T, This <: JavaRDDLike[T, This]] extends Serializable
Defines operations common to several Java RDD implementations.
Defines operations common to several Java RDD implementations.
- Note
This trait is not intended to be implemented by user code.
-
class
JavaSparkContext extends Closeable
A Java-friendly version of org.apache.spark.SparkContext that returns org.apache.spark.api.java.JavaRDDs and works with Java collections instead of Scala ones.
A Java-friendly version of org.apache.spark.SparkContext that returns org.apache.spark.api.java.JavaRDDs and works with Java collections instead of Scala ones.
Only one SparkContext may be active per JVM. You must
stop()
the active SparkContext before creating a new one. This limitation may eventually be removed; see SPARK-2243 for more details. -
class
JavaSparkStatusTracker extends AnyRef
Low-level status reporting APIs for monitoring job and stage progress.
Low-level status reporting APIs for monitoring job and stage progress.
These APIs intentionally provide very weak consistency semantics; consumers of these APIs should be prepared to handle empty / missing information. For example, a job's stage ids may be known but the status API may not have any information about the details of those stages, so
getStageInfo
could potentially returnnull
for a valid stage id.To limit memory usage, these APIs only provide information on recent jobs / stages. These APIs will provide information for the last
spark.ui.retainedStages
stages andspark.ui.retainedJobs
jobs.- Note
This class's constructor should be considered private and may be subject to change.
- final class Optional[T] extends Serializable
- class StorageLevels extends AnyRef
Value Members
- object JavaDoubleRDD extends Serializable
- object JavaPairRDD extends Serializable
- object JavaRDD extends Serializable
- object JavaSparkContext