[repost ]Spark Cluster Mode Overview

original:http://spark.incubator.apache.org/docs/latest/cluster-overview.html This document gives a short overview of how Spark runs on clusters, to make it easier to understand the components involved. Components Spark applications run as independent sets of processes on a cluster, coordinated by the SparkContext object in your main program (called thedriver program). Specifically, to run on a cluster, the SparkContext can [...]



via WordPress http://blog.newitfarmer.com/big_data/big-data-production/spark/13256/repost-spark-cluster-mode-overview#utm_source=rss&utm_medium=rss&utm_campaign=repost-spark-cluster-mode-overview