Ubuntu 14.04.3 LTS下安装Spark环境

安装java

$apt-get install default-jre
$apt-get install default-jdk

安装Scala

下载地址： http://www.scala-lang.org/

$mkdir /usr/loca/scala
$cd /usr/loca/scala
$wget http://downloads.typesafe.com/scala/2.11.7/scala-2.11.7.tgz
$tar zxvf scala-2.11.7.tgz
$cd scala-2.11.7
$mv * ../
$cd -

在 /etc/profile中添加

$export PATH=/usr/loca/scala/bin:$PATH

重启电脑，使/etc/profile永久生效

测试scala是否安装成功

$scala -version
$Scala code runner version 2.11.7 -- Copyright 2002-2013, LAMP/EPFL

下载Spark

下载地址：http://spark.apache.org/downloads.html

选择Spark版本

$mkdir /usr/loca/spark
$cd /usr/loca/spark
$wget http://apache.fayea.com/spark/spark-1.5.1/spark-1.5.1-bin-hadoop2.6.tgz
$cd spark-1.5.1-bin-hadoop2.6
$mv * ../
$cd -

启动Spark

启动成功

启动Pyspark

启动成功