访问https://www.scala-sbt.org/download.html
下载安装包sbt-1.3.10.zip,如果网络原因下载慢可以从 https://ww.lanzous.com/icrmh8b 下载
wget https://piccolo.link/sbt-1.3.10.zip
解压
unzip sbt-1.3.10.zip
之后会有一个sbt文件夹
在用户主目录下创建.sbt
文件夹,在新建repositories
文件
cd
mkdir .sbt
vim .sbt/repositories
repositories
文件内容如下
[repositories]
local
huaweicloud-maven: https://repo.huaweicloud.com/repository/maven/
maven-central: https://repo1.maven.org/maven2/
sbt-plugin-repo: https://repo.scala-sbt.org/scalasbt/sbt-plugin-releases, [organization]/[module]/(scala_[scalaVersion]/)(sbt_[sbtVersion]/)[revision]/[type]s/[artifact](-[classifier]).[ext]
编辑sbt目录下的conf目录中的sbtconfig.txt
,添加如下内容-Dsbt.override.build.repos=true
vim conf/sbtconfig.txt
-Dsbt.override.build.repos=true
切换到sbt下执行
./bin/sbt sbtVersion
如果执行长时间无反应,可以尝试把https://ww.lanzous.com/icrptmf 的.ivy2.tar 解压覆盖到用户主目录
新建一个项目,新建simple.sbt
name := "Simple Project"
version := "1.0"
scalaVersion := "2.11.8"
libraryDependencies += "org.apache.spark" %% "spark-core" % "2.1.0"
新建src/main/scala/SimpleApp.scala
/* SimpleApp.scala */
import org.apache.spark.SparkContext
import org.apache.spark.SparkContext._
import org.apache.spark.SparkConf
object SimpleApp {
def main(args: Array[String]) {
val logFile = "file:///usr/local/spark/README.md" // Should be some file on your system
val conf = new SparkConf().setAppName("Simple Application")
val sc = new SparkContext(conf)
val logData = sc.textFile(logFile, 2).cache()
val numAs = logData.filter(line => line.contains("a")).count()
val numBs = logData.filter(line => line.contains("b")).count()
println("Lines with a: %s, Lines with b: %s".format(numAs, numBs))
}
}
打包
../bin/sbt package
编译成功后在jar包在target/scala-2.11目录下
原文:https://www.cnblogs.com/lzyuid/p/12912187.html