Spark源代码编译生成全攻略
关键字: xmpp
本文来源:http://bookbookpicture.spaces.live.com/blog/cns!68F3076C3C3DA5EB!671.entry
其实关于这个问题在Spark的官网www.igniterealtime.org上有很详尽的介绍,因此本文大部分内容是从英文文档引用而来的,其中还有一些个人的经验。
Spark源代码:下载地址
想了解更多关于"Spark"的文章,请点击这里.
<!--[if !supportLists]-->1. <!--[endif]-->安装JDK
这个不用说了,注意版本,最少要1.5,推荐使用
<!--[if !supportLists]-->2. <!--[endif]-->安装Eclipse3.3
a) 从官网下载Eclipse 3.3 (对Java开发者用的)
b) 假设你把eclipse安装在c:/program files/eclipse,进入这个文件夹,为eclipse.exe创造一个桌面图标,右击这个图标,选择“属性”,打开属性对话框,在“目标”的输入框里,输入如下
"C:/Program Files/Eclipse/eclipse.exe" -vm
"C:/Program Files/Java/jdk1.6.0/bin/javaw"
熟悉eclipse的都知道这是为eclipse指定使用哪个Java VM。
<!--[if !supportLists]-->3. <!--[endif]-->为eclipse安装Subversive插件
a)用上面建的图标打开eclipse,下面开始安装Subversive插件,由于我用的是英文版的ecplipse,
下面的菜单我都用英文。
b) 点击Help::Software Updates::Find and
Install...
c)点击 Search for new features to install ,点Next
d)点New Remote Site... 按钮
e)在name的输入框里输入Subversive,并且在URL输入框里输入
http://www.polarion.org/projects/subversive/download/1.1/update-site
(最新的Subversive地址上http://www.eclipse.org/subversive查询)
f)点击Finish,开始安装Subversive,eclipse将搜索网站,并且在下一个窗口中显示你想安装的功能
选择安装Subversive SVN Team Provider Plugin 和Subversive Client Libraries下面所有的功能
g) 点Next,eclipse开始安装过程,安装结束后重启eclipse。
<!--[if !supportLists]-->4. <!--[endif]-->利用svn方式下载spark代码
a)点击如下Windows::Open Perspective::Other...
b)弹出一个“Open Perspective”对话框,选择“SVN Repository Exploring”,单击OK
c)这是eclipse界面发生变化,在左边的“ SVN Repositories”面板上,右击鼠标
选择New::Repository Location...
d)在“New Repository
Location”的位置输入
“http://svn.igniterealtime.org/svn/repos”,单击 “Finish”
e)在SVN Repositories面板上,会发生变化,展开它,找到spark的选项,右击
spark下面的trunk项,选择“Check Out”,下载spark的代码。
f)下载完成后,选择Window::Open Perspective::Java,在Project Explorer面板上,
看到Spark项目,删掉它,在弹出来的对话框中选择“Do not delete contents”
在工作目录下面找到spark文件夹,里面就是spark的源代码。
注:也可以不要这么麻烦,我在上面提供了一个链接,可以直接下载Spark源代码,上面的步骤都
可以省了.
<!--[if !supportLists]-->5. <!--[endif]-->创建Spark项目
1)点击Window::Open Perspective::Java菜单
2)在Project Explorer窗口中,如果有spark这个项目,把它删了,删除时,会问你要不要删除
文件,选择不要.
3)选择File::New::Project...,再选择Java::Java Project,在New Java Project窗口选择
"Create project from existiing source",然后把spark文件所在的文件夹加进去.
4)在"project name"中输入spark,要和文件夹的名字相同.
5)点Finish.
<!--[if !supportLists]-->6. <!--[endif]-->生成Spark
1)点击Window::Show View::Ant
2)右击Ant面板,选择Add Buildfiles
3)展开spark::build文件夹,选择build.xml,点击"OK"
4)在Ant面板,展开Spark,双击"release",等一段时间,会提示"Build Successful".
<!--[if !supportLists]-->7. <!--[endif]-->Create Project Builder
1)点击Run::Open Debug Dialog...,出现"Run"窗口
2)选择"Java Application",点击"New"按钮.
3)在"Main"标签页,将New_configuration换成Spark或其它的这个无所谓.
4)点击Project::Browse按钮,选择Spark,再点OK.
5)点击Main class::Search按钮,选择main所在的类Startup-org.jivesoftware.launcher,
再点击OK
6)建议勾选Stop in main.
7)点击Classpath标签页,选择User Entries ,使得Advanced..按钮变的可用.点击Advanced
按钮.
8)在弹出来的Advanced Options窗口,选择Add Folders,再点OK,在Folder Selection窗口
选择spark::src::resources 文件夹,点击OK
9)选择Common标签页,勾选Debug,Run前面的框
10)点击Apply,再点击Close
<!--[if !supportLists]-->8. <!--[endif]-->Run/Debug
点击Run::Open Run
Dialog..,在弹出的对话框选择Spark,然后点Run就行了.
英文文档来源:http://www.igniterealtime.org/community/docs/DOC-1040
英文文档如下:
This guide assumes that you are installing everything
from scratch. If you've done some parts of them, this guide may still be
useful. I compile this guide to the best of my knowledge. I apologize if it
doesn't work for you.
Notes:
<!--[if !supportLists]-->·
<!--[endif]-->This guide assumes that you want the latest updates of the
source i.e. from the project'strunkdirectory. If you only want the
released/stable version, checkout the desired release from under
thetagsdirectory.
Install JDK
<!--[if !supportLists]-->·
<!--[endif]-->Download JDK and install them. The least version should
be 1.5. I use 1.6. Sorry, no instruction for this.
Install Eclipse 3.3
<!--[if !supportLists]-->·
<!--[endif]-->Download Eclipse 3.3 from www.eclipse.org. I useEclipse
IDE for Java EE Developers. You should at least useEclipse
IDE for Java Developers.
<!--[if !supportLists]-->·
<!--[endif]-->Extract the downloaded zip file intoC:/Program
Files/Eclipse.
<!--[if !supportLists]-->·
<!--[endif]-->OpenC:/Program Files/Eclipsefolder.
<!--[if !supportLists]-->·
<!--[endif]-->Right click and drageclipse.exeon to your desktop (or Windows taskbar) to
create a shortcut icon.
<!--[if !supportLists]-->·
<!--[endif]-->Right click the shortcut icon and chooseProperties. TheEclipse
Propertieswindow will show.
<!--[if !supportLists]-->·
<!--[endif]-->TheTargettextbox should read something like this"C:/Program
Files/Eclipse/eclipse.exe" -vm "C:/Program
Files/Java/jdk1.6.0/bin/javaw"depending on the JDK that you use and
where you installed it.
<!--[if !supportLists]-->·
<!--[endif]-->Close theEclipse Propertieswindow.
Install Subversive Plugin
<!--[if !supportLists]-->·
<!--[endif]-->Double-click the shortcut icon to start Eclipse.
<!--[if !supportLists]-->·
<!--[endif]-->Select/enter your preferred workspace and clickOKto open Eclipse main IDE window.
<!--[if !supportLists]-->·
<!--[endif]-->Click on theWorkbenchicon to close the welcome screen.
<!--[if !supportLists]-->·
<!--[endif]-->ClickHelp::Software Updates::Find and
Install...menu.
<!--[if !supportLists]-->·
<!--[endif]-->Click onSearch for new features to
installand clickNext.
<!--[if !supportLists]-->·
<!--[endif]-->Click onNew Remote Site...button.
<!--[if !supportLists]-->·
<!--[endif]-->EnterSubversivein theNamebox andhttp://www.polarion.org/projects/subversive/download/1.1/update-sitein the URL box (Check the latest URL fromhttp://www.eclipse.org/subversivewebsite), then clickOK.
<!--[if !supportLists]-->·
<!--[endif]-->ClickFinishto install Subversive. Eclipse will search
for the update site and show the result in a next window where you will select
the features to install. I choose everything underSubversive
SVN Team Provider PluginandSubversive Client Libraries.
<!--[if !supportLists]-->·
<!--[endif]-->ClickNextto continue and so on until the
installation ends. You normally want to restart Eclipse when the installation
ends.
Check Out Spark SVN
<!--[if !supportLists]-->·
<!--[endif]-->ClickWindows::Open
Perspective::Other...menu.
<!--[if !supportLists]-->·
<!--[endif]-->Click onSVN Repository Exploringon theOpen
Perspectivewindow and clickOK.
<!--[if !supportLists]-->·
<!--[endif]-->Right-click onSVN Repositoriesscreen and chooseNew::Repository
Location...
<!--[if !supportLists]-->·
<!--[endif]-->OnNew Repository Locationenterhttp://svn.igniterealtime.org/svn/reposin the URL box and clickFinish. You'll see the URL location in theSVN
Repositoriesscreen.
<!--[if !supportLists]-->·
<!--[endif]-->Expand the URL location.
<!--[if !supportLists]-->·
<!--[endif]-->Expand thesparktree.
<!--[if !supportLists]-->·
<!--[endif]-->Right-click ontrunkand chooseCheck Out. Make yourself some Mocha while waiting
for the checkout to complete.
Create Spark Project
<!--[if !supportLists]-->·
<!--[endif]-->ClickWindow::Open Perspective::Javamenu.
<!--[if !supportLists]-->·
<!--[endif]-->In theProject Explorerscreen, if there is asparkproject, delete it. This project was
created during the Spark check out process. Yes you read it correctly, DELETE
the project!!! Otherwise you'll have to setup your Spark development
environment manually. On theConfirm Project DeletechooseDo not
delete contents, then clickYes.
<!--[if !supportLists]-->·
<!--[endif]-->ClickFile::New::Project...Notice the ellipses!!!
<!--[if !supportLists]-->·
<!--[endif]-->SelectJava::Java Projectand clickNext.
<!--[if !supportLists]-->·
<!--[endif]-->On theNew Java Projectwindow chooseCreate
project from existing sourceand browse to wheresparkfolder is located under your workspace.
<!--[if !supportLists]-->·
<!--[endif]-->In theProjectnamebox enter exactly asspark. Otherwise, theNextandFinishbutton remain disabled. Click onNext. Eclipse will read the directory
structure to setup the environment automatically (almost) for you and you can
see what it does on the next screen. Then click onFinish.
<!--[if !supportLists]-->·
<!--[endif]-->If theOpen Associated Perspectivewindows opens, click Yes.
Build Spark
<!--[if !supportLists]-->·
<!--[endif]-->ClickWindow::Show View::Antmenu.
<!--[if !supportLists]-->·
<!--[endif]-->Right-click theAntscreen and chooseAdd
Buildfiles...
<!--[if !supportLists]-->·
<!--[endif]-->Expand thespark::buildfolder and selectbuild.xml, then clickOK.
<!--[if !supportLists]-->·
<!--[endif]-->On theAntscreen, expand theSparkand double-click onreleaseant task. The build may fail because
you're checking out the daily updates of Spark sources, which may contain bugs.
If so, wait for another day and hope that the developers discover and fix the
bug; or you might dare to fix it yourself. During this first time setup, a
successful build is necessary before you can proceed with the remaining tasks
below.
Create Project Builder
<!--[if !supportLists]-->·
<!--[endif]-->ClickRun::Open Run Dialog...orRun::Open
Debug Dialog...menu. ARunwindow shows.
<!--[if !supportLists]-->·
<!--[endif]-->SelectJava Applicationand click on theNewbutton.
<!--[if !supportLists]-->·
<!--[endif]-->On theMaintab of theRunwindow, change theNew_configurationname toSparkor anything you like.
<!--[if !supportLists]-->·
<!--[endif]-->Click onProject::Browsebutton and selectsparkand clickOK.
<!--[if !supportLists]-->·
<!--[endif]-->Click onMain class::Searchbutton and selectStartup -
org.jivesoftware.launcherand clickOK.
<!--[if !supportLists]-->·
<!--[endif]-->I'd suggest that you selectStop in
maincheck box so that
you could later verify that debugging works.
<!--[if !supportLists]-->·
<!--[endif]-->Click onClasspathtab.
<!--[if !supportLists]-->·
<!--[endif]-->SelectUser Entriesso that theAdvanced...button will be enabled.
<!--[if !supportLists]-->·
<!--[endif]-->Click on theAdvanced...button.
<!--[if !supportLists]-->·
<!--[endif]-->On theAdvanced Optionswindow selectAdd
Foldersand clickOK.
<!--[if !supportLists]-->·
<!--[endif]-->On theFolder Selectionwindow selectspark::src::resourcesfolder and clickOK.
<!--[if !supportLists]-->·
<!--[endif]-->Click onCommontab.
<!--[if !supportLists]-->·
<!--[endif]-->Select theDebugandRuncheck box.
<!--[if !supportLists]-->·
<!--[endif]-->Click onApplybutton.
<!--[if !supportLists]-->·
<!--[endif]-->Click onClosebutton.
Run/Debug
<!--[if !supportLists]-->·
<!--[endif]-->The setting is now complete for Spark.
<!--[if !supportLists]-->·
<!--[endif]-->You may test running and debugging by clicking onRun::Run
History::SparkandRun::Debug History::Sparkrespectively. If you choose the later and
if you follow this instruction closely, execution will stop in the main method
ofStartup.java.
分享到:
相关推荐
自己学习并应用Spark一段时间后,由于需要改源代码,就研究了下怎么编译源码,成功编译后,记录下了编译的步骤和遇到的问题,例如编译过程中,下载大量的依赖包,默认从国外下载,非常慢,可能要编译好几个小时,...
spark的源码部署和编译生成,本文适合于有一定JAVA开发基础的同学看,如果你尚不会配置JDK、尚不会myeclipse的基本操作,你应该先学会了这两项之后再来。
Spark源码编译 解决工作中避免出现的Bug ...● 创建一个目录克隆spark源代码 mkdir -p /projects/opensource cd /projects/opensource git clone https://github.com/apache/spark.git 详细内容见文档
基于Openfirer的IM开发在Eclipse下spark源代码部署及编译,
jdk 1.7以上哦。直接使用eclipse就可以导入了,ant编译之后,就直接可以运行。 具体情况我博客 http://blog.csdn.net/dao2012/article/details/52585152
Spark源代码在Eclipse3.5.2中的部署、编译、运行.docSpark源代码在Eclipse3.5.2中的部署、编译、运行.docSpark源代码在Eclipse3.5.2中的部署、编译、运行.doc
补丁文件包,依赖包,hive3.1.2-spark3.0.0和hive3.1.3-spark3.1.3二进制包已经全部放进该压缩
spark源码下载安装启动,包括遇到的问题,下载地址,.编译spark源码
使用hive3.1.2和spark...所以,如果想要使用高版本的hive和hadoop,我们要重新编译hive,兼容spark3.0.0。除了兼容spark3.0.0外,还将hive3.1.2的guava的版本进行了提升,和hadoop3.x保持一致,以便兼容hadoop3.1.3。
windows环境编译spark2.4.4源码环境要求环境安装源码下载源码编译注意事项后记 环境要求 操作系统环境:Windows 10(Windows7、Windows8亦可) Java版本: jdk1.8 Scala版本:2.11.0 Maven版本:3.5.4 Git版本:版本...
Apache Spark源码剖析,Apache Spark源码剖析,Apache Spark源码剖析
如果你只是想单纯的修改部分类的源码,并不需要网上教程的mvn build等操作。通过我这个教程即可
Spark1.6.1源码包,maven工程导入
Spark源代码在Eclipse中的部署、编译、运行.docSpark源代码在Eclipse中的部署、编译、运行.docSpark源代码在Eclipse中的部署、编译、运行.docSpark源代码在Eclipse中的部署、编译、运行.doc
centos7编译spark2.3v2生成安装包,需要hadoop、java8、maven环境
hbase2.3.5+spark-3.0.3源码编译包
本资源提供了一套基于Scala语言的Apache Spark源代码注释与翻译的设计源码,包含8170个文件。其中包括2245个Questionnaire文件,1297个Scala源代码文件,249个Java源代码文件,154个TXT文档,90个Python脚本文件,56...
酷玩 Spark: Spark 源代码解析、Spark 类库等。、。。。