Setup command line tools and Node
On Mac, using Homebrew:
On Linux, using apt:
Make sure git is version 1.8.x or greater installed on your machine:
Git clone the CDAP repository and the Hydrator plugins:
Now build using maven:
If you get compile errors similar to this one:
this is likely due to the version of maven that does not work properly with latest Java versions. Upgrading to maven 3.6.1 will most likely fix the problem.
If you encounter an error like this one
Run this to update the submodule
Please refer to Build System & CI for more details on building CDAP.
Build and run Local Standalone CDAP
Follow the steps above to build CDAP and install it to the local maven repository. Then cd out of the cdap directory and clone hydrator-plugins:
Build the plugins:
note: --remote pulls the latest versions of every submodule, rather than the versions locked in the hydrator-plugins git. This is intentional.
If you run into errors like this
You may need to run the following command in your CDAP directory and then try to build hydrator plugins again
Then cd out of hydrator-plugins back to the cdap directory, and build the CDAP sandbox, including the plugins:
If you're on a mac you would do ```export HYDRATOR_PLUGINS=[path-to-hydrator-plugins]``` with the full path instead of the above variable assignment otherwise it won't be able to find the hydrator plugins.
- The UI runs on localhost:11011
- Wrangle a sample file, build a pipeline, run it.
- Download the IntelliJ Community Edition from http://www.jetbrains.com/idea/download/
- Import settings into IntelliJ as explained here:
- Coding Standards
- Set Imports: Preferences -> Code Style -> Java -> Imports. Uncheck "Use fully qualified class names in javadocs"
Creating an IntelliJ project
- Clone the CDAP project, if not done already
git clone email@example.com:cdapio/cdap.git
- Open IntelliJ and import the CDAP project
- Go to menu
File -> Import Project ...
- Select the
pom.xmlunder the CDAP directory
Import Maven projects automaticallyand
Automatically download: Sources, Documentationsboxes in the
Import Project from Mavenpopup.
- Click next and the new CDAP project will be created.
- Go to menu
Setting up Checkstyle in IntelliJ
For more information on the rules enforced by checkstyle, see Java Coding Standards.
Setting up Auto Copyright Header in IntelliJ
In IntelliJ, do this:
- Go to menu
IntelliJ IDEA -> Preferences…
- Expand the
Copyrightsetting on the left (under
Copyright Profilesand add a new Copyright Profile (there is a
+button in the top-middle)
- Give the profile a name (e.g. Cask Apache v2)
Paste the following text to the Copyright text box
- In the
Allow replacing copyright if old copyright containsbox, enter
- Click on
Copyrighton the left again and add a new scope of
Allwith the copyright profile added in above step.
- Note: if there is an existing copyright in a file, and you are modifying the file (rather than completely replacing it), extend the copyright rather than replacing it:
"Copyright © 2014" becomes Copyright © 2014-2016" (or similar).