[Java] publishing nightly snapshot java artifacts to maven repo

[asfimport]

The Snapshot repository doesn't seem to be getting any recent snapshot builds. Could this be established for the sake of easier integration?

Environment: CI
Reporter: Antony Mayi / @antonymayi

Related issues:

• issue with current version of git-commit-id-plugin (depends upon)

Original Issue Attachments:

• arrow_development_deploy.xml

_{Note: This issue was originally created as ARROW-1234. Please see the migration documentation for further details.}

[asfimport]

Wes McKinney / @wesm:
Sounds like a good idea to me. I am sure that the Spark developers (among others) would like to more easily run continuous integration against development versions of Arrow. cc @BryanCutler [~holdenkarau]

[asfimport]

Antony Mayi / @antonymayi:
The way to configure this is using the ASF Jenkins (some notes here). The deploy goal would then follow the configuration based on the ASF Publishing Maven Artifact HOWTO to push the snapshots to the repo.

[asfimport]

Antony Mayi / @antonymayi:
Proposing arrow_development_deploy.xml Jenkins job configuration that should do that job. I don't have ASF access myself to configure it in the https://builds.apache.org/ but for someone who can do the procedure should be:

$ curl -o /tmp/jenkins-cli.jar http://builds.apache.org:8080/jnlpJars/jenkins-cli.jar
$ java -jar /tmp/jenkins-cli.jar -s http://<user>:<pass>@builds.apache.org:8080 create-job Arrow_Development_Deploy < /tmp/arrow_development_deploy.xml

Things that might need tweaking:
Go to https://builds.apache.org/job/Arrow_Development_Deploy/configure in the Build section towards the bottom select existing Maven Version from the dropdown (depends on the Jenkins setup)

[asfimport]

Antony Mayi / @antonymayi:
Note this wont work until ARROW-1239 is resolved (PR 869 gets merged).

[asfimport]

Li Jin / @icexelloss:
@antonymayi, I can also help with this. I don't want to duplicate the work if you are ready working on this, but if is there is anything I can help, please let me know. Is there maybe a branch for what you got so far?

[asfimport]

Li Jin / @icexelloss:
I was trying to figure out permission issues such as what account has permission to publish to ASF repo and what account has permission to access ASF jenkins to set up the job. Maybe @julienledem can shed some light?

[asfimport]

Wes McKinney / @wesm:
I believe you need to be a PMC or Committer to set this up.

[asfimport]

Antony Mayi / @antonymayi:

Thanks for stepping up. From my understanding, the jenkins config Antony proposed checks out arrow from github and then run "mvn clean deploy" under java, which will publish snapshot artifacts to https://repository.apache.org/content/repositories/snapshots.

Antony, do you have some comments?

Li

Correct, the parent Apache POM defines the deployment to this ASF repository plus the ASF Jenkins instance is privileged to deploy into that repository so the proposed jenkins config is a daily scheduled job to simply pull master from github and running the deploy - that's all to do the trick I believe...