Hi Anindya, You can very much run map-reduce job on A4AH (Analytic's for Apache Hadoop service). Follow the steps below: 1) Create an Oozie workflow with map-reduce action, configure map-reduce action to user your mapper and reducer classes. For more details on Oozie MR action follow this link- https://oozie.apache.org/docs/3.2.0-incubating/WorkflowFunctionalSpec.html#a3.2.2_Map-Reduce_Action

2) Submit the job created above to the Oozie server via Oozie Rest APIs- curl --user biblumix:password_for_your_provisioned_cluster -X POST -H "Content-Type: application/xml" -d @config.xml "https://hostname_of_your_provisioned_cluster:8443/gateway/default/oozie/v1/jobs?action=start"

Here is a sample config.xml:

user.name biblumix

jobTracker mn01.services.dal.bluemix.net:8050

oozie.wf.application.path hdfs://path/to/your/oozie/application

queueName default

nameNode hdfs://mn01.services.dal.bluemix.net:8020

3) Track progress of the submitted job curl --user biblumix: https://hostname_of_your_provisioned_cluster:8443/gateway/default/oozie/v1/jobs?jobtype=wf

Note: For more details on Oozie Rest API refer this link- https://oozie.apache.org/docs/3.1.3-incubating/WebServicesAPI.html#Job_and_Jobs_End-Points Cheers Dharmesh

[1]: https://oozie.apache.org/docs/3.2.0-incubating/WorkflowFunctionalSpec.html#a3.2.2_Map-Reduce_Action

For more details on uploading and working with uploaded data, refer this link- https://www.ng.bluemix.net/docs/services/AnalyticsforHadoop/index.html#analyticsforhadoop_working

Cheers Dharmesh

Hello.

I can't upload data to HDFS by following the instructions to use the webHDFS interface.

I first got the temporary redirect address by executing this:

curl --user "biblumix:XXXXXXXX" -i -X PUT -T messages https://bi-hadoop-prod-2327.services.dal.bluemix.net:8443/gateway/default/webhdfs/v1/user/biblumix/apps/map-reduce/?op=CREATE

And got the following redirect address: Location: https://bi-hadoop-prod-2327.services.dal.bluemix.net:8443/gateway/default/webhdfs/data/v1/webhdfs/v1/user/biblumix/apps/map-reduce?_=AAAACAAAABAAAACg340D-sTpzl1swuxJvKfoGwPRi0LW66Hz14Peh9pUt6hWCHQRdYve3o9_QSF8EI8CkQto_2SMoHXq9hNaPbrVAWhTlKQpwCqpwvDKkHIANmHbpPdsNUgOdL3o81dKLUH7y5LAs6iHPlh8NEPY8xk1rAvBhROy-_2aCERkFlPRR87Yt6byONX2iLYlpy2MS7K1TbDzgSHN9YgdQRpE1vMxT2V2ElRdRwYJ_ErehmRJO90-roshXafz4w

Then when I try to upload using that address I get the following:

curl --user "biblumix:XXXXXXXX" -i -X PUT -T messages https://bi-hadoop-prod-2327.services.dal.bluemix.net:8443/gateway/default/webhdfs/data/v1/webhdfs/v1/user/biblumix/apps/map-reduce?op=CREATE

HTTP/1.1 500 Server Error Set-Cookie: JSESSIONID=1xp71rnruke4j5gg6b9tr9mce;Path=/gateway/default;Secure;HttpOnly Content-Length: 0 Server: Jetty(8.1.14.v20131031)

Why am I getting error 500 when I try to upload a file to HDFS ?