Configure your Giraph Job

Step 1:
Choose your Hadoop Setup

Where have you downloaded the Okapi jar?

Where have you downloaded the Giraph jar?

Step 2:
What do you want to Run?

{{algorithmGroup.name}}

Step 3:
Pick your Input

The HDFS directory that contains your edge-based input graph.

  • {{inputClass}}

The HDFS directory that contains your vertex-based input graph.

  • {{inputClass}}

Step 4:
Pick your Output

The HDFS directory to write the output

  • {{outputClass.name}} ({{outputClass.type | limitTo:1 | uppercase}})

Step 5:
Optimize your Job

The number of workers to start.

Memory to allocate per worker (e.g. 10M/500M/1G)

Memory to allocate per worker (e.g. 10M/500M/1G)

Step 6:
Zookeepeer Settings (synchronization)

Setting the Zookeeper is required for your distribution.
Please specify it below
Setting the Zookeeper is NOT required for your distribution.
Optionally specify it below

External Zookeeper instance (e.g. zkNode.net:2181)

Step 7:
Advanced Settings: Optional Parameters

http://giraph.apache.org/options.html

Out-of-core

If using out-of-core messaging, it tells how much messages do we keep in memory. (Default 1000000)


Messaging


Others

You're missing several required configuration parameters.

Just copy-paste the following command line argument

HADOOP_CLASSPATH={{configureData.okapiJarLocation | applyJarClassPathTransformation:configureData.selectedComputation}}:{{configureData.giraphJarLocation | applyJarClassPathTransformation:configureData.selectedComputation}} hadoop jar {{configureData.okapiJarLocation | applyOkapiJarTransformation:configureData.selectedComputation:configureData.okapiGiraphSeparate:downloads }}{{configureData.giraphJarLocation | applyGiraphJarTransformation }} org.apache.giraph.GiraphRunner -libjars {{configureData.okapiJarLocation | applyOkapiJarTransformation:configureData.selectedComputation:configureData.okapiGiraphSeparate:downloads }},{{configureData.giraphJarLocation | applyGiraphJarTransformation }} {{configureData.selectedAlgorithm.computationClass}} -mc {{configureData.selectedAlgorithm.masterComputeClass}} -eip {{configureData.edgeInputPath}} -vip {{configureData.vertexInputPath}} -eif {{configureData.selectedEdgeInputClass}} -vif {{configureData.selectedVertexInputClass}} -op {{configureData.outputPath}} -eof {{configureData.selectedOutputClass.name}} -vof {{configureData.selectedOutputClass.name}} -w {{configureData.numberWorkers}} -ca mapred.child.java.opts="-Xmx {{configureData.mmxMemory}}" -ca mapred.child.java.opts="-Xms {{configureData.mmsMemory}}" -yh {{configureData.yarnMaxMemory}} -ca giraph.zkList="{{configureData.zookeeperInstance}}" -ca giraph.useOutOfCoreGraph=true -ca giraph.isStaticGraph=true -ca giraph.useOutOfCoreMessages=true -ca giraph.maxMessagesInMemory={{configureData.maxMessagesInMemory}} -ca giraph.oneToAllMsgSending=true -yj {{configureData.okapiJarLocation | applyOkapiJarTransformation:configureData.selectedComputation:configureData.okapiGiraphSeparate:downloads | basename}},{{configureData.giraphJarLocation | applyGiraphJarTransformation | basename}} {{configureData.selectedAlgorithm.customParameters}} {{configureData.customParameters}}