23 Dec 2010 12:59
hadoop (0.20.1) integration with GE 6.2u5
chambon <chambon <at> cc.in2p3.fr>
2010-12-23 11:59:07 GMT
2010-12-23 11:59:07 GMT
Hello,
I try to setup hadoop with GE 6.2u5
I carefully follow the process as described in "Beta Testing the Sun Grid Engine Hadoop Integration"
(for that matter, I can confirm that it's ok with hadoop 0.20.1 and I can't compile (classpath problem) with
hadoop 0.20.2)
Every thing was ok, until I try to run the Loadsensor
With "setup.pl -i", complex and PE were created, but loadsensor wasn't lauched
If I 'manually' run load_sensor.sh, nothing happens (the script exit immediately)
Looking inside load_sensor.sh, if I try :
> hadoop --config $HADOOP_CONF_DIR com.sun.grid.herd.HerdLoadSensor `hostname`
Exception in thread "main" java.lang.NoClassDefFoundError: com/sun/grid/herd/HerdLoadSensor
Caused by: java.lang.ClassNotFoundException: com.sun.grid.herd.HerdLoadSensor
If I set the jar path (jar $SGE_ROOT/lib/herd.jar), I got a NullPointerException
> hadoop --config $HADOOP_CONF_DIR jar $SGE_ROOT/lib/herd.jar com.sun.grid.herd.HerdLoadSensor `hostname`
Dec 23, 2010 11:59:28 AM com.sun.grid.herd.HerdLoadSensor run
INFO: Started Herd load sensor
Dec 23, 2010 11:59:28 AM com.sun.grid.herd.HerdLoadSensor main
WARNING: Error while running command: java.lang.NullPointerException
at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:134)
As someone encountered the same failure ?
Best regards
Bernard CHAMBON
(Continue reading)
RSS Feed