EMR tensorboard

  1. 在Header上启动tensorboard

ssh root@39.104.103.119 # login to header
source $HADOOP_HOME/libexec/hadoop-config.sh
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$JAVA_HOME/jre/lib/amd64/server
CLASSPATH=$($HADOOP_HDFS_HOME/bin/hadoop classpath --glob) tensorboard --logdir=hdfs:///user/experiments/mnist_train_v2 --port 6006

  1. 通过SSH隧道方式建立代理

# 在mac上执行
ssh -N -D 8157 root@39.104.103.119
/Applications/Google\ Chrome.app/Contents/MacOS/Google\ Chrome  --proxy-server="socks5://localhost:8157" --host-resolver-rules="MAP * 0.0.0.0 , EXCLUDE localhost" --user-data-dir=/tmp/

  1. 在浏览器中输入: http://emr-header-1:6006/