- Kafka Manager is on the port
10900
- OpenTSDB is on port
4242
- Grafana Server is on port
3000
- Spark Web UI is on port
8080
- Jupyter is on port
9000
Red PNDA currently doesn't include the services which provide those functionalities.
Please execute this command on the VM terminal.
bash /opt/pnda/zk-opentsdb-restart.sh
Restarting Zookeeper should fix the problem. You should see Kafka turning back to green after a minute.
If you have built a jar containing all the necessary libs, you can simply scp the jar to the VM and run it with the spark-submit
command.
All component logs are generally available at /var/log/
for debugging purposes.
However, hbase logs are at /usr/local/hbase-1.2.0/logs/
directory.
OpenTSDB might be a bit finicky sometimes, run this script to restart zk and opentsdb. 98% of the times it solves the problem
bash /opt/pnda/zk-opentsdb-restart.sh
We've noticed that as well and are currently investigating what's causing this. Not sure if it's caused by the system being on idle state for too long.
For now, the best thing to do is to reboot the VM.
We are currently running Ubuntu 14.04 but its not advisable to upgrade the OS to the newer version as several init scripts won't run as expected i.e. please refrain from doing a sudo apt-get upgrade
But sudo apt-get update
should be fine and shouldn't cause any issues.