## Monitoring in NEU Env Now we have four VMs set up for monitoring in NE environment. Three VMs are set up on compute node 39, and one VM is set up on Haas master to collect data from IPMI. In order to log into those machines, you will first need send an email to Hua Li(lihua88@bu.edu) with your public ssh key and your preferred username on the VMs. He will add you as a user of the VMS. ### Monitor VMs on Haas Master We've set up a sensu on a VM that is located on Haas Master. This VM have access to the IPMI network. 1. **Log on to Haas Master** You can click [here](Accessing-Northeastern-Cluster.html) for information about logging into Haas Master. 1. **Log on to the VM** ```shell $ ssh -A @192.168.122.147 ``` Now this VM is not set up with the network that can talk to our database -- influxdb. We need to do more configuration on this. ### Monitor VMs on compute 39 - **Sensu, InfluxDB, Grafana** 1. **Log on to the VM** `ssh @129.10.5.55` 1. **Uchiwa Dashboard** Uchiwa Dashboard shows all the checks of sensu and the status of the services/physical nodes that Sensu is monitoring. The webpage is `129.10.5.55:3000` The username and password is in uchiwa.json. See bitwarden Uchiwa password. 1. **InfluxDB Dashboard** InfluxDB is the database in which data collected by Sensu is stored. You can visit it at `129.10.5.55:8083` See bitwarden InfluxDB password. Port settings `8086` 1. **Grafana** Grafana is the visualization tool which utilize the data in InfluxDB directly. You can visit it at `129.10.5.55:3033` ```shell Admin user: see bitwarden Grafana Admin password Guest user: see bitwarden Grafana Guest password ``` More about sensu, influxDB, and Grafana can be viewed here: [Sensu](../../monitoring/Sensu.html),[InfluxDB & Grafana](../../monitoring/Influx-Grafana.html) - **Logstash, ElasticSearch and Kibana** 1. **Log on to the VM** `ssh -A @10.13.37.99` 1. **Check the status** Instances of logstash and elasticsearch running on screen. To list all the screens, run `screen -ls`. To list a running screen, run `screen -x ` *Note: No need to do this unless to check if they’re running, restart them with different config or stop them* 1. **Check if elastic search is running** `curl 10.13.37.99:9200` 1. **Kibana** Kibana is the dashboard for the logs. It can be visited at `10.13.37.99:5601` ### Ceilometer 1. **Log on to the VM** `ssh @129.10.3.56` 1. **MongoDB** Ceilometer use MongoDB as its default database. You can access MongoDB using the following command `mongo 10.13.37.91` (ip address is needed) More about Ceilometer Installation can be viewed [here](../../monitoring/Ceilometer-Installation-in-NE-Env.html) ### Log on to VMs through compute 39 You can also log on to the VMs first by logging on to compute 39 and then use the internal IPs of each VM. But it is not recommended. ```shell ssh -A -D @129.10.3.39 ssh -A @ ``` - **Internal IPs are** - **moc-ceilometer** : 10.13.37.91 - **moc-sensu** : 10.13.37.98 - **Logstash** : 10.13.37.99