Kaizen Networks

This documents lists out all hosts on all Kaizen VLANs.

Public Neu (VLAN 127)

  • 192.12.185.247 kzn-e.massopen.cloud emergency connection is through BU public net
  • Subnet: 129.10.5.0/24
IP Address       Hostname/Description
129.10.5.1       Router IP (on cisco switch) (Highly Available)
129.10.5.2       Router IP (on cisco switch)
129.10.5.3       Router IP (on cisco switch)
129.10.5.4       kzn-hil-client.infra.massopen.cloud
129.10.5.32      node-32 (old kaizen controller-1)
129.10.5.39      node-39 (old kaizen services box)
129.10.5.40      dns server for openshift subdomains (openapp.cloud, mocapps.cloud, massopen.cloud test subdomains)
129.10.5.41      dns server for massopen.cloud
129.10.5.47      node-47 (old kaizen controller-2)
129.10.5.48      kzn-h.infra.massopen.cloud (node-48)
129.10.5.50      Virtual IP for openstack horizon (kaizen.massopen.cloud)
129.10.5.52      Repo server
129.10.5.55      dhcp1.cnv.massopen.cloud
129.10.5.56      dhcp2.cnv.massopen.cloud
129.10.5.100     kaizen.massopen.cloud
129.10.5.101     ov1.massopen.cloud
129.10.5.102     ov2.massopen.cloud
129.10.5.103     ov3.massopen.cloud 192.12.185.247 *129.10.5.103* is local only
129.10.5.104     ovirt.massopen.cloud (Web interface)
129.10.5.105     kzn-ipmi-gw.infra.massopen.cloud
129.10.5.106     kzn-rtr.infra.massopen.cloud (for all subnets)
129.10.5.107     kzn-ssh.infra.massopen.cloud
129.10.5.108     mochat.infra.massopen.cloud (shared repo server)
129.10.5.109     kzn-nagios.infra.massopen.cloud
129.10.5.111     control1.massopen.cloud
129.10.5.112     control2.massopen.cloud
129.10.5.113     control3.massopen.cloud
129.10.5.114     wl.massopen.cloud
129.10.5.115     tld.massopen.cloud
129.10.5.116     freeipa.infra.massopen.cloud
129.10.5.117     osticket.massopen.cloud
129.10.5.118     sso2.massopen.cloud
129.10.5.119     dns.massopen.cloud
129.10.5.120     helpdeskvm.massopen.cloud
129.10.5.121     massopen.cloud
129.10.5.122     DVBackup
129.10.5.123     reports.infra.massopen.cloud
129.10.5.124     kzn-ipmi2-gw.infra.massopen.cloud
129.10.5.125     kaizen.massopen.cloud - info page and redirect to kaizenold
129.10.5.126     kumo-e.massopen.cloud
129.10.5.127     kzn-hil.massopen.cloud
129.10.5.128     kzn-ovpn.massopen.cloud
129.10.5.129     e1-emergency.massopen.cloud
129.10.5.130     neu-15-41 (for apoorve)
129.10.5.131     zabbix.massopen.cloud
129.10.5.132     freeipa2.infra.massopen.cloud
129.10.5.133     rz.massopen.cloud (Research Zabbix)
129.10.5.134     mondata.massopen.cloud
129.10.5.135     chat.massopen.cloud
129.10.5.136     elkmassopen.cloud
129.10.5.137     promtest.infra.massopen.cloud
129.10.5.138     p9con.massopen.cloud
129.10.5.139     kumo-hil-client.infra.massopen.cloud (because BU network is down).

Public BU (VLAN 105)

  • Subnet: 192.12.185.0/24
IP Address       Hostname/Description
192.12.185.1     default gateway
192.12.185.32    start cnv loadbalancer range (192.12.185.32/27)
192.12.185.63    end cnv loadbalancer range
192.12.185.64    general dynamic range start
192.12.185.100   general dynamic range stop
192.12.185.101   dhcp1-bm.cnv.massopen.cloud
192.12.185.102   dhcp2-bm.cnv.massopen.cloud
192.12.185.103   provisioner.cnv.massopen.cloud
192.12.185.104   api.cnv.massopen.cloud
192.12.185.105   ingres-lb.cnv.massopen.cloud
192.12.185.106   ns1.cnv.massopen.cloud
192.12.185.107   bootstrap.cnv.massopen.cloud
192.12.185.110   os-mgr-0.cnv.massopen.cloud
192.12.185.111   os-mgr-1.cnv.massopen.cloud
192.12.185.112   os-mgr-2.cnv.massopen.cloud
192.12.185.115   os-wrk-0.cnv.massopen.cloud
192.12.185.116   os-wrk-1.cnv.massopen.cloud
192.12.185.117   os-wrk-2.cnv.massopen.cloud
192.12.185.120   m01.osh.massopen.cloud
192.12.185.121   m02.osh.massopen.cloud
192.12.185.122   m03.osh.massopen.cloud
192.12.185.123   m04.osh.massopen.cloud
192.12.185.124   m05.osh.massopen.cloud
192.12.185.125   m06.osh.massopen.cloud
192.12.185.130   os-sto-0.cnv.massopen.cloud
192.12.185.131   os-sto-1.cnv.massopen.cloud
192.12.185.132   os-sto-2.cnv.massopen.cloud
192.12.185.140   provisioner.cnv2.massopen.cloud
192.12.185.141   api.cnv2.massopen.cloud
192.12.185.142   ns1.cnv2.massopen.cloud
192.12.185.143   lb.cnv2.massopen.cloud
192.12.185.144   bootstrap.cnv2.massopen.cloud
192.12.185.145   openshift-master-0.cnv2.massopen.cloud
192.12.185.146   openshift-master-1.cnv2.massopen.cloud
192.12.185.147   openshift-master-2.cnv2.massopen.cloud
192.12.185.148   openshift-worker-0.cnv2.massopen.cloud
192.12.185.149   openshift-worker-1.cnv2.massopen.cloud

192.12.185.150   provisioner.ocp.massopen.cloud (neu-5-3)
192.12.185.151   api.ocp.massopen.cloud
192.12.185.152   ns1.ocp.massopen.cloud
192.12.185.153   lb.ocp.massopen.cloud
192.12.185.154   bootstrap.ocp.massopen.cloud
192.12.185.155   openshift-master-0.ocp.massopen.cloud (neu-3-11)
192.12.185.156   openshift-master-1.ocp.massopen.cloud (neu-5-10)
192.12.185.157   openshift-master-2.ocp.massopen.cloud (neu-15-9)
192.12.185.158   openshift-worker-0.ocp.massopen.cloud (neu-5-4)
192.12.185.159   openshift-worker-1.ocp.massopen.cloud (neu-15-4)

192.12.185.254   ov3.massopen.cloud (though this name resolves to 129.10.5.103)

IPMI network: 10.0.0.0/19 (VLAN 1 on 1G network, untagged)

  • IP assignment: 10.0.rack-number.u(nit)-number, servers bigger than 1 U get the lowest U number, numbering increases from bottom to top.
  • 10.0.0.X (X froom 1 to 255, 255 is valid because prefix is 19) (for VMs that can be anywhere)
IP Address       Hostname/Description
10.0.0.1         kzn-ipmi-gw.infra.massopen.cloud
10.0.0.2         kzn-cacti
10.0.0.3         kzn-hil-server.infra.massopen.cloud
10.0.0.4         kzn-nagios.infra.massopen.cloud
10.0.0.5         zabbix.massopen.cloud
10.0.0.6         kzn-ipmi2-gw.infra.massopen.cloud ***ON 1GB VLAN 2 TAGGED ***
10.0.0.7         switchback.massopen.cloud (The host that backs up switch configurations).
10.0.0.8         promtest.massopen.cloud (Test promotheus instance. Talk to Lars/Naved about it).
10.0.0.9         p9con.massopen.cloud
10.0.0.50        dhcp1-ipmi.cnv.massopen.cloud
10.0.0.51        dhcp2-ipmi.cnv.massopen.cloud
10.0.0.255       kzn-h.infra.massopen.cloud
10.0.3.140       ov3.massopen.cloud/kzn-e.massopen.cloud over BU public IPs from Kumo
10.0.5.140       ov2.massopen.cloud
10.0.15.140      ov1.massopen.cloud

IPMI network (for accessing OCT/Umass nodes): 10.2.0.0/24 (VLAN 2 on 1G network, untagged)

There’s dnsmasq on kzn-ipmi-gw.infra.massopen.cloud to serve IPs to UMass nodes’ BMCs.

IP Address       Hostname/Description
10.2.0.1         kzn-ipmi-gw.infra.massopen.cloud
10.2.0.2         kzn-ipmi-gw2.infra.massopen.cloud

OCT/Umass Switch Management (VLAN 207): 10.1.0.0/24

IP Address       Hostname/Description
10.1.0.1         kzn-hil-server.infra.massopen.cloud
10.1.0.11         OCT1 10G switch (Dell S40480-ON)
10.1.0.12         OCT2 10G switch (Dell S40480-ON)
10.1.0.13         OCT3 10G switch (Dell S40480-ON)
10.1.0.14         OCT4 10G switch (Dell S40480-ON)

Ceph cluster/replication (VLAN 248)

  • Subnet: 192.168.255.0/24
IP Address       Hostname/Description
192.168.255.1    ov1
192.168.255.2    ov2
192.168.255.3    ov3
192.168.255.250  nfs-ha virtual ip
192.168.255.251  nfs1
192.168.255.252  nfs2

Ceph cluster/replication (VLAN 249)

  • Subnet: 192.168.40.0/23
IP Address  Hostname/Description
TBD

Ceph client (VLAN 250)

  • Subnet: 192.168.0.0/19
IP Address       Hostname/Description
#Range for Director 192.168.0.0 - 192.168.3.255
192.168.28.1     kzn-osd01
192.168.28.2     kzn-osd02
192.168.28.3     kzn-osd03
192.168.28.4     kzn-osd04
192.168.28.5     kzn-osd05
192.168.28.6     kzn-osd06
192.168.28.7     kzn-osd07
192.168.28.8     kzn-osd08
192.168.28.198   kzn-cacti
192.168.28.199   RGW2
192.168.28.200   RGW1
192.168.28.201   kzn-mon1
192.168.28.202   kzn-mon2
192.168.28.203   kzn-mon3

?? nagios interface

192.168.28.205   neu-3-30-bmi2
192.168.28.211   kzn-vbmi01res.kzn.moc
192.168.28.212   kzn-vbmi01stack.kzn.moc
192.168.28.213   kzn-vbmi02res.kzn.moc
192.168.28.214   kzn-vbmi02stack.kzn.moc

Provision/SNMP network

  • 172.16.0.0/19, Undercloud network
  • 192.168.255.0/24 both on (VLAN 201)
IP Address       Hostname/Description
172.16.0.1       kzn-router.infra.massopen.cloud
172.16.0.3       kzn-foreman.infra.massopen.cloud, kzn-foreman.moc.int
172.16.0.4       kzn-nagios.infra.massopen.cloud
172.16.0.5       kzn-undercloud.infra.massopen.cloud
172.16.0.6       kzn-ipmi-gw.infra.massopen.cloud
172.16.0.7       kzn-cacti
172.16.0.8       kzn-dns2
172.16.0.201     Start foreman DHCP range
172.16.0.255     End Foreman DHCP range

IP assignment - same as IPMI network. BMI has to configure additional tagged interface probably DHCP provided by Foreman

See rack numbers and details

Intranet: 172.16.96.0/19 (VLAN 204)

IP Address       Hostname/Description
172.16.96.1      kzn-router.infra.massopen.cloud
172.16.96.2      kzn-hil-server.infra.massopen.cloud
172.16.96.3      kzn-hil-client.infra.massopen.cloud
172.16.96.4      kzn-vbmi01res.infra.massopen.cloud
172.16.96.5      kzn-cacti
172.16.96.6      kzn-nagios
  • Defauly gateway at 172.16.96.1 connects to internet. Will be registered in HIL so nodes can access internet.

Staging Foreman: 172.17.0.0/19 (VLAN 269)

IP Address       Hostname/Description
172.17.0.1       kzn-router.infra.massopen.cloud
172.17.0.3       Foreman
172.17.0.5       Undercloud VM for staging
172.17.0.5       kzn-ipmi-gw.infra.massopen.cloud

BMI Provisioning (VLAN 500)

  • dhcp-range=10.255.0.45,10.255.0.254,7d
IP Address       Hostname/Description
10.255.0.1       kzn-vbmi01res
10.255.0.2       kzn-vbmi02res
10.255.0.3       kzn-nagios.infra.massopen.cloud
10.255.0.4       kzn-ipmi-gw
10.255.0.5       kzn-rtr
10.255.0.35      kzn-rmon1
10.255.0.39      kzn-rmon2
10.255.0.41      kzn-rmon3
10.255.0.255     kzn-cacti

Stack BMI provision network: 10.254.0.0/19 (VLAN 501)

IP Address       Hostname/Description
10.254.0.1       kzn-vbmi01stack
10.254.0.2       kzn-vbmi02stack
10.254.0.3       kzn-nagios.infra.massopen.cloud
10.254.0.255     kzn-cacti

CSAIL-3803 Public IPs: 128.31.28.0/24 (VLAN 3803)

IP Address       Hostname/Description
128.31.28.1      gateway
128.31.28.248    openshift (Rob)
128.31.28.249    openshift (Rob)
128.31.28.251    openshift (Rob)
128.31.28.252    openshift (Rob)
128.31.28.253    openshift (Rob)
128.31.28.254    openshift (Rob)

Research Ceph (VLAN 252)

IP Address       Hostname/Description
192.168.32.1     kzn-rmon1 kzn-rmon1.infra.massopen.cloud
192.168.32.2     kzn-rmon2 kzn-rmon2.infra.massopen.cloud
192.168.32.3     kzn-rmon3 kzn-rmon3.infra.massopen.cloud
192.168.32.4     kzn-ssh.infra.massopen.cloud
192.168.32.5     kzn-rtr.infra.massopen.cloud
192.168.32.6     kzn-zabbix

192.168.35.21    neu-3-21 neu-3-21.infra.massopen.cloud
192.168.35.22    neu-3-22 neu-3-22.infra.massopen.cloud
192.168.35.23    neu-3-23 neu-3-23.infra.massopen.cloud
192.168.35.41    neu-3-41 neu-3-41.infra.massopen.cloud (cache-server)

192.168.37.21    neu-5-21 neu-5-21.infra.massopen.cloud
192.168.37.22    neu-5-22 neu-5-22.infra.massopen.cloud
192.168.37.23    neu-5-23 neu-5-23.infra.massopen.cloud
192.168.37.41    neu-5-41 neu-5-41.infra.massopen.cloud (cache-server)

192.168.47.21    neu-15-21 neu-15-21.infra.massopen.cloud
192.168.47.22    neu-15-22 neu-15-22.infra.massopen.cloud
192.168.47.23    neu-15-23 neu-15-23.infra.massopen.cloud
192.168.47.41    neu-15-41 neu-15-41.infra.massopen.cloud (cache-server)
  • HIL/BMI users need to have access to ceph-public network (HIL admin operation), add it to their project/nodes/nics and configure an ip, ip is calculated as described below (user operations)
  • For client IPs use 192.168.32+Cnum.Unum mask 255.255.224.0, where Cnum is cage number and Unum is U number. Cage and U numbers are used in node mame - neu-1-21 means Cage 1, U 21 and the ip would be 192.168.33.21
  • Ssh access is by using FreeIpa accounts, nodes are accessible from BMI provision subnet (500) by name. Ssh to monitor nodes to get ceph.conf and admin keyring.
  • Please use ecrbd pool for rbd images to save disk space. To create an image using erasure coded pool for data storage use rbd create mynewrbdimage --data-pool ecrbd --size xxxG
  • Be careful with the number of placement groups if creating new pools

VPN range

172.31.224.0/19

Network connections

For 1 GB U number goes to the same port number.

For 10GB U1 goes to ports 1 and 2 on lower Brocade switch, U2 - ports 3,4 up to U20. U21 goes to ports 1,2 on upper switch and so on.

Lenovo Ceph - for IBM Power9 (VLAN 210 and 211)

VLAN 210 - 192.168.96.0/19 VLAN 211 - 192.168.128.0/19