SSR Troubleshooting

Owned by Jean-luc KRIKER
Last updated: Jun 16, 2022
6 min read


On Conductorsolution
Connected

hostname and salt minion config

more /etc/hostname 

more /etc/salt/minion_id    ( hostname of the local DC router or branch router )

 more /etc/salt/minion    ( Local and master IP address )

salt minion
[t128@routerdc1 ~]$ more /etc/hostname
routerdc1
[t128@routerdc1 ~]$ more /etc/salt/minion_id
routerdc1
[t128@routerdc1 ~]$ more /etc/salt/minion
auth_safemode: true
autoload_dynamic_modules: false
enable_legacy_startup_events: false
include: /usr/lib/128technology/python/salt/file_roots/_beacons/*.conf
master:
- 192.168.0.30
master_alive_interval: 30
master_tries: -1
ping_interval: 1
random_reauth_delay: 120
recon_default: 5000
recon_max: 30000
recon_randomize: true
tcp_authentication_retries: -1
tcp_keepalive_cnt: 3
tcp_keepalive_idle: 5
tcp_keepalive_intvl: 10
transport: tcp
[t128@routerdc1 ~]$

sudo systemctl restart salt-minion.service

sudo systemctl status salt-minion.service

status salt-minion.service
[t128@routerdc1 ~]$ sudo systemctl restart salt-minion.service
[sudo] password for t128:


[t128@routerdc1 ~]$ sudo systemctl status salt-minion.service
● salt-minion.service - The Salt Minion
   Loaded: loaded (/usr/lib/systemd/system/salt-minion.service; enabled; vendor preset: disabled)
  Drop-In: /usr/lib/systemd/system/salt-minion.service.d
           └─dnsTimeout.conf, minionWatchdog.conf, restartAlways.conf
   Active: active (running) since Thu 2020-12-31 16:44:17 UTC; 10s ago
     Docs: man:salt-minion(1)
           file:///usr/share/doc/salt/html/contents.html
           https://docs.saltstack.com/en/latest/contents.html
 Main PID: 13081 (salt-minion)
    Tasks: 8
   Memory: 68.3M
   CGroup: /system.slice/salt-minion.service
           ├─13081 /usr/bin/python3 -s /usr/bin/salt-minion
           ├─13084 /usr/bin/python3 -s /usr/bin/salt-minion
           └─13086 /usr/bin/python3 -s /usr/bin/salt-minion

Dec 31 16:44:17 routerdc1 systemd[1]: Starting The Salt Minion...
Dec 31 16:44:17 routerdc1 systemd[1]: Started The Salt Minion.


[t128@routerdc1 ~]$ sudo systemctl status salt-minion.service
● salt-minion.service - The Salt Minion
   Loaded: loaded (/usr/lib/systemd/system/salt-minion.service; enabled; vendor preset: disabled)
  Drop-In: /usr/lib/systemd/system/salt-minion.service.d
           └─dnsTimeout.conf, minionWatchdog.conf, restartAlways.conf
   Active: active (running) since Thu 2020-12-31 16:44:17 UTC; 30s ago
     Docs: man:salt-minion(1)
           file:///usr/share/doc/salt/html/contents.html
           https://docs.saltstack.com/en/latest/contents.html
 Main PID: 13081 (salt-minion)
    Tasks: 11
   Memory: 69.4M
   CGroup: /system.slice/salt-minion.service
           ├─13081 /usr/bin/python3 -s /usr/bin/salt-minion
           ├─13084 /usr/bin/python3 -s /usr/bin/salt-minion
           └─13086 /usr/bin/python3 -s /usr/bin/salt-minion

Dec 31 16:44:17 routerdc1 systemd[1]: Starting The Salt Minion...
Dec 31 16:44:17 routerdc1 systemd[1]: Started The Salt Minion.
Dec 31 16:44:34 routerdc1 salt-minion[13081]: [WARNING ] The function "module.run" is using its deprecated version and will expire i...odium".
Dec 31 16:44:35 routerdc1 salt-minion[13081]: [WARNING ] The function "module.run" is using its deprecated version and will expire i...odium".
Dec 31 16:44:39 routerdc1 salt-minion[13081]: [ERROR   ] Source file salt://release.pem?saltenv=128T not found in saltenv '128T'
Dec 31 16:44:46 routerdc1 salt-minion[13081]: [WARNING ] The function "module.run" is using its deprecated version and will expire i...odium".
Dec 31 16:44:46 routerdc1 salt-minion[13081]: 2048 SHA256:+qWgWw2vE20RDXCr8WrgFDmEGZm13qJRcuLxkMEVk2g routerdc1 (RSA)
Dec 31 16:44:46 routerdc1 salt-minion[13081]: [WARNING ] The function "module.run" is using its deprecated version and will expire i...odium".
Dec 31 16:44:46 routerdc1 salt-minion[13081]: [WARNING ] The function "module.run" is using its deprecated version and will expire i...odium".
Hint: Some lines were ellipsized, use -l to show in full.
[t128@routerdc1 ~]$


Check status

must be sudo

sudo 128status.sh

sudo 128tok.sh

status
[t128@routerdc1 ~]$ sudo 128status.sh
[sudo] password for t128:
---------------------------
128status.sh version 0.0.6:
---------------------------
check_rpm_signed:             PASS 128T-4.5.4-1.el7 signed with 725a97071b515174
check_time_jumps:             PASS 16:33:44 UTC, 16:33:44 UTC
check_global_init:            PASS Valid json format /etc/128technology/global.init
check_local_init:             PASS Valid json format /etc/128technology/local.init
check_json_env_schema:        WARN Cannot be performed on 128T > 4.1.5 (jsonschema)
check_procmgr_list_init:      PASS Valid json format /etc/128technology/processManagerProcessList.json
check_listen_ports:           PASS Check Listen Ports: 930, 12222, 830, 2181
check_zed_status:             WARN UNMATCHED LOG: Starting PDS with configured servers, ZED inactive
check_zk_ruok:                PASS Zookeeper 4 letter RUOK
check_zk_status:              PASS Connections: 20, Mode: standalone (ZED match)
check_zk_nodes:               PASS All 10 required zk nodes exist
check_zk_node_proc_config:    PASS 18/18 /state/node/<node>/processes/<process> paths have config
 :                                 Node dummy-node; type=control
check_nonzk_ruok:             PASS All FLW 18 processes returned IMOK
check_zk_connections:         PASS All FLW 18 processes are ZK connected
check_free_memory:            PASS 1512/3950MB Free Memory
check_critical_files:         PASS owner+perms for 13/13 files
check_ssh_to_peer:            WARN No peer IP in global.init!
check_ssh_to_conductor:       PASS 1/1 conductors are reachable
==================================
All 18 tests:                 PASS




[t128@routerdc1 ~]$ sudo 128tok.sh

128T System Information:
-----------------------------
Kernel version:               3.10.0-1160.el7.x86_64
Total Cores:                  3
Assigned Cores:               3
Unassigned(DPDK):             0
Context:                      run
Derived Role:                 combo
Specified Role:
Source:                       all

128T System Checks:
-----------------------------
check_cpu_vendor:             PASS CPU VendorID: GenuineIntel (must be Intel)
check_cpu_flags:              PASS CPU 0 core 0 has flags ssse3,sse4_1,sse4_2
check_cpu_flags:              PASS CPU 1 core 1 has flags ssse3,sse4_1,sse4_2
check_cpu_flags:              PASS CPU 2 core 2 has flags ssse3,sse4_1,sse4_2
check_selinux_status:         PASS SELinux status is cfg:disabled,run:disabled
check_system_memory:          PASS 4 GB of Required Minimum of 3 GB
check_swap_mounted:           PASS swapfs is not mounted
check_dpdk_modules:           PASS Module igb_uio.ko is available for 3.10.0-1160.el7.x86_64
check_dpdk_modules:           PASS Module rte_kni.ko is available for 3.10.0-1160.el7.x86_64
check_disk_space:             PASS FS / total=26G >= 25 GB
check_sudoers:                PASS UnCommented 'Defaults requiretty' not found found in /etc/sudoers
check_dumps:                  PASS /proc/sys/kernel/core_pattern -- 128T Pattern DETECTED
check_hugepage_alloc:         PASS Huge pages pre-allocated for 3.10.0-1160.el7.x86_64
check_ecc_memory:             PASS All Memory Modules are ECC
check_resolvable_hostname:    PASS System hostname 'routerdc1' is resolvable
==================================
All 128T Tests:               PASS
[t128@routerdc1 ~]$




On Router
wrong name "dummy-router"






SALT Certificate issue

systemctl stop salt-minion
rm /etc/salt/pki/minion/minion.pem
rm /etc/salt/pki/minion/minion.pub
Optional:  vi /etc/salt/minion_id   ( if the minion_id is wrong )
systemctl start salt-minion