1-50 of 1999 results (16ms)
2019-07-25 §
22:01 <bstorm_> T228573 created tools-worker-1030
21:22 <jeh> rebooting tools-worker-1016 unresponsive
2019-07-24 §
10:14 <arturo> reallocating tools-puppetmaster-01 from cloudvirt1027 to cloudvirt1028 (T227539)
10:12 <arturo> reallocating tools-docker-registry-04 from cloudvirt1027 to cloudvirt1028 (T227539)
2019-07-22 §
18:39 <bstorm_> repooled tools-sgeexec-0905 after reboot
18:33 <bstorm_> depooled tools-sgeexec-0905 because it's acting kind of weird and not responding to prometheus
18:32 <bstorm_> repooled tools-sgewebgrid-lighttpd-0902 after restarting the grid-exec service
18:28 <bstorm_> depooled tools-sgewebgrid-lighttpd-0902 to find out why it is behaving weird
17:55 <bstorm_> draining tools-worker-1023 since it is having issues
17:38 <bstorm_> Adding the prometheus servers to the ferm rules via wikitech hiera for kubelet stats T228573
2019-07-20 §
19:52 <andrewbogott> rebooting tools-worker-1023
2019-07-17 §
20:23 <andrewbogott> migrating tools-sgegrid-shadow to cloudvirt1014
2019-07-15 §
14:50 <bstorm_> cleared error state from tools-sgeexec-0911 which went offline after error from job 5190035
2019-06-25 §
09:30 <arturo> detected puppet issue in all VMs: T226480
2019-06-24 §
17:42 <andrewbogott> moving tools-sgeexec-0905 to cloudvirt1015
2019-06-17 §
14:07 <andrewbogott> moving tools-sgewebgrid-lighttpd-0903 to cloudvirt1015
13:59 <andrewbogott> moving tools-sgewebgrid-generic-0902 and tools-sgewebgrid-lighttpd-0902 to cloudvirt1015 (optimistic re: T220853 )
2019-06-11 §
18:03 <bstorm_> deleted anomalous kubernetes node tools-worker-1019.eqiad.wmflabs
2019-06-05 §
18:33 <andrewbogott> repooled tools-sgeexec-0921 and tools-sgeexec-0929
18:16 <andrewbogott> depooling and moving tools-sgeexec-0921 and tools-sgeexec-0929
2019-05-30 §
13:01 <arturo> uncordon/repool tools-worker-1001/2/3. They should be fine now. I'm only leaving 1029 cordoned for testing purposes
13:01 <arturo> reboot tools-woker-1003 to cleanup sssd config and let nslcd/nscd start freshly
12:47 <arturo> reboot tools-woker-1002 to cleanup sssd config and let nslcd/nscd start freshly
12:42 <arturo> reboot tools-woker-1001 to cleanup sssd config and let nslcd/nscd start freshly
12:35 <arturo> enable puppet in tools-worker nodes
12:29 <arturo> switch hiera setting back to classic/sudoldap for tools-worker because T224651 (T224558)
12:25 <arturo> cordon/drain tools-worker-1002 because T224651 and T224651
12:23 <arturo> cordon/drain tools-worker-1001 because T224651 and T224651
12:22 <arturo> cordon/drain tools-worker-1029 because T224651 and T224651
12:20 <arturo> cordon/drain tools-worker-1003 because T224651 and T224651
11:59 <arturo> T224558 repool tools-worker-1003 (using sssd/sudo now!)
11:23 <arturo> T224558 depool tools-worker-1003
10:48 <arturo> T224558 drop/build a VM for tools-worker-1002. It didn't like the sssd/sudo change :-(
10:33 <arturo> T224558 switch tools-worker-1002 to sssd/sudo. Includes drain/depool/reboot/repool
10:28 <arturo> T224558 use hiera config in prefix tools-worker for sssd/sudo
10:27 <arturo> T224558 switch tools-worker-1001 to sssd/sudo. Includes drain/depool/reboot/repool
10:09 <arturo> T224558 disable puppet in all tools-worker- nodes
10:01 <arturo> T224558 add tools-worker-1029 to the nodes pool of k8s
09:58 <arturo> T224558 reboot tools-worker-1029 after puppet changes for sssd/sudo in jessie
2019-05-29 §
11:13 <arturo> briefly tested some sssd config changes in tools-sgebastion-09
10:13 <arturo> enroll the tools-worker-1029 VM into toolforge k8s, but leave it cordoned for sssd testing purposes (T221225)
10:12 <arturo> re-create the tools-worker-1001 VM, already enrolled into toolforge k8s
09:34 <arturo> delete tools-worker-1001, it was totally malfunctioning
2019-05-28 §
18:15 <arturo> T221225 for the record, tools-worker-1001 is not working after trying with sssd
18:13 <arturo> T221225 created tools-worker-1029 to test sssd/sudo stuff
17:49 <arturo> T221225 repool tools-worker-1002 (using nscd/nslcd and sudoldap)
17:44 <arturo> T221225 back to classic/ldap hiera config in the tools-worker puppet prefix
17:35 <arturo> T221225 hard reboot tools-worker-1001 again
17:26 <arturo> T221225 hard reboot tools-worker-1001
17:12 <arturo> T221225 depool & switch to sssd/sudo & reboot & repool tools-worker-1002