1-50 of 1512 results (7ms)
2019-02-08 §
19:17 <hauskatze> Stopped webservice of `tools.sulinfo` which redirects to `tools.quentinv57-tools` which is also unavalaible
18:32 <hauskatze> Stopped webservice for `tools.quentinv57-tools` for T210829.
13:49 <gtirloni> upgraded all packages in SGE cluster
12:25 <arturo> install aptitude in tools-sgebastion-06
11:08 <godog> flip tools-prometheus.wmflabs.org to tools-prometheus-02 - T215272
01:07 <bd808> Creating tools-sgebastion-07
2019-02-07 §
23:48 <bd808> Updated DNS to make tools-trusty.wmflabs.org and trusty.tools.wmflabs.org CNAMEs for login-trusty.tools.wmflabs.org
20:18 <gtirloni> cleared mail queue on tools-mail-02
08:41 <godog> upgrade prometheus-02 to prometheus 2.6 - T215272
2019-02-04 §
13:19 <arturo> T215154 another reboot for tools-sgebastion-06
12:26 <arturo> T215154 another reboot for tools-sgebastion-06. Puppet is disabled
11:38 <arturo> T215154 reboot tools-sgebastion-06 to totally refresh systemd status
11:36 <arturo> T215154 manually install systemd 239 in tools-sgebastion-06
2019-01-30 §
23:54 <gtirloni> cleared apt cache on sge* hosts
2019-01-25 §
20:50 <bd808> Deployed new tcl/web Kubernetes image based on Debian Stretch (T214668)
14:22 <andrewbogott> draining and moving tools-worker-1016 to a new labvirt for T214447
14:22 <andrewbogott> draining and moving tools-worker-1021 to a new labvirt for T214447
2019-01-24 §
11:09 <arturo> T213421 delete tools-services-01/02
09:46 <arturo> T213418 delete tools-docker-registry-02
09:45 <arturo> T213418 delete tools-docker-builder-05 and tools-docker-registry-01
03:28 <bd808> Fixed rebase conflict in labs/private on tools-puppetmaster-01
2019-01-23 §
22:18 <bd808> Building new tools-sgewebgrid-lighttpd-0904 instance using Stretch base image (T214519)
22:09 <bd808> Deleted tools-sgewebgrid-lighttpd-0904 instance via Horizon, used wrong base image (T214519)
21:04 <bd808> Building new tools-sgewebgrid-lighttpd-0904 instance (T214519)
20:53 <bd808> Deleted broken tools-sgewebgrid-lighttpd-0904 instance via Horizon (T214519)
19:49 <andrewbogott> shutting down eqiad-region proxies tools-proxy-01 and tools-proxy-02
17:44 <bd808> Added rules to default security group for prometheus monitoring on port 9100 (T211684)
2019-01-22 §
20:21 <gtirloni> published new docker images (all)
18:57 <bd808> Changed deb-tools.wmflabs.org proxy to point to tools-sge-services-03.tools.eqiad.wmflabs
2019-01-21 §
05:25 <andrewbogott> restarted tools-sgeexec-0906 and tools-sgeexec-0904; they seem better now but I have not repooled them yet
2019-01-18 §
21:22 <bd808> Forcing php-igbinary update via clush for T213666
2019-01-17 §
23:37 <bd808> Shutdown tools-package-builder-01. Use tools-package-builder-02 instead!
22:09 <bd808> Upgrading tools-manifest to 0.16 on tools-sgecron-01
22:05 <bd808> Upgrading tools-manifest to 0.16 on tools-cron-01
21:51 <bd808> Upgrading tools-manifest to 0.15 on tools-cron-01
20:41 <bd808> Building tools-package-builder-02 to replace tools-package-builder-01
17:16 <arturo> T213421 shutdown tools-services-01/02. Will delete VMs after a grace period
12:54 <arturo> add webservice security group to tools-sge-services-03/04
2019-01-16 §
17:29 <andrewbogott> depooling and moving tools-sgeexec-0904 tools-sgeexec-0906 tools-sgewebgrid-lighttpd-0904
16:38 <arturo> T213418 shutdown tools-docker-registry-01 and 02. Will delete the instances in a week or so
14:34 <arturo> T213418 point docker-registry.tools.wmflabs.org to tools-docker-registry-03 (was in -02)
14:23 <arturo> T213418 allocate floating IPs for tools-docker-registry-03 & 04
2019-01-15 §
21:02 <bstorm_> restarting webservicemonitor on tools-services-02 -- acting funny
18:46 <bd808> Dropped A record for www.tools.wmflabs.org and replaced it with a CNAME pointing to tools.wmflabs.org.
18:29 <bstorm_> T213711 installed python3-requests=2.11.1-1~bpo8+1 python3-urllib3=1.16-1~bpo8+1 on tools-proxy-03, which stopped the bleeding
14:55 <arturo> disable puppet in tools-docker-registry-01 and tools-docker-registry-02, trying with `role::wmcs::toolforge::docker::registry` in the puppetmaster for -03 and -04. The registry shouldn't be affected by this
14:21 <arturo> T213418 put a backup of the docker registry in NFS just in case: `aborrero@tools-docker-registry-02:$ sudo cp /srv/registry/registry.tar.gz /data/project/.system_sge/docker-registry-backup/`
2019-01-14 §
22:03 <bstorm_> T213711 Added UDP port needed for flannel packets to work to k8s worker sec groups in both eqiad and eqiad1-r
22:03 <bstorm_> T213711 Added ports needed for etcd-flannel to work on the etcd security group in eqiad
21:42 <zhuyifei1999_> also `write`-ed to them (as root). auth on my personal account would take a long time