1-50 of 99392 results (25ms)
2018-07-20 §
15:33<elukey>rolling restart of eventstreams on scb2* nodes to reduce the memory pressure before the weekend (still waiting for a permanent fix)
15:19<elukey>powercycle ms-be1016 - RAID errors, no ssh available, I/O errors in com2 console
14:15<reedy@deploy1001>rebuilt and synchronized wikiversions files: wikidatawiki back to .12 T199983
14:11<Reedy>T199983 wikidata wiki abck to .12 on mwdebug1001
13:33<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Repool db1085, db1113:3316 (duration: 00m 55s)
13:13<marostegui>Stop replication in sync db1085 and db1113:3316
13:13<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Repool db1098:3316, depool db1113:3316 (duration: 00m 54s)
13:06<legoktm@deploy1001>Synchronized wmf-config/throttle.php: Update Wikimania IP address - T198288 (duration: 00m 54s)
12:53<marostegui>Stop replication in sync db1085 and db1096:3318
12:53<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Repool db1096:3316, depool db1098:3316 (duration: 00m 54s)
12:32<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Depool db1085 and db1096:3316 (duration: 00m 56s)
12:32<marostegui>Stop replication in sync db1085 and db1096:3316
12:31<marostegui@deploy1001>sync-file aborted: Depool db1085 and db1096:33156 (duration: 00m 01s)
12:00<mobrovac@deploy1001>Finished deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813 (duration: 02m 11s)
11:58<mobrovac@deploy1001>Started deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813
10:42<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Repool db1090:3312, db1105:3312 (duration: 00m 53s)
10:30<marostegui>Stop replication in sync on db1090:3312 and db1105:3312 - T200061
10:30<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Repool db1103:3312, depool db1105:3312 (duration: 00m 54s)
10:17<marostegui>Stop replication in sync on db1090:3312 and db2035 - T200061
10:14<marostegui>Stop replication in sync on db1090:3312 and db1103:3312 - T200061
10:06<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 and db1103:3312 (duration: 00m 55s)
09:46<marostegui>Stop replication on db2063 to fix db2095 - T200061
08:50<marostegui>Stop replication on s7 codfw master to check arwiki.change_tag - T200061
08:47<Amir1>stopping populateChangeTagDef.php (T200061)
08:41<foks>reset email for User:Nomden
08:01<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Repool db1074 after alter table (duration: 00m 55s)
07:46<marostegui>Stop replicaiton on s8 codfw master - T200061
07:43<jynus>stopping db1095 mariadb and cloning it to db1102
07:14<jynus@deploy1001>Synchronized wmf-config/db-eqiad.php: Repool db1099, es1019 fully (duration: 00m 54s)
07:11<marostegui>Stop replication in sync on db1074 and db1125:3312
06:13<marostegui>Deploy schema change on db1074 with replication, this will generate lag on labsdb:s2 T144010T51190T199368
06:12<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Depool db1074 for alter table (duration: 00m 53s)
06:07<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Repool db1076 after alter table (duration: 00m 54s)
05:49<marostegui>Deploy schema change on db1076 T144010T51190T199368
05:44<marostegui@deploy1001>Synchronized wmf-config/db-eqiad.php: Depool db1076 for alter table (duration: 00m 56s)
05:08<marostegui>Start to remove some unused files on db1067 - T200039
01:38<krinkle@deploy1001>Synchronized php-1.32.0-wmf.13/extensions/CentralAuth/includes/CentralAuthUser.php: T170971 (duration: 00m 55s)
00:31<krinkle@deploy1001>Synchronized php-1.32.0-wmf.13/includes/filerepo/: I58706b5610 and I40f6ad2a3d - T200026 (duration: 00m 56s)
00:30<ejegg>updated CiviCRM from 22a8c47668 to d76e3997e6
00:12<bblack>disabled puppet temporary on cp* and kafka-jumbo* for ipsec unconfiguration
2018-07-19 §
23:43<ejegg>updated CiviCRM from 08680be68e to 22a8c47668
23:31<ejegg>updated CiviCRM from 2bb0d0f9d0 to 08680be68e
23:11<thcipriani@deploy1001>Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:446982|Revert "Enable Special:Block Feedback Request"]] (duration: 00m 55s)
22:51<XioNoX>disable ospf on eqdfw-knams link (GTT)
22:18<XioNoX>enable ospf on eqdfw-knams link (GTT)
21:52<hashar>CI Jenkins has been upgraded successfully!
21:21<hashar>restarting CI on contint1001 and actually upgrading it
21:19<hashar>starting CI jenkins on contint1001
21:16<hashar>stopping the CI jenkins on contint1001
20:20<jynus@deploy1001>Synchronized wmf-config/db-eqiad.php: Repool db1099 with low load (duration: 00m 54s)