Analytics/Server Admin Log/Archive/2013
14:44 ottomata: reinstalled analytics1017 and brought it back up as a new datanode
20:38 ottomata: taking analytics1017 down for reinstall
18:44 ottomata: decomissioning analytics1017 datanode in prep for reinstall
15:54 ottomata: rebooted gadolinium to upgrade linux kernel
14:00 ottomata: stopping hadoop and restarting analytics1010 (namenode) for kernel upgrade
16:52 ottomata: rebooting stat1 for kernel upgrade
15:47 ottomata: rebooting analytics1027 (hue, oozie, etc.)
18:42 ottomata: deployed puppet change to make nginx send webrequest logs back to main multicast firehose. NOTE: These logs are not sent to the udp2log instance on emery.
18:02 ottomata: submitted a new webrequest-loss coordinator to work on the webrequest-mobile (geocoded and anonymized) dataset, rather than the soon to be deprecated webrequest-wikipedia-mobile
18:54 ottomata: analytics1009 now sending geocoded anonymized mobile logs to kafka topic webrequest-mobile, this is consumed to /wmf/raw/webrequest/webrequest-mobile every 15 minutes
20:44 ottomata: starting hadoop
20:34 ottomata: stopping hadoop to make config changes: mapreduce.task.io.sort.mb 512 -> 200, mapreduce.task.io.sort.factor 100 -> 10, jvm.reuse −1 -> 1
17:44 ori-l-away: pressing left mouse button + space on stat1
21:10 andrewbogott: testing logbot on a new host
00:45 ottomata: upgraded to cdh4 4.2.0 :) :/
00:41 average_drifter: started charting for each feature on stat1 (500M bump related)
00:40 ottomata: restarting hadoop without mapred.job.tracker set to localhost:8021
23:29 ottomata: restarting hadoop with mapreduce.job.reuse.jvm.num.tasks set to 1
20:44 milimetric: Limn production build can now be done automatically via coke build && coke bundle
23:50 andrewbogott: testing number two
23:32 andrewbogott: testing number one
22:47 ottomata: deployed tab as separator to all frontend cache servers, modified udp2log server filters to DEAL WITH IT!
21:15 drdee: deployed version 0.3.22 of udp-filter on emery, locke and oxygen. This version accept field-delimiter flag.
21:12 ottomata: hiii
17:45 milimetric: Released version 0.6.0 of Limn
20:10 ottomata: Modified webrequest-mobile udp2log filters to produce based on frontend server hostname (^cp104[1-4]) rather than m.wikipedia.org domain.
23:10 drdee: enabled sampling on Thank_You_Main and a country filter on Emery
16:57 ottomata: now collecting X-CS logs into kraken
21:55 milimetric: Limn released a new version to dev with bar graph support
22:37 drdee: yesterday, deployed updated filter for webstatscollector to collect page view counts for wikimediafoundation.org
15:37 ottomata: deployed new webstatscollector filter to collect stats on wikivoyage domains and restarted udp2log on locke
22:16 ottomata: changed log formats to include Accept-Language and X-Carrier on all frontend cache servers