[00:01:53] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Quit: Computer has gone to sleep. [00:05:42] RobWC (~Adium@50-76-52-161-ip-static.hfc.comcastbusiness.net) left irc: Quit: Leaving. [00:06:08] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) joined #redis. [00:07:47] rittyan (~rittyan@95-24-58-110.broadband.corbina.ru) left irc: Remote host closed the connection [00:08:27] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Client Quit [00:09:18] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) joined #redis. [00:10:06] tdegrunt (~tdegrunt@94.247.1.141) joined #redis. [00:11:24] sarkis (~sarkis@unaffiliated/sako) joined #redis. [00:22:54] ron (~ron@unaffiliated/ron) left irc: Ping timeout: 252 seconds [00:23:05] ambroff (~ambroff@c-24-4-207-161.hsd1.ca.comcast.net) joined #redis. [00:23:27] siebertm (~micha@p5DDB9205.dip.t-dialin.net) joined #redis. [00:25:24] when I do a "BLPOP key, any_timeout" and someone pulls the plug out of my redis server (which is somewhere on the network), none of the redis clients i tried EVER returns from the BLPOP call [00:25:55] ( tried node-redis, redis-rb and hiredis - also via redis-rb) [00:26:28] who is supposed to handle that problem? client, server or calling application? [00:26:50] same happens when the connection is in subscribe mode, too.... [00:26:53] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Quit: Computer has gone to sleep. [00:29:46] yoyohey (632f4271@gateway/web/freenode/ip.99.47.66.113) joined #redis. [00:29:54] hi [00:30:25] does redis cluster have consistent hashing support ? [00:31:43] ron (~ron@unaffiliated/ron) joined #redis. [00:32:53] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 248 seconds [00:36:59] Nick change: ajsharp -> ajsharp_zz [00:40:17] h0bbit (~vedang@121.243.225.226) joined #redis. [00:41:28] h0bbit (~vedang@121.243.225.226) left irc: Read error: Connection reset by peer [00:41:48] h0bbit (~vedang@121.243.225.226) joined #redis. [00:44:57] ChristianS_ (c2ec3c6a@gateway/web/freenode/ip.194.236.60.106) joined #redis. [00:46:22] peaceman (~peaceman@pD95812AE.dip.t-dialin.net) joined #redis. [00:49:21] old_sound (~old_sound@77-58-253-248.dclient.hispeed.ch) joined #redis. [00:50:51] rittyan (~rittyan@2a02:6b8:0:40c:7aca:39ff:feb3:d779) joined #redis. [00:51:04] thehodge (~thehodge@2001:470:1f09:13a3:d81e:b420:a858:2882) joined #redis. [00:51:51] yoyohey (632f4271@gateway/web/freenode/ip.99.47.66.113) left irc: Quit: Page closed [00:57:33] nopz___ (~nopz___@8.14.117.35) joined #redis. [01:00:05] Nick change: ajsharp_zz -> ajsharp [01:02:41] old_sound (~old_sound@77-58-253-248.dclient.hispeed.ch) left irc: Quit: old_sound [01:13:32] Nick change: NuckOff -> Nuck [01:15:39] siebertm (~micha@p5DDB9205.dip.t-dialin.net) left irc: Quit: siebertm [01:34:36] nwjlyons (~neil@southill.torchbox.com) joined #redis. [01:44:16] peaceman_ (~peaceman@pD951EF64.dip.t-dialin.net) joined #redis. [01:45:25] peaceman (~peaceman@pD95812AE.dip.t-dialin.net) left irc: Read error: Operation timed out [01:45:25] Nick change: peaceman_ -> peaceman [01:49:29] djuki (~user2@cable-94-189-249-127.dynamic.sbb.rs) joined #redis. [01:51:21] drbobbeaty (~drbobbeat@c-67-184-75-162.hsd1.il.comcast.net) joined #redis. [02:08:03] h0bbit (~vedang@121.243.225.226) left irc: Read error: Connection reset by peer [02:08:48] h0bbit (~vedang@121.243.225.226) joined #redis. [02:16:10] sarkis (~sarkis@unaffiliated/sako) joined #redis. [02:19:44] sarkis (~sarkis@unaffiliated/sako) left irc: Client Quit [02:20:33] TimTim (TimTim@cpe-098-026-149-108.triad.res.rr.com) joined #redis. [02:20:55] thehodge (~thehodge@2001:470:1f09:13a3:d81e:b420:a858:2882) left irc: Remote host closed the connection [02:21:19] thehodge (~thehodge@cpc5-seac20-2-0-cust310.7-2.cable.virginmedia.com) joined #redis. [02:25:18] drbobbeaty (~drbobbeat@c-67-184-75-162.hsd1.il.comcast.net) left irc: Quit: drbobbeaty [02:25:34] thehodge (~thehodge@cpc5-seac20-2-0-cust310.7-2.cable.virginmedia.com) left irc: Ping timeout: 245 seconds [02:26:03] rb2k (~rb2k@HSI-KBW-078-042-219-156.hsi3.kabel-badenwuerttemberg.de) joined #redis. [02:36:13] ChristianS_ (c2ec3c6a@gateway/web/freenode/ip.194.236.60.106) left irc: Quit: Page closed [02:40:25] thehodge (~thehodge@82.109.33.196) joined #redis. [03:11:27] insin (~insin@host86-148-254-166.range86-148.btcentralplus.com) joined #redis. [03:13:15] Kosma (kosma@host-6-66.internetunion.pl) joined #redis. [03:31:58] hackband (~hackband@0x5359d382.cpe.ge-1-1-0-1104.bynqu1.customer.tele.dk) joined #redis. [03:32:23] jonesy (~jonesy@pool-173-71-115-162.cmdnnj.fios.verizon.net) left irc: Quit: Computer has gone to sleep. [03:38:04] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis. [03:38:36] lusis (u2537@gateway/web/irccloud.com/x-ihxejwqnnlfcknpb) left irc: Excess Flood [03:38:55] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left irc: Client Quit [03:39:03] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis. [03:43:23] lusis (u2537@gateway/web/irccloud.com/x-cncuystcecezulzv) joined #redis. [03:43:52] Wuushu (c2ec3c6a@gateway/web/freenode/ip.194.236.60.106) joined #redis. [03:46:39] drbobbeaty (~drbobbeat@38.98.137.29) joined #redis. [03:48:09] d0k (~d0k@p5B3B2E15.dip.t-dialin.net) joined #redis. [03:56:38] jano (~djanowski@190.245.30.40) left irc: Remote host closed the connection [03:57:16] ambroff (~ambroff@c-24-4-207-161.hsd1.ca.comcast.net) left irc: Quit: ambroff [03:59:46] thehodge (~thehodge@82.109.33.196) left irc: Remote host closed the connection [04:00:10] thehodge (~thehodge@82.109.33.196) joined #redis. [04:01:14] any txredis person here? something's wrong w/ zrangebyscore limit [04:02:06] bug bug bug [04:03:28] hadees (~hadees@72-48-91-73.dyn.grandenetworks.net) joined #redis. [04:04:13] kushal (~kdas@fedora/kushal) left irc: Ping timeout: 252 seconds [04:04:47] hadees (~hadees@72-48-91-73.dyn.grandenetworks.net) left irc: Client Quit [04:04:53] thehodge (~thehodge@82.109.33.196) left irc: Ping timeout: 252 seconds [04:22:53] btw is there way to issue zrangescore with offset, but not limit the count? [04:23:23] Nick change: ajsharp -> ajsharp_zz [04:24:07] tilgovi (~randall@couchdb/developer/tilgovi) left irc: Ping timeout: 252 seconds [04:27:48] mattbillenstein (~Adium@67.239.209.154) left irc: Quit: Leaving. [05:00:04] threedot (~threedot@81.214.254.156) joined #redis. [05:00:11] hi [05:00:17] how can i truncate database [05:15:18] soveran (~soveran@186.19.214.247) joined #redis. [05:18:31] Nick change: Nuck -> NuckOff [05:18:56] kaiwu (~chatzilla@221.223.115.169) joined #redis. [05:19:36] kaiwu (~chatzilla@221.223.115.169) left irc: Remote host closed the connection [05:30:23] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Ping timeout: 248 seconds [05:30:42] luckman212_ (~irc@pool-108-41-8-176.nycmny.fios.verizon.net) joined #redis. [05:33:24] luckman212 (~irc@pool-108-41-8-176.nycmny.fios.verizon.net) left irc: Ping timeout: 240 seconds [05:35:59] peaceman_ (~peaceman@pD95805F4.dip.t-dialin.net) joined #redis. [05:37:27] peaceman (~peaceman@pD951EF64.dip.t-dialin.net) left irc: Ping timeout: 252 seconds [05:37:28] Nick change: peaceman_ -> peaceman [05:42:15] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left #redis ("Leaving"). [05:52:29] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis. [05:57:25] seppo0010 (~Adium@200.69.194.105) joined #redis. [05:57:57] seppo0010 (~Adium@200.69.194.105) left #redis. [06:05:14] daelious_ (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis. [06:06:02] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left irc: Disconnected by services [06:06:08] Nick change: daelious_ -> daelious [06:08:18] tdegrunt_ (~tdegrunt@94.247.1.141) joined #redis. [06:12:29] tdegrunt (~tdegrunt@94.247.1.141) left irc: Ping timeout: 252 seconds [06:14:51] Sarevok (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) joined #redis. [06:18:02] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection [06:19:33] tdegrunt_ (~tdegrunt@94.247.1.141) left irc: Ping timeout: 248 seconds [06:20:13] threedot: flushall [06:26:04] where is the erlang native client documented? [06:26:21] ups, wrong channel [06:27:41] soveran (~soveran@186.19.214.247) joined #redis. [06:32:21] zitchdog (~textual@159.182.1.4) joined #redis. [06:34:26] devdazed (~textual@static-96-239-59-191.nycmny.fios.verizon.net) joined #redis. [06:45:18] jano_ (~djanowski@190.245.30.40) joined #redis. [06:45:28] includex (~includex@194.65.5.235) joined #redis. [06:46:45] jano__ (~djanowski@190.245.30.40) joined #redis. [06:46:55] napperjabber (~napperjab@149.48.161.10) left irc: Remote host closed the connection [06:47:01] jano_ (~djanowski@190.245.30.40) left irc: Read error: Connection reset by peer [06:55:59] Kosma: thanks [07:00:01] rittyan (~rittyan@2a02:6b8:0:40c:7aca:39ff:feb3:d779) left irc: Remote host closed the connection [07:00:01] ashc (~ashc@50-56-110-71.static.cloud-ips.com) joined #redis. [07:01:44] jonesy (~jonesy@68.64.144.221) joined #redis. [07:04:51] napperjabber (~napperjab@149.48.161.10) joined #redis. [07:05:03] Is there a good place for me to get more information about Redis configuration? [07:05:13] and more specifically the multi-db stuff? [07:05:47] ashc: multi-db is going away [07:06:05] it's slowly getting deprecated [07:06:10] Kosma: ah.. ok, i was reading some threads about that, but I didn't see any mention of it in the docs [07:06:14] jano__ (~djanowski@190.245.30.40) left irc: Read error: Connection reset by peer [07:06:28] i don't actually see too much config stuff in docs.. is there really not that much configuration needed? [07:06:56] ashc: most docs on configuration are in redis.conf comments [07:07:23] also, you can google individual config entries, but they are pretty much self-explanatory and well documented [07:07:50] Kosma: cool.. thanks [07:07:56] sorry for being so thick =) [07:08:53] Wuushu (c2ec3c6a@gateway/web/freenode/ip.194.236.60.106) left irc: Quit: Page closed [07:10:23] jano_ (~djanowski@190.245.30.40) joined #redis. [07:10:35] ashc (~ashc@50-56-110-71.static.cloud-ips.com) left #redis. [07:12:45] rodrigovieira (~rodrigovi@187.59.120.135) joined #redis. [07:14:07] emocakes (~om@189-11-46-97.mganm703.dsl.brasiltelecom.net.br) joined #redis. [07:15:44] jano_ (~djanowski@190.245.30.40) left irc: Ping timeout: 244 seconds [07:15:54] jano_ (~djanowski@190.245.30.40) joined #redis. [07:32:25] wam (~wam@unaffiliated/wam) left irc: Quit: Ex-Chat [07:33:48] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) joined #redis. [07:36:11] imajes (~imajes@is.imaj.es) left irc: Excess Flood [07:37:21] imajes (~imajes@is.imaj.es) joined #redis. [07:40:50] napperjabber (~napperjab@149.48.161.10) left irc: Quit: napperjabber [07:41:13] napperjabber (~napperjab@149.48.161.10) joined #redis. [07:41:22] ira (~ira@c-24-147-21-104.hsd1.ma.comcast.net) joined #redis. [07:43:25] coopernurse (~coopernur@71-37-43-245.tukw.qwest.net) joined #redis. [07:46:27] soveran_ (~soveran@186.19.214.247) joined #redis. [07:46:28] soveran (~soveran@186.19.214.247) left irc: Read error: Connection reset by peer [07:48:45] ank (~ank@c-67-172-16-188.hsd1.pa.comcast.net) joined #redis. [07:48:48] Nick change: ajsharp_zz -> ajsharp [07:51:53] xetorthio (~jleibiusk@200.41.238.50) joined #redis. [07:52:34] el_kevino (~el_kevino@216.249.7.209.tor.pathcom.com) joined #redis. [07:53:19] Nick change: ajsharp -> ajsharp_zz [07:54:20] soveran_ (~soveran@186.19.214.247) left irc: Remote host closed the connection [07:57:42] Nick change: ajsharp_zz -> ajsharp [08:02:02] djuki (~user2@cable-94-189-249-127.dynamic.sbb.rs) left irc: Remote host closed the connection [08:11:17] thehodge (~thehodge@2001:470:1f09:13a3:29b9:840:7acf:d2f2) joined #redis. [08:13:55] __alex (~alex@g225248159.adsl.alicedsl.de) joined #redis. [08:15:33] Tuxist (~quassel@dslb-092-077-014-198.pools.arcor-ip.net) left irc: Read error: Connection reset by peer [08:16:14] loxs (~metin@85.91.143.230) left irc: Quit: Leaving [08:19:48] h0bbit (~vedang@121.243.225.226) left irc: Ping timeout: 244 seconds [08:22:06] samrat_ (u2534@gateway/web/irccloud.com/x-leiomhiqcolnnrlw) joined #redis. [08:22:25] samrat (u2534@gateway/web/irccloud.com/x-lsrhnjnwrqnpnvyd) left irc: Max SendQ exceeded [08:25:10] tjholowaychuk (~tjholoway@S0106000352031482.gv.shawcable.net) joined #redis. [08:28:50] ira (~ira@c-24-147-21-104.hsd1.ma.comcast.net) left irc: Quit: Leaving... [08:29:12] jscheel (~jscheel@drupal.org/user/116197/view) joined #redis. [08:29:20] NetRoY (~NetRoY@115.248.197.178) joined #redis. [08:31:08] grampajoe (~grampa@50.41.4.191) joined #redis. [08:35:44] gnrfan (~gnrfan@200.110.36.11) joined #redis. [08:36:47] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) joined #redis. [08:37:08] includex (~includex@194.65.5.235) left irc: Remote host closed the connection [08:37:09] NetRoY (~NetRoY@115.248.197.178) left irc: Ping timeout: 248 seconds [08:37:23] rodrigovieira (~rodrigovi@187.59.120.135) left irc: Remote host closed the connection [08:38:24] tjholowaychuk (~tjholoway@S0106000352031482.gv.shawcable.net) left irc: Quit: Bye! [08:38:54] vkandy (~vkandy@static-68-179-6-233.ptr.terago.net) left irc: Quit: Leaving [08:42:02] grampajoe (~grampa@50.41.4.191) left irc: Quit: Bye! [08:47:52] seppo0010 (~Adium@200.69.194.105) joined #redis. [08:50:54] tdegrunt (~tdegrunt@2002:57d2:5406:0:ed90:e1be:bd2c:7c62) joined #redis. [08:53:59] Nick change: ajsharp -> ajsharp_zz [08:56:50] soveran (~soveran@186.19.214.247) joined #redis. [08:58:52] Yacker (~yacker@cpe-76-179-160-209.maine.res.rr.com) joined #redis. [08:59:55] Hi all, I setup redis as a cache behind a magento instance and I am getting a bunch of errors stating, "read error on connection". I think this is from redis and the funny thing is it is only caused by search bots. Anyone have any ideas what is going on? [09:01:42] jano_ (~djanowski@190.245.30.40) left irc: Remote host closed the connection [09:01:54] threedot (~threedot@81.214.254.156) left #redis. [09:02:16] p1d (~p1d@ns1.vonaffenfels.de) left irc: Quit: ... [09:03:08] luckman212_ (~irc@pool-108-41-8-176.nycmny.fios.verizon.net) left irc: Read error: Connection reset by peer [09:05:14] insin (~insin@host86-148-254-166.range86-148.btcentralplus.com) left irc: Quit: What's the point in giving us haaaaannnds? [09:06:15] dlap (~dlap@c-76-111-226-213.hsd1.fl.comcast.net) joined #redis. [09:07:40] RobWC (~Adium@50-76-52-161-ip-static.hfc.comcastbusiness.net) joined #redis. [09:17:28] RobWC (~Adium@50-76-52-161-ip-static.hfc.comcastbusiness.net) left irc: Quit: Leaving. [09:17:47] kenperkins (~textual@174-24-171-37.tukw.qwest.net) joined #redis. [09:23:29] RobWC (~Adium@2001:470:1f05:f2a:81a0:f7d4:7084:bec8) joined #redis. [09:24:20] gregpascale (~textual@174-24-171-37.tukw.qwest.net) joined #redis. [09:26:14] Treffynnon (~Treffynno@82-69-141-230.dsl.in-addr.zen.co.uk) left irc: Remote host closed the connection [09:27:34] nwjlyons (~neil@southill.torchbox.com) left irc: Remote host closed the connection [09:28:16] el_kevin_ (~el_kevino@216.249.7.209.tor.pathcom.com) joined #redis. [09:28:25] cinemascop89 (~yo@r186-52-54-20.dialup.adsl.anteldata.net.uy) joined #redis. [09:28:47] el_kevino (~el_kevino@216.249.7.209.tor.pathcom.com) left irc: Read error: Connection reset by peer [09:34:29] vkandy (~vkandy@static-68-179-6-233.ptr.terago.net) joined #redis. [09:45:05] peaceman (~peaceman@pD95805F4.dip.t-dialin.net) left irc: Quit: Computer has gone to sleep. [09:47:59] seppo0010 (~Adium@200.69.194.105) left #redis. [09:51:23] zitchdog (~textual@159.182.1.4) left irc: Quit: Computer has gone to sleep. [09:55:10] indstry (~apple@c-71-238-98-243.hsd1.mi.comcast.net) joined #redis. [09:55:46] rodrigovieira (~rodrigovi@187.59.120.135) joined #redis. [09:59:52] h0bbit (~vedang@59.95.15.72) joined #redis. [10:06:16] NetRoY (~NetRoY@122.170.45.238) joined #redis. [10:09:41] nopz___ (~nopz___@8.14.117.35) left irc: Quit: This computer has gone to sleep [10:12:53] RobWC (~Adium@2001:470:1f05:f2a:81a0:f7d4:7084:bec8) left irc: Ping timeout: 252 seconds [10:13:19] RobWC (~Adium@50-76-52-161-ip-static.hfc.comcastbusiness.net) joined #redis. [10:14:31] Nick change: wmoss|away -> wmoss [10:15:00] stephank (~stephank@82.197.214.45) joined #redis. [10:22:56] emocakes (~om@189-11-46-97.mganm703.dsl.brasiltelecom.net.br) left irc: Ping timeout: 255 seconds [10:26:34] seppo0010 (~Adium@190.195.37.18) joined #redis. [10:29:52] Nick change: ajsharp_zz -> ajsharp [10:31:40] h0bbit (~vedang@59.95.15.72) left irc: Ping timeout: 240 seconds [10:33:56] h0bbit (~vedang@59.95.15.72) joined #redis. [10:35:56] mattbillenstein (~Adium@65.160.16.86) joined #redis. [10:36:15] seppo0010 (~Adium@190.195.37.18) left #redis. [10:37:11] _macro (~Neil@accessnat4.mochimedia.net) joined #redis. [10:39:28] andymccurdy (~andymccur@69.12.160.66) joined #redis. [10:40:02] Nick change: ajsharp -> ajsharp_zz [10:42:06] tdegrunt (~tdegrunt@2002:57d2:5406:0:ed90:e1be:bd2c:7c62) left irc: Remote host closed the connection [10:45:05] zitchdog (~textual@159.182.1.4) joined #redis. [10:48:48] tdegrunt (~tdegrunt@ip6-84-210-87.adsl2.static.versatel.nl) joined #redis. [10:49:25] chrisjones (~chrisjone@ip68-224-245-47.lv.lv.cox.net) joined #redis. [10:55:41] What function would be best to use as a mutex? [10:56:02] I see setnx, but that won't block [10:56:51] should I just use brpop for that? [10:57:53] hmm, how would that work? on the first acquire, brpop would block. how would it unblock? [10:58:07] not sure, didn't rtfm closely yet [10:59:23] rodrigovieira (~rodrigovi@187.59.120.135) left irc: Remote host closed the connection [10:59:45] here's an example I found [10:59:48] might be what you're after [10:59:49] http://www.davidverhasselt.com/2011/08/06/a-distributed-mutex-and-semaphore-using-redis/ [11:00:54] the getset/lpush is sneaky. that was the bit I wasn't sure how to do [11:01:36] Yep, that is pretty sexy [11:01:42] chrisjones (~chrisjone@ip68-224-245-47.lv.lv.cox.net) left irc: Ping timeout: 268 seconds [11:01:49] redis is slick like that [11:02:15] hackband (~hackband@0x5359d382.cpe.ge-1-1-0-1104.bynqu1.customer.tele.dk) left irc: Remote host closed the connection [11:02:42] powdahou_ (~garret@c-67-169-42-52.hsd1.ca.comcast.net) joined #redis. [11:03:16] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Ping timeout: 240 seconds [11:03:17] Nick change: powdahou_ -> powdahound [11:05:55] el_kevin_ (~el_kevino@216.249.7.209.tor.pathcom.com) left irc: Read error: Connection reset by peer [11:06:21] el_kevino (~el_kevino@216.249.7.209.tor.pathcom.com) joined #redis. [11:08:16] sigmonsays_ (~cd@c-67-169-42-1.hsd1.ca.comcast.net) left irc: Read error: Operation timed out [11:08:31] sigmonsays_ (~cd@c-67-169-42-1.hsd1.ca.comcast.net) joined #redis. [11:08:33] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) joined #redis. [11:08:47] __alex (~alex@g225248159.adsl.alicedsl.de) left irc: Quit: Leaving [11:12:22] Nick change: Sembianc1 -> Sembiance [11:18:35] g0bl1n (~g0blin@unaffiliated/g0bl1n) joined #redis. [11:18:45] rittyan (~rittyan@95-24-58-110.broadband.corbina.ru) joined #redis. [11:34:32] pietern (~pieter@208.91.1.14) joined #redis. [11:34:32] #redis: mode change '+v pietern' by ChanServ!ChanServ@services. [11:55:09] rittyan_ (~rittyan@95-24-58-110.broadband.corbina.ru) joined #redis. [11:55:09] rittyan (~rittyan@95-24-58-110.broadband.corbina.ru) left irc: Read error: Connection reset by peer [11:56:06] luckyruby (~luckyruby@rrcs-24-129-162-10.se.biz.rr.com) joined #redis. [11:58:18] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left #redis ("Leaving"). [11:58:32] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis. [11:59:08] chrisjon_ (~chrisjone@ip68-96-109-92.lv.lv.cox.net) joined #redis. [11:59:22] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) left irc: Read error: Operation timed out [11:59:22] Nick change: chrisjon_ -> chrisjones [12:02:33] jano (~djanowski@190.245.30.40) joined #redis. [12:05:17] deepthawtz (~deepthawt@209.119.38.226) joined #redis. [12:05:17] sigmonsays_ (~cd@c-67-169-42-1.hsd1.ca.comcast.net) left irc: Quit: Leaving [12:05:22] sigmonsays_ (~cd@c-67-169-42-1.hsd1.ca.comcast.net) joined #redis. [12:09:51] hikeonpast_ (~hikeonpas@71-95-209-244.static.mtpk.ca.charter.com) joined #redis. [12:12:37] rittyan (~rittyan@176.14.223.136) joined #redis. [12:15:17] rittyan_ (~rittyan@95-24-58-110.broadband.corbina.ru) left irc: Ping timeout: 248 seconds [12:15:43] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left irc: Quit: Leaving [12:17:55] pyr (pyr@lynx.spootnik.org) joined #redis. [12:18:07] pyr (pyr@lynx.spootnik.org) left #redis. [12:19:41] indstry (~apple@c-71-238-98-243.hsd1.mi.comcast.net) left irc: Remote host closed the connection [12:20:04] jdunck (~jdunck@173-45-226-22.slicehost.net) joined #redis. [12:22:07] jano (~djanowski@190.245.30.40) left irc: Disconnected by services [12:22:07] jano_ (~djanowski@190.245.30.40) joined #redis. [12:23:43] Ambis (ambis@kapsi.fi) left #redis. [12:25:28] jdunck (~jdunck@173-45-226-22.slicehost.net) left irc: Quit: ZNC by prozac - http://znc.sourceforge.net [12:26:10] jdunck (~jdunck@173-45-226-22.slicehost.net) joined #redis. [12:26:24] gnrfan (~gnrfan@200.110.36.11) left irc: Ping timeout: 240 seconds [12:26:29] mattbillenstein (~Adium@65.160.16.86) left irc: Read error: Connection reset by peer [12:26:40] Nick change: jdunck -> jdunck_away [12:26:43] Nick change: jdunck_away -> jdunck [12:27:22] Nick change: jdunck -> jdunck_away [12:27:46] Nick change: jdunck_away -> jdunck [12:28:19] tilgovi (~randall@couchdb/developer/tilgovi) joined #redis. [12:32:19] gnrfan (~gnrfan@200.110.36.11) joined #redis. [12:35:54] Nick change: wmoss -> wmoss|away [12:40:14] gnrfan (~gnrfan@200.110.36.11) left irc: Quit: This computer has gone to sleep [12:47:14] zitchdog (~textual@159.182.1.4) left irc: Quit: Computer has gone to sleep. [12:50:20] Nick change: wmoss|away -> wmoss [12:52:07] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) left irc: Quit: Textual IRC Client: http://www.textualapp.com/ [12:52:23] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) joined #redis. [13:04:38] drbobbeaty_ (~drbobbeat@38.98.137.29) joined #redis. [13:04:38] drbobbeaty (~drbobbeat@38.98.137.29) left irc: Read error: Connection reset by peer [13:04:38] Nick change: drbobbeaty_ -> drbobbeaty [13:05:03] tilgovi (~randall@couchdb/developer/tilgovi) left irc: Remote host closed the connection [13:05:24] coopernurse: But what if the process crashes and never pushes the token back [13:06:07] Brend: good question [13:23:28] petercooper (~petercoop@82.144.254.2) joined #redis. [13:29:48] Nick change: ajsharp_zz -> ajsharp [13:30:26] weird, we suddenly started experiencing issue 141. [13:31:59] NetRoY (~NetRoY@122.170.45.238) left irc: Ping timeout: 252 seconds [13:32:57] hey, so, I just upgraded our slave to 2.4.6 but that doesn't fix the issue [13:33:14] my slave is still just queuing up data in the client input buf [13:36:16] do I also have to upgrade the master? [13:40:21] ah, let me try moving the aof file so the slave doesn't read tyat [13:40:56] g0bl1n (~g0blin@unaffiliated/g0bl1n) left irc: Quit: g0bl1n [13:43:35] nope, doesn't seem to have helped. [13:43:52] jonesy (~jonesy@68.64.144.221) left irc: Quit: Computer has gone to sleep. [13:45:15] xb95: My take away from reading the issue notes was that the master needed to be upgraded as well. We haven't done it yet, but its on the short list. [13:45:53] hikeonpast_: gotcha, thanks. I don't like upgrading our core production services without running the new version as a slave for a while. :\ [13:46:20] may not have a choice here, though. I can't really validate 2.4.6 as a slave when it won't replicate. [13:46:30] xb95: how many slaves do you have? [13:46:52] or, how many slaves are waiting for a sync when you SLAVEOF? [13:47:05] we're in the same boat. One thing that I haven't fully fleshed out is whether the 2.2 branch has the same issue [13:47:21] hikeonpast_: it 99% likely has [13:47:49] pietern: good to know. Thanks. [13:48:16] That moves the upgrade a bit higher on my list... ;) [13:48:17] hikeonpast_: the bug was in part caused by the introduction of a static output buffer in 2.2 [13:48:30] pietern: sorry, I'm not sure what you mean by SLAVEOF? should I run that on my slave to get status or something? the logs don't mention how many are connected [13:48:33] afaik, there's only one slave [13:48:46] the master is our production instance, the slave is just replicating and doing aof for backup purposes [13:48:51] we don't spread our reads [13:48:56] xb95: that's what you run to attach it to a master [13:49:07] sure, but that's in the config file, so I don't run it manually [13:49:11] ok [13:49:34] and the stdout/stderr doesn't show anything about number of slaves [13:49:36] issue 141 should only manifest itself with more than 1 slave trying to SYNC at the same time [13:50:02] can I ask the master if it has any slaves connected? [13:50:03] xb95: so you run INFO against the slave and see the max input buf growing continuously [13:50:03] ? [13:50:07] xb95: yep [13:50:28] yes pietern, it's growing unbounded until it hits ~2GB then it crashes. well, that's what 2.3.11 did [13:50:32] I haven't let 2.4.6 hit 2GB yet [13:51:04] how do I ask the master how many slaves are connected? I don't see it in the info output [13:51:08] oh [13:51:12] connected_slaves:1 [13:51:15] I'm just blind. [13:51:21] what is the replication status? [13:51:27] as seen in the slave's INFO [13:51:34] master_host:redis-master [13:51:35] master_port:6379 [13:51:35] master_link_status:up [13:51:35] master_last_io_seconds_ago:0 [13:51:35] master_sync_in_progress:0 [13:51:50] client_biggest_input_buf:73845106 (and strictly increasing.) [13:52:05] xb95: and the slave doesn't reflect the writes on the master? [13:52:37] dschn (~dschn@c-064-186-242-006.sd2.redwire.net) joined #redis. [13:52:38] correct, if I run "set foo 1" on the master, then wait a while, "get foo" returns (nil) on the slave [13:53:06] the number of keys is different, 2.8m on the master, 2.3m on the slave [13:53:12] and the slave is not writing to the aof file at all [13:53:38] xb95: well, it should start out with the same number of keys [13:54:06] as the master deletes expired keys, and adds new ones the two figures likely diverge [13:54:18] (in your case) [13:54:20] right [13:54:27] can you gist your full slave info output? [13:54:30] sure [13:56:30] https://gist.github.com/1608912 [13:58:09] thanks [13:58:12] checking it out [13:58:15] np [13:58:26] xb95: 3 clients [13:58:29] xb95: 1 is the slave [13:58:33] xb95: 1 is redis-cli [13:58:37] xb95: what is the other one? [13:58:46] OpenTSDB [13:58:54] does it BLPOP? [13:58:57] xetorthio (~jleibiusk@200.41.238.50) left irc: Quit: Ex-Chat [13:58:59] nope, all it does is INFO [13:59:05] every ~15 seconds [13:59:08] ok [13:59:13] that means the slave must be blocked [13:59:20] I see you are running 2.3 on your master [13:59:44] let me check the commit logs [13:59:49] yeah, it's been working just fine until a few days ago [14:00:02] on Monday for some reason the slave started exhibiting this behavior :) [14:00:05] but I think the master feeds a blocking command to the slave, causing the link to block up [14:00:11] did you deploy any new stuff? [14:00:29] probably, yes. we deploy pretty regularly here (I work at Bump) [14:00:42] xb95: cool [14:00:47] xb95: let me check the logs real quick [14:00:57] xb95: I recall such an issue being resolved at some point [14:01:11] probably between 2.2 and 2.4 (where your master is at) [14:02:00] right [14:02:14] you're running RC8 [14:02:16] 2.4 RC8 [14:05:37] does that explain the issue? [14:05:44] I'm reading the release notes [14:05:46] it doesn't... yet [14:06:21] yeah, I don't see anything that jumps out at me [14:06:29] xb95: I suspect the following is happening [14:07:12] there are probably a bunch of BLPOP's happening on the server [14:07:27] for some reason, one of them is replicated, causing the slave to block [14:07:32] the weird thing is [14:07:42] all canonical BLPOP scenarios are covered, [14:07:47] I know they are not replicated [14:07:58] however, there may be some edge case where they are [14:08:36] could you monitor your prod instance and see what kind of BLPOP commands, in which particular order, are being issued [14:08:57] or better, ask devs which BLPOP-related changes they have merged this monday? [14:09:11] this should definitely not happen though [14:10:01] actually, yeah, I just chatted with one of the devs, and I'm grepping the source [14:10:07] git grep -i blpop returns nothing... hm [14:10:12] and he's not aware of us ever using it [14:10:38] bump@fathen:/bump/logs$ strace -s 500 -fp 26955 -e trace=read 2>&1 | grep -i BLPOP [14:10:41] ........ nothing ........... [14:11:12] xb95: that's your prod redis with full output? [14:11:18] ok [14:11:22] yeah, that's the prod redis instance [14:11:27] let me think a bit... [14:11:28] it does ~1000 qps [14:12:09] we do use RPOP [14:12:11] er BRPOP [14:12:24] which is also blocking? [14:12:28] yep [14:12:32] ok [14:12:53] forget about that one every time ;) [14:14:21] what are the brpop patterns that are used? [14:14:38] simple 1-1 blocking pops on lists, where other clients push straight onto? [14:15:01] or complex patterns with BRPOPLPUSH ? [14:15:17] yeah, we're using redis to help us communicate between workers on many machines. someone submits a job with LPUSH, then workers BRPOP a job [14:15:30] but afaik it should be very small queues, they're not huge [14:15:41] right, but nothing complex [14:16:07] hehe, I don't know how you define complex, but I don't think it is [14:16:18] ok :) [14:16:34] xb95: I'll investigate a bit, and see what I can find [14:16:47] but I believe we sealed this kind of bug a while ago [14:17:00] I'm just going over the code again to make sure we didn't miss anything [14:17:06] makes sense. [14:17:23] it's weird that it started randomly monday morning. we hadn't upgraded anything in a long time. [14:17:42] no code deployments monday morning either. well, none were recorded. can't rule out a ninja deploy. [14:19:06] xb95: it happened while a slave was still attached? [14:19:13] or after trying out 2.4.6 for a slave [14:19:44] hold on, let me check.. I can correlate the uptime graph and the buffer list graph [14:24:13] http://xb95.com/pics/redis2.png [14:24:22] this is from the slave. [14:24:24] on monday morning. [14:24:34] at 0716 or so, it stopped processing commands, but it was still alive [14:24:45] and it was not queuing data in the input buffer (blue line) [14:25:12] I take it there's no way to have an empty list w/o using some type of sentinel as first item [14:25:31] dschn: no, redis doesn't have empty values [14:25:36] xb95: thanks [14:25:48] xb95: do you know of anything else that happened at that time? [14:26:15] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis. [14:26:15] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Excess Flood [14:26:32] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis. [14:26:33] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Excess Flood [14:26:51] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis. [14:26:52] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Excess Flood [14:27:07] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis. [14:27:08] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Excess Flood [14:27:25] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis. [14:27:29] there's something with disk space... so it makes me think someone was writing a bunch... looking deeper [14:28:01] h0bbit (~vedang@59.95.15.72) left irc: Ping timeout: 276 seconds [14:28:10] gnrfan (~gnrfan@200.48.22.49) joined #redis. [14:28:29] hm [14:28:34] [26955] 09 Jan 09:18:51 * Slave ask for synchronization [14:28:42] that maps to when the slave stopped processing commands [14:29:20] xb95: probably a short network outage [14:29:25] oh! [14:29:28] requiring a resync [14:29:37] yes yes, we had a network outage Monday morning [14:29:47] but after resync it should pick up again [14:29:48] so the slave asked for a resync, and now it's fubar [14:30:12] hmmm [14:30:14] yesss [14:30:18] that would make two slaves [14:30:25] since it reconnected, but the master still had the old one [14:30:42] so this is issue 141 still [14:30:48] the master is in some fubar state now [14:30:50] xb95: what do you mean with "still had the old one"? [14:30:59] well, the master doesn't ping the slave, right? [14:31:06] so how does the master know if the slave has dropped? [14:31:22] it's possible that the slave reconnected before the master knew it was gone [14:31:27] so the master would see two slaves briefly [14:31:40] rb2k (~rb2k@HSI-KBW-078-042-219-156.hsi3.kabel-badenwuerttemberg.de) left irc: Quit: rb2k [14:31:48] xb95: I see what you mean, but no [14:31:59] 141 should only manifest itself when 2 slaves are doing a concurrent SYNC [14:32:24] oh yes [14:32:25] not when 1 is attached and the other does a SYNC [14:32:37] the network issues weren't 100% downtime, it was manifested as huge packet loss [14:32:51] so, it's possible, the slave reconnected more than once and had concurrent SYNCs going [14:33:17] let me gist this [14:33:30] https://gist.github.com/1609132 [14:33:33] check that server log [14:33:50] a sync started at 09:20:44 and 09:21:49 [14:34:02] the first wasn't yet done [14:34:10] xb95: exactly [14:34:17] this is 141 material ;) [14:34:20] so, issue 141. master is fubar. I have to upgrade and restart. [14:34:31] xb95: one sec [14:34:33] sure [14:34:59] xb95: this holds true for this particular manifestation [14:35:05] but not when there is only one slave [14:35:17] 'this' holds true? which this? that I hve to upgrade/restart the master? [14:35:20] so if you restart the slave, it should again *correctly* sync [14:35:33] well the slave has been restarted ~20 times since Monday.. every time it crsahes :) [14:36:05] gnrfan (~gnrfan@200.48.22.49) left irc: Quit: Leaving [14:36:11] xb95: when the slave restarts, there is only 1 SYNC going on [14:36:32] so, it is definitely 141 in the log on monday [14:36:41] okay. [14:36:53] but I doubt that subsequent restarts would have shown the same issue [14:37:02] since that only had a single slave doing a SYNC [14:37:05] ah :( [14:37:11] nonetheless, updating/restarting the master sounds like a plan [14:37:21] but I'm not too sure it resolves the particular issue [14:37:34] dlap (~dlap@c-76-111-226-213.hsd1.fl.comcast.net) left irc: Quit: dlap [14:37:37] maybe there is some artifact that I'm not taking in account now, which would again point to 141 [14:37:44] let me look more in depth at the patches [14:38:04] napperjabber (~napperjab@149.48.161.10) left irc: Remote host closed the connection [14:38:20] xb95: btw, 30 billion commands in ~100 days [14:38:23] nice :) [14:39:29] xb95: and, this is not an explanation for "blocked_clients:1" [14:39:31] on the slave [14:40:01] hehe, yeah, Bump is pretty popular [14:40:12] (which would mean the master/slave link is blocked, since the other 2 clients do INFO) [14:41:24] hm [14:41:26] ah right [14:42:08] Nick change: jdunck -> jdunck_away [14:42:09] xb95: there's a way to find out what is going on [14:42:15] Nick change: jdunck_away -> jdunck [14:42:42] but that involves attaching gdb [14:42:56] if it's fast, I can do it [14:43:13] as long as it won't kill the process, too...the master does not write an AOF file [14:43:19] so our only copy of teh data is in memory [14:43:29] hackband (~hackband@1385159443.dhcp.dbnet.dk) joined #redis. [14:43:31] (we use the slave for persistence pruposes) [14:44:29] one sec, thinking through the process [14:46:14] sure [14:46:23] and I will dry run the process against a different redis that is backed up :) [14:46:47] yeah, doing the same thing [14:47:06] I think we should be able to find out which command blocked the server [14:47:25] it should be the one that was executed as the last one, blocking the server [14:47:29] nice [14:47:34] its args should still be available [14:47:38] with some luck... :) [14:48:33] I guess this takes me a little longer than a couple of minutes, so please bear with me :) [14:48:39] yeah no hurry on my end [14:49:30] I really appreciate you helping us out [14:49:51] if you're nearby the SF Bay Area we'd be happy to buy you lunch or a beer sometime :) [14:49:53] rittyan (~rittyan@176.14.223.136) left irc: Remote host closed the connection [14:50:33] xer0x (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) joined #redis. [14:52:18] in palo alto :) [14:52:23] devdazed (~textual@static-96-239-59-191.nycmny.fios.verizon.net) left irc: Quit: Computer has gone to sleep. [14:52:29] nice, we're down here in mountain view [14:52:32] right by castro st [14:55:37] xer0x (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) left irc: Remote host closed the connection [14:55:49] xer0x (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) joined #redis. [14:56:41] ambroff (~ambroff@209.66.114.6) joined #redis. [14:56:42] hikeonpast_ (~hikeonpas@71-95-209-244.static.mtpk.ca.charter.com) left irc: Quit: ChatZilla 0.9.88 [Firefox 9.0.1/20111220165912] [15:15:56] mattbillenstein (~Adium@65.160.16.86) joined #redis. [15:20:32] deepthawtz (~deepthawt@209.119.38.226) left irc: Quit: Leaving... [15:21:16] mattbillenstein (~Adium@65.160.16.86) left irc: Ping timeout: 240 seconds [15:22:10] xb95: nice [15:22:20] xb95: it appears that I can't inspect free'd memory with gdb [15:22:35] Yacker (~yacker@cpe-76-179-160-209.maine.res.rr.com) left irc: [15:23:04] hm [15:23:12] I thought you could inspect any address [15:23:25] this one is complaining... [15:23:34] mattbillenstein (~Adium@65.160.16.86) joined #redis. [15:23:42] xb95: I did find another technique though [15:24:02] so, SLAVEOF kicks off a bgsave on the master [15:24:10] then queues all write ops [15:24:20] first the dump gets send to the slave and loaded there [15:24:36] then, the pending write ops are received and executed as the slave catches up with the stream [15:24:52] now, all commands that are received as part of that stream are executed just as other commands [15:24:56] yeah, the dump/load seems to work, and it's receiving commands. it just isn't executing. [15:25:11] so to find out which command is causing the blockage, you can spin up a "redis-cli monitor" against the slave [15:25:18] although I'm not 100% sure the dump/load is accurate since the count of keys is very different [15:25:19] WHILE it is receiving the sync [15:25:29] alright [15:25:53] then, as the slave finished loading and starts taking normal commands, it will display those [15:26:03] and it hopefully becomes clear which command causes blockage [15:26:16] but you say the key count is very different after the dump? [15:26:26] well, it was off by a few hundred thousand ~20 minutes after [15:26:33] let me restart the slave so it does a fresh bgsave/sync [15:26:42] I'll do the monitor and check the keys [15:29:39] bgsave takes ~5 minutes [15:31:34] cool, thanks [15:31:37] hope that shows something [15:32:10] if it shows a blpop/brpop I can start looking in some direction [15:32:24] especially when there is a huge discrepancy in key count [15:32:40] bam! [15:32:52] slave is now in the "broken" state [15:32:52] db0:keys=2289617,expires=2289570 [15:32:58] client_biggest_input_buf:23126073 [15:33:00] and just gorwing [15:33:11] 1326497541.689574 "info" [15:33:12] 1326497544.240062 "info" [15:33:12] 1326497546.906062 "info" [15:33:12] 1326497547.232495 "BRPOP" "transient:last_bump:5B08D33D-F465-439F-8B45-0CCF7D862EC5" "0" [15:33:14] 1326497548.450847 "info" [15:33:17] 1326497554.830340 "info" [15:33:19] 1326497576.740781 "info" [15:33:25] that BRPOP is the only thing in the output other than my info spam [15:34:07] ok [15:34:09] boom! [15:34:17] how many keys/expires on the master? [15:34:20] for perspective? [15:34:26] db0:keys=2826622,expires=2826575 [15:34:31] ~600,000 difference [15:34:47] wtf [15:35:09] this is definitely not 141 [15:35:21] what I think is happening: [15:36:00] for some reason keys do not end up on the slave, and, where the transient BRPOP falls through on the master, [15:36:08] it does not on the slave, because it cannot pop from this key [15:36:33] makes sense. the slave then blocks. [15:36:39] let me start looking in the direction of dictionary management for 2.4-rc8 [15:36:48] thanks for the info [15:36:58] absolutely, anything you need :) [15:37:38] drbobbeaty (~drbobbeat@38.98.137.29) left irc: Quit: drbobbeaty [15:39:02] d0k_ (~d0k@p5B3B2E15.dip.t-dialin.net) joined #redis. [15:39:03] Bakanaka (474a5dbf@gateway/web/freenode/ip.71.74.93.191) joined #redis. [15:39:38] Anyone know how ae.c works? [15:40:22] Keltia_ (roberto@aran.keltia.net) joined #redis. [15:41:02] Trying to figure out why deleting an event can only be done when fd < set size [15:41:10] jano (~djanowski@190.245.30.40) joined #redis. [15:41:24] ank_ (~ank@c-67-172-16-188.hsd1.pa.comcast.net) joined #redis. [15:41:41] Sarevok1 (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) joined #redis. [15:42:30] Also, why is event loop->events init to null? [15:42:55] tdegrunt (~tdegrunt@ip6-84-210-87.adsl2.static.versatel.nl) left irc: Quit: Leaving... [15:42:56] seppo0010 (~Adium@186.19.19.229) joined #redis. [15:42:57] Shapeshi1ter (~Shapeshif@saskatoon.icu.uzh.ch) joined #redis. [15:43:30] leifkb_ (~leifkb@defiant.ecritters.biz) joined #redis. [15:45:24] Bakanaka: fds > setsize cannot be addressed [15:45:28] there is a fixed array of fds [15:46:04] xb95: can't find fixes in later commits for 2.4 [15:46:23] so, this is probably not a known issue then. [15:46:27] which could mean that this bug is in there all along [15:46:29] right [15:46:46] Ok, thanks. Ahh, I forgot fd was an argument [15:47:03] On the one hand, I like finding new things :) on the other, it's nice to hear "do X, fixed" :( [15:48:23] xb95: right... [15:48:28] jano_ (~djanowski@190.245.30.40) got netsplit. [15:48:28] kenperkins (~textual@174-24-171-37.tukw.qwest.net) got netsplit. [15:48:28] ank (~ank@c-67-172-16-188.hsd1.pa.comcast.net) got netsplit. [15:48:28] Sarevok (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) got netsplit. [15:48:28] d0k (~d0k@p5B3B2E15.dip.t-dialin.net) got netsplit. [15:48:28] QiBala (~QiBala@nodester.com) got netsplit. [15:48:28] roidrage (u1352@gateway/web/irccloud.com/x-mfvitnikzxhlgisw) got netsplit. [15:48:28] Keltia (roberto@aran.keltia.net) got netsplit. [15:48:29] Shapeshifter (~Shapeshif@unaffiliated/shapeshifter) got netsplit. [15:48:29] leifkb (~leifkb@defiant.ecritters.biz) got netsplit. [15:48:29] Nick change: d0k_ -> d0k [15:48:29] Possible future nick collision: d0k [15:48:29] Nick change: ank_ -> ank [15:48:29] Possible future nick collision: ank [15:49:00] kenperkins (~textual@174-24-171-37.tukw.qwest.net) returned to #redis. [15:50:24] xb95: you have the dump made by the master just now? [15:50:49] yeah [15:50:53] I'm running a check-dump on it atm [15:50:59] can you preserve it? [15:51:02] just to be sure [15:51:08] ==== Processed 2290242 valid opcodes (in 9493388183 bytes) ===================== [15:51:08] sure [15:51:17] ok 10 gigs [15:51:44] preserving it [15:52:21] roidrage (u1352@gateway/web/irccloud.com/x-tzogpgbbkryrmjft) joined #redis. [15:52:43] andymccurdy (~andymccur@69.12.160.66) left irc: Ping timeout: 252 seconds [15:53:11] QiBala (~QiBala@nodester.com) returned to #redis. [15:59:00] Keltia (roberto@aran.keltia.net) got lost in the net-split. [15:59:00] leifkb (~leifkb@defiant.ecritters.biz) got lost in the net-split. [15:59:00] Shapeshifter (~Shapeshif@unaffiliated/shapeshifter) got lost in the net-split. [15:59:00] Sarevok (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) got lost in the net-split. [15:59:00] jano_ (~djanowski@190.245.30.40) got lost in the net-split. [15:59:30] xb95: tracking down different code paths.. [15:59:41] awesome. :) [16:01:33] also, oddly, the redis-check-dump bundled in 2.4 rc8 can't read this dump file [16:01:39] mark@zima ~/code/redis-2.4.0-rc8/src % ./redis-check-dump ~/bak/dump.rdb !9460 [16:01:43] Unknown RDB format version: 2 [16:02:04] xb95: yep known problem [16:02:09] ah rgr [16:02:10] that has been fixed in one of the finals [16:02:17] right I had to use a later version to check it [16:02:23] yep [16:04:26] Bakanaka (474a5dbf@gateway/web/freenode/ip.71.74.93.191) left irc: Quit: Page closed [16:06:04] xb95: does the discrepancy in number of keys also mean that the 14gigs on the slave, is actually more like 20gigs on the master? [16:06:40] 16G RSS, 26G virt [16:06:43] memory usage on the master [16:06:56] slave is ~14G RSS and 14G virt [16:07:33] also, vm-enabled 0 [16:07:43] Sarevok1 (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) left #redis. [16:08:24] xb95: do these instances only carry ephemeral lists, [16:08:29] or also cached content of some sorts [16:08:52] we have some real content on it, cached data for various functions [16:08:58] this is our "main" instance so it gets used for lots of andom things [16:09:02] *random [16:09:11] ok I see [16:10:43] axl_ (~axl@75-149-152-225-Minnesota.hfc.comcastbusiness.net) left irc: Quit: axl_ [16:14:04] luckyruby (~luckyruby@rrcs-24-129-162-10.se.biz.rr.com) left irc: Remote host closed the connection [16:14:26] xb95: can you compare the time on both machines? [16:14:37] if they are approx ntp'd ? [16:15:11] a second or so is not a big deal [16:15:17] petercooper (~petercoop@82.144.254.2) left irc: Remote host closed the connection [16:15:17] minutes might be [16:15:58] ohs ure [16:16:26] % fab -H fathen,martini do:"date" !9488 [16:16:29] [fathen] out: Fri Jan 13 18:16:17 CST 2012 [16:16:32] [martini] out: Fri Jan 13 18:16:18 CST 2012 [16:16:36] thanks [16:16:47] I use ntp but it's a good thing to check :) [16:18:35] the discrepancy might be a number of keys that have already expired but are not yet removed [16:18:39] those are not included in a dump [16:18:51] but, that wouldn't explain the issue, so continuing [16:19:35] d0k (~d0k@p5B3B2E15.dip.t-dialin.net) left irc: Quit: This sleep has gone computing. [16:19:39] hmmmm [16:20:35] do you know what the data churn is? [16:20:38] assuming expired_keys tracks that, we expire about 20 per second.. [16:20:43] keys expiring every 5-10 minutes? [16:20:48] or more like days/weeks? [16:21:34] some are 3 months, some are 60 seconds [16:22:15] getting more deatils [16:22:21] tnx [16:22:48] lots of churn. [16:23:01] nearly every packet that comes in hits redis with a realtively short expiration [16:23:12] ~few minutes [16:23:28] the pressure on expiry evens out over time [16:23:41] it's an approximate mechanism [16:23:52] which could explain the full difference [16:23:55] but again, not the issue... [16:24:03] right [16:25:44] soveran_ (~soveran@186.19.214.247) joined #redis. [16:25:44] soveran (~soveran@186.19.214.247) left irc: Read error: Connection reset by peer [16:26:37] ^^_ (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) joined #redis. [16:26:44] el_kevino (~el_kevino@216.249.7.209.tor.pathcom.com) left irc: Remote host closed the connection [16:27:48] yeah, the bulk of things have a short ttl of about 30 seconds [16:27:53] just looking at the code [16:28:17] and there are many queues. one per client->backend mapping [16:28:32] whenever something comes in, we LPUSH to the queue, then EXPIRE it at 30 [16:28:40] then we BRPOP from the queue [16:28:51] so, something to note [16:30:06] the master has 288 blocked clients atm [16:30:33] nah this is normal [16:30:36] xer0x (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) left irc: Ping timeout: 240 seconds [16:30:42] looking at our graphs going back [16:31:48] soveran_ (~soveran@186.19.214.247) left irc: Remote host closed the connection [16:32:38] soveran (~soveran@186.19.214.247) joined #redis. [16:35:18] shouldn't be a problem [16:38:14] Nick change: wmoss -> wmoss|away [16:38:58] mattbillenstein (~Adium@65.160.16.86) left irc: Ping timeout: 252 seconds [16:39:08] yeah. also, it's silly that we replicate this data anyway. if we have a server failure, we don't care too much if we lose the in-flight queues. I should move this to a separate instance [16:39:40] xb95: do you use variadic pushes at all? [16:40:57] uh, what's a variadic push? [16:41:18] LPUSH key value1 value2 value3 [16:41:26] that's new in 2.4 [16:42:38] seppo0010 (~Adium@186.19.19.229) left #redis. [16:42:56] tilgovi (~randall@couchdb/developer/tilgovi) joined #redis. [16:43:43] I don't *think* so.. there's a bunch of places we push, none of them look like they do [16:43:52] xb95: if not, I might have found an error there anyway ;) [16:47:18] xb95: also no BRPOPLPUSH, right? [16:47:21] just BRPOP [16:47:52] correct [16:51:09] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) left irc: Quit: jtsnow [16:52:03] Nick change: wmoss|away -> wmoss [16:53:09] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection [16:59:43] cinemascop89 (~yo@r186-52-54-20.dialup.adsl.anteldata.net.uy) left irc: Quit: Leaving. [17:02:06] Sir_Rai (~rai@84.127.26.172.dyn.user.ono.com) joined #redis. [17:03:56] tim_smart (~tim@fostle.xen.prgmr.com) left #redis. [17:04:06] xb95: it does happen consistently, right? [17:04:21] and consistently very fast after completing sync? [17:04:35] since the problem started happening monday, yes [17:04:53] kenperkins (~textual@174-24-171-37.tukw.qwest.net) left irc: Ping timeout: 248 seconds [17:06:01] http://xb95.com/pics/redis3.png <- [17:06:20] every time it hits that ~2GB level it dies off and auto-restarts [17:07:42] total_commands_processed stays flat at 0.14 per second (my info commands) [17:09:21] uhmm if i wanna seitch to DB 2 i need to exec just SELECT 2? [17:09:25] switch* [17:09:29] pietern: hey, if I turn on the AOF writing on my master, that will do a sane fork and such right? it won't block the world? [17:09:52] xb95: no [17:10:03] xb95: meaning that that should just work [17:10:19] awesome. [17:14:37] this is a real headscratcher... [17:19:38] rurufufuss (~rurufufus@115-64-27-246.static.tpgi.com.au) joined #redis. [17:19:51] well, I have to take off shortly. I just turned AOF on on the master, and we'll watch it. [17:20:05] at some point it's probably worth just upgrading to 2.4.6 and restarting the master [17:22:41] xb95: yep [17:22:50] but I still want to know how that BRPOP ends up at the slave [17:23:11] there are only so many code paths that can make that happen [17:23:15] under certain conditions [17:23:40] anyway, I'll let you know when I find something [17:23:45] where can I reach you? [17:26:30] seppo0010 (~Adium@186.19.19.229) joined #redis. [17:31:18] thehodge (~thehodge@2001:470:1f09:13a3:29b9:840:7acf:d2f2) left irc: Remote host closed the connection [17:33:48] Nick change: wmoss -> wmoss|away [17:36:20] jonesy (~jonesy@pool-173-71-115-162.cmdnnj.fios.verizon.net) joined #redis. [17:36:34] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) joined #redis. [17:37:02] ^^_ (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) left irc: Quit: Leaving... [17:40:49] xb95: you still there? [17:41:44] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) left irc: Quit: jtsnow [17:42:44] _macro (~Neil@accessnat4.mochimedia.net) left irc: Quit: Computer has gone to sleep [18:00:01] dschn (~dschn@c-064-186-242-006.sd2.redwire.net) left irc: Quit: This computer has gone to sleep [18:00:13] Nick change: ajsharp -> ajsharp_zz [18:01:20] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) left irc: Quit: Textual IRC Client: http://www.textualapp.com/ [18:01:58] seppo0010 (~Adium@186.19.19.229) left #redis. [18:05:31] hackband (~hackband@1385159443.dhcp.dbnet.dk) left irc: Remote host closed the connection [18:06:56] sarkis (~sarkis@unaffiliated/sako) joined #redis. [18:07:03] hey guys are there perl bindings that don't suck? [18:07:36] i noticed the Redis package on CPAN which is what is recommended for use on the redis.io site doesn't have true perl hashes for redis hash? [18:11:45] Nick change: NuckOff -> Nuck [18:13:53] versicolor (~quassel@46.10.18.203) left irc: Remote host closed the connection [18:14:17] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) joined #redis. [18:30:02] soveran (~soveran@186.19.214.247) joined #redis. [18:40:19] zitchdog (~textual@173-25-169-137.client.mchsi.com) joined #redis. [18:42:21] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 260 seconds [18:46:09] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection [19:00:06] Nick change: Nuck -> NuckOff [19:03:48] gregpasc_ (~textual@174-24-171-37.tukw.qwest.net) joined #redis. [19:04:11] gregpasc_ (~textual@174-24-171-37.tukw.qwest.net) left irc: Client Quit [19:06:08] gregpasc_ (~textual@174-24-171-37.tukw.qwest.net) joined #redis. [19:07:11] gregpascale (~textual@174-24-171-37.tukw.qwest.net) left irc: Ping timeout: 244 seconds [19:07:11] Nick change: gregpasc_ -> gregpascale [19:10:07] pietern (~pieter@208.91.1.14) left irc: Quit: pietern [19:11:26] perezd (~derek@108-71-92-105.lightspeed.sntcca.sbcglobal.net) left irc: Quit: perezd [19:13:55] gregpascale (~textual@174-24-171-37.tukw.qwest.net) left irc: Quit: Computer has gone to sleep. [19:15:08] TimTim (TimTim@cpe-098-026-149-108.triad.res.rr.com) left irc: Ping timeout: 252 seconds [19:17:37] Nick change: NuckOff -> Nuck [19:18:03] Nick change: Nuck -> NuckOff [19:21:55] Nick change: NuckOff -> Nuck [19:27:36] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Quit: Computer has gone to sleep. [19:36:26] samrat_ (u2534@gateway/web/irccloud.com/x-leiomhiqcolnnrlw) left irc: Read error: Connection reset by peer [19:36:26] akahn (u2243@gateway/web/irccloud.com/x-cndcvpllvprrnwje) left irc: Remote host closed the connection [19:36:35] qrush (u1528@gateway/web/irccloud.com/x-bcgpyyomzpdrtaeg) left irc: Remote host closed the connection [19:36:36] purbon (u1730@gateway/web/irccloud.com/x-wyjqnsxfznheyyzr) left irc: Remote host closed the connection [19:36:43] mattly (u2222@gateway/web/irccloud.com/x-xbgjztiqulcqujfb) left irc: Remote host closed the connection [19:36:43] ryanbriones (u2050@gateway/web/irccloud.com/x-wjectitcbcpvktoi) left irc: Remote host closed the connection [19:36:43] croaky (u3102@gateway/web/irccloud.com/x-doyyfzrlfcmputtz) left irc: Remote host closed the connection [19:36:43] mrb_bk (u2099@gateway/web/irccloud.com/x-nzizcmzgvpxbzece) left irc: Remote host closed the connection [19:36:55] oal (u4126@gateway/web/irccloud.com/x-hpqxbbfhybbdtlbv) left irc: Remote host closed the connection [19:36:56] roidrage (u1352@gateway/web/irccloud.com/x-tzogpgbbkryrmjft) left irc: Remote host closed the connection [19:36:56] jacqui (u4004@gateway/web/irccloud.com/x-qflzumxbpdmohnxq) left irc: Remote host closed the connection [19:38:04] strmpnk (u2261@gateway/web/irccloud.com/x-nuymsoargglzirhd) left irc: Remote host closed the connection [19:42:35] oal (u4126@gateway/web/irccloud.com/x-blrjtkigsdtwvnmu) joined #redis. [19:44:16] strmpnk (u2261@gateway/web/irccloud.com/x-qauymmrpvyxgowvs) joined #redis. [19:44:49] jacqui (u4004@gateway/web/irccloud.com/x-onsljntyjbmvweno) joined #redis. [19:48:46] croaky (u3102@gateway/web/irccloud.com/x-iwaopciuccgormft) joined #redis. [19:49:39] purbon (u1730@gateway/web/irccloud.com/x-jabgohhmdfvrfmdq) joined #redis. [19:50:35] roidrage (u1352@gateway/web/irccloud.com/x-nigluodmzhxpiemn) joined #redis. [19:55:32] qrush (u1528@gateway/web/irccloud.com/x-lnfsygfjwfytgamu) joined #redis. [19:58:04] ryanbriones (u2050@gateway/web/irccloud.com/x-mbuqdbcbhpwpzsnq) joined #redis. [20:06:19] samrat_ (u2534@gateway/web/irccloud.com/x-yhwywmdmamdufgkc) joined #redis. [20:07:01] mrb_bk (u2099@gateway/web/irccloud.com/x-yrcmircjnnlupgfh) joined #redis. [20:10:18] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) joined #redis. [20:24:45] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) left irc: Quit: jtsnow [20:27:05] akahn (u2243@gateway/web/irccloud.com/x-czxbmlwjvhgyombn) joined #redis. [20:30:15] Nick change: Nuck -> NuckOff [20:30:55] NetRoY (~NetRoY@122.170.45.238) joined #redis. [20:31:48] soveran (~soveran@186.19.214.247) joined #redis. [20:36:30] sarkis (~sarkis@unaffiliated/sako) joined #redis. [20:36:33] jacqui (u4004@gateway/web/irccloud.com/x-onsljntyjbmvweno) left irc: Remote host closed the connection [20:36:33] samrat_ (u2534@gateway/web/irccloud.com/x-yhwywmdmamdufgkc) left irc: Remote host closed the connection [20:36:54] mrb_bk (u2099@gateway/web/irccloud.com/x-yrcmircjnnlupgfh) left irc: Remote host closed the connection [20:36:54] roidrage (u1352@gateway/web/irccloud.com/x-nigluodmzhxpiemn) left irc: Remote host closed the connection [20:36:54] oal (u4126@gateway/web/irccloud.com/x-blrjtkigsdtwvnmu) left irc: Remote host closed the connection [20:36:54] purbon (u1730@gateway/web/irccloud.com/x-jabgohhmdfvrfmdq) left irc: Remote host closed the connection [20:36:54] akahn (u2243@gateway/web/irccloud.com/x-czxbmlwjvhgyombn) left irc: Remote host closed the connection [20:36:54] strmpnk (u2261@gateway/web/irccloud.com/x-qauymmrpvyxgowvs) left irc: Read error: Connection reset by peer [20:36:54] qrush (u1528@gateway/web/irccloud.com/x-lnfsygfjwfytgamu) left irc: Read error: Connection reset by peer [20:36:55] croaky (u3102@gateway/web/irccloud.com/x-iwaopciuccgormft) left irc: Remote host closed the connection [20:36:55] ryanbriones (u2050@gateway/web/irccloud.com/x-mbuqdbcbhpwpzsnq) left irc: Remote host closed the connection [20:36:55] lusis (u2537@gateway/web/irccloud.com/x-cncuystcecezulzv) left irc: Remote host closed the connection [20:36:56] omarkj (u766@gateway/web/irccloud.com/x-sdiwglufgmztndqf) left irc: Write error: Broken pipe [20:36:59] Andrei (43fa04d2@gateway/web/freenode/ip.67.250.4.210) joined #redis. [20:37:03] ryanbriones (u2050@gateway/web/irccloud.com/x-dwsuxhbhexkprkax) joined #redis. [20:37:20] hi everybody [20:38:00] need some advise on redis [20:38:28] I have to generate a big dataset to test redis [20:38:43] what's the best approach using lua or load it externally ? [20:39:02] the data are lots of random values [20:43:05] croaky (u3102@gateway/web/irccloud.com/x-vzojgasisimlzpgk) joined #redis. [20:43:13] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 268 seconds [20:43:48] oal (u4126@gateway/web/irccloud.com/x-bvuoshqsksukpjow) joined #redis. [20:45:43] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection [20:46:26] lusis (u2537@gateway/web/irccloud.com/x-vrbbdcdxrvresbju) joined #redis. [20:46:37] jacqui (u4004@gateway/web/irccloud.com/x-skyhazscgetdupks) joined #redis. [20:51:06] purbon (u1730@gateway/web/irccloud.com/x-jmcnnrwuatvxwoys) joined #redis. [20:51:15] strmpnk (u2261@gateway/web/irccloud.com/x-pmzcfyxftufplfhx) joined #redis. [20:54:31] phil_ss (~philip@186.204.122.227) joined #redis. [20:55:14] phil_ss (~philip@186.204.122.227) left irc: Client Quit [20:57:27] omarkj (u766@gateway/web/irccloud.com/x-pbahdefgdqmoroni) joined #redis. [20:58:07] ncode (~ncode@unaffiliated/ncode) joined #redis. [21:01:55] NetRoY (~NetRoY@122.170.45.238) left irc: Ping timeout: 276 seconds [21:02:54] NetRoY (~NetRoY@122.170.45.238) joined #redis. [21:07:06] Nick change: jdunck -> jdunck_away [21:07:11] Nick change: jdunck_away -> jdunck [21:07:21] samrat_ (u2534@gateway/web/irccloud.com/x-uhcejeagsvkaekqf) joined #redis. [21:07:51] mrb_bk (u2099@gateway/web/irccloud.com/x-wqivlhkcbzbtiblf) joined #redis. [21:07:52] mattly (u2222@gateway/web/irccloud.com/x-jkvwrfytgbmqdzwz) joined #redis. [21:11:17] NetRoY (~NetRoY@122.170.45.238) left irc: Ping timeout: 248 seconds [21:16:03] Andrei: This can be done any way. Choose what you're most comfortable with. [21:17:53] akahn (u2243@gateway/web/irccloud.com/x-jvppzmxrhnzxlyun) joined #redis. [21:20:15] Andrei (43fa04d2@gateway/web/freenode/ip.67.250.4.210) left irc: Ping timeout: 258 seconds [21:24:53] ncode (~ncode@unaffiliated/ncode) left irc: Quit: Computer has gone to sleep. [21:26:39] ncode (~ncode@unaffiliated/ncode) joined #redis. [21:38:29] qrush (u1528@gateway/web/irccloud.com/x-enravhkgigekbkmt) joined #redis. [21:40:03] roidrage (u1352@gateway/web/irccloud.com/x-unvmdjrztdclxjqw) joined #redis. [21:40:23] sarkis (~sarkis@unaffiliated/sako) joined #redis. [21:56:48] NetRoY (~NetRoY@122.170.45.238) joined #redis. [21:59:31] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis. [22:00:50] kennethepperly (~cinch@boxand.lnk.telstra.net) left irc: Remote host closed the connection [22:00:58] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis. [22:02:08] kennethepperly (~cinch@boxand.lnk.telstra.net) left irc: Remote host closed the connection [22:02:18] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis. [22:07:34] kennethepperly (~cinch@boxand.lnk.telstra.net) left irc: Remote host closed the connection [22:07:40] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis. [22:07:51] kennethepperly (~cinch@boxand.lnk.telstra.net) left irc: Remote host closed the connection [22:11:29] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis. [22:13:51] NetRoY (~NetRoY@122.170.45.238) left irc: Quit: Leaving [22:21:24] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 245 seconds [22:22:02] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) left irc: Ping timeout: 248 seconds [22:34:42] ncode (~ncode@unaffiliated/ncode) left irc: Quit: Computer has gone to sleep. [22:55:39] zitchdog (~textual@173-25-169-137.client.mchsi.com) left irc: Quit: Computer has gone to sleep. [22:55:40] rurufufuss (~rurufufus@115-64-27-246.static.tpgi.com.au) left irc: Ping timeout: 276 seconds [22:57:45] ncode (~ncode@unaffiliated/ncode) joined #redis. [23:03:33] h0bbit (~vedang@59.95.15.72) joined #redis. [23:07:36] sarkis (~sarkis@unaffiliated/sako) joined #redis. [23:07:56] rurufufuss (~rurufufus@115-64-27-246.static.tpgi.com.au) joined #redis. [23:08:48] soveran (~soveran@186.19.214.247) joined #redis. [23:15:00] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 240 seconds [23:23:30] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection [23:23:58] xer0x (~xer0x@S0106000625746e56.vc.shawcable.net) joined #redis. [23:28:41] xer0x (~xer0x@S0106000625746e56.vc.shawcable.net) left irc: Read error: Connection reset by peer [23:33:16] ron (~ron@unaffiliated/ron) left irc: Ping timeout: 240 seconds [23:35:53] ron (~ron@unaffiliated/ron) joined #redis. [23:46:29] _macro (~Neil@c-71-204-169-22.hsd1.ca.comcast.net) joined #redis. [23:49:05] rittyan (~rittyan@176.14.223.136) joined #redis. [23:51:18] pyr (pyr@lynx.spootnik.org) joined #redis. [23:52:01] h0bbit (~vedang@59.95.15.72) left irc: Ping timeout: 252 seconds [23:56:42] pyr (pyr@lynx.spootnik.org) left #redis. [23:57:57] crodas (~crodas@git.crodas.org) left irc: Ping timeout: 252 seconds [00:00:00] --- Sat Jan 14 2012