- [00:01] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Quit: Computer has gone to sleep.
- [00:05] RobWC (~Adium@50-76-52-161-ip-static.hfc.comcastbusiness.net) left irc: Quit: Leaving.
- [00:06] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) joined #redis.
- [00:07] rittyan (~rittyan@95-24-58-110.broadband.corbina.ru) left irc: Remote host closed the connection
- [00:08] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Client Quit
- [00:09] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) joined #redis.
- [00:10] tdegrunt (~tdegrunt@94.247.1.141) joined #redis.
- [00:11] sarkis (~sarkis@unaffiliated/sako) joined #redis.
- [00:22] ron (~ron@unaffiliated/ron) left irc: Ping timeout: 252 seconds
- [00:23] ambroff (~ambroff@c-24-4-207-161.hsd1.ca.comcast.net) joined #redis.
- [00:23] siebertm (~micha@p5DDB9205.dip.t-dialin.net) joined #redis.
- [00:25] <siebertm> when I do a "BLPOP key, any_timeout" and someone pulls the plug out of my redis server (which is somewhere on the network), none of the redis clients i tried EVER returns from the BLPOP call
- [00:25] <siebertm> ( tried node-redis, redis-rb and hiredis - also via redis-rb)
- [00:26] <siebertm> who is supposed to handle that problem? client, server or calling application?
- [00:26] <siebertm> same happens when the connection is in subscribe mode, too....
- [00:26] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Quit: Computer has gone to sleep.
- [00:29] yoyohey (632f4271@gateway/web/freenode/ip.99.47.66.113) joined #redis.
- [00:29] <yoyohey> hi
- [00:30] <yoyohey> does redis cluster have consistent hashing support ?
- [00:31] ron (~ron@unaffiliated/ron) joined #redis.
- [00:32] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 248 seconds
- [00:36] ajsharp -> ajsharp_zz
- [00:40] h0bbit (~vedang@121.243.225.226) joined #redis.
- [00:41] h0bbit (~vedang@121.243.225.226) left irc: Read error: Connection reset by peer
- [00:41] h0bbit (~vedang@121.243.225.226) joined #redis.
- [00:44] ChristianS_ (c2ec3c6a@gateway/web/freenode/ip.194.236.60.106) joined #redis.
- [00:46] peaceman (~peaceman@pD95812AE.dip.t-dialin.net) joined #redis.
- [00:49] old_sound (~old_sound@77-58-253-248.dclient.hispeed.ch) joined #redis.
- [00:50] rittyan (~rittyan@2a02:6b8:0:40c:7aca:39ff:feb3:d779) joined #redis.
- [00:51] thehodge (~thehodge@2001:470:1f09:13a3:d81e:b420:a858:2882) joined #redis.
- [00:51] yoyohey (632f4271@gateway/web/freenode/ip.99.47.66.113) left irc: Quit: Page closed
- [00:57] nopz___ (~nopz___@8.14.117.35) joined #redis.
- [01:00] ajsharp_zz -> ajsharp
- [01:02] old_sound (~old_sound@77-58-253-248.dclient.hispeed.ch) left irc: Quit: old_sound
- [01:13] NuckOff -> Nuck
- [01:15] siebertm (~micha@p5DDB9205.dip.t-dialin.net) left irc: Quit: siebertm
- [01:34] nwjlyons (~neil@southill.torchbox.com) joined #redis.
- [01:44] peaceman_ (~peaceman@pD951EF64.dip.t-dialin.net) joined #redis.
- [01:45] peaceman (~peaceman@pD95812AE.dip.t-dialin.net) left irc: Read error: Operation timed out
- [01:45] peaceman_ -> peaceman
- [01:49] djuki (~user2@cable-94-189-249-127.dynamic.sbb.rs) joined #redis.
- [01:51] drbobbeaty (~drbobbeat@c-67-184-75-162.hsd1.il.comcast.net) joined #redis.
- [02:08] h0bbit (~vedang@121.243.225.226) left irc: Read error: Connection reset by peer
- [02:08] h0bbit (~vedang@121.243.225.226) joined #redis.
- [02:16] sarkis (~sarkis@unaffiliated/sako) joined #redis.
- [02:19] sarkis (~sarkis@unaffiliated/sako) left irc: Client Quit
- [02:20] TimTim (TimTim@cpe-098-026-149-108.triad.res.rr.com) joined #redis.
- [02:20] thehodge (~thehodge@2001:470:1f09:13a3:d81e:b420:a858:2882) left irc: Remote host closed the connection
- [02:21] thehodge (~thehodge@cpc5-seac20-2-0-cust310.7-2.cable.virginmedia.com) joined #redis.
- [02:25] drbobbeaty (~drbobbeat@c-67-184-75-162.hsd1.il.comcast.net) left irc: Quit: drbobbeaty
- [02:25] thehodge (~thehodge@cpc5-seac20-2-0-cust310.7-2.cable.virginmedia.com) left irc: Ping timeout: 245 seconds
- [02:26] rb2k (~rb2k@HSI-KBW-078-042-219-156.hsi3.kabel-badenwuerttemberg.de) joined #redis.
- [02:36] ChristianS_ (c2ec3c6a@gateway/web/freenode/ip.194.236.60.106) left irc: Quit: Page closed
- [02:40] thehodge (~thehodge@82.109.33.196) joined #redis.
- [03:11] insin (~insin@host86-148-254-166.range86-148.btcentralplus.com) joined #redis.
- [03:13] Kosma (kosma@host-6-66.internetunion.pl) joined #redis.
- [03:31] hackband (~hackband@0x5359d382.cpe.ge-1-1-0-1104.bynqu1.customer.tele.dk) joined #redis.
- [03:32] jonesy (~jonesy@pool-173-71-115-162.cmdnnj.fios.verizon.net) left irc: Quit: Computer has gone to sleep.
- [03:38] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis.
- [03:38] lusis (u2537@gateway/web/irccloud.com/x-ihxejwqnnlfcknpb) left irc: Excess Flood
- [03:38] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left irc: Client Quit
- [03:39] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis.
- [03:43] lusis (u2537@gateway/web/irccloud.com/x-cncuystcecezulzv) joined #redis.
- [03:43] Wuushu (c2ec3c6a@gateway/web/freenode/ip.194.236.60.106) joined #redis.
- [03:46] drbobbeaty (~drbobbeat@38.98.137.29) joined #redis.
- [03:48] d0k (~d0k@p5B3B2E15.dip.t-dialin.net) joined #redis.
- [03:56] jano (~djanowski@190.245.30.40) left irc: Remote host closed the connection
- [03:57] ambroff (~ambroff@c-24-4-207-161.hsd1.ca.comcast.net) left irc: Quit: ambroff
- [03:59] thehodge (~thehodge@82.109.33.196) left irc: Remote host closed the connection
- [04:00] thehodge (~thehodge@82.109.33.196) joined #redis.
- [04:01] <ccxCZ> any txredis person here? something's wrong w/ zrangebyscore limit
- [04:02] <ccxCZ> bug bug bug
- [04:03] hadees (~hadees@72-48-91-73.dyn.grandenetworks.net) joined #redis.
- [04:04] kushal (~kdas@fedora/kushal) left irc: Ping timeout: 252 seconds
- [04:04] hadees (~hadees@72-48-91-73.dyn.grandenetworks.net) left irc: Client Quit
- [04:04] thehodge (~thehodge@82.109.33.196) left irc: Ping timeout: 252 seconds
- [04:22] <ccxCZ> btw is there way to issue zrangescore with offset, but not limit the count?
- [04:23] ajsharp -> ajsharp_zz
- [04:24] tilgovi (~randall@couchdb/developer/tilgovi) left irc: Ping timeout: 252 seconds
- [04:27] mattbillenstein (~Adium@67.239.209.154) left irc: Quit: Leaving.
- [05:00] threedot (~threedot@81.214.254.156) joined #redis.
- [05:00] <threedot> hi
- [05:00] <threedot> how can i truncate database
- [05:15] soveran (~soveran@186.19.214.247) joined #redis.
- [05:18] Nuck -> NuckOff
- [05:18] kaiwu (~chatzilla@221.223.115.169) joined #redis.
- [05:19] kaiwu (~chatzilla@221.223.115.169) left irc: Remote host closed the connection
- [05:30] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Ping timeout: 248 seconds
- [05:30] luckman212_ (~irc@pool-108-41-8-176.nycmny.fios.verizon.net) joined #redis.
- [05:33] luckman212 (~irc@pool-108-41-8-176.nycmny.fios.verizon.net) left irc: Ping timeout: 240 seconds
- [05:35] peaceman_ (~peaceman@pD95805F4.dip.t-dialin.net) joined #redis.
- [05:37] peaceman (~peaceman@pD951EF64.dip.t-dialin.net) left irc: Ping timeout: 252 seconds
- [05:37] peaceman_ -> peaceman
- [05:42] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left #redis ("Leaving").
- [05:52] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis.
- [05:57] seppo0010 (~Adium@200.69.194.105) joined #redis.
- [05:57] seppo0010 (~Adium@200.69.194.105) left #redis.
- [06:05] daelious_ (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis.
- [06:06] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left irc: Disconnected by services
- [06:06] daelious_ -> daelious
- [06:08] tdegrunt_ (~tdegrunt@94.247.1.141) joined #redis.
- [06:12] tdegrunt (~tdegrunt@94.247.1.141) left irc: Ping timeout: 252 seconds
- [06:14] Sarevok (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) joined #redis.
- [06:18] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection
- [06:19] tdegrunt_ (~tdegrunt@94.247.1.141) left irc: Ping timeout: 248 seconds
- [06:20] <Kosma> threedot: flushall
- [06:26] <loxs> where is the erlang native client documented?
- [06:26] <loxs> ups, wrong channel
- [06:27] soveran (~soveran@186.19.214.247) joined #redis.
- [06:32] zitchdog (~textual@159.182.1.4) joined #redis.
- [06:34] devdazed (~textual@static-96-239-59-191.nycmny.fios.verizon.net) joined #redis.
- [06:45] jano_ (~djanowski@190.245.30.40) joined #redis.
- [06:45] includex (~includex@194.65.5.235) joined #redis.
- [06:46] jano__ (~djanowski@190.245.30.40) joined #redis.
- [06:46] napperjabber (~napperjab@149.48.161.10) left irc: Remote host closed the connection
- [06:47] jano_ (~djanowski@190.245.30.40) left irc: Read error: Connection reset by peer
- [06:55] <threedot> Kosma: thanks
- [07:00] rittyan (~rittyan@2a02:6b8:0:40c:7aca:39ff:feb3:d779) left irc: Remote host closed the connection
- [07:00] ashc (~ashc@50-56-110-71.static.cloud-ips.com) joined #redis.
- [07:01] jonesy (~jonesy@68.64.144.221) joined #redis.
- [07:04] napperjabber (~napperjab@149.48.161.10) joined #redis.
- [07:05] <ashc> Is there a good place for me to get more information about Redis configuration?
- [07:05] <ashc> and more specifically the multi-db stuff?
- [07:05] <Kosma> ashc: multi-db is going away
- [07:06] <Kosma> it's slowly getting deprecated
- [07:06] <ashc> Kosma: ah.. ok, i was reading some threads about that, but I didn't see any mention of it in the docs
- [07:06] jano__ (~djanowski@190.245.30.40) left irc: Read error: Connection reset by peer
- [07:06] <ashc> i don't actually see too much config stuff in docs.. is there really not that much configuration needed?
- [07:06] <Kosma> ashc: most docs on configuration are in redis.conf comments
- [07:07] <Kosma> also, you can google individual config entries, but they are pretty much self-explanatory and well documented
- [07:07] <ashc> Kosma: cool.. thanks
- [07:07] <ashc> sorry for being so thick =)
- [07:08] Wuushu (c2ec3c6a@gateway/web/freenode/ip.194.236.60.106) left irc: Quit: Page closed
- [07:10] jano_ (~djanowski@190.245.30.40) joined #redis.
- [07:10] ashc (~ashc@50-56-110-71.static.cloud-ips.com) left #redis.
- [07:12] rodrigovieira (~rodrigovi@187.59.120.135) joined #redis.
- [07:14] emocakes (~om@189-11-46-97.mganm703.dsl.brasiltelecom.net.br) joined #redis.
- [07:15] jano_ (~djanowski@190.245.30.40) left irc: Ping timeout: 244 seconds
- [07:15] jano_ (~djanowski@190.245.30.40) joined #redis.
- [07:32] wam (~wam@unaffiliated/wam) left irc: Quit: Ex-Chat
- [07:33] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) joined #redis.
- [07:36] imajes (~imajes@is.imaj.es) left irc: Excess Flood
- [07:37] imajes (~imajes@is.imaj.es) joined #redis.
- [07:40] napperjabber (~napperjab@149.48.161.10) left irc: Quit: napperjabber
- [07:41] napperjabber (~napperjab@149.48.161.10) joined #redis.
- [07:41] ira (~ira@c-24-147-21-104.hsd1.ma.comcast.net) joined #redis.
- [07:43] coopernurse (~coopernur@71-37-43-245.tukw.qwest.net) joined #redis.
- [07:46] soveran_ (~soveran@186.19.214.247) joined #redis.
- [07:46] soveran (~soveran@186.19.214.247) left irc: Read error: Connection reset by peer
- [07:48] ank (~ank@c-67-172-16-188.hsd1.pa.comcast.net) joined #redis.
- [07:48] ajsharp_zz -> ajsharp
- [07:51] xetorthio (~jleibiusk@200.41.238.50) joined #redis.
- [07:52] el_kevino (~el_kevino@216.249.7.209.tor.pathcom.com) joined #redis.
- [07:53] ajsharp -> ajsharp_zz
- [07:54] soveran_ (~soveran@186.19.214.247) left irc: Remote host closed the connection
- [07:57] ajsharp_zz -> ajsharp
- [08:02] djuki (~user2@cable-94-189-249-127.dynamic.sbb.rs) left irc: Remote host closed the connection
- [08:11] thehodge (~thehodge@2001:470:1f09:13a3:29b9:840:7acf:d2f2) joined #redis.
- [08:13] __alex (~alex@g225248159.adsl.alicedsl.de) joined #redis.
- [08:15] Tuxist (~quassel@dslb-092-077-014-198.pools.arcor-ip.net) left irc: Read error: Connection reset by peer
- [08:16] loxs (~metin@85.91.143.230) left irc: Quit: Leaving
- [08:19] h0bbit (~vedang@121.243.225.226) left irc: Ping timeout: 244 seconds
- [08:22] samrat_ (u2534@gateway/web/irccloud.com/x-leiomhiqcolnnrlw) joined #redis.
- [08:22] samrat (u2534@gateway/web/irccloud.com/x-lsrhnjnwrqnpnvyd) left irc: Max SendQ exceeded
- [08:25] tjholowaychuk (~tjholoway@S0106000352031482.gv.shawcable.net) joined #redis.
- [08:28] ira (~ira@c-24-147-21-104.hsd1.ma.comcast.net) left irc: Quit: Leaving...
- [08:29] jscheel (~jscheel@drupal.org/user/116197/view) joined #redis.
- [08:29] NetRoY (~NetRoY@115.248.197.178) joined #redis.
- [08:31] grampajoe (~grampa@50.41.4.191) joined #redis.
- [08:35] gnrfan (~gnrfan@200.110.36.11) joined #redis.
- [08:36] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) joined #redis.
- [08:37] includex (~includex@194.65.5.235) left irc: Remote host closed the connection
- [08:37] NetRoY (~NetRoY@115.248.197.178) left irc: Ping timeout: 248 seconds
- [08:37] rodrigovieira (~rodrigovi@187.59.120.135) left irc: Remote host closed the connection
- [08:38] tjholowaychuk (~tjholoway@S0106000352031482.gv.shawcable.net) left irc: Quit: Bye!
- [08:38] vkandy (~vkandy@static-68-179-6-233.ptr.terago.net) left irc: Quit: Leaving
- [08:42] grampajoe (~grampa@50.41.4.191) left irc: Quit: Bye!
- [08:47] seppo0010 (~Adium@200.69.194.105) joined #redis.
- [08:50] tdegrunt (~tdegrunt@2002:57d2:5406:0:ed90:e1be:bd2c:7c62) joined #redis.
- [08:53] ajsharp -> ajsharp_zz
- [08:56] soveran (~soveran@186.19.214.247) joined #redis.
- [08:58] Yacker (~yacker@cpe-76-179-160-209.maine.res.rr.com) joined #redis.
- [08:59] <Yacker> Hi all, I setup redis as a cache behind a magento instance and I am getting a bunch of errors stating, "read error on connection". I think this is from redis and the funny thing is it is only caused by search bots. Anyone have any ideas what is going on?
- [09:01] jano_ (~djanowski@190.245.30.40) left irc: Remote host closed the connection
- [09:01] threedot (~threedot@81.214.254.156) left #redis.
- [09:02] p1d (~p1d@ns1.vonaffenfels.de) left irc: Quit: ...
- [09:03] luckman212_ (~irc@pool-108-41-8-176.nycmny.fios.verizon.net) left irc: Read error: Connection reset by peer
- [09:05] insin (~insin@host86-148-254-166.range86-148.btcentralplus.com) left irc: Quit: What's the point in giving us haaaaannnds?
- [09:06] dlap (~dlap@c-76-111-226-213.hsd1.fl.comcast.net) joined #redis.
- [09:07] RobWC (~Adium@50-76-52-161-ip-static.hfc.comcastbusiness.net) joined #redis.
- [09:17] RobWC (~Adium@50-76-52-161-ip-static.hfc.comcastbusiness.net) left irc: Quit: Leaving.
- [09:17] kenperkins (~textual@174-24-171-37.tukw.qwest.net) joined #redis.
- [09:23] RobWC (~Adium@2001:470:1f05:f2a:81a0:f7d4:7084:bec8) joined #redis.
- [09:24] gregpascale (~textual@174-24-171-37.tukw.qwest.net) joined #redis.
- [09:26] Treffynnon (~Treffynno@82-69-141-230.dsl.in-addr.zen.co.uk) left irc: Remote host closed the connection
- [09:27] nwjlyons (~neil@southill.torchbox.com) left irc: Remote host closed the connection
- [09:28] el_kevin_ (~el_kevino@216.249.7.209.tor.pathcom.com) joined #redis.
- [09:28] cinemascop89 (~yo@r186-52-54-20.dialup.adsl.anteldata.net.uy) joined #redis.
- [09:28] el_kevino (~el_kevino@216.249.7.209.tor.pathcom.com) left irc: Read error: Connection reset by peer
- [09:34] vkandy (~vkandy@static-68-179-6-233.ptr.terago.net) joined #redis.
- [09:45] peaceman (~peaceman@pD95805F4.dip.t-dialin.net) left irc: Quit: Computer has gone to sleep.
- [09:47] seppo0010 (~Adium@200.69.194.105) left #redis.
- [09:51] zitchdog (~textual@159.182.1.4) left irc: Quit: Computer has gone to sleep.
- [09:55] indstry (~apple@c-71-238-98-243.hsd1.mi.comcast.net) joined #redis.
- [09:55] rodrigovieira (~rodrigovi@187.59.120.135) joined #redis.
- [09:59] h0bbit (~vedang@59.95.15.72) joined #redis.
- [10:06] NetRoY (~NetRoY@122.170.45.238) joined #redis.
- [10:09] nopz___ (~nopz___@8.14.117.35) left irc: Quit: This computer has gone to sleep
- [10:12] RobWC (~Adium@2001:470:1f05:f2a:81a0:f7d4:7084:bec8) left irc: Ping timeout: 252 seconds
- [10:13] RobWC (~Adium@50-76-52-161-ip-static.hfc.comcastbusiness.net) joined #redis.
- [10:14] wmoss|away -> wmoss
- [10:15] stephank (~stephank@82.197.214.45) joined #redis.
- [10:22] emocakes (~om@189-11-46-97.mganm703.dsl.brasiltelecom.net.br) left irc: Ping timeout: 255 seconds
- [10:26] seppo0010 (~Adium@190.195.37.18) joined #redis.
- [10:29] ajsharp_zz -> ajsharp
- [10:31] h0bbit (~vedang@59.95.15.72) left irc: Ping timeout: 240 seconds
- [10:33] h0bbit (~vedang@59.95.15.72) joined #redis.
- [10:35] mattbillenstein (~Adium@65.160.16.86) joined #redis.
- [10:36] seppo0010 (~Adium@190.195.37.18) left #redis.
- [10:37] _macro (~Neil@accessnat4.mochimedia.net) joined #redis.
- [10:39] andymccurdy (~andymccur@69.12.160.66) joined #redis.
- [10:40] ajsharp -> ajsharp_zz
- [10:42] tdegrunt (~tdegrunt@2002:57d2:5406:0:ed90:e1be:bd2c:7c62) left irc: Remote host closed the connection
- [10:45] zitchdog (~textual@159.182.1.4) joined #redis.
- [10:48] tdegrunt (~tdegrunt@ip6-84-210-87.adsl2.static.versatel.nl) joined #redis.
- [10:49] chrisjones (~chrisjone@ip68-224-245-47.lv.lv.cox.net) joined #redis.
- [10:55] <sigmonsays_> What function would be best to use as a mutex?
- [10:56] <sigmonsays_> I see setnx, but that won't block
- [10:56] <sigmonsays_> should I just use brpop for that?
- [10:57] <coopernurse> hmm, how would that work? on the first acquire, brpop would block. how would it unblock?
- [10:58] <sigmonsays_> not sure, didn't rtfm closely yet
- [10:59] rodrigovieira (~rodrigovi@187.59.120.135) left irc: Remote host closed the connection
- [10:59] <coopernurse> here's an example I found
- [10:59] <coopernurse> might be what you're after
- [10:59] <coopernurse> http://www.davidverhasselt.com/2011/08/06/a-distributed-mutex-and-semaphore-using-redis/
- [11:00] <coopernurse> the getset/lpush is sneaky. that was the bit I wasn't sure how to do
- [11:01] <sigmonsays_> Yep, that is pretty sexy
- [11:01] chrisjones (~chrisjone@ip68-224-245-47.lv.lv.cox.net) left irc: Ping timeout: 268 seconds
- [11:01] <coopernurse> redis is slick like that
- [11:02] hackband (~hackband@0x5359d382.cpe.ge-1-1-0-1104.bynqu1.customer.tele.dk) left irc: Remote host closed the connection
- [11:02] powdahou_ (~garret@c-67-169-42-52.hsd1.ca.comcast.net) joined #redis.
- [11:03] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Ping timeout: 240 seconds
- [11:03] powdahou_ -> powdahound
- [11:05] el_kevin_ (~el_kevino@216.249.7.209.tor.pathcom.com) left irc: Read error: Connection reset by peer
- [11:06] el_kevino (~el_kevino@216.249.7.209.tor.pathcom.com) joined #redis.
- [11:08] sigmonsays_ (~cd@c-67-169-42-1.hsd1.ca.comcast.net) left irc: Read error: Operation timed out
- [11:08] sigmonsays_ (~cd@c-67-169-42-1.hsd1.ca.comcast.net) joined #redis.
- [11:08] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) joined #redis.
- [11:08] __alex (~alex@g225248159.adsl.alicedsl.de) left irc: Quit: Leaving
- [11:12] Sembianc1 -> Sembiance
- [11:18] g0bl1n (~g0blin@unaffiliated/g0bl1n) joined #redis.
- [11:18] rittyan (~rittyan@95-24-58-110.broadband.corbina.ru) joined #redis.
- [11:34] pietern (~pieter@208.91.1.14) joined #redis.
- [11:34] #redis: mode change '+v pietern' by ChanServ!ChanServ@services.
- [11:55] rittyan_ (~rittyan@95-24-58-110.broadband.corbina.ru) joined #redis.
- [11:55] rittyan (~rittyan@95-24-58-110.broadband.corbina.ru) left irc: Read error: Connection reset by peer
- [11:56] luckyruby (~luckyruby@rrcs-24-129-162-10.se.biz.rr.com) joined #redis.
- [11:58] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left #redis ("Leaving").
- [11:58] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) joined #redis.
- [11:59] chrisjon_ (~chrisjone@ip68-96-109-92.lv.lv.cox.net) joined #redis.
- [11:59] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) left irc: Read error: Operation timed out
- [11:59] chrisjon_ -> chrisjones
- [12:02] jano (~djanowski@190.245.30.40) joined #redis.
- [12:05] deepthawtz (~deepthawt@209.119.38.226) joined #redis.
- [12:05] sigmonsays_ (~cd@c-67-169-42-1.hsd1.ca.comcast.net) left irc: Quit: Leaving
- [12:05] sigmonsays_ (~cd@c-67-169-42-1.hsd1.ca.comcast.net) joined #redis.
- [12:09] hikeonpast_ (~hikeonpas@71-95-209-244.static.mtpk.ca.charter.com) joined #redis.
- [12:12] rittyan (~rittyan@176.14.223.136) joined #redis.
- [12:15] rittyan_ (~rittyan@95-24-58-110.broadband.corbina.ru) left irc: Ping timeout: 248 seconds
- [12:15] daelious (~daelious@ip-12-157-188-194.kindredhealthcare.com) left irc: Quit: Leaving
- [12:17] pyr (pyr@lynx.spootnik.org) joined #redis.
- [12:18] pyr (pyr@lynx.spootnik.org) left #redis.
- [12:19] indstry (~apple@c-71-238-98-243.hsd1.mi.comcast.net) left irc: Remote host closed the connection
- [12:20] jdunck (~jdunck@173-45-226-22.slicehost.net) joined #redis.
- [12:22] jano (~djanowski@190.245.30.40) left irc: Disconnected by services
- [12:22] jano_ (~djanowski@190.245.30.40) joined #redis.
- [12:23] Ambis (ambis@kapsi.fi) left #redis.
- [12:25] jdunck (~jdunck@173-45-226-22.slicehost.net) left irc: Quit: ZNC by prozac - http://znc.sourceforge.net
- [12:26] jdunck (~jdunck@173-45-226-22.slicehost.net) joined #redis.
- [12:26] gnrfan (~gnrfan@200.110.36.11) left irc: Ping timeout: 240 seconds
- [12:26] mattbillenstein (~Adium@65.160.16.86) left irc: Read error: Connection reset by peer
- [12:26] jdunck -> jdunck_away
- [12:26] jdunck_away -> jdunck
- [12:27] jdunck -> jdunck_away
- [12:27] jdunck_away -> jdunck
- [12:28] tilgovi (~randall@couchdb/developer/tilgovi) joined #redis.
- [12:32] gnrfan (~gnrfan@200.110.36.11) joined #redis.
- [12:35] wmoss -> wmoss|away
- [12:40] gnrfan (~gnrfan@200.110.36.11) left irc: Quit: This computer has gone to sleep
- [12:47] zitchdog (~textual@159.182.1.4) left irc: Quit: Computer has gone to sleep.
- [12:50] wmoss|away -> wmoss
- [12:52] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) left irc: Quit: Textual IRC Client: http://www.textualapp.com/
- [12:52] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) joined #redis.
- [13:04] drbobbeaty_ (~drbobbeat@38.98.137.29) joined #redis.
- [13:04] drbobbeaty (~drbobbeat@38.98.137.29) left irc: Read error: Connection reset by peer
- [13:04] drbobbeaty_ -> drbobbeaty
- [13:05] tilgovi (~randall@couchdb/developer/tilgovi) left irc: Remote host closed the connection
- [13:05] <Brend> coopernurse: But what if the process crashes and never pushes the token back
- [13:06] <coopernurse> Brend: good question
- [13:23] petercooper (~petercoop@82.144.254.2) joined #redis.
- [13:29] ajsharp_zz -> ajsharp
- [13:30] <xb95> weird, we suddenly started experiencing issue 141.
- [13:31] NetRoY (~NetRoY@122.170.45.238) left irc: Ping timeout: 252 seconds
- [13:32] <xb95> hey, so, I just upgraded our slave to 2.4.6 but that doesn't fix the issue
- [13:33] <xb95> my slave is still just queuing up data in the client input buf
- [13:36] <xb95> do I also have to upgrade the master?
- [13:40] <xb95> ah, let me try moving the aof file so the slave doesn't read tyat
- [13:40] g0bl1n (~g0blin@unaffiliated/g0bl1n) left irc: Quit: g0bl1n
- [13:43] <xb95> nope, doesn't seem to have helped.
- [13:43] jonesy (~jonesy@68.64.144.221) left irc: Quit: Computer has gone to sleep.
- [13:45] <hikeonpast_> xb95: My take away from reading the issue notes was that the master needed to be upgraded as well. We haven't done it yet, but its on the short list.
- [13:45] <xb95> hikeonpast_: gotcha, thanks. I don't like upgrading our core production services without running the new version as a slave for a while. :\
- [13:46] <xb95> may not have a choice here, though. I can't really validate 2.4.6 as a slave when it won't replicate.
- [13:46] <pietern> xb95: how many slaves do you have?
- [13:46] <pietern> or, how many slaves are waiting for a sync when you SLAVEOF?
- [13:47] <hikeonpast_> we're in the same boat. One thing that I haven't fully fleshed out is whether the 2.2 branch has the same issue
- [13:47] <pietern> hikeonpast_: it 99% likely has
- [13:47] <hikeonpast_> pietern: good to know. Thanks.
- [13:48] <hikeonpast_> That moves the upgrade a bit higher on my list... ;)
- [13:48] <pietern> hikeonpast_: the bug was in part caused by the introduction of a static output buffer in 2.2
- [13:48] <xb95> pietern: sorry, I'm not sure what you mean by SLAVEOF? should I run that on my slave to get status or something? the logs don't mention how many are connected
- [13:48] <xb95> afaik, there's only one slave
- [13:48] <xb95> the master is our production instance, the slave is just replicating and doing aof for backup purposes
- [13:48] <xb95> we don't spread our reads
- [13:48] <pietern> xb95: that's what you run to attach it to a master
- [13:49] <xb95> sure, but that's in the config file, so I don't run it manually
- [13:49] <pietern> ok
- [13:49] <xb95> and the stdout/stderr doesn't show anything about number of slaves
- [13:49] <pietern> issue 141 should only manifest itself with more than 1 slave trying to SYNC at the same time
- [13:50] <xb95> can I ask the master if it has any slaves connected?
- [13:50] <pietern> xb95: so you run INFO against the slave and see the max input buf growing continuously
- [13:50] <pietern> ?
- [13:50] <pietern> xb95: yep
- [13:50] <xb95> yes pietern, it's growing unbounded until it hits ~2GB then it crashes. well, that's what 2.3.11 did
- [13:50] <xb95> I haven't let 2.4.6 hit 2GB yet
- [13:51] <xb95> how do I ask the master how many slaves are connected? I don't see it in the info output
- [13:51] <xb95> oh
- [13:51] <xb95> connected_slaves:1
- [13:51] <xb95> I'm just blind.
- [13:51] <pietern> what is the replication status?
- [13:51] <pietern> as seen in the slave's INFO
- [13:51] <xb95> master_host:redis-master
- [13:51] <xb95> master_port:6379
- [13:51] <xb95> master_link_status:up
- [13:51] <xb95> master_last_io_seconds_ago:0
- [13:51] <xb95> master_sync_in_progress:0
- [13:51] <xb95> client_biggest_input_buf:73845106 (and strictly increasing.)
- [13:52] <pietern> xb95: and the slave doesn't reflect the writes on the master?
- [13:52] dschn (~dschn@c-064-186-242-006.sd2.redwire.net) joined #redis.
- [13:52] <xb95> correct, if I run "set foo 1" on the master, then wait a while, "get foo" returns (nil) on the slave
- [13:53] <xb95> the number of keys is different, 2.8m on the master, 2.3m on the slave
- [13:53] <xb95> and the slave is not writing to the aof file at all
- [13:53] <pietern> xb95: well, it should start out with the same number of keys
- [13:54] <pietern> as the master deletes expired keys, and adds new ones the two figures likely diverge
- [13:54] <pietern> (in your case)
- [13:54] <xb95> right
- [13:54] <pietern> can you gist your full slave info output?
- [13:54] <xb95> sure
- [13:56] <xb95> https://gist.github.com/1608912
- [13:58] <pietern> thanks
- [13:58] <pietern> checking it out
- [13:58] <xb95> np
- [13:58] <pietern> xb95: 3 clients
- [13:58] <pietern> xb95: 1 is the slave
- [13:58] <pietern> xb95: 1 is redis-cli
- [13:58] <pietern> xb95: what is the other one?
- [13:58] <xb95> OpenTSDB
- [13:58] <pietern> does it BLPOP?
- [13:58] xetorthio (~jleibiusk@200.41.238.50) left irc: Quit: Ex-Chat
- [13:58] <xb95> nope, all it does is INFO
- [13:59] <xb95> every ~15 seconds
- [13:59] <pietern> ok
- [13:59] <pietern> that means the slave must be blocked
- [13:59] <pietern> I see you are running 2.3 on your master
- [13:59] <pietern> let me check the commit logs
- [13:59] <xb95> yeah, it's been working just fine until a few days ago
- [14:00] <xb95> on Monday for some reason the slave started exhibiting this behavior :)
- [14:00] <pietern> but I think the master feeds a blocking command to the slave, causing the link to block up
- [14:00] <pietern> did you deploy any new stuff?
- [14:00] <xb95> probably, yes. we deploy pretty regularly here (I work at Bump)
- [14:00] <pietern> xb95: cool
- [14:00] <pietern> xb95: let me check the logs real quick
- [14:00] <pietern> xb95: I recall such an issue being resolved at some point
- [14:01] <pietern> probably between 2.2 and 2.4 (where your master is at)
- [14:02] <xb95> right
- [14:02] <pietern> you're running RC8
- [14:02] <pietern> 2.4 RC8
- [14:05] <xb95> does that explain the issue?
- [14:05] <xb95> I'm reading the release notes
- [14:05] <pietern> it doesn't... yet
- [14:06] <xb95> yeah, I don't see anything that jumps out at me
- [14:06] <pietern> xb95: I suspect the following is happening
- [14:07] <pietern> there are probably a bunch of BLPOP's happening on the server
- [14:07] <pietern> for some reason, one of them is replicated, causing the slave to block
- [14:07] <pietern> the weird thing is
- [14:07] <pietern> all canonical BLPOP scenarios are covered,
- [14:07] <pietern> I know they are not replicated
- [14:07] <pietern> however, there may be some edge case where they are
- [14:08] <pietern> could you monitor your prod instance and see what kind of BLPOP commands, in which particular order, are being issued
- [14:08] <pietern> or better, ask devs which BLPOP-related changes they have merged this monday?
- [14:09] <pietern> this should definitely not happen though
- [14:10] <xb95> actually, yeah, I just chatted with one of the devs, and I'm grepping the source
- [14:10] <xb95> git grep -i blpop returns nothing... hm
- [14:10] <xb95> and he's not aware of us ever using it
- [14:10] <xb95> bump@fathen:/bump/logs$ strace -s 500 -fp 26955 -e trace=read 2>&1 | grep -i BLPOP
- [14:10] <xb95> ........ nothing ...........
- [14:11] <pietern> xb95: that's your prod redis with full output?
- [14:11] <pietern> ok
- [14:11] <xb95> yeah, that's the prod redis instance
- [14:11] <pietern> let me think a bit...
- [14:11] <xb95> it does ~1000 qps
- [14:12] <xb95> we do use RPOP
- [14:12] <xb95> er BRPOP
- [14:12] <xb95> which is also blocking?
- [14:12] <pietern> yep
- [14:12] <pietern> ok
- [14:12] <pietern> forget about that one every time ;)
- [14:14] <pietern> what are the brpop patterns that are used?
- [14:14] <pietern> simple 1-1 blocking pops on lists, where other clients push straight onto?
- [14:15] <pietern> or complex patterns with BRPOPLPUSH ?
- [14:15] <xb95> yeah, we're using redis to help us communicate between workers on many machines. someone submits a job with LPUSH, then workers BRPOP a job
- [14:15] <xb95> but afaik it should be very small queues, they're not huge
- [14:15] <pietern> right, but nothing complex
- [14:16] <xb95> hehe, I don't know how you define complex, but I don't think it is
- [14:16] <pietern> ok :)
- [14:16] <pietern> xb95: I'll investigate a bit, and see what I can find
- [14:16] <pietern> but I believe we sealed this kind of bug a while ago
- [14:17] <pietern> I'm just going over the code again to make sure we didn't miss anything
- [14:17] <xb95> makes sense.
- [14:17] <xb95> it's weird that it started randomly monday morning. we hadn't upgraded anything in a long time.
- [14:17] <xb95> no code deployments monday morning either. well, none were recorded. can't rule out a ninja deploy.
- [14:19] <pietern> xb95: it happened while a slave was still attached?
- [14:19] <pietern> or after trying out 2.4.6 for a slave
- [14:19] <xb95> hold on, let me check.. I can correlate the uptime graph and the buffer list graph
- [14:24] <xb95> http://xb95.com/pics/redis2.png
- [14:24] <xb95> this is from the slave.
- [14:24] <xb95> on monday morning.
- [14:24] <xb95> at 0716 or so, it stopped processing commands, but it was still alive
- [14:24] <xb95> and it was not queuing data in the input buffer (blue line)
- [14:25] <dschn> I take it there's no way to have an empty list w/o using some type of sentinel as first item
- [14:25] <pietern> dschn: no, redis doesn't have empty values
- [14:25] <pietern> xb95: thanks
- [14:25] <pietern> xb95: do you know of anything else that happened at that time?
- [14:26] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis.
- [14:26] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Excess Flood
- [14:26] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis.
- [14:26] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Excess Flood
- [14:26] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis.
- [14:26] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Excess Flood
- [14:27] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis.
- [14:27] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) left irc: Excess Flood
- [14:27] Axsuul (~Axsuul@75-140-75-52.dhcp.mtpk.ca.charter.com) joined #redis.
- [14:27] <xb95> there's something with disk space... so it makes me think someone was writing a bunch... looking deeper
- [14:28] h0bbit (~vedang@59.95.15.72) left irc: Ping timeout: 276 seconds
- [14:28] gnrfan (~gnrfan@200.48.22.49) joined #redis.
- [14:28] <xb95> hm
- [14:28] <xb95> [26955] 09 Jan 09:18:51 * Slave ask for synchronization
- [14:28] <xb95> that maps to when the slave stopped processing commands
- [14:29] <pietern> xb95: probably a short network outage
- [14:29] <xb95> oh!
- [14:29] <pietern> requiring a resync
- [14:29] <xb95> yes yes, we had a network outage Monday morning
- [14:29] <pietern> but after resync it should pick up again
- [14:29] <xb95> so the slave asked for a resync, and now it's fubar
- [14:30] <pietern> hmmm
- [14:30] <pietern> yesss
- [14:30] <xb95> that would make two slaves
- [14:30] <xb95> since it reconnected, but the master still had the old one
- [14:30] <xb95> so this is issue 141 still
- [14:30] <xb95> the master is in some fubar state now
- [14:30] <pietern> xb95: what do you mean with "still had the old one"?
- [14:30] <xb95> well, the master doesn't ping the slave, right?
- [14:31] <xb95> so how does the master know if the slave has dropped?
- [14:31] <xb95> it's possible that the slave reconnected before the master knew it was gone
- [14:31] <xb95> so the master would see two slaves briefly
- [14:31] rb2k (~rb2k@HSI-KBW-078-042-219-156.hsi3.kabel-badenwuerttemberg.de) left irc: Quit: rb2k
- [14:31] <pietern> xb95: I see what you mean, but no
- [14:31] <pietern> 141 should only manifest itself when 2 slaves are doing a concurrent SYNC
- [14:32] <xb95> oh yes
- [14:32] <pietern> not when 1 is attached and the other does a SYNC
- [14:32] <xb95> the network issues weren't 100% downtime, it was manifested as huge packet loss
- [14:32] <xb95> so, it's possible, the slave reconnected more than once and had concurrent SYNCs going
- [14:33] <xb95> let me gist this
- [14:33] <xb95> https://gist.github.com/1609132
- [14:33] <xb95> check that server log
- [14:33] <xb95> a sync started at 09:20:44 and 09:21:49
- [14:34] <xb95> the first wasn't yet done
- [14:34] <pietern> xb95: exactly
- [14:34] <pietern> this is 141 material ;)
- [14:34] <xb95> so, issue 141. master is fubar. I have to upgrade and restart.
- [14:34] <pietern> xb95: one sec
- [14:34] <xb95> sure
- [14:34] <pietern> xb95: this holds true for this particular manifestation
- [14:35] <pietern> but not when there is only one slave
- [14:35] <xb95> 'this' holds true? which this? that I hve to upgrade/restart the master?
- [14:35] <pietern> so if you restart the slave, it should again *correctly* sync
- [14:35] <xb95> well the slave has been restarted ~20 times since Monday.. every time it crsahes :)
- [14:36] gnrfan (~gnrfan@200.48.22.49) left irc: Quit: Leaving
- [14:36] <pietern> xb95: when the slave restarts, there is only 1 SYNC going on
- [14:36] <pietern> so, it is definitely 141 in the log on monday
- [14:36] <xb95> okay.
- [14:36] <pietern> but I doubt that subsequent restarts would have shown the same issue
- [14:37] <pietern> since that only had a single slave doing a SYNC
- [14:37] <xb95> ah :(
- [14:37] <pietern> nonetheless, updating/restarting the master sounds like a plan
- [14:37] <pietern> but I'm not too sure it resolves the particular issue
- [14:37] dlap (~dlap@c-76-111-226-213.hsd1.fl.comcast.net) left irc: Quit: dlap
- [14:37] <pietern> maybe there is some artifact that I'm not taking in account now, which would again point to 141
- [14:37] <pietern> let me look more in depth at the patches
- [14:38] napperjabber (~napperjab@149.48.161.10) left irc: Remote host closed the connection
- [14:38] <pietern> xb95: btw, 30 billion commands in ~100 days
- [14:38] <pietern> nice :)
- [14:39] <pietern> xb95: and, this is not an explanation for "blocked_clients:1"
- [14:39] <pietern> on the slave
- [14:40] <xb95> hehe, yeah, Bump is pretty popular
- [14:40] <pietern> (which would mean the master/slave link is blocked, since the other 2 clients do INFO)
- [14:41] <xb95> hm
- [14:41] <xb95> ah right
- [14:42] jdunck -> jdunck_away
- [14:42] <pietern> xb95: there's a way to find out what is going on
- [14:42] jdunck_away -> jdunck
- [14:42] <pietern> but that involves attaching gdb
- [14:42] <xb95> if it's fast, I can do it
- [14:43] <xb95> as long as it won't kill the process, too...the master does not write an AOF file
- [14:43] <xb95> so our only copy of teh data is in memory
- [14:43] hackband (~hackband@1385159443.dhcp.dbnet.dk) joined #redis.
- [14:43] <xb95> (we use the slave for persistence pruposes)
- [14:44] <pietern> one sec, thinking through the process
- [14:46] <xb95> sure
- [14:46] <xb95> and I will dry run the process against a different redis that is backed up :)
- [14:46] <pietern> yeah, doing the same thing
- [14:47] <pietern> I think we should be able to find out which command blocked the server
- [14:47] <pietern> it should be the one that was executed as the last one, blocking the server
- [14:47] <xb95> nice
- [14:47] <pietern> its args should still be available
- [14:47] <pietern> with some luck... :)
- [14:48] <pietern> I guess this takes me a little longer than a couple of minutes, so please bear with me :)
- [14:48] <xb95> yeah no hurry on my end
- [14:49] <xb95> I really appreciate you helping us out
- [14:49] <xb95> if you're nearby the SF Bay Area we'd be happy to buy you lunch or a beer sometime :)
- [14:49] rittyan (~rittyan@176.14.223.136) left irc: Remote host closed the connection
- [14:50] xer0x (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) joined #redis.
- [14:52] <pietern> in palo alto :)
- [14:52] devdazed (~textual@static-96-239-59-191.nycmny.fios.verizon.net) left irc: Quit: Computer has gone to sleep.
- [14:52] <xb95> nice, we're down here in mountain view
- [14:52] <xb95> right by castro st
- [14:55] xer0x (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) left irc: Remote host closed the connection
- [14:55] xer0x (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) joined #redis.
- [14:56] ambroff (~ambroff@209.66.114.6) joined #redis.
- [14:56] hikeonpast_ (~hikeonpas@71-95-209-244.static.mtpk.ca.charter.com) left irc: Quit: ChatZilla 0.9.88 [Firefox 9.0.1/20111220165912]
- [15:15] mattbillenstein (~Adium@65.160.16.86) joined #redis.
- [15:20] deepthawtz (~deepthawt@209.119.38.226) left irc: Quit: Leaving...
- [15:21] mattbillenstein (~Adium@65.160.16.86) left irc: Ping timeout: 240 seconds
- [15:22] <pietern> xb95: nice
- [15:22] <pietern> xb95: it appears that I can't inspect free'd memory with gdb
- [15:22] Yacker (~yacker@cpe-76-179-160-209.maine.res.rr.com) left irc:
- [15:23] <xb95> hm
- [15:23] <xb95> I thought you could inspect any address
- [15:23] <pietern> this one is complaining...
- [15:23] mattbillenstein (~Adium@65.160.16.86) joined #redis.
- [15:23] <pietern> xb95: I did find another technique though
- [15:24] <pietern> so, SLAVEOF kicks off a bgsave on the master
- [15:24] <pietern> then queues all write ops
- [15:24] <pietern> first the dump gets send to the slave and loaded there
- [15:24] <pietern> then, the pending write ops are received and executed as the slave catches up with the stream
- [15:24] <pietern> now, all commands that are received as part of that stream are executed just as other commands
- [15:24] <xb95> yeah, the dump/load seems to work, and it's receiving commands. it just isn't executing.
- [15:25] <pietern> so to find out which command is causing the blockage, you can spin up a "redis-cli monitor" against the slave
- [15:25] <xb95> although I'm not 100% sure the dump/load is accurate since the count of keys is very different
- [15:25] <pietern> WHILE it is receiving the sync
- [15:25] <xb95> alright
- [15:25] <pietern> then, as the slave finished loading and starts taking normal commands, it will display those
- [15:26] <pietern> and it hopefully becomes clear which command causes blockage
- [15:26] <pietern> but you say the key count is very different after the dump?
- [15:26] <xb95> well, it was off by a few hundred thousand ~20 minutes after
- [15:26] <xb95> let me restart the slave so it does a fresh bgsave/sync
- [15:26] <xb95> I'll do the monitor and check the keys
- [15:29] <xb95> bgsave takes ~5 minutes
- [15:31] <pietern> cool, thanks
- [15:31] <pietern> hope that shows something
- [15:32] <pietern> if it shows a blpop/brpop I can start looking in some direction
- [15:32] <pietern> especially when there is a huge discrepancy in key count
- [15:32] <xb95> bam!
- [15:32] <xb95> slave is now in the "broken" state
- [15:32] <xb95> db0:keys=2289617,expires=2289570
- [15:32] <xb95> client_biggest_input_buf:23126073
- [15:33] <xb95> and just gorwing
- [15:33] <xb95> 1326497541.689574 "info"
- [15:33] <xb95> 1326497544.240062 "info"
- [15:33] <xb95> 1326497546.906062 "info"
- [15:33] <xb95> 1326497547.232495 "BRPOP" "transient:last_bump:5B08D33D-F465-439F-8B45-0CCF7D862EC5" "0"
- [15:33] <xb95> 1326497548.450847 "info"
- [15:33] <xb95> 1326497554.830340 "info"
- [15:33] <xb95> 1326497576.740781 "info"
- [15:33] <xb95> that BRPOP is the only thing in the output other than my info spam
- [15:34] <pietern> ok
- [15:34] <pietern> boom!
- [15:34] <pietern> how many keys/expires on the master?
- [15:34] <pietern> for perspective?
- [15:34] <xb95> db0:keys=2826622,expires=2826575
- [15:34] <xb95> ~600,000 difference
- [15:34] <pietern> wtf
- [15:35] <pietern> this is definitely not 141
- [15:35] <pietern> what I think is happening:
- [15:36] <pietern> for some reason keys do not end up on the slave, and, where the transient BRPOP falls through on the master,
- [15:36] <pietern> it does not on the slave, because it cannot pop from this key
- [15:36] <xb95> makes sense. the slave then blocks.
- [15:36] <pietern> let me start looking in the direction of dictionary management for 2.4-rc8
- [15:36] <pietern> thanks for the info
- [15:36] <xb95> absolutely, anything you need :)
- [15:37] drbobbeaty (~drbobbeat@38.98.137.29) left irc: Quit: drbobbeaty
- [15:39] d0k_ (~d0k@p5B3B2E15.dip.t-dialin.net) joined #redis.
- [15:39] Bakanaka (474a5dbf@gateway/web/freenode/ip.71.74.93.191) joined #redis.
- [15:39] <Bakanaka> Anyone know how ae.c works?
- [15:40] Keltia_ (roberto@aran.keltia.net) joined #redis.
- [15:41] <Bakanaka> Trying to figure out why deleting an event can only be done when fd < set size
- [15:41] jano (~djanowski@190.245.30.40) joined #redis.
- [15:41] ank_ (~ank@c-67-172-16-188.hsd1.pa.comcast.net) joined #redis.
- [15:41] Sarevok1 (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) joined #redis.
- [15:42] <Bakanaka> Also, why is event loop->events init to null?
- [15:42] tdegrunt (~tdegrunt@ip6-84-210-87.adsl2.static.versatel.nl) left irc: Quit: Leaving...
- [15:42] seppo0010 (~Adium@186.19.19.229) joined #redis.
- [15:42] Shapeshi1ter (~Shapeshif@saskatoon.icu.uzh.ch) joined #redis.
- [15:43] leifkb_ (~leifkb@defiant.ecritters.biz) joined #redis.
- [15:45] <pietern> Bakanaka: fds > setsize cannot be addressed
- [15:45] <pietern> there is a fixed array of fds
- [15:46] <pietern> xb95: can't find fixes in later commits for 2.4
- [15:46] <xb95> so, this is probably not a known issue then.
- [15:46] <pietern> which could mean that this bug is in there all along
- [15:46] <pietern> right
- [15:46] <Bakanaka> Ok, thanks. Ahh, I forgot fd was an argument
- [15:47] <xb95> On the one hand, I like finding new things :) on the other, it's nice to hear "do X, fixed" :(
- [15:48] <pietern> xb95: right...
- [15:48] jano_ (~djanowski@190.245.30.40) got netsplit.
- [15:48] kenperkins (~textual@174-24-171-37.tukw.qwest.net) got netsplit.
- [15:48] ank (~ank@c-67-172-16-188.hsd1.pa.comcast.net) got netsplit.
- [15:48] Sarevok (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) got netsplit.
- [15:48] d0k (~d0k@p5B3B2E15.dip.t-dialin.net) got netsplit.
- [15:48] QiBala (~QiBala@nodester.com) got netsplit.
- [15:48] roidrage (u1352@gateway/web/irccloud.com/x-mfvitnikzxhlgisw) got netsplit.
- [15:48] Keltia (roberto@aran.keltia.net) got netsplit.
- [15:48] Shapeshifter (~Shapeshif@unaffiliated/shapeshifter) got netsplit.
- [15:48] leifkb (~leifkb@defiant.ecritters.biz) got netsplit.
- [15:48] d0k_ -> d0k
- [15:48] Possible future nick collision: d0k
- [15:48] ank_ -> ank
- [15:48] Possible future nick collision: ank
- [15:49] kenperkins (~textual@174-24-171-37.tukw.qwest.net) returned to #redis.
- [15:50] <pietern> xb95: you have the dump made by the master just now?
- [15:50] <xb95> yeah
- [15:50] <xb95> I'm running a check-dump on it atm
- [15:50] <pietern> can you preserve it?
- [15:51] <pietern> just to be sure
- [15:51] <xb95> ==== Processed 2290242 valid opcodes (in 9493388183 bytes) =====================
- [15:51] <xb95> sure
- [15:51] <pietern> ok 10 gigs
- [15:51] <xb95> preserving it
- [15:52] roidrage (u1352@gateway/web/irccloud.com/x-tzogpgbbkryrmjft) joined #redis.
- [15:52] andymccurdy (~andymccur@69.12.160.66) left irc: Ping timeout: 252 seconds
- [15:53] QiBala (~QiBala@nodester.com) returned to #redis.
- [15:59] Keltia (roberto@aran.keltia.net) got lost in the net-split.
- [15:59] leifkb (~leifkb@defiant.ecritters.biz) got lost in the net-split.
- [15:59] Shapeshifter (~Shapeshif@unaffiliated/shapeshifter) got lost in the net-split.
- [15:59] Sarevok (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) got lost in the net-split.
- [15:59] jano_ (~djanowski@190.245.30.40) got lost in the net-split.
- [15:59] <pietern> xb95: tracking down different code paths..
- [15:59] <xb95> awesome. :)
- [16:01] <xb95> also, oddly, the redis-check-dump bundled in 2.4 rc8 can't read this dump file
- [16:01] <xb95> mark@zima ~/code/redis-2.4.0-rc8/src % ./redis-check-dump ~/bak/dump.rdb !9460
- [16:01] <xb95> Unknown RDB format version: 2
- [16:02] <pietern> xb95: yep known problem
- [16:02] <xb95> ah rgr
- [16:02] <pietern> that has been fixed in one of the finals
- [16:02] <xb95> right I had to use a later version to check it
- [16:02] <pietern> yep
- [16:04] Bakanaka (474a5dbf@gateway/web/freenode/ip.71.74.93.191) left irc: Quit: Page closed
- [16:06] <pietern> xb95: does the discrepancy in number of keys also mean that the 14gigs on the slave, is actually more like 20gigs on the master?
- [16:06] <xb95> 16G RSS, 26G virt
- [16:06] <xb95> memory usage on the master
- [16:06] <xb95> slave is ~14G RSS and 14G virt
- [16:07] <xb95> also, vm-enabled 0
- [16:07] Sarevok1 (~locke@rrcs-98-101-176-132.midsouth.biz.rr.com) left #redis.
- [16:08] <pietern> xb95: do these instances only carry ephemeral lists,
- [16:08] <pietern> or also cached content of some sorts
- [16:08] <xb95> we have some real content on it, cached data for various functions
- [16:08] <xb95> this is our "main" instance so it gets used for lots of andom things
- [16:09] <xb95> *random
- [16:09] <pietern> ok I see
- [16:10] axl_ (~axl@75-149-152-225-Minnesota.hfc.comcastbusiness.net) left irc: Quit: axl_
- [16:14] luckyruby (~luckyruby@rrcs-24-129-162-10.se.biz.rr.com) left irc: Remote host closed the connection
- [16:14] <pietern> xb95: can you compare the time on both machines?
- [16:14] <pietern> if they are approx ntp'd ?
- [16:15] <pietern> a second or so is not a big deal
- [16:15] petercooper (~petercoop@82.144.254.2) left irc: Remote host closed the connection
- [16:15] <pietern> minutes might be
- [16:15] <xb95> ohs ure
- [16:16] <xb95> % fab -H fathen,martini do:"date" !9488
- [16:16] <xb95> [fathen] out: Fri Jan 13 18:16:17 CST 2012
- [16:16] <xb95> [martini] out: Fri Jan 13 18:16:18 CST 2012
- [16:16] <pietern> thanks
- [16:16] <xb95> I use ntp but it's a good thing to check :)
- [16:18] <pietern> the discrepancy might be a number of keys that have already expired but are not yet removed
- [16:18] <pietern> those are not included in a dump
- [16:18] <pietern> but, that wouldn't explain the issue, so continuing
- [16:19] d0k (~d0k@p5B3B2E15.dip.t-dialin.net) left irc: Quit: This sleep has gone computing.
- [16:19] <xb95> hmmmm
- [16:20] <pietern> do you know what the data churn is?
- [16:20] <xb95> assuming expired_keys tracks that, we expire about 20 per second..
- [16:20] <pietern> keys expiring every 5-10 minutes?
- [16:20] <pietern> or more like days/weeks?
- [16:21] <xb95> some are 3 months, some are 60 seconds
- [16:22] <xb95> getting more deatils
- [16:22] <pietern> tnx
- [16:22] <xb95> lots of churn.
- [16:23] <xb95> nearly every packet that comes in hits redis with a realtively short expiration
- [16:23] <xb95> ~few minutes
- [16:23] <pietern> the pressure on expiry evens out over time
- [16:23] <pietern> it's an approximate mechanism
- [16:23] <pietern> which could explain the full difference
- [16:23] <pietern> but again, not the issue...
- [16:24] <xb95> right
- [16:25] soveran_ (~soveran@186.19.214.247) joined #redis.
- [16:25] soveran (~soveran@186.19.214.247) left irc: Read error: Connection reset by peer
- [16:26] ^^_ (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) joined #redis.
- [16:26] el_kevino (~el_kevino@216.249.7.209.tor.pathcom.com) left irc: Remote host closed the connection
- [16:27] <xb95> yeah, the bulk of things have a short ttl of about 30 seconds
- [16:27] <xb95> just looking at the code
- [16:28] <xb95> and there are many queues. one per client->backend mapping
- [16:28] <xb95> whenever something comes in, we LPUSH to the queue, then EXPIRE it at 30
- [16:28] <xb95> then we BRPOP from the queue
- [16:28] <xb95> so, something to note
- [16:30] <xb95> the master has 288 blocked clients atm
- [16:30] <xb95> nah this is normal
- [16:30] xer0x (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) left irc: Ping timeout: 240 seconds
- [16:30] <xb95> looking at our graphs going back
- [16:31] soveran_ (~soveran@186.19.214.247) left irc: Remote host closed the connection
- [16:32] soveran (~soveran@186.19.214.247) joined #redis.
- [16:35] <pietern> shouldn't be a problem
- [16:38] wmoss -> wmoss|away
- [16:38] mattbillenstein (~Adium@65.160.16.86) left irc: Ping timeout: 252 seconds
- [16:39] <xb95> yeah. also, it's silly that we replicate this data anyway. if we have a server failure, we don't care too much if we lose the in-flight queues. I should move this to a separate instance
- [16:39] <pietern> xb95: do you use variadic pushes at all?
- [16:40] <xb95> uh, what's a variadic push?
- [16:41] <pietern> LPUSH key value1 value2 value3
- [16:41] <pietern> that's new in 2.4
- [16:42] seppo0010 (~Adium@186.19.19.229) left #redis.
- [16:42] tilgovi (~randall@couchdb/developer/tilgovi) joined #redis.
- [16:43] <xb95> I don't *think* so.. there's a bunch of places we push, none of them look like they do
- [16:43] <pietern> xb95: if not, I might have found an error there anyway ;)
- [16:47] <pietern> xb95: also no BRPOPLPUSH, right?
- [16:47] <pietern> just BRPOP
- [16:47] <xb95> correct
- [16:51] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) left irc: Quit: jtsnow
- [16:52] wmoss|away -> wmoss
- [16:53] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection
- [16:59] cinemascop89 (~yo@r186-52-54-20.dialup.adsl.anteldata.net.uy) left irc: Quit: Leaving.
- [17:02] Sir_Rai (~rai@84.127.26.172.dyn.user.ono.com) joined #redis.
- [17:03] tim_smart (~tim@fostle.xen.prgmr.com) left #redis.
- [17:04] <pietern> xb95: it does happen consistently, right?
- [17:04] <pietern> and consistently very fast after completing sync?
- [17:04] <xb95> since the problem started happening monday, yes
- [17:04] kenperkins (~textual@174-24-171-37.tukw.qwest.net) left irc: Ping timeout: 248 seconds
- [17:06] <xb95> http://xb95.com/pics/redis3.png <-
- [17:06] <xb95> every time it hits that ~2GB level it dies off and auto-restarts
- [17:07] <xb95> total_commands_processed stays flat at 0.14 per second (my info commands)
- [17:09] <Sir_Rai> uhmm if i wanna seitch to DB 2 i need to exec just SELECT 2?
- [17:09] <Sir_Rai> switch*
- [17:09] <xb95> pietern: hey, if I turn on the AOF writing on my master, that will do a sane fork and such right? it won't block the world?
- [17:09] <pietern> xb95: no
- [17:10] <pietern> xb95: meaning that that should just work
- [17:10] <xb95> awesome.
- [17:14] <pietern> this is a real headscratcher...
- [17:19] rurufufuss (~rurufufus@115-64-27-246.static.tpgi.com.au) joined #redis.
- [17:19] <xb95> well, I have to take off shortly. I just turned AOF on on the master, and we'll watch it.
- [17:20] <xb95> at some point it's probably worth just upgrading to 2.4.6 and restarting the master
- [17:22] <pietern> xb95: yep
- [17:22] <pietern> but I still want to know how that BRPOP ends up at the slave
- [17:23] <pietern> there are only so many code paths that can make that happen
- [17:23] <pietern> under certain conditions
- [17:23] <pietern> anyway, I'll let you know when I find something
- [17:23] <pietern> where can I reach you?
- [17:26] seppo0010 (~Adium@186.19.19.229) joined #redis.
- [17:31] thehodge (~thehodge@2001:470:1f09:13a3:29b9:840:7acf:d2f2) left irc: Remote host closed the connection
- [17:33] wmoss -> wmoss|away
- [17:36] jonesy (~jonesy@pool-173-71-115-162.cmdnnj.fios.verizon.net) joined #redis.
- [17:36] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) joined #redis.
- [17:37] ^^_ (~xer0x@static-209-17-135-1.gtcust.grouptelecom.net) left irc: Quit: Leaving...
- [17:40] <pietern> xb95: you still there?
- [17:41] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) left irc: Quit: jtsnow
- [17:42] _macro (~Neil@accessnat4.mochimedia.net) left irc: Quit: Computer has gone to sleep
- [18:00] dschn (~dschn@c-064-186-242-006.sd2.redwire.net) left irc: Quit: This computer has gone to sleep
- [18:00] ajsharp -> ajsharp_zz
- [18:01] chrisjones (~chrisjone@ip68-96-109-92.lv.lv.cox.net) left irc: Quit: Textual IRC Client: http://www.textualapp.com/
- [18:01] seppo0010 (~Adium@186.19.19.229) left #redis.
- [18:05] hackband (~hackband@1385159443.dhcp.dbnet.dk) left irc: Remote host closed the connection
- [18:06] sarkis (~sarkis@unaffiliated/sako) joined #redis.
- [18:07] <sarkis> hey guys are there perl bindings that don't suck?
- [18:07] <sarkis> i noticed the Redis package on CPAN which is what is recommended for use on the redis.io site doesn't have true perl hashes for redis hash?
- [18:11] NuckOff -> Nuck
- [18:13] versicolor (~quassel@46.10.18.203) left irc: Remote host closed the connection
- [18:14] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) joined #redis.
- [18:30] soveran (~soveran@186.19.214.247) joined #redis.
- [18:40] zitchdog (~textual@173-25-169-137.client.mchsi.com) joined #redis.
- [18:42] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 260 seconds
- [18:46] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection
- [19:00] Nuck -> NuckOff
- [19:03] gregpasc_ (~textual@174-24-171-37.tukw.qwest.net) joined #redis.
- [19:04] gregpasc_ (~textual@174-24-171-37.tukw.qwest.net) left irc: Client Quit
- [19:06] gregpasc_ (~textual@174-24-171-37.tukw.qwest.net) joined #redis.
- [19:07] gregpascale (~textual@174-24-171-37.tukw.qwest.net) left irc: Ping timeout: 244 seconds
- [19:07] gregpasc_ -> gregpascale
- [19:10] pietern (~pieter@208.91.1.14) left irc: Quit: pietern
- [19:11] perezd (~derek@108-71-92-105.lightspeed.sntcca.sbcglobal.net) left irc: Quit: perezd
- [19:13] gregpascale (~textual@174-24-171-37.tukw.qwest.net) left irc: Quit: Computer has gone to sleep.
- [19:15] TimTim (TimTim@cpe-098-026-149-108.triad.res.rr.com) left irc: Ping timeout: 252 seconds
- [19:17] NuckOff -> Nuck
- [19:18] Nuck -> NuckOff
- [19:21] NuckOff -> Nuck
- [19:27] powdahound (~garret@c-67-169-42-52.hsd1.ca.comcast.net) left irc: Quit: Computer has gone to sleep.
- [19:36] samrat_ (u2534@gateway/web/irccloud.com/x-leiomhiqcolnnrlw) left irc: Read error: Connection reset by peer
- [19:36] akahn (u2243@gateway/web/irccloud.com/x-cndcvpllvprrnwje) left irc: Remote host closed the connection
- [19:36] qrush (u1528@gateway/web/irccloud.com/x-bcgpyyomzpdrtaeg) left irc: Remote host closed the connection
- [19:36] purbon (u1730@gateway/web/irccloud.com/x-wyjqnsxfznheyyzr) left irc: Remote host closed the connection
- [19:36] mattly (u2222@gateway/web/irccloud.com/x-xbgjztiqulcqujfb) left irc: Remote host closed the connection
- [19:36] ryanbriones (u2050@gateway/web/irccloud.com/x-wjectitcbcpvktoi) left irc: Remote host closed the connection
- [19:36] croaky (u3102@gateway/web/irccloud.com/x-doyyfzrlfcmputtz) left irc: Remote host closed the connection
- [19:36] mrb_bk (u2099@gateway/web/irccloud.com/x-nzizcmzgvpxbzece) left irc: Remote host closed the connection
- [19:36] oal (u4126@gateway/web/irccloud.com/x-hpqxbbfhybbdtlbv) left irc: Remote host closed the connection
- [19:36] roidrage (u1352@gateway/web/irccloud.com/x-tzogpgbbkryrmjft) left irc: Remote host closed the connection
- [19:36] jacqui (u4004@gateway/web/irccloud.com/x-qflzumxbpdmohnxq) left irc: Remote host closed the connection
- [19:38] strmpnk (u2261@gateway/web/irccloud.com/x-nuymsoargglzirhd) left irc: Remote host closed the connection
- [19:42] oal (u4126@gateway/web/irccloud.com/x-blrjtkigsdtwvnmu) joined #redis.
- [19:44] strmpnk (u2261@gateway/web/irccloud.com/x-qauymmrpvyxgowvs) joined #redis.
- [19:44] jacqui (u4004@gateway/web/irccloud.com/x-onsljntyjbmvweno) joined #redis.
- [19:48] croaky (u3102@gateway/web/irccloud.com/x-iwaopciuccgormft) joined #redis.
- [19:49] purbon (u1730@gateway/web/irccloud.com/x-jabgohhmdfvrfmdq) joined #redis.
- [19:50] roidrage (u1352@gateway/web/irccloud.com/x-nigluodmzhxpiemn) joined #redis.
- [19:55] qrush (u1528@gateway/web/irccloud.com/x-lnfsygfjwfytgamu) joined #redis.
- [19:58] ryanbriones (u2050@gateway/web/irccloud.com/x-mbuqdbcbhpwpzsnq) joined #redis.
- [20:06] samrat_ (u2534@gateway/web/irccloud.com/x-yhwywmdmamdufgkc) joined #redis.
- [20:07] mrb_bk (u2099@gateway/web/irccloud.com/x-yrcmircjnnlupgfh) joined #redis.
- [20:10] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) joined #redis.
- [20:24] jtsnow (~jtsnow@75-169-84-216.slkc.qwest.net) left irc: Quit: jtsnow
- [20:27] akahn (u2243@gateway/web/irccloud.com/x-czxbmlwjvhgyombn) joined #redis.
- [20:30] Nuck -> NuckOff
- [20:30] NetRoY (~NetRoY@122.170.45.238) joined #redis.
- [20:31] soveran (~soveran@186.19.214.247) joined #redis.
- [20:36] sarkis (~sarkis@unaffiliated/sako) joined #redis.
- [20:36] jacqui (u4004@gateway/web/irccloud.com/x-onsljntyjbmvweno) left irc: Remote host closed the connection
- [20:36] samrat_ (u2534@gateway/web/irccloud.com/x-yhwywmdmamdufgkc) left irc: Remote host closed the connection
- [20:36] mrb_bk (u2099@gateway/web/irccloud.com/x-yrcmircjnnlupgfh) left irc: Remote host closed the connection
- [20:36] roidrage (u1352@gateway/web/irccloud.com/x-nigluodmzhxpiemn) left irc: Remote host closed the connection
- [20:36] oal (u4126@gateway/web/irccloud.com/x-blrjtkigsdtwvnmu) left irc: Remote host closed the connection
- [20:36] purbon (u1730@gateway/web/irccloud.com/x-jabgohhmdfvrfmdq) left irc: Remote host closed the connection
- [20:36] akahn (u2243@gateway/web/irccloud.com/x-czxbmlwjvhgyombn) left irc: Remote host closed the connection
- [20:36] strmpnk (u2261@gateway/web/irccloud.com/x-qauymmrpvyxgowvs) left irc: Read error: Connection reset by peer
- [20:36] qrush (u1528@gateway/web/irccloud.com/x-lnfsygfjwfytgamu) left irc: Read error: Connection reset by peer
- [20:36] croaky (u3102@gateway/web/irccloud.com/x-iwaopciuccgormft) left irc: Remote host closed the connection
- [20:36] ryanbriones (u2050@gateway/web/irccloud.com/x-mbuqdbcbhpwpzsnq) left irc: Remote host closed the connection
- [20:36] lusis (u2537@gateway/web/irccloud.com/x-cncuystcecezulzv) left irc: Remote host closed the connection
- [20:36] omarkj (u766@gateway/web/irccloud.com/x-sdiwglufgmztndqf) left irc: Write error: Broken pipe
- [20:36] Andrei (43fa04d2@gateway/web/freenode/ip.67.250.4.210) joined #redis.
- [20:37] ryanbriones (u2050@gateway/web/irccloud.com/x-dwsuxhbhexkprkax) joined #redis.
- [20:37] <Andrei> hi everybody
- [20:38] <Andrei> need some advise on redis
- [20:38] <Andrei> I have to generate a big dataset to test redis
- [20:38] <Andrei> what's the best approach using lua or load it externally ?
- [20:39] <Andrei> the data are lots of random values
- [20:43] croaky (u3102@gateway/web/irccloud.com/x-vzojgasisimlzpgk) joined #redis.
- [20:43] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 268 seconds
- [20:43] oal (u4126@gateway/web/irccloud.com/x-bvuoshqsksukpjow) joined #redis.
- [20:45] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection
- [20:46] lusis (u2537@gateway/web/irccloud.com/x-vrbbdcdxrvresbju) joined #redis.
- [20:46] jacqui (u4004@gateway/web/irccloud.com/x-skyhazscgetdupks) joined #redis.
- [20:51] purbon (u1730@gateway/web/irccloud.com/x-jmcnnrwuatvxwoys) joined #redis.
- [20:51] strmpnk (u2261@gateway/web/irccloud.com/x-pmzcfyxftufplfhx) joined #redis.
- [20:54] phil_ss (~philip@186.204.122.227) joined #redis.
- [20:55] phil_ss (~philip@186.204.122.227) left irc: Client Quit
- [20:57] omarkj (u766@gateway/web/irccloud.com/x-pbahdefgdqmoroni) joined #redis.
- [20:58] ncode (~ncode@unaffiliated/ncode) joined #redis.
- [21:01] NetRoY (~NetRoY@122.170.45.238) left irc: Ping timeout: 276 seconds
- [21:02] NetRoY (~NetRoY@122.170.45.238) joined #redis.
- [21:07] jdunck -> jdunck_away
- [21:07] jdunck_away -> jdunck
- [21:07] samrat_ (u2534@gateway/web/irccloud.com/x-uhcejeagsvkaekqf) joined #redis.
- [21:07] mrb_bk (u2099@gateway/web/irccloud.com/x-wqivlhkcbzbtiblf) joined #redis.
- [21:07] mattly (u2222@gateway/web/irccloud.com/x-jkvwrfytgbmqdzwz) joined #redis.
- [21:11] NetRoY (~NetRoY@122.170.45.238) left irc: Ping timeout: 248 seconds
- [21:16] <vsmatck> Andrei: This can be done any way. Choose what you're most comfortable with.
- [21:17] akahn (u2243@gateway/web/irccloud.com/x-jvppzmxrhnzxlyun) joined #redis.
- [21:20] Andrei (43fa04d2@gateway/web/freenode/ip.67.250.4.210) left irc: Ping timeout: 258 seconds
- [21:24] ncode (~ncode@unaffiliated/ncode) left irc: Quit: Computer has gone to sleep.
- [21:26] ncode (~ncode@unaffiliated/ncode) joined #redis.
- [21:38] qrush (u1528@gateway/web/irccloud.com/x-enravhkgigekbkmt) joined #redis.
- [21:40] roidrage (u1352@gateway/web/irccloud.com/x-unvmdjrztdclxjqw) joined #redis.
- [21:40] sarkis (~sarkis@unaffiliated/sako) joined #redis.
- [21:56] NetRoY (~NetRoY@122.170.45.238) joined #redis.
- [21:59] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis.
- [22:00] kennethepperly (~cinch@boxand.lnk.telstra.net) left irc: Remote host closed the connection
- [22:00] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis.
- [22:02] kennethepperly (~cinch@boxand.lnk.telstra.net) left irc: Remote host closed the connection
- [22:02] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis.
- [22:07] kennethepperly (~cinch@boxand.lnk.telstra.net) left irc: Remote host closed the connection
- [22:07] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis.
- [22:07] kennethepperly (~cinch@boxand.lnk.telstra.net) left irc: Remote host closed the connection
- [22:11] kennethepperly (~cinch@boxand.lnk.telstra.net) joined #redis.
- [22:13] NetRoY (~NetRoY@122.170.45.238) left irc: Quit: Leaving
- [22:21] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 245 seconds
- [22:22] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) left irc: Ping timeout: 248 seconds
- [22:34] ncode (~ncode@unaffiliated/ncode) left irc: Quit: Computer has gone to sleep.
- [22:55] zitchdog (~textual@173-25-169-137.client.mchsi.com) left irc: Quit: Computer has gone to sleep.
- [22:55] rurufufuss (~rurufufus@115-64-27-246.static.tpgi.com.au) left irc: Ping timeout: 276 seconds
- [22:57] ncode (~ncode@unaffiliated/ncode) joined #redis.
- [23:03] h0bbit (~vedang@59.95.15.72) joined #redis.
- [23:07] sarkis (~sarkis@unaffiliated/sako) joined #redis.
- [23:07] rurufufuss (~rurufufus@115-64-27-246.static.tpgi.com.au) joined #redis.
- [23:08] soveran (~soveran@186.19.214.247) joined #redis.
- [23:15] sarkis (~sarkis@unaffiliated/sako) left irc: Ping timeout: 240 seconds
- [23:23] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection
- [23:23] xer0x (~xer0x@S0106000625746e56.vc.shawcable.net) joined #redis.
- [23:28] xer0x (~xer0x@S0106000625746e56.vc.shawcable.net) left irc: Read error: Connection reset by peer
- [23:33] ron (~ron@unaffiliated/ron) left irc: Ping timeout: 240 seconds
- [23:35] ron (~ron@unaffiliated/ron) joined #redis.
- [23:46] _macro (~Neil@c-71-204-169-22.hsd1.ca.comcast.net) joined #redis.
- [23:49] rittyan (~rittyan@176.14.223.136) joined #redis.
- [23:51] pyr (pyr@lynx.spootnik.org) joined #redis.
- [23:52] h0bbit (~vedang@59.95.15.72) left irc: Ping timeout: 252 seconds
- [23:56] pyr (pyr@lynx.spootnik.org) left #redis.
- [23:57] crodas (~crodas@git.crodas.org) left irc: Ping timeout: 252 seconds
- [00:00] --- Sat Jan 14 2012