[00:00:46] axl_ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) left irc: Read error: Connection reset by peer [00:01:03] axl_ (~axl@216-43-114-19.ip.mcleodusa.net) joined #redis. [00:01:26] axl_ (~axl@216-43-114-19.ip.mcleodusa.net) left irc: Read error: Connection reset by peer [00:01:27] p1d (~p1d@ns1.vonaffenfels.de) joined #redis. [00:04:11] rittyan (~rittyan@176.14.223.175) joined #redis. [00:08:08] p1d (~p1d@ns1.vonaffenfels.de) left irc: Ping timeout: 252 seconds [00:15:12] p1d (~p1d@ns1.vonaffenfels.de) joined #redis. [00:17:59] _macro (~Neil@c-67-169-183-90.hsd1.ca.comcast.net) joined #redis. [00:22:32] martincozzi (~martincoz@c-67-180-194-70.hsd1.ca.comcast.net) joined #redis. [00:27:04] Jrz (~jrz@87.239.184.141) joined #redis. [00:27:46] muhqu (~Adium@pD95802CE.dip.t-dialin.net) joined #redis. [00:30:58] rittyan (~rittyan@176.14.223.175) left irc: Remote host closed the connection [00:36:03] martincozzi (~martincoz@c-67-180-194-70.hsd1.ca.comcast.net) left irc: Quit: martincozzi [00:38:58] mjr_ (~mjr_@vpn.rebelvox.com) left irc: Quit: mjr_ [00:50:34] thehodge (~thehodge@82.109.33.196) joined #redis. [00:50:52] thehodge (~thehodge@82.109.33.196) left irc: Remote host closed the connection [00:53:48] dribdrab (~dribdrab@c-24-5-88-169.hsd1.ca.comcast.net) joined #redis. [00:55:03] mjr_ (~mjr_@vpn.rebelvox.com) joined #redis. [00:55:28] daniel_karlsson (~kardan@c83-254-118-140.bredband.comhem.se) joined #redis. [00:56:01] Corren (~textual@50-47-18-37.evrt.wa.frontiernet.net) joined #redis. [00:59:16] chakrit (~chakrit@ppp-58-8-232-51.revip2.asianet.co.th) joined #redis. [01:03:43] wmage (~wmage@nat-88-212-40-142.antik.sk) joined #redis. [01:05:25] rb2k (~rb2k@HSI-KBW-134-3-0-160.hsi14.kabel-badenwuerttemberg.de) joined #redis. [01:06:56] d0k (~d0k@aef.wh.uni-dortmund.de) joined #redis. [01:16:01] dribdrab (~dribdrab@c-24-5-88-169.hsd1.ca.comcast.net) left irc: Quit: dribdrab [01:17:29] thehodge (~thehodge@212.183.128.236) joined #redis. [01:20:44] mjr_ (~mjr_@vpn.rebelvox.com) left irc: Quit: mjr_ [01:23:44] _macro (~Neil@c-67-169-183-90.hsd1.ca.comcast.net) left irc: Quit: Computer has gone to sleep [01:24:16] Nick change: Corren -> kenperkins [01:24:41] dougx (~doug@41.23.135.124) joined #redis. [01:33:55] thehodge_ (~thehodge@212.183.128.236) joined #redis. [01:34:53] QiBol (~QiBol@nodester.com) joined #redis. [01:35:53] thehodge (~thehodge@212.183.128.236) left irc: Ping timeout: 245 seconds [01:38:48] thehodge_ (~thehodge@212.183.128.236) left irc: Ping timeout: 245 seconds [01:43:38] lux___ (~lux@ppp-169-35.24-151.libero.it) joined #redis. [01:44:41] drbobbeaty (~drbobbeat@c-67-184-75-162.hsd1.il.comcast.net) joined #redis. [01:50:50] ddilinger (~guy@unaffiliated/ddilinger) left irc: Ping timeout: 252 seconds [01:51:30] ddilinger (~guy@unaffiliated/ddilinger) joined #redis. [01:54:56] rittyan (~rittyan@dhcp-216-33-wifi.yandex.net) joined #redis. [01:58:27] dougx (~doug@41.23.135.124) left irc: Ping timeout: 240 seconds [02:00:25] thehodge (~thehodge@82.109.33.196) joined #redis. [02:05:58] rurufufuss (~rurufufus@115-64-27-246.static.tpgi.com.au) joined #redis. [02:07:03] Net_RoY (~NetRoY@nat/yahoo/x-vnxltvweiyojjtih) joined #redis. [02:09:15] NetRoY (~NetRoY@nat/yahoo/x-rduejnixawajiwcy) left irc: Ping timeout: 244 seconds [02:09:15] Nick change: Net_RoY -> NetRoY [02:25:11] drbobbeaty (~drbobbeat@c-67-184-75-162.hsd1.il.comcast.net) left irc: Quit: drbobbeaty [02:26:33] lux___ (~lux@ppp-169-35.24-151.libero.it) left irc: Quit: Leaving [02:26:39] lux___ (~lux@ppp-169-35.24-151.libero.it) joined #redis. [02:33:30] nek (~nek@61.135.165.159) left irc: Ping timeout: 255 seconds [02:34:33] Kosma (kosma@host-6-66.internetunion.pl) joined #redis. [02:40:30] horsey_ (~horsey@27.34.244.74) joined #redis. [02:40:55] wilmoore (~wilmoore@c-67-190-17-108.hsd1.co.comcast.net) left irc: Ping timeout: 276 seconds [02:41:29] Nick change: horsey_ -> horsey [02:43:08] saschagehlich (~saschageh@p5DD54DDC.dip.t-dialin.net) joined #redis. [02:46:30] Is Redis databases just about namespace division? Or is there more to it? For example, can I have different settings for different databases ( persistence, durability etc. etc.) [03:02:59] Wombert (~Wombert@dslb-092-074-120-056.pools.arcor-ip.net) joined #redis. [03:12:14] NetRoY (~NetRoY@nat/yahoo/x-vnxltvweiyojjtih) left irc: Quit: NetRoY [03:14:46] Nick change: NuckOff -> Nuck [03:19:10] kushal (~kdas@fedora/kushal) left irc: Ping timeout: 252 seconds [03:23:47] hackband (~hackband@1385159443.dhcp.dbnet.dk) joined #redis. [03:25:01] lux___ (~lux@ppp-169-35.24-151.libero.it) left irc: Quit: Leaving [03:29:42] daelious (~daelious@ip-12-157-188-198.kindredhealthcare.com) joined #redis. [03:31:36] jonesy (~jonesy@pool-173-71-115-162.cmdnnj.fios.verizon.net) left irc: Quit: Computer has gone to sleep. [03:33:44] soveran (~soveran@186.19.214.247) joined #redis. [03:40:21] go_mansi (~mansi@117.207.43.24) joined #redis. [03:44:26] drbobbeaty (~drbobbeat@38.98.137.29) joined #redis. [03:45:51] NetRoY (~NetRoY@nat/yahoo/x-iohdmvjfiszztqiu) joined #redis. [03:46:43] dougx (~doug@41.30.31.40) joined #redis. [03:53:45] chakrit (~chakrit@ppp-58-8-232-51.revip2.asianet.co.th) left irc: Quit: chakrit [03:59:49] ddilinger (~guy@unaffiliated/ddilinger) left irc: Ping timeout: 252 seconds [04:02:34] fanjie (~fanjie@c-67-180-77-58.hsd1.ca.comcast.net) left irc: Quit: fanjie [04:04:40] fanjie (~fanjie@c-67-180-77-58.hsd1.ca.comcast.net) joined #redis. [04:05:07] QiBol (~QiBol@nodester.com) left irc: Ping timeout: 240 seconds [04:18:54] nsalvo (~nsalvo@190.55.32.117) joined #redis. [04:21:08] NetRoY (~NetRoY@nat/yahoo/x-iohdmvjfiszztqiu) left irc: Quit: NetRoY [04:21:24] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) left irc: Remote host closed the connection [04:21:39] nu7hatch (~cubox@r186-48-247-83.dialup.adsl.anteldata.net.uy) joined #redis. [04:28:36] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) joined #redis. [04:33:28] seppo0010 (~Adium@200.69.194.105) left #redis. [04:39:13] elcuervo (~elcuervo@r186-48-247-83.dialup.adsl.anteldata.net.uy) joined #redis. [04:43:00] seppo0010 (~Adium@200.69.194.105) joined #redis. [04:49:13] jonesy (~jonesy@68.64.144.221) joined #redis. [04:52:07] Nick change: Nuck -> NuckOff [04:52:47] Nick change: NuckOff -> Nuck [04:58:57] Nick change: Nuck -> NuckOff [04:59:19] wmage (~wmage@nat-88-212-40-142.antik.sk) left irc: Quit: Leaving... [05:18:33] saschagehlich (~saschageh@p5DD54DDC.dip.t-dialin.net) left irc: Remote host closed the connection [05:19:42] wmage (~wmage@ip-155-111.wifi.tuke.sk) joined #redis. [05:20:32] wmage (~wmage@ip-155-111.wifi.tuke.sk) left irc: Client Quit [05:22:29] seppo0010 (~Adium@200.69.194.105) left irc: Ping timeout: 244 seconds [05:23:19] seppo0010 (~Adium@200.69.194.105) joined #redis. [05:23:19] purbon (u1730@gateway/web/irccloud.com/x-shobucyafxfwqjvx) left irc: Remote host closed the connection [05:23:19] omarkj (u766@gateway/web/irccloud.com/x-wyyribwfrjkgrzcr) left irc: Read error: Connection reset by peer [05:23:19] samrat (u2534@gateway/web/irccloud.com/x-kjaixdpnrawuuvwp) left irc: Write error: Connection reset by peer [05:23:27] qrush (u1528@gateway/web/irccloud.com/x-rscgodwjwhmijvan) left irc: Remote host closed the connection [05:23:27] lusis (u2537@gateway/web/irccloud.com/x-ldooycygvhtcfpkn) left irc: Remote host closed the connection [05:23:27] evilhackerdude (u1451@gateway/web/irccloud.com/x-fjjbhvfnkcryzxvv) left irc: Remote host closed the connection [05:23:27] jacqui (u4004@gateway/web/irccloud.com/x-bviuohzcyyqdlqfu) left irc: Remote host closed the connection [05:23:28] roidrage (u1352@gateway/web/irccloud.com/x-ewtlmsqgdxoaxjqx) left irc: Read error: Connection reset by peer [05:23:28] mattly (u2222@gateway/web/irccloud.com/x-dylivzwenowiqipp) left irc: Remote host closed the connection [05:23:28] D_Roch (u1594@gateway/web/irccloud.com/x-oyqsrxsoalfzeoyt) left irc: Write error: Broken pipe [05:23:30] mrb_bk (u2099@gateway/web/irccloud.com/x-jwnxbvticcmcfqwj) left irc: Remote host closed the connection [05:24:21] D_Roch (u1594@gateway/web/irccloud.com/x-ipvtcupbfeudcfjr) joined #redis. [05:24:41] wam (~wam@unaffiliated/wam) joined #redis. [05:27:07] omarkj (u766@gateway/web/irccloud.com/x-bshantyskatupqpi) joined #redis. [05:29:25] jacqui (u4004@gateway/web/irccloud.com/x-nvrcqnvzirgvvvdi) joined #redis. [05:30:04] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) joined #redis. [05:31:49] napperjabber (~napperjab@149.48.161.10) joined #redis. [05:32:20] saschagehlich (~saschageh@p5DD54DDC.dip.t-dialin.net) joined #redis. [05:32:33] roidrage (u1352@gateway/web/irccloud.com/x-ggtbtjpbjdyaixju) joined #redis. [05:32:39] seppo0010 (~Adium@200.69.194.105) left #redis. [05:33:24] lusis (u2537@gateway/web/irccloud.com/x-hpitglsspxvhsref) joined #redis. [05:33:52] DZ (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) joined #redis. [05:34:17] Nick change: DZ -> Guest3582 [05:34:27] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) left irc: Ping timeout: 240 seconds [05:37:24] brunov (~bruno@74-154-89-200.fibertel.com.ar) joined #redis. [05:42:26] evilhackerdude (u1451@gateway/web/irccloud.com/x-dlfbiqxsjjzoeuho) joined #redis. [05:43:35] JeremyWei (~textual@122.193.209.13) left irc: Quit: Computer has gone to sleep. [05:50:14] xetorthio (~jleibiusk@200.41.238.50) joined #redis. [05:53:15] samrat (u2534@gateway/web/irccloud.com/x-qsirypzdcqbwfqsj) joined #redis. [05:53:17] purbon (u1730@gateway/web/irccloud.com/x-xczbpjwsevgjuewo) joined #redis. [05:54:18] Comandante (~Comandant@200.41.238.50) joined #redis. [05:55:24] luckyruby (~luckyruby@125-187.96-97.tampabay.res.rr.com) left irc: Remote host closed the connection [05:56:28] h0bbit (~vedang@121.243.225.226) joined #redis. [05:59:25] xetorthio (~jleibiusk@200.41.238.50) left irc: Quit: Ex-Chat [06:01:21] xetorthio (~jleibiusk@200.41.238.50) joined #redis. [06:03:03] qrush (u1528@gateway/web/irccloud.com/x-owwanuaonvzeemuz) joined #redis. [06:03:19] mrb_bk (u2099@gateway/web/irccloud.com/x-ouzwgnrxgsxarpcq) joined #redis. [06:12:27] mattly (u2222@gateway/web/irccloud.com/x-wzlbkpzcgmxaiodl) joined #redis. [06:13:07] Guest3582 (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) left irc: Ping timeout: 240 seconds [06:15:45] johnsanders (~johnsande@c-69-181-21-76.hsd1.ca.comcast.net) joined #redis. [06:23:33] roidrage (u1352@gateway/web/irccloud.com/x-ggtbtjpbjdyaixju) left irc: Remote host closed the connection [06:23:38] evilhackerdude (u1451@gateway/web/irccloud.com/x-dlfbiqxsjjzoeuho) left irc: Remote host closed the connection [06:23:38] D_Roch (u1594@gateway/web/irccloud.com/x-ipvtcupbfeudcfjr) left irc: Remote host closed the connection [06:23:38] purbon (u1730@gateway/web/irccloud.com/x-xczbpjwsevgjuewo) left irc: Remote host closed the connection [06:23:38] jacqui (u4004@gateway/web/irccloud.com/x-nvrcqnvzirgvvvdi) left irc: Remote host closed the connection [06:23:38] qrush (u1528@gateway/web/irccloud.com/x-owwanuaonvzeemuz) left irc: Remote host closed the connection [06:23:39] mrb_bk (u2099@gateway/web/irccloud.com/x-ouzwgnrxgsxarpcq) left irc: Remote host closed the connection [06:23:52] go_mansi (~mansi@117.207.43.24) left irc: Ping timeout: 276 seconds [06:27:08] agentzh (~agentz@nginx/adept/agentzh) left irc: Quit: Leaving. [06:29:53] evilhackerdude (u1451@gateway/web/irccloud.com/x-zkbakliodtpdyxqk) joined #redis. [06:30:14] jacqui (u4004@gateway/web/irccloud.com/x-hzmvxpbkgsutxemp) joined #redis. [06:31:54] wam (~wam@unaffiliated/wam) left irc: Quit: Ex-Chat [06:34:26] D_Roch (u1594@gateway/web/irccloud.com/x-vjlgqfowrfmupovw) joined #redis. [06:35:23] roidrage (u1352@gateway/web/irccloud.com/x-fqfjohrwajsernrd) joined #redis. [06:36:22] qrush (u1528@gateway/web/irccloud.com/x-vcboghqnenivtcjm) joined #redis. [06:36:24] JeremyWei (~textual@122.193.209.13) joined #redis. [06:38:28] NetRoY (~NetRoY@122.167.90.12) joined #redis. [06:38:36] NetRoY (~NetRoY@122.167.90.12) left irc: Client Quit [06:44:36] purbon (u1730@gateway/web/irccloud.com/x-iuxdyowicbozrsqx) joined #redis. [06:45:44] h0bbit (~vedang@121.243.225.226) left irc: Ping timeout: 268 seconds [06:46:47] muhqu (~Adium@pD95802CE.dip.t-dialin.net) left irc: Ping timeout: 240 seconds [06:52:56] muhqu (~Adium@pD9580EA3.dip.t-dialin.net) joined #redis. [07:00:42] davehimself (~davehimse@c-98-200-201-146.hsd1.tx.comcast.net) joined #redis. [07:03:43] mrb_bk (u2099@gateway/web/irccloud.com/x-ebjdjwsnobemhhzg) joined #redis. [07:06:06] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) joined #redis. [07:08:24] johnsanders (~johnsande@c-69-181-21-76.hsd1.ca.comcast.net) left irc: Quit: Leaving... [07:16:27] dougx (~doug@41.30.31.40) left irc: Ping timeout: 240 seconds [07:17:20] Sarevok (~locke@rrcs-98-101-176-143.midsouth.biz.rr.com) joined #redis. [07:17:30] axl_ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) joined #redis. [07:18:52] Sarevok (~locke@rrcs-98-101-176-143.midsouth.biz.rr.com) left #redis. [07:22:06] el_kevino (~el_kevino@216.249.7.209.tor.pathcom.com) joined #redis. [07:25:19] Sarevok (~locke@rrcs-98-101-176-143.midsouth.biz.rr.com) joined #redis. [07:28:02] wilmoore (~wilmoore@c-67-190-17-108.hsd1.co.comcast.net) joined #redis. [07:30:27] wilmoore (~wilmoore@c-67-190-17-108.hsd1.co.comcast.net) left irc: Remote host closed the connection [07:32:44] muhqu (~Adium@pD9580EA3.dip.t-dialin.net) left irc: Quit: Leaving. [07:35:28] seppo00101 (~Adium@200.69.194.105) joined #redis. [07:35:49] S1kx (~S1kx@ip-95-223-80-198.unitymediagroup.de) joined #redis. [07:35:49] S1kx (~S1kx@ip-95-223-80-198.unitymediagroup.de) left irc: Changing host [07:35:49] S1kx (~S1kx@pdpc/supporter/monthlybyte/s1kx) joined #redis. [07:36:07] h0bbit (~vedang@59.95.12.233) joined #redis. [07:37:04] ddilinger (~guy@unaffiliated/ddilinger) joined #redis. [07:38:33] thehodge (~thehodge@82.109.33.196) left irc: Remote host closed the connection [07:39:12] thehodge (~thehodge@82.109.33.196) joined #redis. [07:42:10] danlucraft (~dan@67-207-147-14.slicehost.net) joined #redis. [07:43:03] is there any way to measure the serverside operation time of a command, as opposed to the network roundtrip? [07:43:27] (just sent a DEL with 100k keys, it finished in 0.23s and I'm wondering what the breakdown is) [07:48:07] pharkmillups (~markphill@70-36-146-239.dsl.dynamic.sonic.net) joined #redis. [07:48:15] just discovered SLOWLOG get, nm :) [07:49:56] nsalvo (~nsalvo@190.55.32.117) left irc: Quit: leaving [07:51:41] airhorns (~airhorns@76-10-166-126.dsl.teksavvy.com) joined #redis. [07:52:03] Oh thank you. [07:52:15] versicolor_ (~quassel@90.154.208.149) left irc: Read error: Connection reset by peer [07:52:29] danlucraft, say, if this is one time operation or you consider running similar numbers in future? [07:53:45] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) left irc: Quit: ceej [07:54:23] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) joined #redis. [07:54:25] danlucraft, also, you could measure external time of PING command and hopefully, subtraction will give approximate server side time of DEL. [07:54:31] perezd (~derek@99-105-56-161.lightspeed.sntcca.sbcglobal.net) joined #redis. [07:54:47] temoto: it's something we're considering doing regularly in production [07:55:13] actually considering redis as a drop in replacement for memcached because we can do multidelete with 100k keys [07:56:28] danlucraft, i'd love to know how it works out in terms of average and max response time under load. [07:57:07] versicolor (~quassel@90.154.208.149) left irc: Ping timeout: 252 seconds [07:57:08] me too :) [07:57:31] the slowlog says that the command took 77ms, btw. so I guess the rest is network & parsing? [07:57:58] pretty badass that a query of 77ms is considered slow enough to go in the default slow query log [07:59:23] perezd (~derek@99-105-56-161.lightspeed.sntcca.sbcglobal.net) left irc: Client Quit [07:59:43] JeremyWei (~textual@122.193.209.13) left irc: Quit: Textual IRC Client: http://www.textualapp.com/ [07:59:48] perezd (~derek@99-105-56-161.lightspeed.sntcca.sbcglobal.net) joined #redis. [07:59:50] seppo00101 (~Adium@200.69.194.105) left #redis. [08:00:30] I'd say rest is network and parsing is few µs. [08:00:49] right. this command is over a meg in size, after all [08:03:12] 77ms is pretty much terrible considering there was no chance to execute a single command or even accept a connection from another client. [08:03:34] yep, but it's better than 0.23s [08:03:47] we'll probably break up the queries a bit [08:04:15] But then, it's a miracle considering how much it would take in Mysql or similar. [08:04:18] awksed2greep (~awksedgre@c-24-98-243-58.hsd1.ga.comcast.net) left irc: Quit: This computer has gone to sleep [08:04:46] saschagehlich (~saschageh@p5DD54DDC.dip.t-dialin.net) left irc: Remote host closed the connection [08:10:03] perezd (~derek@99-105-56-161.lightspeed.sntcca.sbcglobal.net) left irc: Quit: perezd [08:11:57] Jrz (~jrz@87.239.184.141) left irc: Quit: Computer has gone to sleep. [08:16:22] Tuxist (~quassel@dslb-092-077-014-198.pools.arcor-ip.net) left irc: Read error: Connection reset by peer [08:23:07] QiBol (~QiBol@nodester.com) joined #redis. [08:32:50] tjholowaychuk (~tjholoway@S010658b03565e6c6.gv.shawcable.net) joined #redis. [08:33:00] tjholowaychuk (~tjholoway@S010658b03565e6c6.gv.shawcable.net) left irc: Remote host closed the connection [08:36:30] perezd (~derek@99-105-56-161.lightspeed.sntcca.sbcglobal.net) joined #redis. [08:36:57] wilmoore (~wilmoore@70-89-165-49-ISTS-co.hfc.comcastbusiness.net) joined #redis. [08:38:41] saschagehlich (~saschageh@p5DD54DDC.dip.t-dialin.net) joined #redis. [08:41:41] hackband (~hackband@1385159443.dhcp.dbnet.dk) left irc: Remote host closed the connection [08:42:19] stephank (~stephank@82.197.214.45) joined #redis. [08:43:19] rittyan (~rittyan@dhcp-216-33-wifi.yandex.net) left irc: Ping timeout: 248 seconds [08:45:32] rittyan (~rittyan@2a02:6b8:0:40c:7aca:39ff:feb3:d779) joined #redis. [08:48:45] wedgeV (~wedge@static-96-239-100-26.nycmny.fios.verizon.net) joined #redis. [08:50:45] andymccurdy (~andymccur@c-67-188-242-100.hsd1.ca.comcast.net) left irc: Quit: Computer has gone to sleep. [08:51:30] kppullin_ (~kppullin@wsip-98-173-13-146.oc.oc.cox.net) left irc: Read error: Connection reset by peer [08:53:34] _macro (~Neil@c-67-169-183-90.hsd1.ca.comcast.net) joined #redis. [08:59:09] perezd (~derek@99-105-56-161.lightspeed.sntcca.sbcglobal.net) left irc: Quit: perezd [09:05:23] rittyan (~rittyan@2a02:6b8:0:40c:7aca:39ff:feb3:d779) left irc: Remote host closed the connection [09:07:54] nsalvo (~nsalvo@190.55.32.117) joined #redis. [09:12:15] xcbt (~xcbt@208-100-139-67.bendbroadband.com) joined #redis. [09:13:02] Jrz (~jrz@d152222.upc-d.chello.nl) joined #redis. [09:14:39] _macro (~Neil@c-67-169-183-90.hsd1.ca.comcast.net) left irc: Quit: Computer has gone to sleep [09:15:13] d0k (~d0k@aef.wh.uni-dortmund.de) left irc: Read error: Connection reset by peer [09:15:23] d0k (~d0k@aef.wh.uni-dortmund.de) joined #redis. [09:16:35] KevBurnsJr (~KevBurnsJ@50.0.103.39) joined #redis. [09:18:36] perezd (~derek@108-71-92-105.lightspeed.sntcca.sbcglobal.net) joined #redis. [09:21:00] Jrz (~jrz@d152222.upc-d.chello.nl) left irc: Quit: Computer has gone to sleep. [09:28:53] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) left irc: Quit: ceej [09:29:37] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) joined #redis. [09:29:54] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) left irc: Remote host closed the connection [09:30:34] dribdrab (~dribdrab@70-36-146-235.dsl.dynamic.sonic.net) joined #redis. [09:31:05] hey guys, a devious idea just came to my mind :D any clue if with current redis implementation is possible to make redis an embeddable static library ^^? [09:32:56] awksed2greep (~awksedgre@66.6.147.87) joined #redis. [09:34:56] uuu, just ack'ed for the global `server` var usages... and it's f*** everywhere :/ ahh... whyyy? [09:37:36] nu7hatch, you may like BerkleyDB. [09:38:08] awksed2greep (~awksedgre@66.6.147.87) left irc: Ping timeout: 240 seconds [09:39:57] thehodge (~thehodge@82.109.33.196) left irc: Remote host closed the connection [09:42:49] awksed2greep (~awksedgre@glo3.manheim.com) joined #redis. [09:44:00] yeah i was wondering about it, or considering tokyo cabinet as well... but so far it doesn't convince too much [09:44:42] probably i will end up with one of those, but would be good to have redis embeddable soooooooooooome day in the future :) [09:47:34] airhorns (~airhorns@76-10-166-126.dsl.teksavvy.com) left irc: Quit: Leaving... [09:48:01] airhorns (~airhorns@206-248-184-147.dsl.teksavvy.com) joined #redis. [09:52:28] airhorns (~airhorns@206-248-184-147.dsl.teksavvy.com) left irc: Ping timeout: 240 seconds [09:54:22] rittyan (~rittyan@176.14.223.175) joined #redis. [09:55:00] chrisjones (~chrisjone@ip68-224-245-47.lv.lv.cox.net) joined #redis. [10:02:34] nu7hatch, what's wrong with those two? [10:04:32] temoto: i don't like bdb in general because of political reasons :) but tc is quite nice, but last time i was using it i was experiencing weird situations and even segvs, but it was quite long time ago [10:05:19] Try kyoto :) [10:05:21] rb2k (~rb2k@HSI-KBW-134-3-0-160.hsi14.kabel-badenwuerttemberg.de) left irc: Quit: rb2k [10:05:25] besides i think it would be awesome to have redis features embeddable [10:06:11] besides in all cases it's quite tricky because i need to port tc or bdb to go lang... -_-" [10:06:51] The only feature i see here is write ahead log persistency. [10:08:13] For regular dumps, well you could just use your favorite language built-in types such as list, set, etc and dump it occasionally using regular mechanisms. [10:09:11] andymccurdy (~andymccur@69.12.160.66) joined #redis. [10:10:03] rb2k (~rb2k@HSI-KBW-134-3-0-160.hsi14.kabel-badenwuerttemberg.de) joined #redis. [10:13:29] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection [10:16:20] temoto: yeah, but it's way simpler just port the tc with minimum effort than develop something new from scratch [10:16:59] soveran (~soveran@186.19.214.247) joined #redis. [10:17:11] rb2k (~rb2k@HSI-KBW-134-3-0-160.hsi14.kabel-badenwuerttemberg.de) left irc: Quit: rb2k [10:18:40] kppullin (~kppullin@pdpc/supporter/active/kppullin) joined #redis. [10:21:07] wedgeV (~wedge@static-96-239-100-26.nycmny.fios.verizon.net) left irc: Quit: wedgeV [10:22:23] Nick change: wmoss|away -> wmoss [10:25:45] lux___ (~lux@ppp-109-100.25-151.libero.it) joined #redis. [10:29:29] NetRoY (~NetRoY@122.167.90.12) joined #redis. [10:30:19] __alex (~alex@g225249129.adsl.alicedsl.de) joined #redis. [10:33:01] davehimself (~davehimse@c-98-200-201-146.hsd1.tx.comcast.net) left irc: Quit: Computer has gone to sleep. [10:40:24] jrydberg_ (~jrydberg@c-2c08e253.1137-1-64736c10.cust.bredbandsbolaget.se) joined #redis. [10:46:01] senderista (~senderist@216.161.248.54) joined #redis. [10:54:56] lux___ (~lux@ppp-109-100.25-151.libero.it) left irc: Quit: This computer has gone to sleep [10:58:19] arnee (~arnee@a89-183-30-10.net-htp.de) joined #redis. [10:59:03] elcuervo (~elcuervo@r186-48-247-83.dialup.adsl.anteldata.net.uy) left irc: Remote host closed the connection [11:00:31] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection [11:02:50] soveran (~soveran@186.19.214.247) joined #redis. [11:02:58] Nick change: wmoss -> wmoss|away [11:03:53] lux___ (~lux@ppp-36-77.25-151.libero.it) joined #redis. [11:04:14] lux___ (~lux@ppp-36-77.25-151.libero.it) left irc: Remote host closed the connection [11:09:34] _macro (~Neil@accessnat4.mochimedia.net) joined #redis. [11:09:56] elcuervo (~elcuervo@r186-48-247-83.dialup.adsl.anteldata.net.uy) joined #redis. [11:11:05] ank (~ank@c-67-172-16-188.hsd1.pa.comcast.net) joined #redis. [11:13:30] drbobbeaty (~drbobbeat@38.98.137.29) left irc: Read error: Connection reset by peer [11:13:38] drbobbeaty (~drbobbeat@38.98.137.29) joined #redis. [11:13:44] drbobbeaty (~drbobbeat@38.98.137.29) left irc: Read error: Connection reset by peer [11:13:53] drbobbeaty (~drbobbeat@38.98.137.29) joined #redis. [11:15:47] __alex (~alex@g225249129.adsl.alicedsl.de) left irc: Ping timeout: 240 seconds [11:17:04] Nick change: wmoss|away -> wmoss [11:19:37] merlin83 (~merlin83@unaffiliated/merlin83) left irc: Remote host closed the connection [11:21:10] lux___ (~lux@ppp-36-77.25-151.libero.it) joined #redis. [11:22:54] axl__ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) joined #redis. [11:23:36] axl_ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) left irc: Ping timeout: 240 seconds [11:23:39] wmage (~wmage@nat-88-212-40-142.antik.sk) joined #redis. [11:23:44] p1d (~p1d@ns1.vonaffenfels.de) left irc: Quit: ... [11:25:30] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection [11:28:25] __alex (~alex@g225251194.adsl.alicedsl.de) joined #redis. [11:32:38] Nick change: wmoss -> wmoss|away [11:37:29] arnee (~arnee@a89-183-30-10.net-htp.de) left irc: Ping timeout: 252 seconds [11:39:08] wmage (~wmage@nat-88-212-40-142.antik.sk) left irc: Ping timeout: 240 seconds [11:40:42] saschagehlich (~saschageh@p5DD54DDC.dip.t-dialin.net) left irc: Ping timeout: 255 seconds [11:41:16] axl__ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) left irc: Read error: Connection reset by peer [11:42:23] pietern: ping [11:42:45] mrb_bk: hi [11:43:06] pietern: still looking at the issue from yesterday [11:43:15] now we're seeing actual Timeout::Error: Timeout::Error [11:43:18] did the slowlog give any more information? [11:43:46] does the face that we're seeing the timeout error provide you with any other useful information? [11:43:50] there's some slow queries [11:43:56] but i just don't see how the timeouts are happening [11:44:58] it's hard to pinpoint.. [11:45:08] mrb_bk: if you add a logger to the redis object in ruby [11:45:15] and have the slowlog ready [11:45:25] pietern: yeah we're trying to do that [11:45:31] just monkeypatching the @client.call method [11:45:32] you could try and cross match failing commands on the ruby side with slow commands on the redis side [11:45:39] mrb_bk: redis-rb actually can take a :logger option [11:45:43] no need to monkeypatch [11:45:50] oh! [11:46:10] https://github.com/ezmobius/redis-rb/blob/master/lib/redis/client.rb#L243 [11:46:22] pietern: is that just a Logger object? [11:46:38] very nice [11:48:40] pietern: so you suspect it's a repetitive, slow call that's causing this? [11:48:48] rittyan (~rittyan@176.14.223.175) left irc: Remote host closed the connection [11:48:53] mrb_bk: hard to tell... [11:49:02] yeah [11:49:19] it can be an intermittent network issue equally well [11:49:28] if slowlog doesn't show slow calls, but commands time out [11:49:54] right [11:57:39] nsalvo (~nsalvo@190.55.32.117) left irc: Quit: leaving [11:58:30] Jrz (~jrz@d152222.upc-d.chello.nl) joined #redis. [11:59:44] napperjabber_ (~napperjab@149.48.161.10) joined #redis. [11:59:50] napperjabber (~napperjab@149.48.161.10) left irc: Ping timeout: 248 seconds [11:59:50] Nick change: napperjabber_ -> napperjabber [12:05:23] daelious (~daelious@ip-12-157-188-198.kindredhealthcare.com) left #redis ("Leaving"). [12:07:27] twittard (~twittard@wc.lax.truecarcorp.com) joined #redis. [12:09:57] Some Redis Q's... How are people handling failure? IE, a redis node goes down... How does the master / slave replication work? [12:10:34] I'm not sure exactly what question I want to ask. I'm basically unsure of what's available, both in Redis itself and in the client libraries. [12:10:45] Half of the equation would be retry logic in the client. [12:10:49] ncode (~ncode@unaffiliated/ncode) joined #redis. [12:19:15] nu7hatch (~cubox@r186-48-247-83.dialup.adsl.anteldata.net.uy) left irc: Read error: Connection reset by peer [12:19:15] elcuervo (~elcuervo@r186-48-247-83.dialup.adsl.anteldata.net.uy) left irc: Read error: Connection reset by peer [12:20:27] elcuervo (~elcuervo@r186-48-195-228.dialup.adsl.anteldata.net.uy) joined #redis. [12:20:41] mjr_ (~mjr_@vpn.rebelvox.com) joined #redis. [12:21:31] nu7hatch (~cubox@r186-48-204-244.dialup.adsl.anteldata.net.uy) joined #redis. [12:21:40] elcuervo_ (~elcuervo@r186-48-204-244.dialup.adsl.anteldata.net.uy) joined #redis. [12:24:28] elcuerv__ (~elcuervo@r186-48-226-58.dialup.adsl.anteldata.net.uy) joined #redis. [12:24:28] nu7hatch_ (~cubox@r186-48-226-58.dialup.adsl.anteldata.net.uy) joined #redis. [12:24:36] elcuervo (~elcuervo@r186-48-195-228.dialup.adsl.anteldata.net.uy) left irc: Ping timeout: 240 seconds [12:25:33] elcuervo (~elcuervo@r186-48-228-170.dialup.adsl.anteldata.net.uy) joined #redis. [12:25:47] nu7hatch (~cubox@r186-48-204-244.dialup.adsl.anteldata.net.uy) left irc: Ping timeout: 240 seconds [12:26:34] elcuervo_ (~elcuervo@r186-48-204-244.dialup.adsl.anteldata.net.uy) left irc: Ping timeout: 276 seconds [12:27:03] nu7hatch (~cubox@r186-48-228-170.dialup.adsl.anteldata.net.uy) joined #redis. [12:28:14] rittyan (~rittyan@176.14.223.175) joined #redis. [12:28:47] nu7hatch_ (~cubox@r186-48-226-58.dialup.adsl.anteldata.net.uy) left irc: Ping timeout: 240 seconds [12:29:03] elcuerv__ (~elcuervo@r186-48-226-58.dialup.adsl.anteldata.net.uy) left irc: Read error: Operation timed out [12:34:05] wmage (~wmage@nat-88-212-40-142.antik.sk) joined #redis. [12:35:33] lux___ (~lux@ppp-36-77.25-151.libero.it) left irc: Quit: This computer has gone to sleep [12:35:58] brunov (~bruno@74-154-89-200.fibertel.com.ar) left irc: Quit: Ex-Chat [12:42:35] awksed2greep (~awksedgre@glo3.manheim.com) left irc: Quit: This computer has gone to sleep [12:46:36] mjr_ (~mjr_@vpn.rebelvox.com) left irc: Ping timeout: 240 seconds [12:47:06] xetorthio (~jleibiusk@200.41.238.50) left irc: Ping timeout: 268 seconds [12:51:52] Nick change: wmoss|away -> wmoss [12:59:19] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) joined #redis. [13:00:15] pietern (~pieter@208.91.1.14) left irc: Ping timeout: 244 seconds [13:00:52] pietern (~pieter@64.125.181.73) joined #redis. [13:00:52] #redis: mode change '+v pietern' by ChanServ!ChanServ@services. [13:03:03] insin (~insin@host31-53-218-142.range31-53.btcentralplus.com) joined #redis. [13:03:58] lux___ (~lux@ppp-36-77.25-151.libero.it) joined #redis. [13:04:46] Caius (~Caius@about/apple/macbookpro/Caius) left irc: Excess Flood [13:04:46] axl_ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) joined #redis. [13:09:04] Caius (~Caius@about/apple/macbookpro/Caius) joined #redis. [13:10:08] jnns (~jnns@g226050121.adsl.alicedsl.de) joined #redis. [13:19:33] h0bbit (~vedang@59.95.12.233) left irc: Ping timeout: 248 seconds [13:24:46] jnns (~jnns@g226050121.adsl.alicedsl.de) left irc: Quit: leaving [13:26:29] twittard (~twittard@wc.lax.truecarcorp.com) left irc: Remote host closed the connection [13:26:52] twittard (~twittard@wc.lax.truecarcorp.com) joined #redis. [13:27:20] pietern (~pieter@64.125.181.73) left irc: Quit: pietern [13:29:42] I've got a bit of a struggle ahead of me, perhaps I can find some help here. I had a master/slave setup with Redis, however the monitoring on the backup failed, and Redis also failed. Because it's an amazon EC2 instance there's no swap etc, so it died without any grace. Now, the problem is that the primary/master machine does not have appendonly on, and is not doing dumps. This primary machine has less than 1gb free of memory [13:29:42] redis is using roughly 15gb (12gb human readable). The machine has ~17gb total. [13:31:02] I have a few options in mind, but if this machine with persistence falls over, I'll be losing a week of data. One idea is to mount another volume to the machine, live-set the path for dumps and run a bgsave (or save). [13:31:43] How safe would one think it is to run a bgdump on the machine with ~1gb free and a solid 12gb database? [13:31:59] pietern (~pieter@64.125.181.69) joined #redis. [13:31:59] #redis: mode change '+v pietern' by ChanServ!ChanServ@services. [13:33:12] Another oddity is that, I have spun up a third machine with 34gb ram, and have tried to slave redis off of the 17gb server. It copies over about 9mil of the 16mil keys, and reports that the sync is complete. In replication docs, I haven't been able to determine what would cause this [13:33:39] awksed2greep (~awksedgre@c-24-98-243-58.hsd1.ga.comcast.net) joined #redis. [13:34:00] arek_deepinit (~arek@esposa.patyk.net.pl) joined #redis. [13:34:06] The "third machine" has plenty of disk. The master however does not have sufficient disk to dump the entire database. This is why I am leaning towards mounting a volume and running a save [13:34:59] pietern (~pieter@64.125.181.69) left irc: Client Quit [13:36:57] mhald (~mhald@c-76-115-96-86.hsd1.or.comcast.net) joined #redis. [13:37:11] afternoon :) [13:39:18] pietern (~pieter@64.125.181.69) joined #redis. [13:39:18] #redis: mode change '+v pietern' by ChanServ!ChanServ@services. [13:41:03] jonesy (~jonesy@68.64.144.221) left irc: Quit: Computer has gone to sleep. [13:45:21] pietern (~pieter@64.125.181.69) left irc: Quit: pietern [13:45:46] johnsanders (~johnsande@c-69-181-21-76.hsd1.ca.comcast.net) joined #redis. [13:47:09] daniel_karlsson (~kardan@c83-254-118-140.bredband.comhem.se) left irc: Quit: daniel_karlsson [13:47:26] jrydberg_ (~jrydberg@c-2c08e253.1137-1-64736c10.cust.bredbandsbolaget.se) left irc: Quit: This computer has gone to sleep [13:47:35] martincozzi (~martincoz@209.66.114.6) joined #redis. [13:51:51] tilgovi (~randall@couchdb/developer/tilgovi) joined #redis. [13:52:36] axl__ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) joined #redis. [13:52:40] seppo0010 (~Adium@200.69.194.105) joined #redis. [13:54:47] axl_ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) left irc: Ping timeout: 240 seconds [13:57:58] seppo0010 (~Adium@200.69.194.105) left #redis. [14:02:14] Jrz (~jrz@d152222.upc-d.chello.nl) left irc: Quit: Computer has gone to sleep. [14:02:17] axl__ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) left irc: Read error: Connection reset by peer [14:04:16] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) left irc: Remote host closed the connection [14:04:50] wmage (~wmage@nat-88-212-40-142.antik.sk) left irc: Read error: Connection timed out [14:07:45] Swimming_Bird (~textual@64.70.114.89) left irc: Quit: Computer has gone to sleep. [14:08:45] axl_ (~axl@173-11-52-113-Minnesota.hfc.comcastbusiness.net) joined #redis. [14:09:16] senderista (~senderist@216.161.248.54) left irc: Quit: senderista [14:13:00] senderista (~senderist@216.161.248.54) joined #redis. [14:14:08] NetRoY (~NetRoY@122.167.90.12) left irc: Quit: NetRoY [14:17:17] senderista (~senderist@216.161.248.54) left irc: Client Quit [14:21:24] soveran (~soveran@186.19.214.247) joined #redis. [14:21:55] d0k (~d0k@aef.wh.uni-dortmund.de) left irc: Quit: he does that [14:26:45] elcuervo (~elcuervo@r186-48-228-170.dialup.adsl.anteldata.net.uy) left irc: Ping timeout: 248 seconds [14:28:12] stask312 (~stask312@62.219.149.27) joined #redis. [14:28:31] bmizerany (~bmizerany@204.14.152.118) joined #redis. [14:29:11] gnrfan (~gnrfan@200.106.71.56) joined #redis. [14:32:53] gnrfan (~gnrfan@200.106.71.56) left irc: Client Quit [14:34:29] rb2k (~rb2k@HSI-KBW-134-3-0-160.hsi14.kabel-badenwuerttemberg.de) joined #redis. [14:35:06] luckyruby (~luckyruby@125-187.96-97.tampabay.res.rr.com) joined #redis. [14:37:58] napperjabber (~napperjab@149.48.161.10) left irc: Quit: napperjabber [14:38:31] pietern (~pieter@208.91.1.14) joined #redis. [14:38:31] #redis: mode change '+v pietern' by ChanServ!ChanServ@services. [14:39:35] pietern: hey hey [14:39:38] still around by any chance? [14:39:43] mrb_bk: hola [14:39:47] yep :) [14:40:32] pietern: hey! o/ AOF format did't change between 2.2 and 2.4, right? [14:40:45] rittyan: hi, no it didn't :) [14:40:52] it will for 2.6 though [14:40:58] still fwd compatible, not backward [14:40:58] pietern: sent you a private [14:41:07] __alex (~alex@g225251194.adsl.alicedsl.de) left irc: Ping timeout: 240 seconds [14:41:24] pietern: is there a chance for redis to 1) stop writing AOF suddenly and still work, or 2) read AOF not completely during start up and then... work? [14:41:48] rittyan: yes, I believe there is [14:41:59] Can you tell me more about it? [14:41:59] I think on disk full, redis doesn [14:42:05] pietern: on disk full redis quits [14:42:06] redis doesn't abort, [14:42:13] ok [14:42:21] if write(2) fails, redis quits [14:42:24] let me check out some code [14:43:21] pietern: it's just, we upgraded from 2.2 to 2.4 recently, and after restarting suddenly one instance had an old (few days old) data. I blame sysadmins for screwing up something somewhere, they blame me as a redis advocate in our company :-) [14:44:37] Probably it didn't happen like this. I just got a phone call with the description of what happened [14:44:56] But what if there's still a chance for such a scenario, when redis breaks [14:45:38] rittyan: there shouldn't [14:45:46] rittyan: I mixed it up with bgsaves [14:45:51] if it cannot save it doesn't quit [14:45:53] but with aof it does [14:46:03] Okay [14:46:11] can it read aof not completely during startup? [14:46:44] rittyan: nope, it reads until EOF [14:46:51] do you still have this particular aof? [14:46:56] pietern: thank you for your help :-) [14:47:23] rittyan: it would be reassuring to know the exact cause for this [14:47:25] no I have nothing, we have nazi sysadmins. All I have is what they decide to tell me [14:47:28] pietern: yup [14:47:38] but without any more data it's impossible [14:47:44] exactly [14:47:49] I will try to persuade them [14:48:11] pietern: if AOF has no new data in it, then they restored an old backup or w/e [14:48:24] anyway, looks like a human mistake to me [14:48:30] pietern: thank you [14:48:41] rittyan: no problem! I hope this is indeed a human error ;) [14:53:35] drbobbeaty (~drbobbeat@38.98.137.29) left irc: Quit: drbobbeaty [14:55:33] __alex (~alex@g230196148.adsl.alicedsl.de) joined #redis. [14:58:47] rb2k (~rb2k@HSI-KBW-134-3-0-160.hsi14.kabel-badenwuerttemberg.de) left irc: Remote host closed the connection [14:59:24] rb2k (~rb2k@205.164.38.254) joined #redis. [15:05:01] rb2k_ (~rb2k@HSI-KBW-134-3-0-160.hsi14.kabel-badenwuerttemberg.de) joined #redis. [15:07:21] rb2k (~rb2k@205.164.38.254) left irc: Ping timeout: 244 seconds [15:07:21] arek_deepinit (~arek@esposa.patyk.net.pl) left irc: Read error: Connection reset by peer [15:07:21] Nick change: rb2k_ -> rb2k [15:09:00] senderista (~senderist@216.161.248.54) joined #redis. [15:13:22] rurufufuss (~rurufufus@115-64-27-246.static.tpgi.com.au) left irc: Read error: Connection reset by peer [15:15:23] johnsanders (~johnsande@c-69-181-21-76.hsd1.ca.comcast.net) left irc: Quit: Leaving... [15:17:47] rb2k (~rb2k@HSI-KBW-134-3-0-160.hsi14.kabel-badenwuerttemberg.de) left irc: Quit: rb2k [15:19:02] thehodge (~thehodge@2001:470:1f09:13a3:ccfb:e41b:1bfe:8c01) joined #redis. [15:22:10] stephank (~stephank@82.197.214.45) left irc: Quit: *Poof!* [15:26:33] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) left irc: Quit: ceej [15:27:54] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) joined #redis. [15:28:50] hoodow (~hoodow@pdpc/supporter/active/hoodow) left irc: Ping timeout: 252 seconds [15:29:15] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) left irc: Remote host closed the connection [15:29:45] jscheel (~jscheel@drupal.org/user/116197/view) left irc: Read error: Connection reset by peer [15:30:13] hoodow (~hoodow@2001:41d0:2:b214:20::5) joined #redis. [15:30:14] hoodow (~hoodow@2001:41d0:2:b214:20::5) left irc: Changing host [15:30:14] hoodow (~hoodow@pdpc/supporter/active/hoodow) joined #redis. [15:33:38] petercooper (~petercoop@82.144.254.2) joined #redis. [15:34:24] hoodow (~hoodow@pdpc/supporter/active/hoodow) left irc: Excess Flood [15:34:43] tilgovi (~randall@couchdb/developer/tilgovi) left irc: Ping timeout: 252 seconds [15:34:48] PiotrSikora (~none@nginx/adept/piotrsikora) left irc: Read error: Connection reset by peer [15:35:00] hoodow (~hoodow@2001:41d0:2:b214:20::5) joined #redis. [15:35:00] hoodow (~hoodow@2001:41d0:2:b214:20::5) left irc: Changing host [15:35:00] hoodow (~hoodow@pdpc/supporter/active/hoodow) joined #redis. [15:36:20] PiotrSikora_ (~none@nginx/adept/piotrsikora) joined #redis. [15:47:30] ncode (~ncode@unaffiliated/ncode) left irc: Quit: Computer has gone to sleep. [15:50:52] ddilinger (~guy@unaffiliated/ddilinger) left irc: Ping timeout: 268 seconds [15:51:30] ddilinger (~guy@unaffiliated/ddilinger) joined #redis. [15:54:55] Comandante (~Comandant@200.41.238.50) left irc: Remote host closed the connection [15:58:25] xcbt (~xcbt@208-100-139-67.bendbroadband.com) left irc: Remote host closed the connection [15:58:58] rittyan (~rittyan@176.14.223.175) left irc: Remote host closed the connection [15:59:14] bmizerany (~bmizerany@204.14.152.118) left irc: Remote host closed the connection [16:05:03] Wombert (~Wombert@dslb-092-074-120-056.pools.arcor-ip.net) left irc: Quit: Wombert [16:05:15] thehodge (~thehodge@2001:470:1f09:13a3:ccfb:e41b:1bfe:8c01) left irc: Remote host closed the connection [16:05:34] wilmoore (~wilmoore@70-89-165-49-ISTS-co.hfc.comcastbusiness.net) left irc: Remote host closed the connection [16:05:39] thehodge (~thehodge@2001:470:1f09:13a3:ccfb:e41b:1bfe:8c01) joined #redis. [16:06:19] fmeyer (~fmeyer@186.220.10.39) joined #redis. [16:06:24] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) joined #redis. [16:10:16] thehodge (~thehodge@2001:470:1f09:13a3:ccfb:e41b:1bfe:8c01) left irc: Ping timeout: 252 seconds [16:14:15] bmizerany (~bmizerany@204.14.152.118) joined #redis. [16:24:13] Nick change: NuckOff -> Nuck [16:30:10] napperjabber (~napperjab@c-98-231-251-134.hsd1.md.comcast.net) joined #redis. [16:31:02] napperjabber (~napperjab@c-98-231-251-134.hsd1.md.comcast.net) left irc: Client Quit [16:32:09] jonesy (~jonesy@pool-173-71-115-162.cmdnnj.fios.verizon.net) joined #redis. [16:38:11] tilgovi (~randall@173-13-150-22-sfba.hfc.comcastbusiness.net) joined #redis. [16:38:12] tilgovi (~randall@173-13-150-22-sfba.hfc.comcastbusiness.net) left irc: Changing host [16:38:12] tilgovi (~randall@couchdb/developer/tilgovi) joined #redis. [16:42:16] insin (~insin@host31-53-218-142.range31-53.btcentralplus.com) left irc: Quit: What's the point in giving us haaaaannnds? [16:45:51] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) left irc: Ping timeout: 252 seconds [17:03:11] tilgovi (~randall@couchdb/developer/tilgovi) left irc: Remote host closed the connection [17:07:47] __alex (~alex@g230196148.adsl.alicedsl.de) left irc: Ping timeout: 240 seconds [17:10:55] rb2k (~rb2k@HSI-KBW-134-3-0-160.hsi14.kabel-badenwuerttemberg.de) joined #redis. [17:15:57] merlin83 (~merlin83@unaffiliated/merlin83) joined #redis. [17:19:55] wilmoore (~wilmoore@mail2.remycorp.com) joined #redis. [17:32:19] martincozzi (~martincoz@209.66.114.6) left irc: Quit: martincozzi [17:33:43] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) joined #redis. [17:33:56] Sarevok (~locke@rrcs-98-101-176-143.midsouth.biz.rr.com) left #redis. [17:34:14] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) joined #redis. [17:35:17] bmizerany (~bmizerany@204.14.152.118) left irc: Remote host closed the connection [17:35:19] stask312_ (~stask312@62.219.149.27) joined #redis. [17:35:58] stask312 (~stask312@62.219.149.27) left irc: Read error: Connection reset by peer [17:36:46] wilmoore (~wilmoore@mail2.remycorp.com) left irc: Remote host closed the connection [17:43:32] pharkmillups (~markphill@70-36-146-239.dsl.dynamic.sonic.net) left irc: Quit: pharkmillups [17:51:17] alc (~nek@61.135.165.159) joined #redis. [17:51:53] martincozzi (~martincoz@172.sub-75-210-22.myvzw.com) joined #redis. [17:55:49] martincozzi (~martincoz@172.sub-75-210-22.myvzw.com) left irc: Client Quit [18:09:02] bmizerany (~bmizerany@204.14.152.118) joined #redis. [18:18:20] Nick change: wmoss -> wmoss|away [18:18:52] wilmoore (~wilmoore@mail2.remycorp.com) joined #redis. [18:20:49] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) left irc: Ping timeout: 276 seconds [18:22:13] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) left irc: Remote host closed the connection [18:24:47] _macro (~Neil@accessnat4.mochimedia.net) left irc: Ping timeout: 240 seconds [18:35:36] Nick change: Nuck -> NuckOff [18:37:42] ncode (~ncode@189.38.154.97) joined #redis. [18:37:42] ncode (~ncode@189.38.154.97) left irc: Changing host [18:37:42] ncode (~ncode@unaffiliated/ncode) joined #redis. [18:39:51] bmizerany (~bmizerany@204.14.152.118) left irc: Remote host closed the connection [18:39:56] nek (~nek@61.135.165.159) joined #redis. [18:40:13] Save vs Bgsave question [18:40:25] I don't have enough free memory to do a bgsave [18:40:36] will a save work? [18:40:43] without killing the process? [18:40:52] The OS is kiling the fork on bgsave due to memory issues [18:41:58] thanks for any help [18:43:19] alc (~nek@61.135.165.159) left irc: Ping timeout: 244 seconds [18:44:52] martincozzi (~martincoz@c-67-180-194-70.hsd1.ca.comcast.net) joined #redis. [18:47:00] chrisjones (~chrisjone@ip68-224-245-47.lv.lv.cox.net) left irc: Quit: Textual IRC Client: http://www.textualapp.com/ [18:54:11] tilgovi (~randall@nat-sonicnet.noisebridge.net) joined #redis. [18:54:11] tilgovi (~randall@nat-sonicnet.noisebridge.net) left irc: Changing host [18:54:11] tilgovi (~randall@couchdb/developer/tilgovi) joined #redis. [18:59:47] radsaq (~radsaq@c-71-63-48-142.hsd1.va.comcast.net) left irc: Remote host closed the connection [19:00:18] perezd (~derek@108-71-92-105.lightspeed.sntcca.sbcglobal.net) left irc: Quit: perezd [19:01:14] wilmoore (~wilmoore@mail2.remycorp.com) left irc: Remote host closed the connection [19:02:36] pietern (~pieter@208.91.1.14) left irc: Ping timeout: 240 seconds [19:05:24] martincozzi (~martincoz@c-67-180-194-70.hsd1.ca.comcast.net) left irc: Quit: martincozzi [19:07:37] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) joined #redis. [19:18:55] johnsanders (~johnsande@c-69-181-21-76.hsd1.ca.comcast.net) joined #redis. [19:19:30] mjr_ (~mjr_@vpn.rebelvox.com) joined #redis. [19:19:50] wilmoore (~wilmoore@mail2.remycorp.com) joined #redis. [19:22:25] luckman212 (~irc@pool-108-41-8-176.nycmny.fios.verizon.net) left irc: Remote host closed the connection [19:22:32] awksed2greep (~awksedgre@c-24-98-243-58.hsd1.ga.comcast.net) left irc: Quit: This computer has gone to sleep [19:24:36] Nick change: PiotrSikora_ -> PiotrSikora [19:29:38] Hmm, cant bgsave, OS kills the fork. Afraid to save, as the OS may kill the main process. What to do? [19:33:12] twittard (~twittard@wc.lax.truecarcorp.com) left irc: Ping timeout: 255 seconds [19:40:31] senderista (~senderist@216.161.248.54) left irc: Quit: senderista [19:43:15] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) joined #redis. [19:46:26] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) joined #redis. [19:47:43] agentzh (~agentz@nginx/adept/agentzh) joined #redis. [19:49:35] soveran (~soveran@186.19.214.247) left irc: Remote host closed the connection [19:56:26] versicolor (~quassel@90.154.208.149) joined #redis. [19:59:55] KevBurnsJr (~KevBurnsJ@50.0.103.39) left irc: [20:03:23] nek (~nek@61.135.165.159) left irc: Remote host closed the connection [20:03:49] nu7hatch (~cubox@r186-48-228-170.dialup.adsl.anteldata.net.uy) left irc: Quit: nu7hatch [20:03:59] codeographer: slave to another process? [20:07:51] lux___ (~lux@ppp-36-77.25-151.libero.it) left irc: Quit: This computer has gone to sleep [20:12:31] I'm trying to attach a slave, and the master (which has no persistence) just cant seem to finish the sync. [20:12:51] When redis forks to do a bgsave, the fork dies. [20:14:14] awksed2greep (~awksedgre@glo3.manheim.com) joined #redis. [20:15:52] mjr_: So the problem is that I had a master/slave configuration, and the slave which was disk-persistent died days ago. I don't want to lose the data on the master, but I've tried every approach I can think of in order to get the data to the new slave. Including a bgsave and enabling AOF (and/or bgwriteaof). It starts to write the dump file, or the AOF but dies pretty quickly [20:16:24] hmm, that's rough [20:16:41] so you attach a slave from a different machine? [20:16:59] And it starts the sync, and is it busy while syncing? [20:17:26] yes, load on the master spikes - logs indicate that it's doing the bgsave, i see redis fork [20:18:07] I assume that you checked to make sure you aren't out of disk space or memory? [20:18:54] To make matters worse, there's no swap on these machines, and even though this particular instance is 2.2.4 I wouldn't be able to enable the deprecated VM capabilities just for the sake of the new slave [20:19:06] Yes, disk is fine but I am running very slim on physical memory [20:19:10] redis is at about 90% [20:19:17] awksed2greep (~awksedgre@glo3.manheim.com) left irc: Read error: Operation timed out [20:21:03] Hah, and the kicker is in 5 days ec2 will shut down this particular instance. [20:22:30] wilmoore (~wilmoore@mail2.remycorp.com) left irc: Remote host closed the connection [20:22:32] mjr_: What I've identified is roughly 300k SETS in redis that can potentially be removed. Hoping this frees up enough memory. Once removed, I'll repeat the process of attempting to attach the slave. [20:23:15] So did you set overcommit memory? [20:23:20] I assume this is Linux [20:23:42] ncode (~ncode@unaffiliated/ncode) left irc: Quit: Computer has gone to sleep. [20:23:52] yes [20:23:56] (and yes) [20:24:05] wilmoore (~wilmoore@mail2.remycorp.com) joined #redis. [20:24:21] awksed2greep (~awksedgre@glo3.manheim.com) joined #redis. [20:25:13] mjr_: cat /proc/sys/vm/overcommit_memory yields 1 [20:27:10] hmm [20:27:25] It's troubling that attaching the slave doesn't finish. [20:27:36] That shouldn't fork on the master, I don't think. [20:28:10] Wombert (~Wombert@dslb-092-074-120-056.pools.arcor-ip.net) joined #redis. [20:28:14] mjr_: I see the master write the dump file and it grows to ~4gb before this falls over [20:29:24] that's when you do a save on the master, though, right? [20:29:32] Does it also grow when you connect a slave? [20:29:50] yes, it creates a dumpfile when connecting the slave to it [20:30:04] even with saves off etc, no AOF enabled [20:30:33] Oh, I guess I didn't understand how the replication works after all. [20:30:40] Interesting. [20:30:53] I wish I could help you. [20:31:03] This is just what I've noticed, I clearly am not a redis expert :) [20:31:44] The frightening thing is that the OS constantly kills that forked process. The final option i see is running a blocking save, but im afraid the main process will get wacked when doing so. [20:31:57] mjr_: Thanks for listening either way [20:34:30] perezd (~derek@108-71-92-105.lightspeed.sntcca.sbcglobal.net) joined #redis. [20:35:16] wilmoore (~wilmoore@mail2.remycorp.com) left irc: Remote host closed the connection [20:38:55] nicholas_ (~nicholasf@ppp196-159.static.internode.on.net) joined #redis. [20:39:24] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) left irc: Read error: Connection reset by peer [20:40:36] tilgovi (~randall@couchdb/developer/tilgovi) left irc: Ping timeout: 244 seconds [20:41:09] nicholas_ (~nicholasf@ppp196-159.static.internode.on.net) left irc: Read error: Connection reset by peer [20:41:24] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) joined #redis. [20:42:57] horsey (~horsey@27.34.244.74) left irc: Ping timeout: 255 seconds [20:44:25] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) left irc: Read error: Connection reset by peer [20:44:31] chakrit (~chakrit@ppp-58-8-232-51.revip2.asianet.co.th) joined #redis. [20:44:57] chakrit (~chakrit@ppp-58-8-232-51.revip2.asianet.co.th) left irc: Client Quit [20:44:58] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) joined #redis. [20:45:07] chakrit (~chakrit@ppp-58-8-232-51.revip2.asianet.co.th) joined #redis. [20:48:57] brianseeders (~BS@108-216-88-132.lightspeed.bcvloh.sbcglobal.net) left irc: Ping timeout: 252 seconds [20:49:03] perezd (~derek@108-71-92-105.lightspeed.sntcca.sbcglobal.net) left irc: Quit: perezd [20:53:07] horsey (~horsey@27.34.244.74) joined #redis. [20:58:02] petercooper (~petercoop@82.144.254.2) left irc: Remote host closed the connection [20:58:53] dribdrab (~dribdrab@70-36-146-235.dsl.dynamic.sonic.net) left irc: Quit: dribdrab [21:01:30] perezd (~derek@108-71-92-105.lightspeed.sntcca.sbcglobal.net) joined #redis. [21:03:18] perezd (~derek@108-71-92-105.lightspeed.sntcca.sbcglobal.net) left irc: Client Quit [21:03:56] Wombert (~Wombert@dslb-092-074-120-056.pools.arcor-ip.net) left irc: Quit: Wombert [21:06:22] wilmoore (~wilmoore@mail2.remycorp.com) joined #redis. [21:06:45] JeremyWei (~textual@122.193.209.13) joined #redis. [21:14:56] andymccurdy (~andymccur@69.12.160.66) left irc: Ping timeout: 240 seconds [21:23:14] _macro (~Neil@c-67-169-183-90.hsd1.ca.comcast.net) joined #redis. [21:25:26] kushal (~kdas@fedora/kushal) joined #redis. [21:57:15] ceej (~anonymous@cpe-72-190-40-203.tx.res.rr.com) left irc: Quit: ceej [21:57:43] dribdrab (~dribdrab@c-24-5-88-169.hsd1.ca.comcast.net) joined #redis. [21:59:33] dribdrab_ (~dribdrab@c-24-5-88-169.hsd1.ca.comcast.net) joined #redis. [21:59:33] dribdrab (~dribdrab@c-24-5-88-169.hsd1.ca.comcast.net) left irc: Read error: Connection reset by peer [21:59:33] Nick change: dribdrab_ -> dribdrab [22:02:30] pharkmillups (~markphill@c-98-234-235-225.hsd1.ca.comcast.net) joined #redis. [22:07:56] wilmoore (~wilmoore@mail2.remycorp.com) left irc: Ping timeout: 252 seconds [22:17:11] twittard (~twittard@cpe-76-169-74-39.socal.res.rr.com) joined #redis. [22:21:39] twittard (~twittard@cpe-76-169-74-39.socal.res.rr.com) left irc: Remote host closed the connection [22:21:55] twittard (~twittard@vpn.lax.truecarcorp.com) joined #redis. [22:37:44] muhqu (~Adium@port-6214.pppoe.wtnet.de) joined #redis. [22:40:55] martincozzi (~martincoz@c-67-180-194-70.hsd1.ca.comcast.net) joined #redis. [22:42:14] muhqu (~Adium@port-6214.pppoe.wtnet.de) left irc: Ping timeout: 252 seconds [22:43:30] luckyruby (~luckyruby@125-187.96-97.tampabay.res.rr.com) left irc: Remote host closed the connection [22:44:35] luckyruby (~luckyruby@125-187.96-97.tampabay.res.rr.com) joined #redis. [22:46:44] muhqu (~Adium@port-6214.pppoe.wtnet.de) joined #redis. [22:52:52] p1d (~p1d@ns1.vonaffenfels.de) joined #redis. [22:56:30] fmeyer (~fmeyer@186.220.10.39) left irc: Remote host closed the connection [22:57:06] fmeyer (~fmeyer@186.220.10.39) joined #redis. [23:10:07] wilmoore (~wilmoore@c-67-190-17-108.hsd1.co.comcast.net) joined #redis. [23:12:00] nicholasf (~nicholasf@ppp196-159.static.internode.on.net) left irc: Remote host closed the connection [23:13:19] Nick change: wmoss|away -> wmoss [23:14:25] fanjie (~fanjie@c-67-180-77-58.hsd1.ca.comcast.net) left irc: Quit: fanjie [23:14:55] fanjie (~fanjie@c-67-180-77-58.hsd1.ca.comcast.net) joined #redis. [23:17:46] dribdrab (~dribdrab@c-24-5-88-169.hsd1.ca.comcast.net) left irc: Quit: dribdrab [23:17:59] Jrz (~jrz@87.239.184.141) joined #redis. [23:19:13] fanjie (~fanjie@c-67-180-77-58.hsd1.ca.comcast.net) left irc: Ping timeout: 244 seconds [23:30:29] Tuxist (~quassel@dslb-092-077-014-198.pools.arcor-ip.net) joined #redis. [23:35:03] xcbt (~xcbt@bc98121.bendcable.com) joined #redis. [23:37:03] PiotrSikora (~none@nginx/adept/piotrsikora) left irc: Quit: ZNC - http://znc.in [23:39:03] PiotrSikora (~none@nginx/adept/piotrsikora) joined #redis. [23:41:16] chakrit (~chakrit@ppp-58-8-232-51.revip2.asianet.co.th) left irc: Ping timeout: 240 seconds [23:41:58] mjr_ (~mjr_@vpn.rebelvox.com) left irc: Quit: mjr_ [23:43:19] chakrit (~chakrit@ppp-58-8-67-165.revip2.asianet.co.th) joined #redis. [23:49:42] pharkmillups (~markphill@c-98-234-235-225.hsd1.ca.comcast.net) left irc: Quit: pharkmillups [23:53:19] NuckOff (~Nuck@unaffiliated/nuck) left irc: Quit: ZNC - http://znc.sourceforge.net [23:53:59] Nuck (~Nuck@unaffiliated/nuck) joined #redis. [23:55:25] chakrit_ (~chakrit@ppp-58-8-180-249.revip2.asianet.co.th) joined #redis. [23:56:38] h0bbit (~vedang@121.243.225.226) joined #redis. [23:57:27] chakrit (~chakrit@ppp-58-8-67-165.revip2.asianet.co.th) left irc: Ping timeout: 240 seconds [23:57:27] Nick change: chakrit_ -> chakrit [00:00:00] --- Fri Dec 16 2011