Displaying #cassandra-dev/2016-10-28.log:

Fri Oct 28 00:04:28 2016  dikang:Joined the channel
Fri Oct 28 00:05:56 2016  exlt:fwiw, ubuntu popcon stats: 99.973% of systems have 'apt' installed; 0.146% of systems have 'snapd' installed (based on dividing by the #1 installed package)
Fri Oct 28 00:07:25 2016  exlt:interesting distribution service, but not used much
Fri Oct 28 00:10:09 2016  exlt:it can also be argued that popcon is irrelevant and means nothing :)
Fri Oct 28 00:10:46 2016  driftx:to be fair, can you even run a debian-based system without apt? heh
Fri Oct 28 00:10:58 2016  exlt:yep - dpkg is all you need
Fri Oct 28 00:11:07 2016  driftx:if you want to kill yourself
Fri Oct 28 00:15:53 2016  EnigmaCurry:Joined the channel
Fri Oct 28 00:21:03 2016  aaron_morton:Joined the channel
Fri Oct 28 00:21:31 2016  mhall119:exlt: I think popcon is opt-in on Ubuntu
Fri Oct 28 00:21:43 2016  exlt:of course it is
Fri Oct 28 00:22:07 2016  exlt:that's why it can be argued that it means nothing
Fri Oct 28 00:22:58 2016  exlt:it means less when people try to quote exact install numbers, but to get an idea of percentages of installs of packages, it's not too bad
Fri Oct 28 00:23:15 2016  exlt:there are no other statistics gathered, so popcon is about all there is
Fri Oct 28 00:27:17 2016  mhall119:well, 0.146% of 45 million is still a pretty big number ;)
Fri Oct 28 00:27:44 2016  jmckenzie:Joined the channel
Fri Oct 28 00:28:07 2016  mstepura:Joined the channel
Fri Oct 28 00:31:08 2016  exlt:yep :) get more users using it! and go kick vorlon in the shins and tell him to fix the damn RC bug in debian and upload 2.16 ;)
Fri Oct 28 00:33:31 2016  mhall119:I believe mvo is kicking him already
Fri Oct 28 00:33:55 2016  mhall119:we're also backporting snapd to 14.04 so even more users will get it
Fri Oct 28 00:34:15 2016  exlt:ah, cool
Fri Oct 28 00:34:49 2016  mhall119:we're also close to getting it into fedora's repos
Fri Oct 28 00:35:38 2016  exlt:grats
Fri Oct 28 00:36:10 2016  exlt:if it indeed takes off as a viable method to install cross-platform packages, it could solve a few problems :)
Fri Oct 28 02:42:55 2016  dikang:Joined the channel
Fri Oct 28 02:58:32 2016  aaron_morton:Joined the channel
Fri Oct 28 03:00:55 2016  aaron_morton:Joined the channel
Fri Oct 28 03:16:17 2016  dikang:Joined the channel
Fri Oct 28 04:16:25 2016  mebigfatguy:Joined the channel
Fri Oct 28 05:46:21 2016  mstepura:Joined the channel
Fri Oct 28 05:50:55 2016  mstepura:Joined the channel
Fri Oct 28 05:51:41 2016  mstepura:Joined the channel
Fri Oct 28 05:52:29 2016  mstepura:Joined the channel
Fri Oct 28 05:53:19 2016  mstepura:Joined the channel
Fri Oct 28 05:54:04 2016  mstepura:Joined the channel
Fri Oct 28 06:02:04 2016  aaron_morton:Joined the channel
Fri Oct 28 07:23:59 2016  spodkowinski:Joined the channel
Fri Oct 28 07:39:03 2016  kvaster:Joined the channel
Fri Oct 28 09:07:26 2016  kvaster:Joined the channel
Fri Oct 28 09:13:48 2016  kvaster:Joined the channel
Fri Oct 28 09:17:53 2016  kvaster:Joined the channel
Fri Oct 28 09:23:14 2016  kvaster:Joined the channel
Fri Oct 28 09:39:15 2016  snazy:Joined the channel
Fri Oct 28 10:04:48 2016  jameshowe:Joined the channel
Fri Oct 28 10:05:07 2016  jameshowe:Left the channel
Fri Oct 28 10:17:48 2016  krut:Joined the channel
Fri Oct 28 10:43:36 2016  kohlisankalp:Joined the channel
Fri Oct 28 11:03:12 2016  dikang:Joined the channel
Fri Oct 28 12:09:12 2016  norman_:Joined the channel
Fri Oct 28 12:36:00 2016  marcuse:Joined the channel
Fri Oct 28 12:36:08 2016  zaller:Joined the channel
Fri Oct 28 12:48:18 2016  jmckenzie:Joined the channel
Fri Oct 28 13:01:27 2016  gila_:Joined the channel
Fri Oct 28 13:32:05 2016  adamholmberg:Joined the channel
Fri Oct 28 13:44:33 2016  ostefano:Joined the channel
Fri Oct 28 14:01:04 2016  ostefano:Joined the channel
Fri Oct 28 15:00:29 2016  kohlisankalp:Joined the channel
Fri Oct 28 15:24:11 2016  ASFBot:Joined the channel
Fri Oct 28 15:45:10 2016  thobbs:Joined the channel
Fri Oct 28 16:07:35 2016  mstepura:Joined the channel
Fri Oct 28 16:07:39 2016  jmckenzie:Joined the channel
Fri Oct 28 16:11:00 2016  aaron_morton:Joined the channel
Fri Oct 28 16:29:55 2016  aaron_morton:Joined the channel
Fri Oct 28 16:31:41 2016  kvaster:Joined the channel
Fri Oct 28 16:39:49 2016  rustyrazorblade:Joined the channel
Fri Oct 28 16:41:01 2016  ryansvihla:Joined the channel
Fri Oct 28 16:42:22 2016  dikang:Joined the channel
Fri Oct 28 16:45:11 2016  wadey:Joined the channel
Fri Oct 28 16:46:16 2016  ostefano:Joined the channel
Fri Oct 28 17:04:00 2016  jmckenzie_:Joined the channel
Fri Oct 28 17:07:36 2016  kvaster:Joined the channel
Fri Oct 28 17:12:30 2016  jmckenzie__:Joined the channel
Fri Oct 28 17:29:10 2016  jmckenzie_:Joined the channel
Fri Oct 28 17:29:31 2016  jmckenzie__:Joined the channel
Fri Oct 28 17:34:31 2016  rs_atl:Joined the channel
Fri Oct 28 17:35:06 2016  rs_atl:hey, i want to raise awareness of this new issue: #12859
Fri Oct 28 17:35:08 2016  CassBotJr:https://issues.apache.org/jira/browse/CASSANDRA-12859 (Open; Unresolved; Unscheduled): "Column-level permissions"
Fri Oct 28 17:35:34 2016  rs_atl:one of my team members hopes to implement this, and would like some feedback
Fri Oct 28 17:43:03 2016  intjonathan:Joined the channel
Fri Oct 28 17:56:19 2016  zaller:Joined the channel
Fri Oct 28 18:04:00 2016  kvaster:Joined the channel
Fri Oct 28 18:05:59 2016  dikang:Joined the channel
Fri Oct 28 18:22:37 2016  intjonathan:Joined the channel
Fri Oct 28 18:23:13 2016  intjonathan:so I'm running a 30-ish node 3.7 cluster and we ran an outage test
Fri Oct 28 18:23:17 2016  intjonathan:we expected hints to play back as nodes returned, and since the outage was slightly longer than the hint ttl, we expected data gaps of outageTime - hintWindow length
Fri Oct 28 18:23:21 2016  intjonathan:however, when the nodes came back the hint files just... sat there
Fri Oct 28 18:23:24 2016  intjonathan:most machines had 10-15 tasks in the HintDispatcher pending tasks queue, but they just stayed at that level
Fri Oct 28 18:23:27 2016  intjonathan:they had about 1 active task in the HintDispatcher thread pool
Fri Oct 28 18:23:38 2016  intjonathan:iamaleksey: I asked in the datastaxacademy slack and was told to ask you here
Fri Oct 28 18:24:03 2016  intjonathan:how should we be monitoring hint replay behavior? how fast should we expect them to replay?
Fri Oct 28 18:35:33 2016  kohlisankalp:Joined the channel
Fri Oct 28 18:38:18 2016  aaron_morton:Joined the channel
Fri Oct 28 18:46:24 2016  iamaleksey:intjonathan: hey o
Fri Oct 28 18:46:34 2016  intjonathan:howdy!
Fri Oct 28 18:47:40 2016  iamaleksey:in 3.7, your best bet is inspecting the logs
Fri Oct 28 18:48:02 2016  iamaleksey:in trunk (not sure if made it to 3.9 or 3.10 only) you can use HintsServiceMetrics
Fri Oct 28 18:48:24 2016  intjonathan:hmm, we didn't see much output
Fri Oct 28 18:48:49 2016  intjonathan:some nodes emitted INFO messages when they were done with a file, but there didn't seem to be much in the way of progress status
Fri Oct 28 18:49:15 2016  intjonathan:what are the hints dispatcher thread pools doing? anything?
Fri Oct 28 18:51:27 2016  iamaleksey:dispathing hints
Fri Oct 28 18:52:17 2016  iamaleksey:I didn't add any extra metrics beyond the ones that already existed when rewriting the implementation, sorry about that
Fri Oct 28 18:53:07 2016  intjonathan:should we try a higher loglevel?
Fri Oct 28 18:54:17 2016  alice_:Joined the channel
Fri Oct 28 18:54:24 2016  iamaleksey:you might. there is a bunch of .trace() level messages there
Fri Oct 28 18:54:31 2016  iamaleksey:but most are info
Fri Oct 28 18:56:00 2016  mstepura:Joined the channel
Fri Oct 28 18:56:38 2016  intjonathan:ok, that's something
Fri Oct 28 18:56:51 2016  intjonathan:how fast does it replay the files? I saw something in the ticket about a 10 minute timer
Fri Oct 28 18:58:07 2016  alice_:I'm seeing better logs around hints now
Fri Oct 28 18:58:13 2016  alice_:INFO 18:56:21 Finished hinted handoff of file 00fea5b2-02af-47e6-87b0-dbb103d2b818-1477680759407-1.hints to endpoint 00fea5b2-02af-47e6-87b0-dbb103d2b818
Fri Oct 28 19:04:09 2016  intjonathan:FWIW, a rolling restart appears to have nudged it into a somewhat happier state, only one node has 124 hint files on it
Fri Oct 28 19:08:20 2016  intjonathan:and after its restart, that node is busy playing its hints too
Fri Oct 28 19:11:09 2016  aaron_morton:Joined the channel
Fri Oct 28 19:12:38 2016  lukerb:Joined the channel
Fri Oct 28 20:02:22 2016  dikang:Joined the channel
Fri Oct 28 20:05:47 2016  aaron_morton:Joined the channel
Fri Oct 28 21:02:43 2016  zaller:Joined the channel
Fri Oct 28 21:47:17 2016  kohlisankalp:Joined the channel
Fri Oct 28 21:52:13 2016  dikang:Joined the channel
Fri Oct 28 23:34:38 2016  mstepura:Joined the channel

Comments