Displaying #cassandra-dev/2016-12-07.log:

Wed Dec 7 00:33:23 2016  mstepura:Joined the channel
Wed Dec 7 00:56:18 2016  bradfordcp:Joined the channel
Wed Dec 7 00:58:42 2016  bradfordcp:Joined the channel
Wed Dec 7 01:04:10 2016  kohlisankalp:Joined the channel
Wed Dec 7 01:05:17 2016  bradfordcp:Joined the channel
Wed Dec 7 01:07:06 2016  bradfordcp_:Joined the channel
Wed Dec 7 01:09:09 2016  bradfordcp_:Joined the channel
Wed Dec 7 01:44:51 2016  kohlisankalp:Joined the channel
Wed Dec 7 01:51:52 2016  kohlisankalp:Joined the channel
Wed Dec 7 01:55:43 2016  kohlisankalp:Joined the channel
Wed Dec 7 02:37:18 2016  kohlisankalp:Joined the channel
Wed Dec 7 02:59:23 2016  mstepura:Joined the channel
Wed Dec 7 03:01:15 2016  bbromhead:Joined the channel
Wed Dec 7 03:14:04 2016  mstepura:Joined the channel
Wed Dec 7 03:14:51 2016  mstepura:Joined the channel
Wed Dec 7 03:16:46 2016  mstepura:Joined the channel
Wed Dec 7 03:17:26 2016  mstepura:Joined the channel
Wed Dec 7 03:25:50 2016  mstepura:Joined the channel
Wed Dec 7 04:03:02 2016  mstepura:Joined the channel
Wed Dec 7 04:04:59 2016  mstepura:Joined the channel
Wed Dec 7 04:05:48 2016  mstepura:Joined the channel
Wed Dec 7 04:06:33 2016  mstepura:Joined the channel
Wed Dec 7 04:07:23 2016  mstepura:Joined the channel
Wed Dec 7 04:11:47 2016  dikang:Joined the channel
Wed Dec 7 04:15:54 2016  bbromhead:Joined the channel
Wed Dec 7 04:20:56 2016  bbromhead:Joined the channel
Wed Dec 7 04:27:51 2016  mstepura:Joined the channel
Wed Dec 7 04:55:20 2016  zaller:Joined the channel
Wed Dec 7 04:57:52 2016  mstepura:Joined the channel
Wed Dec 7 05:14:13 2016  blerer_:Joined the channel
Wed Dec 7 05:14:28 2016  jeromatron_:Joined the channel
Wed Dec 7 05:15:00 2016  ryansvihla_:Joined the channel
Wed Dec 7 05:24:35 2016  ptnapoleon:Joined the channel
Wed Dec 7 05:25:46 2016  dikang:Joined the channel
Wed Dec 7 05:28:23 2016  dikang:Joined the channel
Wed Dec 7 05:29:21 2016  kohlisankalp:Joined the channel
Wed Dec 7 05:30:21 2016  mstepura:Joined the channel
Wed Dec 7 06:29:55 2016  dikang_:Joined the channel
Wed Dec 7 06:49:58 2016  minimarcel__:Joined the channel
Wed Dec 7 07:23:26 2016  kvaster:Joined the channel
Wed Dec 7 08:00:36 2016  kohlisankalp:Joined the channel
Wed Dec 7 08:02:21 2016  jshook:Joined the channel
Wed Dec 7 08:21:03 2016  minimarcel__:Joined the channel
Wed Dec 7 09:39:23 2016  iksaif:hey, do you know if there is any work in progress to speed up streaming ? Looks like the current way of doing it is pretty inneficient when you have huge files and a few nodes because it parses/encodes all the files on a single CPU and does only one file at a time per node
Wed Dec 7 09:40:13 2016  iksaif:1 - why can't we just write the sstable as-is without trying to parse it ? (and wait for the following compaction to cleanup and re-encode) Is it because we drop un-wanted data on the fly ?
Wed Dec 7 09:40:31 2016  iksaif:2 - did anybody look at increasing the parallelism ?
Wed Dec 7 09:48:50 2016  iksaif:looks like adding a connectionPerHosts to RangeStreamer and passing it down to StreamPlan could help with that, any idea what it could breaking during bootstrap ?
Wed Dec 7 10:02:59 2016  bradfordcp:Joined the channel
Wed Dec 7 10:14:56 2016  iksaif:(basically: https://github.com/iksaif/cassandra/commit/8352c21284811ca15d63183ceae0b11586623f31)
Wed Dec 7 10:30:12 2016  minimarcel__:Joined the channel
Wed Dec 7 10:33:18 2016  zsmithnyc:Joined the channel
Wed Dec 7 10:43:56 2016  bradfordcp:Joined the channel
Wed Dec 7 10:59:17 2016  mikewallace:Joined the channel
Wed Dec 7 11:42:20 2016  mikewall-:Joined the channel
Wed Dec 7 11:56:11 2016  mal``:Joined the channel
Wed Dec 7 12:00:03 2016  kohlisankalp:Joined the channel
Wed Dec 7 12:53:16 2016  bradfordcp:Joined the channel
Wed Dec 7 13:12:16 2016  spodkowinski:Joined the channel
Wed Dec 7 14:23:22 2016  adamholmberg:Joined the channel
Wed Dec 7 14:30:21 2016  clohfink:Joined the channel
Wed Dec 7 14:44:15 2016  jasobrown:iksaif: #12229
Wed Dec 7 14:44:15 2016  CassBotJr:https://issues.apache.org/jira/browse/CASSANDRA-12229 (Open; Unresolved; 4.0): "Move streaming to non-blocking IO and netty (streaming 2.1)"
Wed Dec 7 14:54:55 2016  jasobrown:iksaif: also, that would be a good conversation for the dev@ mailing list
Wed Dec 7 15:03:41 2016  iksaif:while 12229 is a more general approach I guess my patch can easilly provide a solution to mitigate the issue
Wed Dec 7 15:03:51 2016  iksaif:I'll post someting on the dev@ mailing list
Wed Dec 7 15:08:17 2016  kvaster:Joined the channel
Wed Dec 7 15:14:53 2016  gerl1ng:Joined the channel
Wed Dec 7 15:20:30 2016  vjarnot:Joined the channel
Wed Dec 7 15:34:40 2016  bradfordcp:Joined the channel
Wed Dec 7 15:50:55 2016  zaller:Joined the channel
Wed Dec 7 15:54:46 2016  kohlisankalp:Joined the channel
Wed Dec 7 16:02:30 2016  thobbs:Joined the channel
Wed Dec 7 16:03:10 2016  iksaif:ifesdjeen: thanks for merging the patch :), regarding CASSANDRA-12962, do you know if this code is necessary ? Could we use fact that the index is marked as built to skip the rebuild ?
Wed Dec 7 16:03:12 2016  CassBotJr:https://issues.apache.org/jira/browse/CASSANDRA-12962 (Open; Unresolved; 3.x): "SASI: Index are rebuilt on restart"
Wed Dec 7 16:03:58 2016  ifesdjeen:@iksaif thanks for the patch!
Wed Dec 7 16:04:28 2016  ifesdjeen:I’m not sure yet. I’ll try to find some time for #12962 asap though @iksaif
Wed Dec 7 16:04:30 2016  CassBotJr:https://issues.apache.org/jira/browse/CASSANDRA-12962 (Open; Unresolved; 3.x): "SASI: Index are rebuilt on restart"
Wed Dec 7 16:07:58 2016  iksaif:ifesdjeen: I'll be happy to write the code, I just need some guidance, the SASI code seems lacks comments explaining *why* things are done this way :P
Wed Dec 7 16:08:42 2016  ifesdjeen::) I’m always glad to help. With a caveat that I’m not a SASI expert, although I’ll do my best to debug.
Wed Dec 7 16:37:01 2016  rustyrazorblade:morning
Wed Dec 7 16:39:45 2016  driftx:yo
Wed Dec 7 16:43:48 2016  adamholm_:Joined the channel
Wed Dec 7 17:07:49 2016  mstepura:Joined the channel
Wed Dec 7 17:14:13 2016  dikang:Joined the channel
Wed Dec 7 17:23:54 2016  mpenick:Joined the channel
Wed Dec 7 17:31:45 2016  rustyrazorblade:how goes it driftx
Wed Dec 7 17:31:58 2016  driftx:not too bad, you?
Wed Dec 7 17:33:49 2016  rustyrazorblade:not bad. did you noticed i'm dominating the JIRA 13K's?
Wed Dec 7 17:34:02 2016  driftx:I did
Wed Dec 7 17:34:06 2016  rustyrazorblade:pretty sure I've got 30% of them
Wed Dec 7 17:34:30 2016  driftx:I was like "What a fortuitous time to break 13k"
Wed Dec 7 17:34:37 2016  rustyrazorblade:lol
Wed Dec 7 17:35:00 2016  rustyrazorblade:i think i can do the patches for all of them too, except maybe my grand plan to make compactions more testable, that will be... tricky
Wed Dec 7 17:35:58 2016  kvaster:Joined the channel
Wed Dec 7 17:43:05 2016  guy__:Joined the channel
Wed Dec 7 17:47:13 2016  rustyrazorblade:looking at CASSANDRA-13015, I'm seeing all the metrics now are generated via information gathered from the CompactionInfo.Holder. nothing gets incremented externally. some of the information that I'm looking to add isn't available there and could be a pain to add. is it the convention that everything is exposed via information collected from Holder, or is
Wed Dec 7 17:47:13 2016  rustyrazorblade:it coincidence?
Wed Dec 7 17:47:13 2016  CassBotJr:https://issues.apache.org/jira/browse/CASSANDRA-13015 (Open; Unresolved; 4.0): "improved compactions metrics"
Wed Dec 7 17:47:48 2016  rustyrazorblade:specifically when sstables are dropped out of a compaction task due to disk limits
Wed Dec 7 17:52:01 2016  kvaster:Joined the channel
Wed Dec 7 17:58:11 2016  kohlisankalp:Joined the channel
Wed Dec 7 18:00:09 2016  kohlisankalp:Joined the channel
Wed Dec 7 18:02:40 2016  RobertBirnie:Joined the channel
Wed Dec 7 18:22:53 2016  rustyrazorblade:nevermind, figured it out.
Wed Dec 7 18:28:33 2016  adamcm:Joined the channel
Wed Dec 7 18:59:54 2016  bbromhead:Joined the channel
Wed Dec 7 19:02:06 2016  vjarnot:Joined the channel
Wed Dec 7 19:28:33 2016  dikang_:Joined the channel
Wed Dec 7 20:18:06 2016  minimarcel__:Joined the channel
Wed Dec 7 20:29:28 2016  mstepura:Joined the channel
Wed Dec 7 20:32:37 2016  kohlisankalp:Joined the channel
Wed Dec 7 20:34:13 2016  bbromhead:Joined the channel
Wed Dec 7 20:36:01 2016  kohlisankalp:Joined the channel
Wed Dec 7 20:39:07 2016  kohlisankalp:Joined the channel
Wed Dec 7 22:01:58 2016  spodkowinski:Joined the channel
Wed Dec 7 22:09:45 2016  kohlisankalp:Joined the channel
Wed Dec 7 22:11:23 2016  spodkowinski:any ideas why I can't start cqlsh in cassandra-3.0?
Wed Dec 7 22:11:24 2016  spodkowinski:./bin/cqlsh
Wed Dec 7 22:11:24 2016  spodkowinski:Connection error: ('Unable to connect to any servers', {'127.0.0.1': AttributeError("'NoneType' object has no attribute 'startswith'",)})
Wed Dec 7 22:14:47 2016  kohlisankalp:Joined the channel
Wed Dec 7 22:17:25 2016  exlt:is cassandra native rpc running on 127.0.0.1?
Wed Dec 7 22:20:42 2016  exlt:if not, check native_transport_port for non-default port and/or rpc_address not configured for localhost - or pass in what you need to connect to: `cqlsh $IP_ADDR $PORT`
Wed Dec 7 22:21:15 2016  exlt:"Connects to 127.0.0.1:9042 by default."
Wed Dec 7 22:21:39 2016  driftx:well, the startswith thing is kinda weird
Wed Dec 7 22:22:08 2016  exlt:oh.. I needed to keep reading the line.. :)
Wed Dec 7 22:23:21 2016  driftx:but that's probably cosmetic, the real problem is likely what you described
Wed Dec 7 22:25:17 2016  spodkowinski:that is so weird.. origin/cassandra-3.0 works fine
Wed Dec 7 22:25:57 2016  spodkowinski:i've added a single statement in MetadataCollector and now the log tells me "Not starting RPC server as requested."
Wed Dec 7 22:26:10 2016  dikang:Joined the channel
Wed Dec 7 22:41:57 2016  minimarcel__:Joined the channel
Wed Dec 7 23:18:12 2016  zaller:Joined the channel
Wed Dec 7 23:32:40 2016  iamaleksey:it's cqlsh/python issue
Wed Dec 7 23:32:46 2016  iamaleksey:fixed in 3.X
Wed Dec 7 23:33:03 2016  iamaleksey:or you can downgrade your Python
Wed Dec 7 23:33:28 2016  iamaleksey:or upgrade your python driver lib to latest and instruct cqlsh to not use the bundled one
Wed Dec 7 23:34:34 2016  dikang_:Joined the channel

Comments