Displaying #cassandra-dev/2017-02-16.log:

Thu Feb 16 00:07:01 2017  JayZhuang:Joined the channel
Thu Feb 16 00:15:44 2017  minimarcel_:Joined the channel
Thu Feb 16 00:23:48 2017  kohlisankalp:Joined the channel
Thu Feb 16 00:24:20 2017  krut:Joined the channel
Thu Feb 16 00:33:32 2017  JayZhuang:Joined the channel
Thu Feb 16 00:33:54 2017  mstepura:Joined the channel
Thu Feb 16 00:35:29 2017  kohlisan_:Joined the channel
Thu Feb 16 00:36:30 2017  kohlisankalp:Joined the channel
Thu Feb 16 00:47:34 2017  adamholmberg:Joined the channel
Thu Feb 16 00:49:04 2017  bbromhead:Joined the channel
Thu Feb 16 00:55:02 2017  adamholmberg:Joined the channel
Thu Feb 16 00:56:32 2017  EdwardCapriolo:Joined the channel
Thu Feb 16 01:04:41 2017  JayZhuang:Joined the channel
Thu Feb 16 01:18:07 2017  exlt:release vote x3 :)
Thu Feb 16 01:23:20 2017  jasobrown: exlt: it's raining releases :)
Thu Feb 16 01:31:20 2017  mstepura:Joined the channel
Thu Feb 16 01:39:30 2017  EdwardCapriolo:Joined the channel
Thu Feb 16 02:01:54 2017  dikang:Joined the channel
Thu Feb 16 02:08:17 2017  bbromhead:Joined the channel
Thu Feb 16 02:18:28 2017  adamholmberg:Joined the channel
Thu Feb 16 02:20:45 2017  driftx:exlt: thanks for wrecking my watch's batt life this week
Thu Feb 16 02:21:14 2017  exlt:lol, you're welcome :)
Thu Feb 16 02:21:18 2017  driftx::)
Thu Feb 16 02:28:15 2017  bbromhead:Joined the channel
Thu Feb 16 02:30:12 2017  bbromhea_:Joined the channel
Thu Feb 16 02:44:16 2017  Guest73:Joined the channel
Thu Feb 16 02:49:09 2017  mstepura:Joined the channel
Thu Feb 16 03:05:32 2017  adamholmberg:Joined the channel
Thu Feb 16 03:08:33 2017  mstepura:Joined the channel
Thu Feb 16 03:25:53 2017  mstepura:Joined the channel
Thu Feb 16 03:26:48 2017  mstepura:Joined the channel
Thu Feb 16 03:27:35 2017  mstepura:Joined the channel
Thu Feb 16 03:28:15 2017  mstepura:Joined the channel
Thu Feb 16 03:42:36 2017  bbromhead:Joined the channel
Thu Feb 16 03:45:11 2017  mstepura:Joined the channel
Thu Feb 16 04:21:14 2017  dikang:Joined the channel
Thu Feb 16 04:21:31 2017  mstepura:Joined the channel
Thu Feb 16 04:24:06 2017  RussSpitzer:Joined the channel
Thu Feb 16 04:44:13 2017  bbromhead:Joined the channel
Thu Feb 16 04:54:42 2017  mstepura:Joined the channel
Thu Feb 16 05:10:50 2017  noobNode:Joined the channel
Thu Feb 16 05:24:55 2017  mstepura:Joined the channel
Thu Feb 16 05:28:52 2017  noobNode:Joined the channel
Thu Feb 16 05:44:27 2017  mstepura:Joined the channel
Thu Feb 16 06:00:32 2017  mstepura:Joined the channel
Thu Feb 16 06:01:21 2017  mstepura:Joined the channel
Thu Feb 16 06:02:16 2017  mstepura:Joined the channel
Thu Feb 16 06:02:59 2017  mstepura:Joined the channel
Thu Feb 16 06:03:48 2017  mstepura:Joined the channel
Thu Feb 16 06:04:38 2017  mstepura:Joined the channel
Thu Feb 16 06:14:32 2017  bbromhea_:Joined the channel
Thu Feb 16 06:33:19 2017  mstepura:Joined the channel
Thu Feb 16 07:35:41 2017  makrusak:Joined the channel
Thu Feb 16 07:44:07 2017  cosql:Joined the channel
Thu Feb 16 07:54:37 2017  spodkowinski:Joined the channel
Thu Feb 16 08:07:14 2017  bbromhead:Joined the channel
Thu Feb 16 08:15:25 2017  cosql:Joined the channel
Thu Feb 16 09:13:44 2017  minimarcel_:Joined the channel
Thu Feb 16 09:29:42 2017  noobNode:Joined the channel
Thu Feb 16 09:43:14 2017  spodkowinski:exlt: are you aware of any known issues with the rpm builds? is there still anything holding us back from releasing official rpm packages?
Thu Feb 16 09:46:30 2017  substance:Joined the channel
Thu Feb 16 09:54:40 2017  noobNode:Left the channel
Thu Feb 16 09:54:51 2017  noobNode:Joined the channel
Thu Feb 16 09:55:11 2017  substance:Hi, Guys! I have a question about compression/decompression in cassandra. The java cassandra driver has an option to compress data before send it to cassandra. I use the LZ4 algorithm. It compress 0.5G data down to 40Mb. Through debug I see that exactly to 40Mb was sent to cassandra. Then cassandra server receive it and decompress. Also target table configured to use sstable compression. Debugging cassandra I found out that
Thu Feb 16 09:55:52 2017  substance:Debugging cassandra I found out that there is ChannelPipeline at Server.Initializer class. One of the ChannelHandler there is Frame.Decompressor. It check that given frame has a Header.Flag.COMPRESSED flag and decompress data in case it exist. While decompressing casssandra die with OOM. I thought that it will not decompress already compressed data and store it as is in the target table. Is there flag that tell cassandra to
Thu Feb 16 10:00:38 2017  substance:Cassandra config has a commitlog_compression option and I set it to LZ4Compressor but looks like it's not that I'm looking for
Thu Feb 16 11:41:26 2017  substance:I've asked it on SO If somebody can help
Thu Feb 16 11:41:38 2017  substance:http://stackoverflow.com/questions/42272932/why-cassandra-decompress-already-compressed-data
Thu Feb 16 11:48:44 2017  kvaster:Joined the channel
Thu Feb 16 13:24:23 2017  noobNode:Left the channel
Thu Feb 16 14:04:11 2017  ifesdjeen:Joined the channel
Thu Feb 16 14:15:17 2017  EdwardCapriolo:Joined the channel
Thu Feb 16 14:26:40 2017  adamholmberg:Joined the channel
Thu Feb 16 14:32:12 2017  clohfink:Joined the channel
Thu Feb 16 15:00:14 2017  aweisberg:substance: This is a better question for #cassandra. The compression is transport compression for when the messages are in flight over the network. If you want the data compressed at rest in the DB you would use "WITH COMPRESSION" when you create the table. You might choose to compress outside the DB to save C* the overhead of working with the uncompressed
Thu Feb 16 15:00:14 2017  aweisberg:data compressing/decompressing it at every node. It sounds like you get a lot of mileage out of compression and won't be parsing the data inside the DB.
Thu Feb 16 15:45:46 2017  EdwardCapriolo:Joined the channel
Thu Feb 16 15:46:22 2017  EdwardCapriolo:Joined the channel
Thu Feb 16 15:56:25 2017  dikang:Joined the channel
Thu Feb 16 16:04:29 2017  joaquin:Joined the channel
Thu Feb 16 16:15:06 2017  exlt:spodkowinski: mainly it's an issue of time and docker foo to automate - issues are unknown, since there's no testing - on the bright side, INFRA has installed docker on our ASF jenkins slaves, and running a few basic tests, it seems to work fine
Thu Feb 16 16:16:28 2017  exlt:I have a local rpm build docker run script that gets the deps we need installed, builds with openjdk and completes OK
Thu Feb 16 16:16:55 2017  exlt:haven't touched gpg and repo building
Thu Feb 16 16:20:43 2017  thobbs:Joined the channel
Thu Feb 16 16:21:23 2017  exlt:looking at my associated debian build docker, I started down the path of curl'ing oracle jdk and jce - messy..
Thu Feb 16 16:27:12 2017  dikang:Joined the channel
Thu Feb 16 16:29:24 2017  spodkowinski:exlt: so the idea is to have ASF jenkings create the package by using a docker based rpm build process?
Thu Feb 16 16:33:04 2017  exlt:if we can, that would be great - at the moment, I've fuddled through rpm build locally in docker, but have other priorities, too
Thu Feb 16 16:33:50 2017  exlt:gpg signing will still need to download artifacts
Thu Feb 16 16:34:33 2017  spodkowinski:how does the deb packaging process looks like atm? that's done locally, right?
Thu Feb 16 16:35:08 2017  exlt:correct - https://github.com/mshuler/cassandra-release/tree/mshuler
Thu Feb 16 16:42:23 2017  exlt:threw the little docker files I have under docker-wip/ in the cassandra-builds repo
Thu Feb 16 16:45:21 2017  kvaster:Joined the channel
Thu Feb 16 16:53:44 2017  spodkowinski:so whats left to do is to update the cassandra-release scripts to use docker as build environment and to make them work with both kinds of generated artifacts
Thu Feb 16 17:01:08 2017  JayZhuang:Joined the channel
Thu Feb 16 17:11:28 2017  exlt:patches welcomed
Thu Feb 16 17:14:24 2017  mstepura:Joined the channel
Thu Feb 16 17:28:36 2017  exlt:ah, he left - anyway, I'm going to copy the cassandra-release scripts over to the asf cassandra-builds repo, so we have a central location for allthingsbuild
Thu Feb 16 18:03:57 2017  dikang:Joined the channel
Thu Feb 16 18:07:28 2017  kohlisankalp:Joined the channel
Thu Feb 16 18:10:42 2017  exlt:#13230 for those interested in RPM packages and improving our build/test/release infra
Thu Feb 16 18:10:42 2017  CassBotJr:https://issues.apache.org/jira/browse/CASSANDRA-13230 (Open; Unresolved; Unscheduled): "Build RPM packages for release"
Thu Feb 16 18:16:49 2017  bbromhead:Joined the channel
Thu Feb 16 18:21:22 2017  mpenick:Joined the channel
Thu Feb 16 18:21:51 2017  dikang:Joined the channel
Thu Feb 16 18:47:42 2017  bbromhead:Joined the channel
Thu Feb 16 18:50:17 2017  kvaster:Joined the channel
Thu Feb 16 19:05:54 2017  cosql:Joined the channel
Thu Feb 16 19:57:46 2017  kohlisankalp:Joined the channel
Thu Feb 16 20:00:42 2017  bbromhead:Joined the channel
Thu Feb 16 20:11:46 2017  mstepura:Joined the channel
Thu Feb 16 20:23:20 2017  kohlisankalp:Joined the channel
Thu Feb 16 20:23:55 2017  bbromhead:Joined the channel
Thu Feb 16 20:24:32 2017  bbromhead:Joined the channel
Thu Feb 16 20:30:54 2017  JayZhuang:Joined the channel
Thu Feb 16 20:53:48 2017  JayZhuang:Joined the channel
Thu Feb 16 21:30:12 2017  JayZhuang:Joined the channel
Thu Feb 16 22:06:49 2017  dikang:Joined the channel
Thu Feb 16 22:08:35 2017  kohlisankalp:Joined the channel
Thu Feb 16 22:11:19 2017  JayZhuang:Joined the channel
Thu Feb 16 22:31:25 2017  clohfink:Joined the channel
Thu Feb 16 22:42:47 2017  kohlisankalp:Joined the channel
Thu Feb 16 22:54:22 2017  kohlisankalp:Joined the channel
Thu Feb 16 23:19:12 2017  JayZhuang:Joined the channel
Thu Feb 16 23:20:10 2017  dikang:Joined the channel
Thu Feb 16 23:20:44 2017  Vijay:Joined the channel
Thu Feb 16 23:32:58 2017  kohlisankalp:Joined the channel
Thu Feb 16 23:40:08 2017  JayZhuang:Joined the channel
Thu Feb 16 23:53:10 2017  bbromhead:Joined the channel
Thu Feb 16 23:55:43 2017  kohlisankalp:Joined the channel
Thu Feb 16 23:58:32 2017  mebigfatguy:Joined the channel

Comments