Displaying #traffic-server/2015-11-25.log:

Wed Nov 25 00:03:38 2015  biilmann:Joined the channel
Wed Nov 25 00:04:41 2015  sbeards:bcall: I remember you saying there was a known delay after the cache milestones?
Wed Nov 25 00:05:04 2015  sbeards:I see some time being spent between cache_open_read_end and dns_lookup_begin
Wed Nov 25 00:07:31 2015  sbeards:hmmm actually I see it between dns begin and end.... that points me at a broken dns... nevermind
Wed Nov 25 00:09:48 2015  dxu_:Joined the channel
Wed Nov 25 00:19:24 2015  bcall:sbeards: k
Wed Nov 25 00:31:28 2015  shinrich1:Joined the channel
Wed Nov 25 00:33:10 2015  shinrich2:Joined the channel
Wed Nov 25 00:40:29 2015  dxu_:Joined the channel
Wed Nov 25 00:45:33 2015  dxu_:Joined the channel
Wed Nov 25 00:52:55 2015  dxu_:Joined the channel
Wed Nov 25 00:58:28 2015  dxu_:Joined the channel
Wed Nov 25 01:02:54 2015  jacksontj:sudheerv: nvm-- looks like that HRR rule doesn't work
Wed Nov 25 01:03:02 2015  jacksontj:since the option is being set on the http/1.1 txn internally
Wed Nov 25 01:03:31 2015  dxu_:Joined the channel
Wed Nov 25 01:04:54 2015  sudheerv:you can override the setting with a custom plugin
Wed Nov 25 01:06:08 2015  sudheerv:or even just traffic_line manually
Wed Nov 25 01:06:19 2015  sudheerv:(or with a script) when you want to put the host OOR?
Wed Nov 25 01:08:37 2015  dxu_:Joined the channel
Wed Nov 25 01:14:02 2015  blattj:Joined the channel
Wed Nov 25 01:15:48 2015  blattj1:Joined the channel
Wed Nov 25 01:30:24 2015  reveller2:Joined the channel
Wed Nov 25 01:30:54 2015  dxu_:Joined the channel
Wed Nov 25 01:32:16 2015  jacksontj:well, with a plugin-- i want to set it to 1 when the box should be OOR and back to w/e is in records.config when its not
Wed Nov 25 01:45:03 2015  dxu_:Joined the channel
Wed Nov 25 02:02:51 2015  dxu_:Joined the channel
Wed Nov 25 02:07:16 2015  dxu_:Joined the channel
Wed Nov 25 02:12:14 2015  dxu_:Joined the channel
Wed Nov 25 02:18:13 2015  dxu_:Joined the channel
Wed Nov 25 02:23:22 2015  dxu_:Joined the channel
Wed Nov 25 02:23:47 2015  TyroneMirada:Joined the channel
Wed Nov 25 02:23:48 2015  TyroneMirada:Hi All
Wed Nov 25 02:23:54 2015  TyroneMirada:I could really use someones help
Wed Nov 25 02:24:15 2015  TyroneMirada:We are getting a hell of a lot of ERR_UNKNOWN in our access.logs
Wed Nov 25 02:24:38 2015  TyroneMirada:so much so that we have 175000 CLOSE_WAIT sockets opening every 5 minutes
Wed Nov 25 02:25:03 2015  TyroneMirada:we are currently using 4.0.2
Wed Nov 25 02:30:59 2015  dxu_:Joined the channel
Wed Nov 25 02:34:53 2015  briang:TyroneMirada: have you considered setting /proc/sys/net/ipv4/tcp_tw_reuse or tcp_tw_recycle?
Wed Nov 25 02:37:03 2015  dxu_:Joined the channel
Wed Nov 25 02:37:15 2015  jacksontj:those are only safe if you have no clients behind FWs
Wed Nov 25 02:37:22 2015  jacksontj:well, NAT specifically
Wed Nov 25 02:37:32 2015  briang:any other ideas jacksontj how to resolve CLOSE_WAITS?
Wed Nov 25 02:37:35 2015  jacksontj:have you always had ERR_UNKNOWN ?
Wed Nov 25 02:37:43 2015  jacksontj:CLOSE_WAITs aren't a problem in and of themselves
Wed Nov 25 02:37:57 2015  jacksontj:it sounds like you are getting a bunch of garbage requests
Wed Nov 25 02:38:06 2015  jacksontj:do they look well formed in tcpdump?
Wed Nov 25 02:38:13 2015  jacksontj:also, do we even support 4.0.2?
Wed Nov 25 02:38:23 2015  briang:technically 4.2.x was the LTS
Wed Nov 25 02:38:27 2015  briang:@TyroneMirada ^
Wed Nov 25 02:38:56 2015  briang:4.2.x and 5.3.x are the current LTS branches.
Wed Nov 25 02:39:09 2015  briang:actually even 4.2.x is no longer supported I guess.
Wed Nov 25 02:39:37 2015  jacksontj:but regardless, ERR_UNKNOWN just means ats has no idea what the request is IIRC
Wed Nov 25 02:48:34 2015  dxu_:Joined the channel
Wed Nov 25 02:56:06 2015  dxu_:Joined the channel
Wed Nov 25 03:00:21 2015  gancho:Joined the channel
Wed Nov 25 03:14:45 2015  TyroneMirada:yes
Wed Nov 25 03:14:51 2015  TyroneMirada:we have already set both of those to 1
Wed Nov 25 03:15:06 2015  TyroneMirada:and set sockets to 50000 for each ATS
Wed Nov 25 03:15:50 2015  TyroneMirada:Yea
Wed Nov 25 03:15:54 2015  TyroneMirada:We do need to update
Wed Nov 25 03:16:04 2015  TyroneMirada:cant even download 4.0.2 anymore
Wed Nov 25 03:16:15 2015  biilmann:Joined the channel
Wed Nov 25 03:16:30 2015  TyroneMirada:Im off to bed guys
Wed Nov 25 03:16:35 2015  TyroneMirada:cheers
Wed Nov 25 03:16:37 2015  TyroneMirada:Left the channel
Wed Nov 25 03:23:13 2015  dxu_:Joined the channel
Wed Nov 25 03:25:57 2015  biilmann:Joined the channel
Wed Nov 25 03:27:16 2015  gancho:Joined the channel
Wed Nov 25 03:35:40 2015  ibrezac:Joined the channel
Wed Nov 25 03:50:30 2015  Randeep:Joined the channel
Wed Nov 25 05:19:52 2015  biilmann:Joined the channel
Wed Nov 25 05:54:27 2015  biilmann:Joined the channel
Wed Nov 25 06:02:08 2015  slx86:Joined the channel
Wed Nov 25 06:03:23 2015  biilmann:Joined the channel
Wed Nov 25 06:17:20 2015  oag:I have a question about AsyncHttpFetch in the C++ API.
Wed Nov 25 06:18:36 2015  oag:I'm supplying a url of http://119.9.28.38/en-au/ and a host header of 'www.jeanswest.com.au' in the hope that it will connect to that IP and supply the given host header.
Wed Nov 25 06:18:56 2015  oag:But instead it seems to be supplying 119.9.28.38 as the host.
Wed Nov 25 06:19:12 2015  oag:Using 5.3.1 I belive.
Wed Nov 25 06:20:26 2015  oag:Any idea if this behaviour has been changed in more recent versions, or whether it is easily possible to change it?
Wed Nov 25 06:20:47 2015  dxu_:Joined the channel
Wed Nov 25 06:21:30 2015  gancho:Joined the channel
Wed Nov 25 06:27:35 2015  biilmann:Joined the channel
Wed Nov 25 09:04:42 2015  Lethalman:Joined the channel
Wed Nov 25 09:06:42 2015  felicity:the patch on TS-4009 doesn't look right - doesn't it leak mutexes all over the place?
Wed Nov 25 09:09:59 2015  felicity:i think this patch is better: https://github.com/torchbox/trafficserver/commit/bab20102d7d95f6a36c4c0b1824ad9ad3afab793 (untested)
Wed Nov 25 10:44:52 2015  dxu_:Joined the channel
Wed Nov 25 11:14:31 2015  Prasun:Joined the channel
Wed Nov 25 13:01:06 2015  faysal:Joined the channel
Wed Nov 25 13:02:07 2015  faysal:hi there everyone
Wed Nov 25 13:20:32 2015  bahumbug:Joined the channel
Wed Nov 25 13:27:25 2015  reveller:Joined the channel
Wed Nov 25 13:35:30 2015  JSeymour:Joined the channel
Wed Nov 25 13:36:22 2015  reveller1:Joined the channel
Wed Nov 25 13:42:13 2015  ibrezac:Joined the channel
Wed Nov 25 14:13:17 2015  faysal:Joined the channel
Wed Nov 25 14:43:26 2015  faysal:hi guys
Wed Nov 25 15:26:20 2015  davet:Joined the channel
Wed Nov 25 15:37:59 2015  blattj:Joined the channel
Wed Nov 25 15:39:44 2015  blattj1:Joined the channel
Wed Nov 25 15:55:29 2015  blattj:Joined the channel
Wed Nov 25 16:32:27 2015  faysal:hi guys
Wed Nov 25 16:37:56 2015  biilmann:Joined the channel
Wed Nov 25 16:44:11 2015  faysal:amc, Hi
Wed Nov 25 16:44:19 2015  faysal:any news regarding TS-3636
Wed Nov 25 16:45:52 2015  Prasun:Joined the channel
Wed Nov 25 17:23:53 2015  biilmann:Joined the channel
Wed Nov 25 17:33:40 2015  Randeep:Joined the channel
Wed Nov 25 17:36:49 2015  blattj:Joined the channel
Wed Nov 25 17:39:16 2015  shinrich1:Joined the channel
Wed Nov 25 17:40:07 2015  Lethalman:I'm unable to reload remap.config :(
Wed Nov 25 17:40:08 2015  Lethalman:it changes
Wed Nov 25 17:40:16 2015  Lethalman:I do traffic_line -x, or traffic_ctl config reload
Wed Nov 25 17:40:24 2015  Lethalman:it doesn't apply the new changes
Wed Nov 25 17:40:28 2015  Lethalman:and I don't see any message in the config
Wed Nov 25 17:40:39 2015  Lethalman:anybody knows the debug tag when reloading happens? I've set conf.*
Wed Nov 25 17:40:41 2015  Lethalman:but nothing is written
Wed Nov 25 17:40:45 2015  shinrich2:Joined the channel
Wed Nov 25 17:40:52 2015  Lethalman:any hints on how to debug why config is not being reloaded?
Wed Nov 25 17:43:19 2015  BlackCobra:Joined the channel
Wed Nov 25 17:44:06 2015  sudheerv:Lethalman: can you check if there's any message in diags.log or manager.log
Wed Nov 25 17:44:12 2015  Lethalman:sudheerv, I'm checking
Wed Nov 25 17:44:17 2015  Lethalman:all the log files....
Wed Nov 25 17:45:21 2015  sudheerv:and you don't see anything in any log file?
Wed Nov 25 17:45:26 2015  Lethalman:sudheerv, nothing nothing
Wed Nov 25 17:45:34 2015  Lethalman:I can see some messages it has started
Wed Nov 25 17:45:35 2015  Lethalman:cache loaded
Wed Nov 25 17:45:36 2015  Lethalman:as usual
Wed Nov 25 17:45:42 2015  Lethalman:then now some debug from remap.*
Wed Nov 25 17:45:46 2015  Lethalman:and from config.*
Wed Nov 25 17:45:53 2015  Lethalman:I don't see anything when I issue those reloading commands
Wed Nov 25 17:46:06 2015  Lethalman:whatelse could I add to the diag tags?
Wed Nov 25 17:46:26 2015  jpeach:Lethalman: touch records.config and do "traffic_ctl config status"
Wed Nov 25 17:47:03 2015  Lethalman:jpeach, Reconfiguration required
Wed Nov 25 17:47:25 2015  jpeach:ok, good start
Wed Nov 25 17:47:30 2015  Lethalman::)
Wed Nov 25 17:47:40 2015  Lethalman:but first of all, should the logs tell me when I reload the config?
Wed Nov 25 17:47:58 2015  jpeach:yeh there should be a NOTE or something at that level
Wed Nov 25 17:48:25 2015  Lethalman:my logging is INT 3
Wed Nov 25 17:48:39 2015  Lethalman:ah btw it tells me space exhausted
Wed Nov 25 17:48:42 2015  Lethalman:maybe it's that?
Wed Nov 25 17:48:50 2015  Lethalman:however it doesn't apply the new remap rules, too
Wed Nov 25 17:48:52 2015  biilmann:Joined the channel
Wed Nov 25 17:49:03 2015  Lethalman:though there are 800mb free for the logs directory :(
Wed Nov 25 17:49:24 2015  jpeach:yeh check your loggin headroom, etc
Wed Nov 25 17:49:53 2015  Lethalman:I've changed it in any way
Wed Nov 25 17:50:03 2015  Lethalman:default values, non-default, big, little
Wed Nov 25 17:50:10 2015  Lethalman:always space exhausted
Wed Nov 25 17:50:16 2015  sudheerv:Lethalman: one of the reasons for failing to apply remap could be a syntax error in your new remap file
Wed Nov 25 17:50:27 2015  Lethalman:sudheerv, restarting TS is fine and applies the new config
Wed Nov 25 17:50:44 2015  sudheerv:yes, restarting will always apply the new config even if it's bad syntax
Wed Nov 25 17:50:50 2015  Lethalman:but the config works :)
Wed Nov 25 17:50:52 2015  sudheerv:and then traffic_server would fail to come up
Wed Nov 25 17:50:58 2015  sudheerv:hmm..ok
Wed Nov 25 17:51:12 2015  sudheerv:don't know what happened with traffic_line/ctl then :)
Wed Nov 25 17:51:18 2015  sudheerv:may be, your management port wasn't running?
Wed Nov 25 17:51:50 2015  reveller:Left the channel
Wed Nov 25 17:51:58 2015  Lethalman:sudheerv, well, I have no errors from those commands
Wed Nov 25 17:52:10 2015  jpeach:Lethalman: does sudo traffic_ctl --debug config reload
Wed Nov 25 17:52:44 2015  Lethalman:jpeach, I only get this [Nov 25 18:52:32.046] {0x7fcebefd1740} DEBUG: <traffic_ctl.cc:235 (main)> (traffic_ctl) debug logging active
Wed Nov 25 17:52:53 2015  jpeach:meh
Wed Nov 25 17:52:56 2015  Lethalman:this is TS 6.0.0
Wed Nov 25 17:53:50 2015  biilmann:Joined the channel
Wed Nov 25 17:58:45 2015  Lethalman:ok I got an error with url_rewrite.* diag
Wed Nov 25 17:58:56 2015  Lethalman:but I get a NOTE now from manager :S
Wed Nov 25 17:59:15 2015  Lethalman:I think it has no permission to roll the remap file
Wed Nov 25 17:59:22 2015  Lethalman:indeed
Wed Nov 25 17:59:46 2015  jpeach:can the logging be improved?
Wed Nov 25 17:59:48 2015  Lethalman:but........ I believe I had to enable url_rewrite.* diag for some reason
Wed Nov 25 17:59:50 2015  Lethalman:I don't get it
Wed Nov 25 17:59:58 2015  Lethalman:jpeach, probably my fault
Wed Nov 25 18:00:03 2015  Lethalman:but I'm sure there was no such note before
Wed Nov 25 18:00:17 2015  Lethalman:I'll try again without diags url.*
Wed Nov 25 18:02:05 2015  Lethalman:no way now I see the message
Wed Nov 25 18:02:33 2015  Lethalman:sorry for bothering don't know what happened, perhaps some permission also wrong on manager.log
Wed Nov 25 18:02:54 2015  sudheerv:or may be the logging space caused the log not to appear
Wed Nov 25 18:03:20 2015  Lethalman:it's still spitting out that warning though on log space
Wed Nov 25 18:03:32 2015  Lethalman:now that I think of it
Wed Nov 25 18:03:41 2015  Lethalman:it appeared after I deleted all the log files
Wed Nov 25 18:03:50 2015  Lethalman:so that might be the reason
Wed Nov 25 18:03:54 2015  Lethalman:anyway, happy now :)
Wed Nov 25 18:03:57 2015  Lethalman:thanks
Wed Nov 25 18:04:26 2015  sudheerv:cool :)
Wed Nov 25 18:04:40 2015  Lethalman:I'm configuring 10 ats with 2 haproxy
Wed Nov 25 18:05:02 2015  Lethalman:we're really tankful to everybody involved
Wed Nov 25 18:05:03 2015  Lethalman:bye :)
Wed Nov 25 18:05:16 2015  jpeach:sudheerv: side-effect of log rotation being added to diags?
Wed Nov 25 18:05:51 2015  sudheerv:jpeach: unsure, it could be..
Wed Nov 25 18:06:06 2015  dxu_:Joined the channel
Wed Nov 25 18:11:26 2015  faysal:shinrich2, hi
Wed Nov 25 18:36:47 2015  dxu_:Joined the channel
Wed Nov 25 19:43:16 2015  dxu_:Joined the channel
Wed Nov 25 19:48:54 2015  biilmann:Joined the channel
Wed Nov 25 20:02:39 2015  dxu_:Joined the channel
Wed Nov 25 20:22:09 2015  PSUdaemon:amc: http://apaste.info/6o6
Wed Nov 25 20:28:07 2015  biilmann:Joined the channel
Wed Nov 25 20:58:16 2015  dstates:hey phil
Wed Nov 25 20:58:17 2015  dstates:you here
Wed Nov 25 20:58:50 2015  PSUdaemon:yeah
Wed Nov 25 20:59:00 2015  dstates:when we were at fibbar mcgees
Wed Nov 25 20:59:10 2015  dstates:did I go on for like 10 minutes about legal vs regal
Wed Nov 25 20:59:17 2015  PSUdaemon:yes
Wed Nov 25 20:59:19 2015  dstates:fuck
Wed Nov 25 20:59:30 2015  dstates:i don't remember that at all
Wed Nov 25 20:59:34 2015  PSUdaemon:haha
Wed Nov 25 20:59:39 2015  dstates:dcarlin is busting my balls for not getting his vague reference
Wed Nov 25 20:59:54 2015  dcarlin:thanks phil
Wed Nov 25 21:00:46 2015  PSUdaemon:was a fun time
Wed Nov 25 21:00:58 2015  dcarlin:yeah but he doesn't remember any of it
Wed Nov 25 21:01:02 2015  dstates:something about fit for a kind
Wed Nov 25 21:01:10 2015  PSUdaemon:any of it?
Wed Nov 25 21:01:13 2015  dcarlin:seems not
Wed Nov 25 21:01:24 2015  dstates:hahaha I remember being there
Wed Nov 25 21:01:26 2015  dcarlin:we went out another night, and he couldn't remember shit he told me 5 mins prior
Wed Nov 25 21:01:34 2015  dstates:*sigh*
Wed Nov 25 21:01:37 2015  dcarlin:haha
Wed Nov 25 21:02:10 2015  dcarlin:its good to know if I ever piss you off, I'll have a clean slate soon
Wed Nov 25 21:02:25 2015  dstates:if your survive that long
Wed Nov 25 21:02:30 2015  dcarlin:lol
Wed Nov 25 21:03:02 2015  PSUdaemon:regal...of the king!
Wed Nov 25 21:03:19 2015  biilmann:Joined the channel
Wed Nov 25 21:03:40 2015  PSUdaemon:i also remember that bartender
Wed Nov 25 21:03:42 2015  PSUdaemon:she was pretty funny
Wed Nov 25 21:03:51 2015  PSUdaemon:like she was babysitting a bunch of kids
Wed Nov 25 21:03:56 2015  dstates:hahahaha
Wed Nov 25 21:04:08 2015  dcarlin:hmm, I felt a certain air of contempt from her
Wed Nov 25 21:04:10 2015  dstates:didn't she tell us no rough housing or something to that affect
Wed Nov 25 21:04:19 2015  dstates:dcarlin: that's because she only liked phil and I
Wed Nov 25 21:04:38 2015  PSUdaemon:she wanted to close down and you were oring like 6 beers
Wed Nov 25 21:04:41 2015  PSUdaemon:ordering*
Wed Nov 25 21:04:55 2015  PSUdaemon:she made us sit in the back
Wed Nov 25 21:04:56 2015  dcarlin:she preemptively told us we needed to be chill - she was able to accurately assess the state in which we arrived at her establishment
Wed Nov 25 21:04:59 2015  dstates:oh now I remember, she said don't get to roudy
Wed Nov 25 21:05:08 2015  PSUdaemon:yeah
Wed Nov 25 21:05:16 2015  dstates:rowdy
Wed Nov 25 21:05:17 2015  PSUdaemon:she was probably breaking all sorts of rules by even serving us
Wed Nov 25 21:05:30 2015  PSUdaemon:i hope you tipped well
Wed Nov 25 21:05:51 2015  dstates:I always tip my bartenders well
Wed Nov 25 21:05:54 2015  dstates:>20% usually
Wed Nov 25 21:06:14 2015  dstates:To Insure Priority Service
Wed Nov 25 21:24:30 2015  dxu_:Joined the channel
Wed Nov 25 21:37:48 2015  Humbedooh:I have a theory...
Wed Nov 25 21:38:11 2015  Humbedooh:if we remove all the Br[yi]ans and Dan(iel)?s from ASF, there'd be 10 people left..
Wed Nov 25 21:56:01 2015  PSUdaemon:but then it'd be no fun, right?
Wed Nov 25 21:56:25 2015  PSUdaemon:ok, upgrade time
Wed Nov 25 21:56:29 2015  PSUdaemon:lets hope this works out!
Wed Nov 25 21:56:34 2015  Humbedooh:true, true
Wed Nov 25 21:58:28 2015  gancho:Joined the channel
Wed Nov 25 23:03:55 2015  blattj:Joined the channel
Wed Nov 25 23:07:22 2015  hariszuka:Joined the channel
Wed Nov 25 23:18:28 2015  dxu_:Joined the channel
Wed Nov 25 23:23:31 2015  dxu_:Joined the channel
Wed Nov 25 23:43:38 2015  dxu_:Joined the channel
Wed Nov 25 23:48:45 2015  dxu_:Joined the channel
Wed Nov 25 23:53:49 2015  dxu_:Joined the channel

Comments