metric tank getting each point for ~google_com twice?

[Dieterbe]

metric_tank log full of messages for what seems to be the ~google_com endpoint.
note thatthe ts it tries to add is same as what lastTs is set to. as if it tries to add each point twice or something

grep 4faff826820dc87d7da62bf96eb57d08 metric_tank.log
2016/02/17 10:29:12 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455704951 lastTs: 1455704951
2016/02/17 10:29:22 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455704961 lastTs: 1455704961
2016/02/17 10:29:32 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455704971 lastTs: 1455704971
2016/02/17 10:29:42 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455704981 lastTs: 1455704981
2016/02/17 10:29:52 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455704991 lastTs: 1455704991
2016/02/17 10:30:02 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705001 lastTs: 1455705001
2016/02/17 10:30:25 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705011 lastTs: 1455705011
2016/02/17 10:30:28 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705021 lastTs: 1455705021
2016/02/17 10:30:32 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705031 lastTs: 1455705031
2016/02/17 10:30:42 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705041 lastTs: 1455705041
2016/02/17 10:30:52 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705051 lastTs: 1455705051
2016/02/17 10:31:02 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705061 lastTs: 1455705061
2016/02/17 10:31:12 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705071 lastTs: 1455705071
2016/02/17 10:31:22 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705081 lastTs: 1455705081
2016/02/17 10:31:33 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705091 lastTs: 1455705091
2016/02/17 10:31:42 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705101 lastTs: 1455705101
2016/02/17 10:31:51 [aggmetric.go:433 Add()] [E] failed to add metric to chunk for -1.4faff826820dc87d7da62bf96eb57d08. Point must be newer than already added points. t:1455705111 lastTs: 1455705111

[Dieterbe]

this is metrictank1 which has 0 backlog btw.

[Dieterbe]

i can confirm this in devstack

root@nms:/go/src/github.com/raintank/raintank-metric/nsq_metrics_to_stdout# ./nsq_metrics_to_stdout --nsqd-tcp-address nsqd:4150 | grep 'litmus.~google_com_demo.dev1.ping.min'
2016/02/18 06:37:41 INF    1 [metrics/stdout711231#ephemeral] (nsqd:4150) connecting to nsqd
2016/02/18 06:37:41 [I] connected to nsqd
2016/02/18 06:37:41 [I] starting listener for http/debug on :6060
litmus.~google_com_demo.dev1.ping.min 1455777461 11.60993 [collector:dev1 endpoint_id:0 monitor_id:NaN]
litmus.~google_com_demo.dev1.ping.min 1455777461 124.251912 [collector:dev1 endpoint_id:0 monitor_id:NaN]
litmus.~google_com_demo.dev1.ping.min 1455777471 10.138014 [collector:dev1 endpoint_id:0 monitor_id:NaN]
litmus.~google_com_demo.dev1.ping.min 1455777471 15.790208999999999 [collector:dev1 endpoint_id:0 monitor_id:NaN]
litmus.~google_com_demo.dev1.ping.min 1455777481 16.956497000000002 [collector:dev1 endpoint_id:0 monitor_id:NaN]
litmus.~google_com_demo.dev1.ping.min 1455777481 23.180794000000002 [collector:dev1 endpoint_id:0 monitor_id:NaN]
litmus.~google_com_demo.dev1.ping.min 1455777491 8.600265 [collector:dev1 endpoint_id:0 monitor_id:NaN]
litmus.~google_com_demo.dev1.ping.min 1455777491 11.308057000000002 [collector:dev1 endpoint_id:0 monitor_id:NaN]

[woodsaj]

Duplicates are definitely sent. This is a bug with raintank-collector.

raintank/raintank-collector#40