SYSTEM WARNING: 'date_default_timezone_get(): It is not safe to rely on the system's timezone settings. You are *required* to use the date.timezone setting or the date_default_timezone_set() function. In case you used any of those methods and you are still getting this warning, you most likely misspelled the timezone identifier. We selected the timezone 'UTC' for now, but please set date.timezone to select your timezone.' in '/usr/share/mantis/www/core.php' line 264
|Anonymous | Login||2019-11-20 04:46 UTC|
|Main | My View | View Issues | Change Log | Roadmap|
|View Issue Details|
|ID||Project||Category||View Status||Date Submitted||Last Update|
|0002681||Endian Firewall||GUI||public||2010-02-13 10:40||2010-11-22 12:08|
|Target Version||2.3.1||Fixed in Version||2.4.1|
|Summary||0002681: Dashboard stats have wrong values|
|Description||Statistics for the pop3 proxy in the dashboard are way too high.|
Stats show for the last hour around 2000 received mails and for Today around 4000.
In reality there should only be about 5 per hour and max 50 per day.
|Same for smtp proxy|
edited on: 2010-02-19 17:53
Found similar issue in memory usage.
Dashboard shows 26% RAM in use, on the status page shows 38% RAM in use.
Looks like the dashboard shows the +/- buffers/cache value instead of actual ram usage.
Similar to http://bugs.endian.com/view.php?id=2195 [^]
The pop counter on the dashboard are counting connections not e-mails.
Mar 15 16:17:25 efw-v2 p3scan: POP3 Connection from 10.0.0.4:19120
Mar 15 16:17:25 efw-v2 p3scan: Real-server address is 188.8.131.52:110
Mar 15 16:17:25 efw-v2 p3scan: USER 'userxy'
Mar 15 16:17:27 efw-v2 p3scan: Session done (Clean Exit). Mails: 0 Bytes: 0
Regex "POP3 Connection from "
|The values however seem too high even for counting the connections|
well, the memory usage percentage on dashboard ans status.cgi differs because dashboard uses memory usage - cache/buffers, which is what really counts.
status.cgi shows both percentages. we should remove that on status.cgi, but that page will disappear anyway in future, so unsure if we really should touch that.
http proxy hit/miss will be double counted, since the connection passes twice
(squid -> havp -> dansguardian -> squid) which will double-log
HTTP Proxy 'virus found' counter appears twice, while filter-counter does not show up.
-> Wrong label and will be read out from wrong rrd file
p3scan does not log whether a virus or spam has been found or not, so we can eliminate those counters or need to patch p3scan
there's no possibility to filter away squid access from 127.0.0.1 :(
i think we need to patch collectd in order to add a ExcludeRegEx
- fixed pop proxy virus regexp (which was completely wrong)
- changed pop3 counter to count scanned mails instead of connections
spam counter is still missing, needs the p3scan patch
the fetched values are still strange.
rrdtool images show 400M scanned mails when there were only about 1000, and found 800m virus, when it was 1 (ok this could be ok, due to the fact that it is a rate per second not an absolute value)
|p3scan counts now also spam mails and displays them in dashboard|
|found a new issue: 0002785|
and another one:
dashboard counter are counted *always* twice.
this is easily reproduceable:
logger -p local6.info -t squid <<EOF
Mar 19 15:24:55 UPLINKSTEST2 squid: 1269008695.976 134 127.0.0.1 \
TCP_MISS/200 1746 GET http://intranet.endian.it/logo.gif [^] - \
appears as 1, and then after a short time increases by another 1
same on p3scan counters
i think this is on every other counter, too
probably this is because we read multiple times witin the collectd 5 seconds interval where the data does not change.
so if already read out the same value will be read out a second time.
probably we need to check if the timestamp of the last read is older than the current timestamp and ignore if it is (?)
|values counting twice is fixed|
|dansguardian counter is correct in collectd, but is always 0 on gui|
dansguardian is ok now.
- http proxy values are all ok, last missing is "miss" which is counted twice (needs collectd patch)
- pop3 proxy values are also all ok now
- mails in queue is ok
- clean mail received is ok
- viruses found is ok
- mails received counts twice (from client and from amavis) (needs collectd
- mails blocked does work but is in fact mails rejected.. it is not virus
or spam mails blocked -> rename it
- collectd patch is now ready
- smtp and proxy counters are ok now
last open things:
- collectd sometimes does not remove the socket file
- values sometimes are completely wrong (overflow?)
- unixsock patch is sent upstream
- values have now an upper limit as suggested by collectd mailinglist
|2010-02-13 10:40||baldy||New Issue|
|2010-02-15 09:03||luca-endian||Status||new => confirmed|
|2010-02-15 14:20||luca-endian||Note Added: 0003792|
|2010-02-15 14:23||luca-endian||Summary||POP3 proxy stats way too high => Dashboard stats have wrong values|
|2010-02-15 14:23||luca-endian||Tag Attached: purple|
|2010-02-18 20:44||baldy||Note Added: 0003818|
|2010-02-18 20:47||baldy||Note Edited: 0003818|
|2010-02-19 17:53||baldy||Note Edited: 0003818|
|2010-03-03 16:01||ra-endian||Assigned To||=> ra-endian|
|2010-03-03 16:01||ra-endian||Status||confirmed => assigned|
|2010-03-03 16:01||ra-endian||Target Version||=> future|
|2010-03-04 07:56||ra-endian||Priority||normal => high|
|2010-03-04 07:56||ra-endian||Target Version||future => 2.3.1|
|2010-03-15 15:06||ra-endian||Severity||tweak => major|
|2010-03-16 08:56||ra-endian||Note Added: 0004039|
|2010-03-16 10:09||luca-endian||Note Added: 0004043|
|2010-03-18 08:07||ra-endian||Status||assigned => new|
|2010-03-18 08:07||ra-endian||Assigned To||ra-endian => peter-endian|
|2010-03-18 08:07||ra-endian||Status||new => confirmed|
|2010-03-18 17:14||peter-endian||Note Added: 0004067|
|2010-03-18 17:19||peter-endian||Note Added: 0004068|
|2010-03-18 19:29||peter-endian||Note Added: 0004069|
|2010-03-18 19:32||peter-endian||Note Added: 0004070|
|2010-03-19 17:11||peter-endian||Note Added: 0004073|
|2010-03-19 20:42||peter-endian||Note Added: 0004074|
|2010-03-22 15:37||peter-endian||Note Added: 0004077|
|2010-03-22 15:38||peter-endian||Note Added: 0004078|
|2010-03-22 15:38||peter-endian||Relationship added||related to 0002785|
|2010-03-22 16:09||peter-endian||Note Added: 0004079|
|2010-03-22 22:37||peter-endian||Note Added: 0004082|
|2010-03-22 23:10||peter-endian||Note Added: 0004083|
|2010-03-22 23:43||peter-endian||Note Added: 0004084|
|2010-03-23 20:29||peter-endian||Note Added: 0004089|
|2010-03-26 15:14||peter-endian||Status||confirmed => resolved|
|2010-03-26 15:14||peter-endian||Fixed in Version||=> 2.3.1|
|2010-03-26 15:14||peter-endian||Resolution||open => fixed|
|2010-03-26 15:15||peter-endian||Note Added: 0004101|
|2010-11-22 12:08||peter-endian||Fixed in Version||2.3.1 => 2.4.1|
|2010-11-22 12:08||peter-endian||Status||resolved => closed|
|Copyright © 2000 - 2012 MantisBT Group|