SYSTEM WARNING: 'date_default_timezone_get(): It is not safe to rely on the system's timezone settings. You are *required* to use the date.timezone setting or the date_default_timezone_set() function. In case you used any of those methods and you are still getting this warning, you most likely misspelled the timezone identifier. We selected the timezone 'UTC' for now, but please set date.timezone to select your timezone.' in '/usr/share/mantis/www/core.php' line 264

0003267: rrdfix.sh not found problem and high cpu load - MantisBT
MantisBT - Endian Firewall
View Issue Details
0003267Endian FirewallOther Scriptspublic2010-11-08 09:202012-09-07 14:53
ardit-endian 
peter-endian 
normaltweakalways
confirmedreopened 
2.3.1 
2.4.1 
0003267: rrdfix.sh not found problem and high cpu load
 The RRDFIX Script delete every 5 minutes all the .rrd files, ok. In
 this case the script get an error:
 -------------------------------------------------------------
 ERROR: opening '/var/ntop/rrd/flows/Host': No such file or directory
 ------------------------------------------------------------

 Result: The System Load goes over 4.00 for 3 minutes:>(

 I delete the DIRS
 /var/ntop
 in rrdfix.sh.
 Result:
 -----------------------------------------------------------
 DIRS="/var/log/rrd/ /var/lib/collectd/rrd/"
 -----------------------------------------------------------
 And now the system runs with 0,6. Perfect.

 Is this OK?

Please refer also to this topic on efwsupport.com :
http://efwsupport.com/index.php?topic=1341.0 [^]

purple
Issue History
2010-11-08 09:20ardit-endianNew Issue
2010-11-08 10:15luca-endianTag Attached: purple
2010-11-08 10:30ra-endianNote Added: 0005039
2010-11-08 13:47ardit-endianNote Added: 0005041
2010-11-08 13:47ardit-endianNote Edited: 0005041
2010-11-11 17:03ra-endianNote Added: 0005093
2010-11-24 09:14ardit-endianNote Added: 0005189
2010-11-25 11:01lorenzo-endianNote Added: 0005205
2010-11-25 11:01lorenzo-endianAssigned To => lorenzo-endian
2010-11-25 11:01lorenzo-endianStatusnew => feedback
2010-11-25 12:06ardit-endianNote Added: 0005206
2010-11-26 16:30ardit-endianNote Added: 0005220
2010-12-02 09:15lorenzo-endianNote Added: 0005262
2010-12-02 09:15lorenzo-endianStatusfeedback => closed
2010-12-02 09:15lorenzo-endianResolutionopen => fixed
2010-12-02 09:15lorenzo-endianFixed in Version => 2.4.1
2011-01-26 09:19ardit-endianStatusclosed => feedback
2011-01-26 09:19ardit-endianResolutionfixed => reopened
2011-02-15 10:53lorenzo-endianCustomer Occurencies => 0
2011-02-15 10:53lorenzo-endianAssigned Tolorenzo-endian => ardit-endian
2011-02-24 09:52ardit-endianNote Added: 0005751
2011-02-24 10:02lorenzo-endianNote Added: 0005752
2011-02-24 10:02lorenzo-endianAssigned Toardit-endian => lorenzo-endian
2011-02-24 10:02lorenzo-endianStatusfeedback => confirmed
2011-03-16 09:45lorenzo-endianNote Added: 0005968
2011-03-16 09:45lorenzo-endianAssigned Tolorenzo-endian => peter-endian
2012-09-07 14:33luke-endianNote Added: 0008095
2012-09-07 14:36luke-endianNote Added: 0008096

Notes
(0005039)
ra-endian   
2010-11-08 10:30   
I think the rrdfix script should not run every 5 minutes. I check this now.
(0005041)
ardit-endian   
2010-11-08 13:47   
In deed it is in cron.cyclic and from crontab, and run every 5 min:
&nolog */5 * * * * [ -x /bin/run-parts ] && run-parts --report /etc/cron.cyclic

cron.cyclic :
# cat /etc/cron.cyclic/makegraphs
#!/bin/sh

[ -x /usr/local/bin/rrdfix.sh ] && /usr/local/bin/rrdfix.sh >/dev/null
/usr/local/bin/makegraphs.pl >/dev/null
exit 0

(0005093)
ra-endian   
2010-11-11 17:03   
ok. you are right.Then for now we should exclude the ntop directory. It's to big for check that directory every 5 minutes.
(0005189)
ardit-endian   
2010-11-24 09:14   
Hello ra,

I'm looking now to a system, and it gaves me :

rrdfix.sh
ERROR: opening '/var/ntop/rrd/flows/Host': No such file or directory
ERROR: opening '/var/ntop/rrd/flows/Host': No such file or directory

And if we remove the /var/ntop dir from the script then the files under that directory will be not deleted.
i executed the script and under the /var/ntop directory the file count is the same:
# for i in ntop; do echo -n "$i: "; find $i -type f | wc -l; done
ntop: 8201
i suppose that after the error, the script don't check that directory any more..
-------------
Other update, i found the problem i think..
indeed there is no /var/ntop/rrd/flows/Host directory but is:

root@endian:/var/ntop/rrd/flows # cd Host\ Last\ Seen/
root@endian:/var/ntop/rrd/flows/Host Last Seen #

# ls -acl
total 16
drwx------ 4 ntop ntop 4096 Nov 15 17:02 .
drwxr-xr-x 5 ntop ntop 4096 Mar 16 2010 ..
drwx------ 2 ntop ntop 4096 Nov 15 17:02 Host Last Seen
drwx------ 2 ntop ntop 4096 Nov 15 17:02 ICMP Watch

i think the problem will be the same with ICMP Watch also because the directory name is splitted.

the solution would be modifying the script to be able to check directories like /var/ntop/rrd/flows/Host Last Seen # or ntop creating 1 named directories..

Regards,
ardit.
(0005205)
lorenzo-endian   
2010-11-25 11:01   
hi ardit,

i have done some tests and on my machine this problem never arises.

on which hardware the software is running?

thanks a lot!

lo
(0005206)
ardit-endian   
2010-11-25 12:06   
hi lo :)
please check the mail,

thanks,
ardit
(0005220)
ardit-endian   
2010-11-26 16:30   
hi lo,
I also verified on some systems (specially mini) that when ntop is on the CPU shows 100% almost all the time, and i think there is some impact when the script is automatically executed then it runs on the memory all the time..

You can check this thread on efw-support for more info, because different users reported this with the community edition as well.
http://efwsupport.com/index.php?topic=1341.0 [^]

regards
ardit.
(0005262)
lorenzo-endian   
2010-12-02 09:15   
Hello ardit,

this problem has been fixed in the last update :)

let me know if the problem persists!

have a nice day

Lo
(0005751)
ardit-endian   
2011-02-24 09:52   
root@biofw:~ # rrdfix.sh
ERROR: opening '/var/ntop/rrd/flows/Host': No such file or directory
ERROR: opening '/var/ntop/rrd/flows/Host': No such file or directory

another system
(0005752)
lorenzo-endian   
2011-02-24 10:02   
Hi ardit!

as said, the problem exists and we are sure about that.

Now, I will work hard in order to reproduce it, because up to now it arises in an unpredictable way.

Thanks for testing & happy hacking

Lo
(0005968)
lorenzo-endian   
2011-03-16 09:45   
We have to release the fix for 2.3 :)
(0008095)
luke-endian   
2012-09-07 14:33   
Hi Guys

i've the same problem on a 2.5 x86
i see that when the rrdfix cron in /etc/cron.cyclic starts CPU shows 100% almost all the time.
I have notice that the problem is NTOP folder (/var/ntop)that is 1.4 GB and rrdfix.sh script uses about 4 minutes to be completed and coronjob start every 5 minutes.
(0008096)
luke-endian   
2012-09-07 14:36   
Sorry, i would add that i have no "file not found" problem but "only" CPU high workload problem.