cacti-user Mailing List for Cacti

Daniel Rossi wrote:
> On 30/07/2008, at 3:27 AM, Reinhard Scheck wrote:
>>>
>>> Typo, its the total connections for the lifetime of the server online
>>> and yes its a counter. ActiveConnections is a gauge. It's storing the
>>> values in the rrd like 1.9 instead of the real value which is 100  
>>> even
>>> when running via command line. So its something ive done wrong in
>>> cacti, or the rrd is being built incorrectly for what i want it to  
>>> do ?
>> Please be aware of the fact, that commonly COUNTERs have to be read  
>> as "value
>> per second". To get "value per minute", you'll have to multiply by  
>> 60. To get
>> "value per interval" (where "interval" is assumed to be 300),  
>> multiply by 300.
>> That's a guess, for sure.
> 
> So that number i need to display by multiplying the interval, if it  
> got 1.9 as a value for instance and i had entered manually 100 into  
> rrdtool update for that current timestamp, what would i need to times  
> then to get the 100 value for instance.
> 
> I guess we just want to graph connections within the given minute,
Fine. Than use (create) a CDEF "Make Data per minute" that multiplies the 
CURRENT_DATA_SOURCE by 60
> or  
> given data update, rather than working out connections per second  
> however that would also be nice to graph.
>>>
>> It would be nice to see the debug for the data source to see, if all  
>> CFs are
>> present.
> 
> Here it is sorry
> 
> /usr/bin/rrdtool create \
> /var/www/web4/web/rra/localhost_activeconnections_154.rrd \
> --step 300  \
> DS:ActiveConnections:GAUGE:600:0:10000000000 \
> DS:MaxConnections:GAUGE:600:0:10000000000 \
> DS:TotalConnections:COUNTER:600:0:10000000000 \
> DS:ActiveClients:GAUGE:600:0:10000000000 \
> DS:MaxClients:GAUGE:600:0:10000000000 \
> DS:TotalClients:COUNTER:600:0:10000000000 \
> DS:ActiveSubscopes:GAUGE:600:0:10000000000 \
> DS:MaxSubscopes:GAUGE:600:0:10000000000 \
> DS:TotalSubscopes:COUNTER:600:0:10000000000 \
> RRA:AVERAGE:0.5:1:500 \
> RRA:AVERAGE:0.5:1:600 \
> RRA:AVERAGE:0.5:6:700 \
> RRA:AVERAGE:0.5:24:775 \
> RRA:AVERAGE:0.5:288:797 \
> RRA:MIN:0.5:1:600 \
> RRA:MIN:0.5:6:700 \
> RRA:MIN:0.5:24:775 \
> RRA:MIN:0.5:288:797 \
> RRA:MAX:0.5:1:500 \
> RRA:MAX:0.5:1:600 \
> RRA:MAX:0.5:6:700 \
> RRA:MAX:0.5:24:775 \
> RRA:MAX:0.5:288:797 \
> RRA:LAST:0.5:1:600 \
> RRA:LAST:0.5:6:700 \
> RRA:LAST:0.5:24:775 \
> RRA:LAST:0.5:288:797 \
That's fine. No issue here
> 
> Clearly i have no idea how rrd works, i wish it was a simple sql query  
> syntax though.
In this case you would have to deal with consolidation on your own, graphing 
would be left to you and stuff. Please understand, that cacti relies on rrdtool. 
It uses most of rrdtool features but inherts all of its limitations

Reinhard

Daniel Rossi wrote:
> It has been in debug mode here is the last result
> 
> 07/30/2008 03:52:50 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
> Remote Process [CMD: /usr/bin/spine, ARGS:  0 6]
> Waiting on 1/1 pollers.
This DEBUG is incomplete.
At least the call of the polling script/snmp get is missing

> 07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'TotalSwapSpaceSize:3989250048' [map TotalSwapSpaceSize- 
>  >TotalSwapSpaceSize]
> 07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'FreeSwapSpaceSize:3989250048' [map FreeSwapSpaceSize- 
>  >FreeSwapSpaceSize]
> 07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'FreePhysicalMemorySize:1147408384' [map FreePhysicalMemorySize- 
>  >FreeMemorySize]
> 07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'TotalPhysicalMemorySize:4155834368' [map TotalPhysicalMemorySize- 
>  >TotalMemorySize]
> 07/30/2008 03:52:51 AM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool  
> update /var/www/web4/web/rra/localhost_totalswapspacesize_156.rrd -- 
> template  
> TotalSwapSpaceSize:FreeSwapSpaceSize:FreeMemorySize:TotalMemorySize  
> 1217353970:3989250048:3989250048:1147408384:4155834368
> 07/30/2008 03:52:51 AM - SYSTEM STATS: Time:1.1141 Method:spine  
> Processes:1 Threads:100 Hosts:3 HostsPerProcess:3 DataSources:0  
> RRDsProcessed:1
The 1 RRDsProcessed is /var/www/web4/web/rra/localhost_totalswapspacesize_156.rrd

BTB: Threads=100 is insane. Set to 12 ... 15
> OK u:0.00 s:0.00 r:1.00
> Loop  Time is: 1.11492395401
> Sleep Time is: 8.88507604599
> Total Time is: 31.116046905518
> 07/30/2008 03:53:00 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
> Remote Process [CMD: /usr/bin/spine, ARGS:  0 6]
> Waiting on 1/1 pollers.
> 07/30/2008 03:53:01 AM - SYSTEM STATS: Time:1.1103 Method:spine  
> Processes:1 Threads:100 Hosts:3 HostsPerProcess:3 DataSources:0  
> RRDsProcessed:0
> Loop  Time is: 1.1113040447235
> Sleep Time is: 8.8886959552765
> Total Time is: 41.11278796196
> 07/30/2008 03:53:10 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
> Remote Process [CMD: /usr/bin/spine, ARGS:  0 6]
> Waiting on 1/1 pollers.
> 07/30/2008 03:53:11 AM - SYSTEM STATS: Time:1.1098 Method:spine  
> Processes:1 Threads:100 Hosts:3 HostsPerProcess:3 DataSources:0  
> RRDsProcessed:0
> Loop  Time is: 1.1108620166779
> Sleep Time is: 8.8891379833221
> Total Time is: 51.112715005875
> 
> 
> The host for the new graphs is up, but i have set it to ping instead  
> of snmp because i do not know its snmp info yet.
Ahh. This may cause issues!
PHP ping requires root privileges (IMHO not recommended). You're using cacti 
087*? Then, please deactivate downed host detection (edit the host, set this 
option to NONE), until you know the SNMP data

Reinhard

BTB: we may discuss issues on the IRC channel #Cacti instead of mailing every 
other minute

i deleted all graphs, and create each graph again one at a time. So  
create graph, run poller etc. I also think the issue with the cron is  
that the web user for the site  is within a chroot, so not sure if  
cron attemps to log the user in first to run the commands or not. I  
will try to setup cron as root for now.

On 30/07/2008, at 3:55 AM, Daniel Rossi wrote:

> It has been in debug mode here is the last result
>
> 07/30/2008 03:52:50 AM - POLLER: Poller[0] DEBUG: About to Spawn a
> Remote Process [CMD: /usr/bin/spine, ARGS:  0 6]
> Waiting on 1/1 pollers.
> 07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field
> 'TotalSwapSpaceSize:3989250048' [map TotalSwapSpaceSize-
>> TotalSwapSpaceSize]
> 07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field
> 'FreeSwapSpaceSize:3989250048' [map FreeSwapSpaceSize-
>> FreeSwapSpaceSize]
> 07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field
> 'FreePhysicalMemorySize:1147408384' [map FreePhysicalMemorySize-
>> FreeMemorySize]
> 07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field
> 'TotalPhysicalMemorySize:4155834368' [map TotalPhysicalMemorySize-
>> TotalMemorySize]
> 07/30/2008 03:52:51 AM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool
> update /var/www/web4/web/rra/localhost_totalswapspacesize_156.rrd --
> template
> TotalSwapSpaceSize:FreeSwapSpaceSize:FreeMemorySize:TotalMemorySize
> 1217353970:3989250048:3989250048:1147408384:4155834368
> 07/30/2008 03:52:51 AM - SYSTEM STATS: Time:1.1141 Method:spine
> Processes:1 Threads:100 Hosts:3 HostsPerProcess:3 DataSources:0
> RRDsProcessed:1
> OK u:0.00 s:0.00 r:1.00
> Loop  Time is: 1.11492395401
> Sleep Time is: 8.88507604599
> Total Time is: 31.116046905518
> 07/30/2008 03:53:00 AM - POLLER: Poller[0] DEBUG: About to Spawn a
> Remote Process [CMD: /usr/bin/spine, ARGS:  0 6]
> Waiting on 1/1 pollers.
> 07/30/2008 03:53:01 AM - SYSTEM STATS: Time:1.1103 Method:spine
> Processes:1 Threads:100 Hosts:3 HostsPerProcess:3 DataSources:0
> RRDsProcessed:0
> Loop  Time is: 1.1113040447235
> Sleep Time is: 8.8886959552765
> Total Time is: 41.11278796196
> 07/30/2008 03:53:10 AM - POLLER: Poller[0] DEBUG: About to Spawn a
> Remote Process [CMD: /usr/bin/spine, ARGS:  0 6]
> Waiting on 1/1 pollers.
> 07/30/2008 03:53:11 AM - SYSTEM STATS: Time:1.1098 Method:spine
> Processes:1 Threads:100 Hosts:3 HostsPerProcess:3 DataSources:0
> RRDsProcessed:0
> Loop  Time is: 1.1108620166779
> Sleep Time is: 8.8891379833221
> Total Time is: 51.112715005875
>
>
> The host for the new graphs is up, but i have set it to ping instead
> of snmp because i do not know its snmp info yet.
>
> On 30/07/2008, at 3:44 AM, Reinhard Scheck wrote:
>
>> Daniel Rossi wrote:
>>> Its doing it again even though ive ran poller.php manually a dozen
>>> times after adding new graphs. It would be good to see how the graph
>>> is generated right away when adding it. ive waited over 30 mins and
>>> ran poller.php quite a few times, maybe i should wait longer ?
>> No. Only one run of poller.php is required to create the rrd file IF
>> the target
>> is responsive and the requested data source provides valid data.
>> Run the poller in debug mode to get more info about what may fail
>>
>> Reinhard
>>
>> -------------------------------------------------------------------------
>> This SF.Net email is sponsored by the Moblin Your Move Developer's
>> challenge
>> Build the coolest Linux based applications with Moblin SDK & win
>> great prizes
>> Grand prize is a trip for two to an Open Source event anywhere in
>> the world
>> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>> _______________________________________________
>> cacti-user mailing list
>> cac...@li...
>> https://lists.sourceforge.net/lists/listinfo/cacti-user
>
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's  
> challenge
> Build the coolest Linux based applications with Moblin SDK & win  
> great prizes
> Grand prize is a trip for two to an Open Source event anywhere in  
> the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> cacti-user mailing list
> cac...@li...
> https://lists.sourceforge.net/lists/listinfo/cacti-user

It has been in debug mode here is the last result

07/30/2008 03:52:50 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
Remote Process [CMD: /usr/bin/spine, ARGS:  0 6]
Waiting on 1/1 pollers.
07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field  
'TotalSwapSpaceSize:3989250048' [map TotalSwapSpaceSize- 
 >TotalSwapSpaceSize]
07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field  
'FreeSwapSpaceSize:3989250048' [map FreeSwapSpaceSize- 
 >FreeSwapSpaceSize]
07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field  
'FreePhysicalMemorySize:1147408384' [map FreePhysicalMemorySize- 
 >FreeMemorySize]
07/30/2008 03:52:51 AM - POLLER: Poller[0] Parsed MULTI output field  
'TotalPhysicalMemorySize:4155834368' [map TotalPhysicalMemorySize- 
 >TotalMemorySize]
07/30/2008 03:52:51 AM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool  
update /var/www/web4/web/rra/localhost_totalswapspacesize_156.rrd -- 
template  
TotalSwapSpaceSize:FreeSwapSpaceSize:FreeMemorySize:TotalMemorySize  
1217353970:3989250048:3989250048:1147408384:4155834368
07/30/2008 03:52:51 AM - SYSTEM STATS: Time:1.1141 Method:spine  
Processes:1 Threads:100 Hosts:3 HostsPerProcess:3 DataSources:0  
RRDsProcessed:1
OK u:0.00 s:0.00 r:1.00
Loop  Time is: 1.11492395401
Sleep Time is: 8.88507604599
Total Time is: 31.116046905518
07/30/2008 03:53:00 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
Remote Process [CMD: /usr/bin/spine, ARGS:  0 6]
Waiting on 1/1 pollers.
07/30/2008 03:53:01 AM - SYSTEM STATS: Time:1.1103 Method:spine  
Processes:1 Threads:100 Hosts:3 HostsPerProcess:3 DataSources:0  
RRDsProcessed:0
Loop  Time is: 1.1113040447235
Sleep Time is: 8.8886959552765
Total Time is: 41.11278796196
07/30/2008 03:53:10 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
Remote Process [CMD: /usr/bin/spine, ARGS:  0 6]
Waiting on 1/1 pollers.
07/30/2008 03:53:11 AM - SYSTEM STATS: Time:1.1098 Method:spine  
Processes:1 Threads:100 Hosts:3 HostsPerProcess:3 DataSources:0  
RRDsProcessed:0
Loop  Time is: 1.1108620166779
Sleep Time is: 8.8891379833221
Total Time is: 51.112715005875


The host for the new graphs is up, but i have set it to ping instead  
of snmp because i do not know its snmp info yet.

On 30/07/2008, at 3:44 AM, Reinhard Scheck wrote:

> Daniel Rossi wrote:
>> Its doing it again even though ive ran poller.php manually a dozen
>> times after adding new graphs. It would be good to see how the graph
>> is generated right away when adding it. ive waited over 30 mins and
>> ran poller.php quite a few times, maybe i should wait longer ?
> No. Only one run of poller.php is required to create the rrd file IF  
> the target
> is responsive and the requested data source provides valid data.
> Run the poller in debug mode to get more info about what may fail
>
> Reinhard
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's  
> challenge
> Build the coolest Linux based applications with Moblin SDK & win  
> great prizes
> Grand prize is a trip for two to an Open Source event anywhere in  
> the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> cacti-user mailing list
> cac...@li...
> https://lists.sourceforge.net/lists/listinfo/cacti-user

Daniel Rossi wrote:
> Its doing it again even though ive ran poller.php manually a dozen  
> times after adding new graphs. It would be good to see how the graph  
> is generated right away when adding it. ive waited over 30 mins and  
> ran poller.php quite a few times, maybe i should wait longer ?
No. Only one run of poller.php is required to create the rrd file IF the target 
is responsive and the requested data source provides valid data.
Run the poller in debug mode to get more info about what may fail

Reinhard

On 30/07/2008, at 3:27 AM, Reinhard Scheck wrote:
>>
>>
>> Typo, its the total connections for the lifetime of the server online
>> and yes its a counter. ActiveConnections is a gauge. It's storing the
>> values in the rrd like 1.9 instead of the real value which is 100  
>> even
>> when running via command line. So its something ive done wrong in
>> cacti, or the rrd is being built incorrectly for what i want it to  
>> do ?
> Please be aware of the fact, that commonly COUNTERs have to be read  
> as "value
> per second". To get "value per minute", you'll have to multiply by  
> 60. To get
> "value per interval" (where "interval" is assumed to be 300),  
> multiply by 300.
> That's a guess, for sure.

So that number i need to display by multiplying the interval, if it  
got 1.9 as a value for instance and i had entered manually 100 into  
rrdtool update for that current timestamp, what would i need to times  
then to get the 100 value for instance.

I guess we just want to graph connections within the given minute, or  
given data update, rather than working out connections per second  
however that would also be nice to graph.
>>
>>
> It would be nice to see the debug for the data source to see, if all  
> CFs are
> present.

Here it is sorry

/usr/bin/rrdtool create \
/var/www/web4/web/rra/localhost_activeconnections_154.rrd \
--step 300  \
DS:ActiveConnections:GAUGE:600:0:10000000000 \
DS:MaxConnections:GAUGE:600:0:10000000000 \
DS:TotalConnections:COUNTER:600:0:10000000000 \
DS:ActiveClients:GAUGE:600:0:10000000000 \
DS:MaxClients:GAUGE:600:0:10000000000 \
DS:TotalClients:COUNTER:600:0:10000000000 \
DS:ActiveSubscopes:GAUGE:600:0:10000000000 \
DS:MaxSubscopes:GAUGE:600:0:10000000000 \
DS:TotalSubscopes:COUNTER:600:0:10000000000 \
RRA:AVERAGE:0.5:1:500 \
RRA:AVERAGE:0.5:1:600 \
RRA:AVERAGE:0.5:6:700 \
RRA:AVERAGE:0.5:24:775 \
RRA:AVERAGE:0.5:288:797 \
RRA:MIN:0.5:1:600 \
RRA:MIN:0.5:6:700 \
RRA:MIN:0.5:24:775 \
RRA:MIN:0.5:288:797 \
RRA:MAX:0.5:1:500 \
RRA:MAX:0.5:1:600 \
RRA:MAX:0.5:6:700 \
RRA:MAX:0.5:24:775 \
RRA:MAX:0.5:288:797 \
RRA:LAST:0.5:1:600 \
RRA:LAST:0.5:6:700 \
RRA:LAST:0.5:24:775 \
RRA:LAST:0.5:288:797 \

Clearly i have no idea how rrd works, i wish it was a simple sql query  
syntax though.

> d to be a bug but more of a "missing feature".
> There's a well know but purely manual workaround that may help.
>
> Please create the FIRST graph as usual (Create Graphs for this  
> Host). This will
> not only create the graph, but the data source and rrd file as well.
> The next graphs will be created from "Graph Management". Provide the  
> Graph
> Template and name the Host. Then, please associate the now existing  
> datra
> sources to the new graph. This will avoid creating new data sources.

Thats what im doing right now for two of the graphs yeah :)

>

Its doing it again even though ive ran poller.php manually a dozen  
times after adding new graphs. It would be good to see how the graph  
is generated right away when adding it. ive waited over 30 mins and  
ran poller.php quite a few times, maybe i should wait longer ?

ERROR: opening '/var/www/web4/web/rra/www8_activeconnections_159.rrd':  
No such file or directory

On 30/07/2008, at 1:55 AM, Reinhard Scheck wrote:

> Daniel Rossi wrote:
>>
>> FYI, when adding new graphs you have to wait a certain ammount of  
>> time
>> depending on what the interval time is set which is 5 mins or
>> something like that.
> It's always assumed that crontab is set up correctly. Then, rrd file  
> generation
> is kinda automatic.
>
>> I seriouslly suggest generate them automatically
>> or add this comment in the docs somewhere.
> Sure. Any suggestion where to put it best?
>
>> I am an experience user so
>> something has gone wrong there. I waited 5 mins, ran the poller to  
>> see
>> what output it would have an then the rrd file was generated so sorry
>> about the noise.
> The poller.php is the only one that generates rrd files (and updates  
> them). They
> are not generated by the apache user (security issues when allowing  
> httpd to
> create files)
>
>>
>> I am however having issues still with either getting data into the  
>> rrd
>> or getting it out, the graphs show up nan unless i run rrdtool update
>> manually.
>
> So, to sum up, you've now managed to create rrd files successfully  
> by means of
> the poller.php. Anything that prevents you from setting up crontab,  
> then? This
> will avoid many issues.
>
> Reinhard
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's  
> challenge
> Build the coolest Linux based applications with Moblin SDK & win  
> great prizes
> Grand prize is a trip for two to an Open Source event anywhere in  
> the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> cacti-user mailing list
> cac...@li...
> https://lists.sourceforge.net/lists/listinfo/cacti-user

Daniel Rossi wrote:
> On 30/07/2008, at 2:06 AM, Reinhard Scheck wrote:
> 
>> Daniel Rossi wrote:
>>> Hi there, im trying to build graphs to graph information from a  
>>> system
>>> which produces totals for current total connections (counter),  
>>> current
>>> active connections and current max connections. How do i get it on  
>>> the
>>> graph so its not calculated as averages but as the actual numbers ?
>> You're really sure, that "current total connections" is a COUNTER,  
>> not a GAUGE?
>> Very unlikely.
> 
> 
> Typo, its the total connections for the lifetime of the server online  
> and yes its a counter. ActiveConnections is a gauge. It's storing the  
> values in the rrd like 1.9 instead of the real value which is 100 even  
> when running via command line. So its something ive done wrong in  
> cacti, or the rrd is being built incorrectly for what i want it to do ?
Please be aware of the fact, that commonly COUNTERs have to be read as "value 
per second". To get "value per minute", you'll have to multiply by 60. To get 
"value per interval" (where "interval" is assumed to be 300), multiply by 300. 
That's a guess, for sure.

> 
>>
>> Next, I suppose that there's still an issue understanding rrdtool
>> consolidation/normalization (sorry, no offense).
> 
> No offense taken, i don't understand it at all and to be frank i'd  
> rather not and was trying to avoid having to setup these custom  
> graphs, its taken me 2 weeks just to setup graphs after building the  
> custom script. I'm guessing I should just use the command line tools  
> instead of a gui if i need to learn it. It took a while to work out  
> cacti and opennms was more of a nightmare, now the problem is working  
> out how to store / display the data correctly even when copying  
> similar graphs. I've connected a live server now so hopefully i get  
> more active data coming into a demo graph !
> 
>> You can't avoid
>> consolidation/normalization.
>> Normalization is performed, if the rrdtool update timestamp has an  
>> offset from
>> an exact "step" boundary (by default: every 300 sec.). E.g.  
>> timestamps 302, 602,
>> 902 are exactly 300 sec apart but "off boundary". 300, 600, 900  
>> would be without
>> offset. There's no way to force cacti to work only "on boundary".
>>
>> Consolidation is performed to "compress" data in two situations
>> - Historical consolidation: Squeeze data e.g. of the last year into  
>> a single rra
>> - "Graphical" consolidation: Print a graph of "n pixels width" using  
>> ">n data
>> points".
>>
>> Many users try to avoid "historical consolidation" by defining huge  
>> rra's and
>> omitting CDPs per PDP > 1. But they run into "graphical  
>> consolidation" if
>> viewing e.g. a year's worth of data. There's no escape from  
>> consolidation with
>> rrdtool.
>>
>> Solution: make rrdtool consolidate the "right way", e.g. use CF=MAX  
>> for "max
>> connections"
> 
> 
> Here is a generate graph command, i think the CF is AVERAGE here
see comments below
> , i  
> also want it to show the total as a line somewhere or just somewhere  
> in the legend at the least, current active and max concurrent  
> connections are the interesting ones here. I also dont want the  
> rrdtool to display things like M / GB in the y axis and legend or  
> whatever thinking it's memory usage just a raw number.
That's doable, but first let's get the correct numbers. Then, we'll cope with 
the format of numbers
> 
> 
> /usr/bin/rrdtool graph - \
> --imgformat=PNG \
> --start=-86400 \
> --end=-300 \
> --title="Localhost - Red5 - Connections" \
> --base=1000 \
> --height=120 \
> --width=500 \
> --alt-autoscale-max \
> --lower-limit=1 \
> --vertical-label="connections" \
> --slope-mode \
> --font TITLE:12: \
> --font AXIS:8: \
> --font LEGEND:10: \
> --font UNIT:8: \
> DEF:a="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":MaxConnections:AVERAGE \
this is the rra for CF AVERAGE
> DEF:b="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":MaxConnections:LAST \
this is the rra for CF LAST
> DEF:c="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":MaxConnections:MIN \
this is the rra for CF MIN
> DEF:d="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":MaxConnections:MAX \
this is the rra for CF MAX
> DEF:e="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":ActiveConnections:AVERAGE \
> DEF:f="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":ActiveConnections:LAST \
> DEF:g="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":ActiveConnections:MIN \
> DEF:h="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":ActiveConnections:MAX \
> DEF:i="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":TotalConnections:AVERAGE \
> DEF:j="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":TotalConnections:LAST \
> DEF:ba="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":TotalConnections:MIN \
> DEF:bb="/var/www/web4/web/rra/ 
> localhost_activeconnections_154.rrd":TotalConnections:MAX \
> LINE1:a#FF0000FF:"Max"  \
> GPRINT:b:LAST:"   Current\:%8.0lf"  \
> GPRINT:a:AVERAGE:"Average\:%8.2lf %s"  \
> GPRINT:d:MAX:"Maximum\:%8.0lf"  \
> AREA:e#0000FFFF:"Active"  \
> GPRINT:f:LAST:"Current\:%8.0lf"  \
> GPRINT:e:AVERAGE:"Average\:%8.2lf %s"  \
> GPRINT:h:MAX:"Maximum\:%8.0lf"  \
> LINE3:i#00FF00FF:"Total"  \
> GPRINT:j:LAST:" Current\:%8.0lf"  \
> GPRINT:i:AVERAGE:"Average\:%8.2lf %s"  \
> GPRINT:bb:MAX:"Maximum\:%8.0lf"
> 
It would be nice to see the debug for the data source to see, if all CFs are 
present.
> 
> The other thing id like to be able is be able to share datasources   
> data templates across graphs. Ie i have a data template with multiple  
> fields set, 3 graphs use different fields within it. The problem with  
> this is when i go to add each graph it duplicates the datasource  
> trying to use its own. Is there a fix for this I believe this is a  
> known problem.
It's a known fact, not supposed to be a bug but more of a "missing feature". 
There's a well know but purely manual workaround that may help.

Please create the FIRST graph as usual (Create Graphs for this Host). This will 
not only create the graph, but the data source and rrd file as well.
The next graphs will be created from "Graph Management". Provide the Graph 
Template and name the Host. Then, please associate the now existing datra 
sources to the new graph. This will avoid creating new data sources.

Reinhard

On 30/07/2008, at 2:06 AM, Reinhard Scheck wrote:

> Daniel Rossi wrote:
>> Hi there, im trying to build graphs to graph information from a  
>> system
>> which produces totals for current total connections (counter),  
>> current
>> active connections and current max connections. How do i get it on  
>> the
>> graph so its not calculated as averages but as the actual numbers ?
>
> You're really sure, that "current total connections" is a COUNTER,  
> not a GAUGE?
> Very unlikely.


Typo, its the total connections for the lifetime of the server online  
and yes its a counter. ActiveConnections is a gauge. It's storing the  
values in the rrd like 1.9 instead of the real value which is 100 even  
when running via command line. So its something ive done wrong in  
cacti, or the rrd is being built incorrectly for what i want it to do ?

>
>
> Next, I suppose that there's still an issue understanding rrdtool
> consolidation/normalization (sorry, no offense).

No offense taken, i don't understand it at all and to be frank i'd  
rather not and was trying to avoid having to setup these custom  
graphs, its taken me 2 weeks just to setup graphs after building the  
custom script. I'm guessing I should just use the command line tools  
instead of a gui if i need to learn it. It took a while to work out  
cacti and opennms was more of a nightmare, now the problem is working  
out how to store / display the data correctly even when copying  
similar graphs. I've connected a live server now so hopefully i get  
more active data coming into a demo graph !

> You can't avoid
> consolidation/normalization.
> Normalization is performed, if the rrdtool update timestamp has an  
> offset from
> an exact "step" boundary (by default: every 300 sec.). E.g.  
> timestamps 302, 602,
> 902 are exactly 300 sec apart but "off boundary". 300, 600, 900  
> would be without
> offset. There's no way to force cacti to work only "on boundary".
>
> Consolidation is performed to "compress" data in two situations
> - Historical consolidation: Squeeze data e.g. of the last year into  
> a single rra
> - "Graphical" consolidation: Print a graph of "n pixels width" using  
> ">n data
> points".
>
> Many users try to avoid "historical consolidation" by defining huge  
> rra's and
> omitting CDPs per PDP > 1. But they run into "graphical  
> consolidation" if
> viewing e.g. a year's worth of data. There's no escape from  
> consolidation with
> rrdtool.
>
> Solution: make rrdtool consolidate the "right way", e.g. use CF=MAX  
> for "max
> connections"


Here is a generate graph command, i think the CF is AVERAGE here, i  
also want it to show the total as a line somewhere or just somewhere  
in the legend at the least, current active and max concurrent  
connections are the interesting ones here. I also dont want the  
rrdtool to display things like M / GB in the y axis and legend or  
whatever thinking it's memory usage just a raw number.


/usr/bin/rrdtool graph - \
--imgformat=PNG \
--start=-86400 \
--end=-300 \
--title="Localhost - Red5 - Connections" \
--base=1000 \
--height=120 \
--width=500 \
--alt-autoscale-max \
--lower-limit=1 \
--vertical-label="connections" \
--slope-mode \
--font TITLE:12: \
--font AXIS:8: \
--font LEGEND:10: \
--font UNIT:8: \
DEF:a="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":MaxConnections:AVERAGE \
DEF:b="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":MaxConnections:LAST \
DEF:c="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":MaxConnections:MIN \
DEF:d="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":MaxConnections:MAX \
DEF:e="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":ActiveConnections:AVERAGE \
DEF:f="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":ActiveConnections:LAST \
DEF:g="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":ActiveConnections:MIN \
DEF:h="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":ActiveConnections:MAX \
DEF:i="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":TotalConnections:AVERAGE \
DEF:j="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":TotalConnections:LAST \
DEF:ba="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":TotalConnections:MIN \
DEF:bb="/var/www/web4/web/rra/ 
localhost_activeconnections_154.rrd":TotalConnections:MAX \
LINE1:a#FF0000FF:"Max"  \
GPRINT:b:LAST:"   Current\:%8.0lf"  \
GPRINT:a:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:d:MAX:"Maximum\:%8.0lf"  \
AREA:e#0000FFFF:"Active"  \
GPRINT:f:LAST:"Current\:%8.0lf"  \
GPRINT:e:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:h:MAX:"Maximum\:%8.0lf"  \
LINE3:i#00FF00FF:"Total"  \
GPRINT:j:LAST:" Current\:%8.0lf"  \
GPRINT:i:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:bb:MAX:"Maximum\:%8.0lf"

here is another one i have going but yet to get data for it yet, its  
for java memory utilization

/usr/bin/rrdtool graph - \
--imgformat=PNG \
--start=-86400 \
--end=-300 \
--title="Localhost - Red5 - JVM Memory" \
--base=1024 \
--height=120 \
--width=500 \
--alt-autoscale-max \
--lower-limit=0 \
--vertical-label="" \
--slope-mode \
--font TITLE:12: \
--font AXIS:8: \
--font LEGEND:10: \
--font UNIT:8: \
DEF:a="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":TotalMemorySize:AVERAGE \
DEF:b="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":TotalMemorySize:LAST \
DEF:c="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":TotalMemorySize:MIN \
DEF:d="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":TotalMemorySize:MAX \
DEF:e="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":FreeMemorySize:AVERAGE \
DEF:f="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":FreeMemorySize:LAST \
DEF:g="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":FreeMemorySize:MIN \
DEF:h="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":FreeMemorySize:MAX \
DEF:i="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":TotalSwapSpaceSize:AVERAGE \
DEF:j="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":TotalSwapSpaceSize:LAST \
DEF:ba="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":TotalSwapSpaceSize:MIN \
DEF:bb="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":TotalSwapSpaceSize:MAX \
DEF:bc="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":FreeSwapSpaceSize:AVERAGE \
DEF:bd="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":FreeSwapSpaceSize:LAST \
DEF:be="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":FreeSwapSpaceSize:MIN \
DEF:bf="/var/www/web4/web/rra/ 
localhost_totalswapspacesize_156.rrd":FreeSwapSpaceSize:MAX \
CDEF:cdefe=a,e,- \
CDEF:cdeff=a,f,- \
CDEF:cdefh=a,h,- \
CDEF:cdefbg=d,bc,- \
CDEF:cdefbh=d,bd,- \
CDEF:cdefbj=d,bf,- \
LINE1:a#FF0000FF:"Max"  \
GPRINT:b:LAST:"      Current\:%8.2lf %s"  \
GPRINT:a:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:d:MAX:"Maximum\:%8.2lf %s\n"  \
AREA:cdefe#0000FFFF:"Used"  \
GPRINT:cdeff:LAST:"     Current\:%8.2lf %s"  \
GPRINT:cdefe:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:cdefh:MAX:"Maximum\:%8.2lf %s\n"  \
AREA:e#00FF00FF:"Free"  \
GPRINT:f:LAST:"     Current\:%8.2lf %s"  \
GPRINT:e:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:h:MAX:"Maximum\:%8.2lf %s\n"  \
LINE2:i#ED7600FF:"Max Swap"  \
GPRINT:j:LAST:" Current\:%8.2lf %s"  \
GPRINT:i:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:bb:MAX:"Maximum\:%8.2lf %s\n"  \
AREA:cdefbg#002A97FF:"Used Swap"  \
GPRINT:cdefbh:LAST:"Current\:%8.2lf %s"  \
GPRINT:cdefbg:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:cdefbj:MAX:"Maximum\:%8.2lf %s"  \
AREA:bc#009485FF:"Free Swap"  \
GPRINT:bd:LAST:"Current\:%8.2lf %s"  \
GPRINT:bc:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:bf:MAX:"Max Swap%8.2lf %s\n"


The other thing id like to be able is be able to share datasources   
data templates across graphs. Ie i have a data template with multiple  
fields set, 3 graphs use different fields within it. The problem with  
this is when i go to add each graph it duplicates the datasource  
trying to use its own. Is there a fix for this I believe this is a  
known problem.

On 30/07/2008, at 1:55 AM, Reinhard Scheck wrote:

>
> So, to sum up, you've now managed to create rrd files successfully  
> by means of
> the poller.php. Anything that prevents you from setting up crontab,  
> then? This
> will avoid many issues.
>

I turned it off to debug things. Its creating them but either once  
running poller.php dozens of times or wait 5 mins !

My issue now is storing and displaying data correctly, ie i want to  
graph totals and not have rrd do any funny calculations. I can see  
wierd things in the created rrd files when a value of 100 becomes 1.9  
or something like that. Even though ive set that field as a counter. 

Anton Gorlov wrote:
> Cacti draws a juniper loading plot judging by the SNMP generic template.
> The value is constant practically always and equal to 74 ~ 75.
> In some time, cacti starts to draw an empty plot, but if zoom it, we can
> see that the plot exists.
> 
> 
> ===
> Cacti Version 0.8.7b
> Cacti OS unix
> SNMP Version net-snmp
> RRDTool Version RRDTool 1.2.x
> Hosts 21
> Graphs 506
> Data Sources Script/Command: 6
> SNMP: 101
> SNMP Query: 349
> Script Query - Script Server: 103
> Total: 559
> Poller Information
> Interval 60
> Type cmd.php
> Items Action[0]: 799
> Action[1]: 6
> Action[2]: 185
> Total: 990
> Concurrent Processes 20
> Max Threads 1
> PHP Servers 1
> Script Timeout 35
> Max OID 40
> Last Run Statistics Time:4.4322 Method:cmd.php Processes:20 Threads:N/A
> Hosts:22 HostsPerProcess:2 DataSources:990 RRDsProcessed:545
> PHP Information
> PHP Version 5.2.5
> PHP OS FreeBSD
> PHP uname FreeBSD monitoring 6.3-RELEASE-p1 FreeBSD 6.3-RELEASE-p1 #0:
> Wed Apr 9 12:17:00 MSD 2008
> root@monitoring:/usr/obj/usr/src/sys/MYKERNEL3 i386
> PHP SNMP Installed
> max_execution_time 130
> memory_limit 150M

- Is the graph empty and values are zero or
- is the graph broken or
- is the graph empty and values are NaN?

I suppose the first case matches. If this assumption is correct, please change 
data source type from COUNTER to GAUGE

Reinhard

Daniel Rossi wrote:
> Hi there, im trying to build graphs to graph information from a system  
> which produces totals for current total connections (counter), current  
> active connections and current max connections. How do i get it on the  
> graph so its not calculated as averages but as the actual numbers ? 

You're really sure, that "current total connections" is a COUNTER, not a GAUGE? 
Very unlikely.

Next, I suppose that there's still an issue understanding rrdtool 
consolidation/normalization (sorry, no offense). You can't avoid 
consolidation/normalization.
Normalization is performed, if the rrdtool update timestamp has an offset from 
an exact "step" boundary (by default: every 300 sec.). E.g. timestamps 302, 602, 
902 are exactly 300 sec apart but "off boundary". 300, 600, 900 would be without 
offset. There's no way to force cacti to work only "on boundary".

Consolidation is performed to "compress" data in two situations
- Historical consolidation: Squeeze data e.g. of the last year into a single rra
- "Graphical" consolidation: Print a graph of "n pixels width" using ">n data 
points".

Many users try to avoid "historical consolidation" by defining huge rra's and 
omitting CDPs per PDP > 1. But they run into "graphical consolidation" if 
viewing e.g. a year's worth of data. There's no escape from consolidation with 
rrdtool.

Solution: make rrdtool consolidate the "right way", e.g. use CF=MAX for "max 
connections"

Reinhard

Daniel Rossi wrote:
> 
> FYI, when adding new graphs you have to wait a certain ammount of time  
> depending on what the interval time is set which is 5 mins or  
> something like that.
It's always assumed that crontab is set up correctly. Then, rrd file generation 
is kinda automatic.

> I seriouslly suggest generate them automatically  
> or add this comment in the docs somewhere.
Sure. Any suggestion where to put it best?

> I am an experience user so  
> something has gone wrong there. I waited 5 mins, ran the poller to see  
> what output it would have an then the rrd file was generated so sorry  
> about the noise.
The poller.php is the only one that generates rrd files (and updates them). They 
are not generated by the apache user (security issues when allowing httpd to 
create files)

> 
> I am however having issues still with either getting data into the rrd  
> or getting it out, the graphs show up nan unless i run rrdtool update  
> manually.

So, to sum up, you've now managed to create rrd files successfully by means of 
the poller.php. Anything that prevents you from setting up crontab, then? This 
will avoid many issues.

Reinhard

Daniel Rossi wrote:
> On 29/07/2008, at 6:14 AM, Reinhard Scheck wrote:
> 
>> Daniel Rossi wrote:
>>> it gets even more wierd
>>>
>> Sorry to drop in, now.
>> But from a short glance on this discussion, I fear that you've gone  
>> astray.
>>
>> First, you will never see rrdtool action when using cmd.php and/or  
>> spine. They
>> will of course perform the polling but only update table  
>> "poller_output".
>>
>> RRDTool action will only be performed by "poller.php".
>>
>> Pay attention when running poller.php as a "normal" user. It will  
>> create rrd
>> files with those permissions only and "cactiuser" may fail to update  
>> those files
>> subsequently.
>>
>> There are numerous reasons why polling may fail. Find the most  
>> popular issues at
>> http://docs.cacti.net in the HowTo section (HowTo Debug ...)
> 
> 
> sorry i forgot to add the output, i add a graph, run cmp.php +  
> poller.php
> 
> php poller.php
> 07/29/2008 06:27:10 AM - POLLER: Poller[0] NOTE: Poller Int: '60',  
> Cron Int: '60', Time Since Last: '2584', Max Runtime '58', Poller  
> Runs: '1'
> 07/29/2008 06:27:10 AM - POLLER: Poller[0] WARNING: Cron is out of  
> sync with the Poller Interval!  The Poller Interval is '60' seconds,  
> with a maximum of a '300' second Cron, but 2584 seconds have passed  
> since the last poll!
This error happens if the poller is run only from time to time. Avoid it by 
running "php -q poller.php --force"

> 07/29/2008 06:27:10 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
> Remote Process [CMD: /usr/bin/spine, ARGS:  0 5]
> Waiting on 1/1 pollers.
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'ActiveConnections:0' [map ActiveConnections->ActiveConnections]
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'TotalConnections:31' [map TotalConnections->TotalConnections]
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'MaxConnections:1' [map MaxConnections->MaxConnections]
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'ActiveClients:0' [map ActiveClients->ActiveClients]
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'TotalClients:31' [map TotalClients->TotalClients]
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'MaxClients:1' [map MaxClients->MaxClients]
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'ActiveSubscopes:0' [map ActiveSubscopes->ActiveSubscopes]
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'TotalSubscopes:0' [map TotalSubscopes->TotalSubscopes]
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
> 'MaxSubscopes:0' [map MaxSubscopes->MaxSubscopes]
> 07/29/2008 06:27:11 AM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool  
> update /var/www/web4/web/rra/localhost_activeconnections_137.rrd -- 
> template  
> ActiveConnections:TotalConnections:MaxConnections:ActiveClients:TotalClients:MaxClients:ActiveSubscopes:TotalSubscopes:MaxSubscopes 
>   1217276830:0:31:1:0:31:1:0:0:0
> OK u:0.00 s:0.01 r:1.00
So this update seems to work fine. Is the file in place?
> 07/29/2008 06:27:11 AM - SYSTEM STATS: Time:1.1127 Method:spine  
> Processes:1 Threads:100 Hosts:2 HostsPerProcess:2 DataSources:1  
> RRDsProcessed:1
> Loop  Time is: 1.1142411231995
> Sleep Time is: 58.883410930634
> Total Time is: 1.1165890693665
> 
> 
> 
> root@beasty:/var/www/cacti.electroteque.org/web# php cmd.php
> 07/29/2008 06:28:14 AM - CMDPHP: Poller[0] Host[5] PING: Host is alive
Which downed host detection is used for that host?

> 07/29/2008 06:28:15 AM - CMDPHP: Poller[0] Host[5] DS[138] CMD: /var/ 
> www/web4/web/scripts/JMXManager/red5manager.sh -h localhost -b  
> java.lang:type=Runtime -c Uptime, output: Uptime:343187794
> 07/29/2008 06:28:15 AM - CMDPHP: Poller[0] Time: 0.5784 s, Theads: N/ 
> A, Hosts: 1
> 
> 
> This command relfects the data for the new datasource, but no file  
> created
cmd.php will NEVER create a new rrd file

> 
> 07/29/2008 06:28:36 AM - POLLER: Poller[0] NOTE: Poller Int: '60',  
> Cron Int: '60', Time Since Last: '86', Max Runtime '58', Poller Runs:  
> '1'
> 07/29/2008 06:28:36 AM - POLLER: Poller[0] WARNING: Cron is out of  
> sync with the Poller Interval!  The Poller Interval is '60' seconds,  
> with a maximum of a '300' second Cron, but 86 seconds have passed  
> since the last poll!
> 07/29/2008 06:28:36 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
> Remote Process [CMD: /usr/bin/spine, ARGS:  0 5]
> 07/29/2008 06:28:36 AM - SYSTEM STATS: Time:0.1094 Method:spine  
> Processes:1 Threads:100 Hosts:2 HostsPerProcess:2 DataSources:0  
> RRDsProcessed:0
> Loop  Time is: 0.11368989944458
> Sleep Time is: 59.88418006897
> Total Time is: 0.11581993103027
> 
> 
> Nothing in here either again
> 
> the path is suppose to be something like this
> 
> <path_rra>/localhost_vmversion_138.rrd
> 
Again, spine will never create an rrd file.
Get more debugging info by running

./spine --verbosity=5 ...

Reinhard

Daniel Rossi wrote:
> On 29/07/2008, at 6:14 AM, Reinhard Scheck wrote:
> 
>> Daniel Rossi wrote:
>>> it gets even more wierd
>>>
>> Sorry to drop in, now.
>> But from a short glance on this discussion, I fear that you've gone  
>> astray.
>>
>> First, you will never see rrdtool action when using cmd.php and/or  
>> spine. They
>> will of course perform the polling but only update table  
>> "poller_output".
>>
>> RRDTool action will only be performed by "poller.php".
>>
>> Pay attention when running poller.php as a "normal" user. It will  
>> create rrd
>> files with those permissions only and "cactiuser" may fail to update  
>> those files
>> subsequently.
>>
>> There are numerous reasons why polling may fail. Find the most  
>> popular issues at
>> http://docs.cacti.net in the HowTo section (HowTo Debug ...)
> 
> Ive been in the docs dozens of times, the howto debug is where i  
> started :)
> 
> So i should be running poller.php like i was so I can debug things as  
> root ?  even as root it doesnt create the rrd files if thats what you  
> mean. 
If you want to create rrd files, you MUST run the poller.php. cmd.php/spine do 
NEVER perform ANY rrd file operation.

> I made a note it did start producing results but only after i  
> changed the timestamp manualy to N in the rrd update command, so  
> running the command line manually seems to update it with something at  
> least, 
That's interesting. If not explicitely stated (and, IMHO, cacti works this way), 
rrdfiles will have a starting date/time of NOW().
For normal operation, this should be ok. Only for "back-dating" this may produce 
errors.
What happens, if you manually run the update statement "as is" (with timestamp) 
against the rrd file? Any error message?

> but the data as i said isnt exactly coming back how i entered  
> it ie 7.87 instead of 100 as the value.
That's another issue. Let's drop it for the moment or read about "rrdtool always 
stores rates" in rrdtool-users mailing list or the rrdtool documentation (It's 
quite a hard task).
> 
> there is still an issue creating new datasources even as root !
Usually, the fact that rrd files are not created is a problem with e.g. the 
target not responding to cacti's "downed host detection".

Reinhard

Cacti draws a juniper loading plot judging by the SNMP generic template.
The value is constant practically always and equal to 74 ~ 75.
In some time, cacti starts to draw an empty plot, but if zoom it, we can
see that the plot exists.


===
Cacti Version 0.8.7b
Cacti OS unix
SNMP Version net-snmp
RRDTool Version RRDTool 1.2.x
Hosts 21
Graphs 506
Data Sources Script/Command: 6
SNMP: 101
SNMP Query: 349
Script Query - Script Server: 103
Total: 559
Poller Information
Interval 60
Type cmd.php
Items Action[0]: 799
Action[1]: 6
Action[2]: 185
Total: 990
Concurrent Processes 20
Max Threads 1
PHP Servers 1
Script Timeout 35
Max OID 40
Last Run Statistics Time:4.4322 Method:cmd.php Processes:20 Threads:N/A
Hosts:22 HostsPerProcess:2 DataSources:990 RRDsProcessed:545
PHP Information
PHP Version 5.2.5
PHP OS FreeBSD
PHP uname FreeBSD monitoring 6.3-RELEASE-p1 FreeBSD 6.3-RELEASE-p1 #0:
Wed Apr 9 12:17:00 MSD 2008
root@monitoring:/usr/obj/usr/src/sys/MYKERNEL3 i386
PHP SNMP Installed
max_execution_time 130
memory_limit 150M

Hi there, im trying to build graphs to graph information from a system  
which produces totals for current total connections (counter), current  
active connections and current max connections. How do i get it on the  
graph so its not calculated as averages but as the actual numbers ? 

>

FYI, when adding new graphs you have to wait a certain ammount of time  
depending on what the interval time is set which is 5 mins or  
something like that. I seriouslly suggest generate them automatically  
or add this comment in the docs somewhere. I am an experience user so  
something has gone wrong there. I waited 5 mins, ran the poller to see  
what output it would have an then the rrd file was generated so sorry  
about the noise.

I am however having issues still with either getting data into the rrd  
or getting it out, the graphs show up nan unless i run rrdtool update  
manually.

I'm pleased to announce that once again Groundwork Open Source [1] has 
provided a means for the Cacti Developers to collaborate in person.

All of the core Cacti Team Members will be meeting the week of Linux 
World [2] from Aug 4th to Aug 7th.  We will be discussing many issues 
and concerns over the days such as fixing bugs, assessing feature 
requests, and setting priorities for the direction of Cacti, as well as 
having philosophical discussions about Canadian beer (inside joke).

Also: we'll be hanging around GroundWork Open Source's booth at 
LinuxWorld (Booth 501) and attending the BayLISA Monitoring SIG banquet 
at 7:30 PM Wednesday, August 8 at a nearby Chinese Restaurant.  All 
Cacti enthusiasts are welcome to that as well; RSVP to Peter Mui, 
pm...@gr....

Happy Graphing!

The Cacti Group

[1] http://www.groundworkopensource.com
[2] http://www.linuxworld.com

On 29/07/2008, at 6:14 AM, Reinhard Scheck wrote:

> Daniel Rossi wrote:
>> it gets even more wierd
>>
>
> Sorry to drop in, now.
> But from a short glance on this discussion, I fear that you've gone  
> astray.
>
> First, you will never see rrdtool action when using cmd.php and/or  
> spine. They
> will of course perform the polling but only update table  
> "poller_output".
>
> RRDTool action will only be performed by "poller.php".
>
> Pay attention when running poller.php as a "normal" user. It will  
> create rrd
> files with those permissions only and "cactiuser" may fail to update  
> those files
> subsequently.
>
> There are numerous reasons why polling may fail. Find the most  
> popular issues at
> http://docs.cacti.net in the HowTo section (HowTo Debug ...)


sorry i forgot to add the output, i add a graph, run cmp.php +  
poller.php

php poller.php
07/29/2008 06:27:10 AM - POLLER: Poller[0] NOTE: Poller Int: '60',  
Cron Int: '60', Time Since Last: '2584', Max Runtime '58', Poller  
Runs: '1'
07/29/2008 06:27:10 AM - POLLER: Poller[0] WARNING: Cron is out of  
sync with the Poller Interval!  The Poller Interval is '60' seconds,  
with a maximum of a '300' second Cron, but 2584 seconds have passed  
since the last poll!
07/29/2008 06:27:10 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
Remote Process [CMD: /usr/bin/spine, ARGS:  0 5]
Waiting on 1/1 pollers.
07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
'ActiveConnections:0' [map ActiveConnections->ActiveConnections]
07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
'TotalConnections:31' [map TotalConnections->TotalConnections]
07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
'MaxConnections:1' [map MaxConnections->MaxConnections]
07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
'ActiveClients:0' [map ActiveClients->ActiveClients]
07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
'TotalClients:31' [map TotalClients->TotalClients]
07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
'MaxClients:1' [map MaxClients->MaxClients]
07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
'ActiveSubscopes:0' [map ActiveSubscopes->ActiveSubscopes]
07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
'TotalSubscopes:0' [map TotalSubscopes->TotalSubscopes]
07/29/2008 06:27:11 AM - POLLER: Poller[0] Parsed MULTI output field  
'MaxSubscopes:0' [map MaxSubscopes->MaxSubscopes]
07/29/2008 06:27:11 AM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool  
update /var/www/web4/web/rra/localhost_activeconnections_137.rrd -- 
template  
ActiveConnections:TotalConnections:MaxConnections:ActiveClients:TotalClients:MaxClients:ActiveSubscopes:TotalSubscopes:MaxSubscopes 
  1217276830:0:31:1:0:31:1:0:0:0
OK u:0.00 s:0.01 r:1.00
07/29/2008 06:27:11 AM - SYSTEM STATS: Time:1.1127 Method:spine  
Processes:1 Threads:100 Hosts:2 HostsPerProcess:2 DataSources:1  
RRDsProcessed:1
Loop  Time is: 1.1142411231995
Sleep Time is: 58.883410930634
Total Time is: 1.1165890693665



root@beasty:/var/www/cacti.electroteque.org/web# php cmd.php
07/29/2008 06:28:14 AM - CMDPHP: Poller[0] Host[5] PING: Host is alive
07/29/2008 06:28:15 AM - CMDPHP: Poller[0] Host[5] DS[138] CMD: /var/ 
www/web4/web/scripts/JMXManager/red5manager.sh -h localhost -b  
java.lang:type=Runtime -c Uptime, output: Uptime:343187794
07/29/2008 06:28:15 AM - CMDPHP: Poller[0] Time: 0.5784 s, Theads: N/ 
A, Hosts: 1


This command relfects the data for the new datasource, but no file  
created

07/29/2008 06:28:36 AM - POLLER: Poller[0] NOTE: Poller Int: '60',  
Cron Int: '60', Time Since Last: '86', Max Runtime '58', Poller Runs:  
'1'
07/29/2008 06:28:36 AM - POLLER: Poller[0] WARNING: Cron is out of  
sync with the Poller Interval!  The Poller Interval is '60' seconds,  
with a maximum of a '300' second Cron, but 86 seconds have passed  
since the last poll!
07/29/2008 06:28:36 AM - POLLER: Poller[0] DEBUG: About to Spawn a  
Remote Process [CMD: /usr/bin/spine, ARGS:  0 5]
07/29/2008 06:28:36 AM - SYSTEM STATS: Time:0.1094 Method:spine  
Processes:1 Threads:100 Hosts:2 HostsPerProcess:2 DataSources:0  
RRDsProcessed:0
Loop  Time is: 0.11368989944458
Sleep Time is: 59.88418006897
Total Time is: 0.11581993103027


Nothing in here either again

the path is suppose to be something like this

<path_rra>/localhost_vmversion_138.rrd

On 29/07/2008, at 6:14 AM, Reinhard Scheck wrote:

> Daniel Rossi wrote:
>> it gets even more wierd
>>
>
> Sorry to drop in, now.
> But from a short glance on this discussion, I fear that you've gone  
> astray.
>
> First, you will never see rrdtool action when using cmd.php and/or  
> spine. They
> will of course perform the polling but only update table  
> "poller_output".
>
> RRDTool action will only be performed by "poller.php".
>
> Pay attention when running poller.php as a "normal" user. It will  
> create rrd
> files with those permissions only and "cactiuser" may fail to update  
> those files
> subsequently.
>
> There are numerous reasons why polling may fail. Find the most  
> popular issues at
> http://docs.cacti.net in the HowTo section (HowTo Debug ...)

Ive been in the docs dozens of times, the howto debug is where i  
started :)

So i should be running poller.php like i was so I can debug things as  
root ?  even as root it doesnt create the rrd files if thats what you  
mean. I made a note it did start producing results but only after i  
changed the timestamp manualy to N in the rrd update command, so  
running the command line manually seems to update it with something at  
least, but the data as i said isnt exactly coming back how i entered  
it ie 7.87 instead of 100 as the value.

there is still an issue creating new datasources even as root !

>
>
> And please see http://forums.cacti.net for more traffic.
>
> There are more hints about understanding RRDTOOL there as well.
>
> Reinhard
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's  
> challenge
> Build the coolest Linux based applications with Moblin SDK & win  
> great prizes
> Grand prize is a trip for two to an Open Source event anywhere in  
> the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> cacti-user mailing list
> cac...@li...
> https://lists.sourceforge.net/lists/listinfo/cacti-user

Daniel Rossi wrote:
> it gets even more wierd
> 

Sorry to drop in, now.
But from a short glance on this discussion, I fear that you've gone astray.

First, you will never see rrdtool action when using cmd.php and/or spine. They 
will of course perform the polling but only update table "poller_output".

RRDTool action will only be performed by "poller.php".

Pay attention when running poller.php as a "normal" user. It will create rrd 
files with those permissions only and "cactiuser" may fail to update those files 
subsequently.

There are numerous reasons why polling may fail. Find the most popular issues at 
http://docs.cacti.net in the HowTo section (HowTo Debug ...)

And please see http://forums.cacti.net for more traffic.

There are more hints about understanding RRDTOOL there as well.

Reinhard

it gets even more wierd

1217274900: 7.3571937667e+01 1.1736094033e+00 0.0000000000e+00  
0.0000000000e+00 1.0000000000e+00 0.0000000000e+00 0.0000000000e+00  
0.0000000000e+00 0.0000000000e+00

this is generated

from the command below, when it should be 100 not 7.37, in cacti its  
showing up as 73.57.

so maybe its something wrong with the ubuntu rrdtool aswell ?

On 29/07/2008, at 5:56 AM, Daniel Rossi wrote:

> it finally started to actually update some of the data anyway, but
> only if i can this via command line
>
>  /usr/bin/rrdtool update /var/www/web4/web/rra/
> localhost_activeconnections_137.rrd --template
> ActiveConnections:TotalConnections:MaxConnections:ActiveClients:TotalClients:MaxClients:ActiveSubscopes:TotalSubscopes:MaxSubscopes
>  N:100:30:2:0:30:1:0:0:0
>
> instead of this which is generated in cacti
>
>  /usr/bin/rrdtool update /var/www/web4/web/rra/
> localhost_activeconnections_137.rrd --template
> ActiveConnections:TotalConnections:MaxConnections:ActiveClients:TotalClients:MaxClients:ActiveSubscopes:TotalSubscopes:MaxSubscopes
>  actualtimestamp:100:30:2:0:30:1:0:0:0
>
>
>
> On 29/07/2008, at 5:09 AM, Daniel Rossi wrote:
>
>>
>> On 29/07/2008, at 4:58 AM, Daniel Rossi wrote:
>>
>>> I spent up to a week trying to get data working before i came  
>>> here, i
>>> consider it a bug how do I report it, there is a few bugs actually.
>>> The rrd files still do not generate, there is alot of noise on the
>>> web
>>> about this problem but no actual fix.
>>
>> I checked out trunk and its still doing it there. I'm running a fast
>> CGI / PHP5 environment if that helps at all.
>>
>>
>> -------------------------------------------------------------------------
>> This SF.Net email is sponsored by the Moblin Your Move Developer's
>> challenge
>> Build the coolest Linux based applications with Moblin SDK & win
>> great prizes
>> Grand prize is a trip for two to an Open Source event anywhere in
>> the world
>> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>> _______________________________________________
>> cacti-user mailing list
>> cac...@li...
>> https://lists.sourceforge.net/lists/listinfo/cacti-user
>
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's  
> challenge
> Build the coolest Linux based applications with Moblin SDK & win  
> great prizes
> Grand prize is a trip for two to an Open Source event anywhere in  
> the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> cacti-user mailing list
> cac...@li...
> https://lists.sourceforge.net/lists/listinfo/cacti-user

it finally started to actually update some of the data anyway, but  
only if i can this via command line

  /usr/bin/rrdtool update /var/www/web4/web/rra/ 
localhost_activeconnections_137.rrd --template  
ActiveConnections:TotalConnections:MaxConnections:ActiveClients:TotalClients:MaxClients:ActiveSubscopes:TotalSubscopes:MaxSubscopes 
  N:100:30:2:0:30:1:0:0:0

instead of this which is generated in cacti

  /usr/bin/rrdtool update /var/www/web4/web/rra/ 
localhost_activeconnections_137.rrd --template  
ActiveConnections:TotalConnections:MaxConnections:ActiveClients:TotalClients:MaxClients:ActiveSubscopes:TotalSubscopes:MaxSubscopes 
  actualtimestamp:100:30:2:0:30:1:0:0:0



On 29/07/2008, at 5:09 AM, Daniel Rossi wrote:

>
> On 29/07/2008, at 4:58 AM, Daniel Rossi wrote:
>
>> I spent up to a week trying to get data working before i came here, i
>> consider it a bug how do I report it, there is a few bugs actually.
>> The rrd files still do not generate, there is alot of noise on the  
>> web
>> about this problem but no actual fix.
>
> I checked out trunk and its still doing it there. I'm running a fast
> CGI / PHP5 environment if that helps at all.
>
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's  
> challenge
> Build the coolest Linux based applications with Moblin SDK & win  
> great prizes
> Grand prize is a trip for two to an Open Source event anywhere in  
> the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> cacti-user mailing list
> cac...@li...
> https://lists.sourceforge.net/lists/listinfo/cacti-user

On 29/07/2008, at 4:58 AM, Daniel Rossi wrote:

> I spent up to a week trying to get data working before i came here, i
> consider it a bug how do I report it, there is a few bugs actually.
> The rrd files still do not generate, there is alot of noise on the web
> about this problem but no actual fix.

I checked out trunk and its still doing it there. I'm running a fast  
CGI / PHP5 environment if that helps at all.