<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: By the power of R, statistical computing at your fingertips</title>
	<atom:link href="http://altentee.com/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/feed/" rel="self" type="application/rss+xml" />
	<link>http://altentee.com/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/</link>
	<description>Performance and Test Automation Experts</description>
	<lastBuildDate>Fri, 13 Aug 2010 04:08:44 +1000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: metric table</title>
		<link>http://altentee.com/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/comment-page-1/#comment-57</link>
		<dc:creator>metric table</dc:creator>
		<pubDate>Mon, 27 Oct 2008 07:06:01 +0000</pubDate>
		<guid isPermaLink="false">http://90kts.com/blog/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/#comment-57</guid>
		<description>great article. I will bookmark this</description>
		<content:encoded><![CDATA[<p>great article. I will bookmark this</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Tim</title>
		<link>http://altentee.com/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/comment-page-1/#comment-56</link>
		<dc:creator>Tim</dc:creator>
		<pubDate>Mon, 28 Apr 2008 02:48:27 +0000</pubDate>
		<guid isPermaLink="false">http://90kts.com/blog/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/#comment-56</guid>
		<description>I&#039;ve had a look at using this from Windows with a WAMP installation. There are a couple of extras you need to do. Firstly install the pre-compiled binaries into your \libraries path for RMySQL and DBI from &lt;a href=&quot;http://stat.bell-labs.com/RS-DBI/download/index.html&quot; rel=&quot;nofollow&quot;&gt;here&lt;/a&gt;

Then copy the libmysqll.dll from D:\wamp\bin\mysql\mysql5.0.51a\bin into your \R\R-2.7.0\library\RMySQL\libs directory.

After that you should be able to run similar reports to those identified above. Substitute the quartz() function (for Mac OSX) to the windows() function for WinXP.

Also instead of using a C:\my.cnf you can also pass in connection properties with your dbConnect call:
&lt;code&gt;con&lt;-dbConnect(m, user=&quot;root&quot;, port=&quot;3306&quot;, host=&quot;myhost&quot;, dbname=&quot;mydb&quot;)&lt;/code&gt;</description>
		<content:encoded><![CDATA[<p>I&#8217;ve had a look at using this from Windows with a WAMP installation. There are a couple of extras you need to do. Firstly install the pre-compiled binaries into your \libraries path for RMySQL and DBI from <a href="http://stat.bell-labs.com/RS-DBI/download/index.html" rel="nofollow">here</a></p>
<p>Then copy the libmysqll.dll from D:\wamp\bin\mysql\mysql5.0.51a\bin into your \R\R-2.7.0\library\RMySQL\libs directory.</p>
<p>After that you should be able to run similar reports to those identified above. Substitute the quartz() function (for Mac OSX) to the windows() function for WinXP.</p>
<p>Also instead of using a C:\my.cnf you can also pass in connection properties with your dbConnect call:<br />
<code>con< -dbConnect(m, user="root", port="3306", host="myhost", dbname="mydb")</code></code></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Tim</title>
		<link>http://altentee.com/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/comment-page-1/#comment-55</link>
		<dc:creator>Tim</dc:creator>
		<pubDate>Fri, 18 Apr 2008 22:53:05 +0000</pubDate>
		<guid isPermaLink="false">http://90kts.com/blog/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/#comment-55</guid>
		<description>Hi Charlie,

I would use Ruby&#124;Perl to open up your existing SiteScope\log files, parse them by line, and then use a &lt;strong&gt;mysqlimport&lt;/strong&gt; statement at the end of the script.

For example, this line in a SiteScope log:
&lt;code&gt;00:03:06 02/23/2008goodIF.1IF Server Ping 0.01 sec2:2216ok10.0100
&lt;/code&gt;

Could be translated into a csv using ruby so that it reads something like:
&lt;code&gt;02-23-2008 00:03:06,good,IF.1,IF Server,Ping,0.01,10.0,100&lt;/code&gt;

Then at the end of your ruby script suck that data into MySql using a puts %x{mysql import command}

I&#039;m doing something similar &lt;a href=&quot;http://90kts.com/blog/2008/formatting-data-for-import-into-loadrunner-analysis/&quot; rel=&quot;nofollow&quot;&gt;here&lt;/a&gt;

A mysql import command on windows looks like this:
&lt;code&gt;mysqlimport -h host -P 3306 -s -u myimportuser --password=mypassword --fields-optionally-enclosed-by=&quot;&quot;&quot; --fields-terminated-by=, --lines-terminated-by=&quot;\r\n&quot; --local perfstats D:\path\to\your\file_created_by_ruby.csv
&lt;/code&gt;
I&#039;ve left some current Ruby scripts that do something very similar at work, so will post them on Monday for you.

I&#039;m tending to use SiteScope less and less though. I hate its lack of flexibility (in presenting data) and I prefer to tweak my own monitors launched via scheduled tasks or cron as appropriate, that way I can control exactly what counters I want, and how they are formatted. For example, its not easy (possible?) to setup a custom DTrace monitor for Solaris using SiteScope, and it&#039;s sometimes easier (to get access) to just ask a remote sysadmin to run a set of native commands he&#039;s used to rather than impose the clunky use of SiteScope -&gt; ssh -&gt; &lt;run out of date generic unix commands&gt; ...
:D

For example, on windows, for batch collection I just use typeperf as in
&lt;code&gt;typeperf -cf D:\monitors\perfcounters.txt -si 55 -sc 5 -s \\%1 -o&lt;/code&gt;

For solaris or *ix, I just use vmstat, iostat and sar mostly via cron. Or other arrangements depending on the system and level of access granted ...

For app servers I use JMX, called via a ruby script as per that previous link I showed you.

I import all that data usually into a MySql database, which you can still use SiteScope as a  reporting tool against that data (if you wish). But like in this article, tools like R let you quickly analyze tons of data, without necessarily worrying about how you set the monitor up in the first place. In other words, I&#039;m leaning towards (and I know some people will hate this approach :)), monitor *everything*, report on select few ... way of doing things...

I&#039;ve even mucked around with a SiteScope &#039;faker&#039; which can re-present data from a MySql database when a LoadRunner controller is running, giving you the perception of live counters during a load test run :) All SiteScope really does is present XML data via a http port 8888 in this case ...

Hmm, too much coffee this morning :)

Cheers,
Tim Koopmans</description>
		<content:encoded><![CDATA[<p>Hi Charlie,</p>
<p>I would use Ruby|Perl to open up your existing SiteScope\log files, parse them by line, and then use a <strong>mysqlimport</strong> statement at the end of the script.</p>
<p>For example, this line in a SiteScope log:<br />
<code>00:03:06 02/23/2008goodIF.1IF Server Ping 0.01 sec2:2216ok10.0100<br />
</code></p>
<p>Could be translated into a csv using ruby so that it reads something like:<br />
<code>02-23-2008 00:03:06,good,IF.1,IF Server,Ping,0.01,10.0,100</code></p>
<p>Then at the end of your ruby script suck that data into MySql using a puts %x{mysql import command}</p>
<p>I&#8217;m doing something similar <a href="http://90kts.com/blog/2008/formatting-data-for-import-into-loadrunner-analysis/" rel="nofollow">here</a></p>
<p>A mysql import command on windows looks like this:<br />
<code>mysqlimport -h host -P 3306 -s -u myimportuser --password=mypassword --fields-optionally-enclosed-by=""" --fields-terminated-by=, --lines-terminated-by="\r\n" --local perfstats D:\path\to\your\file_created_by_ruby.csv<br />
</code><br />
I&#8217;ve left some current Ruby scripts that do something very similar at work, so will post them on Monday for you.</p>
<p>I&#8217;m tending to use SiteScope less and less though. I hate its lack of flexibility (in presenting data) and I prefer to tweak my own monitors launched via scheduled tasks or cron as appropriate, that way I can control exactly what counters I want, and how they are formatted. For example, its not easy (possible?) to setup a custom DTrace monitor for Solaris using SiteScope, and it&#8217;s sometimes easier (to get access) to just ask a remote sysadmin to run a set of native commands he&#8217;s used to rather than impose the clunky use of SiteScope -> ssh -> <run out of date generic unix commands> &#8230; <img src='http://altentee.com/wp-includes/images/smilies/icon_biggrin.gif' alt=':D' class='wp-smiley' /> </p>
<p>For example, on windows, for batch collection I just use typeperf as in<br />
<code>typeperf -cf D:\monitors\perfcounters.txt -si 55 -sc 5 -s \\%1 -o</code></p>
<p>For solaris or *ix, I just use vmstat, iostat and sar mostly via cron. Or other arrangements depending on the system and level of access granted &#8230;</p>
<p>For app servers I use JMX, called via a ruby script as per that previous link I showed you.</p>
<p>I import all that data usually into a MySql database, which you can still use SiteScope as a  reporting tool against that data (if you wish). But like in this article, tools like R let you quickly analyze tons of data, without necessarily worrying about how you set the monitor up in the first place. In other words, I&#8217;m leaning towards (and I know some people will hate this approach <img src='http://altentee.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> ), monitor *everything*, report on select few &#8230; way of doing things&#8230;</p>
<p>I&#8217;ve even mucked around with a SiteScope &#8216;faker&#8217; which can re-present data from a MySql database when a LoadRunner controller is running, giving you the perception of live counters during a load test run <img src='http://altentee.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' />  All SiteScope really does is present XML data via a http port 8888 in this case &#8230;</p>
<p>Hmm, too much coffee this morning <img src='http://altentee.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
<p>Cheers,<br />
Tim Koopmans</run></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Charlie</title>
		<link>http://altentee.com/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/comment-page-1/#comment-54</link>
		<dc:creator>Charlie</dc:creator>
		<pubDate>Fri, 18 Apr 2008 12:20:28 +0000</pubDate>
		<guid isPermaLink="false">http://90kts.com/blog/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/#comment-54</guid>
		<description>Cool, now I&#039;ll have to take another look at R.  I had checked it out briefly about a year ago, but it fell off the radar.

Since I&#039;m using SiteScope to collect performance data, I could have it log into a MySQL DB... now you&#039;ve got me thinking.

How do you get your data into MySQL?</description>
		<content:encoded><![CDATA[<p>Cool, now I&#8217;ll have to take another look at R.  I had checked it out briefly about a year ago, but it fell off the radar.</p>
<p>Since I&#8217;m using SiteScope to collect performance data, I could have it log into a MySQL DB&#8230; now you&#8217;ve got me thinking.</p>
<p>How do you get your data into MySQL?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: tim</title>
		<link>http://altentee.com/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/comment-page-1/#comment-53</link>
		<dc:creator>tim</dc:creator>
		<pubDate>Thu, 06 Dec 2007 04:24:22 +0000</pubDate>
		<guid isPermaLink="false">http://90kts.com/blog/2007/by-the-power-of-r-statistical-computing-at-your-fingertips/#comment-53</guid>
		<description>this is cool</description>
		<content:encoded><![CDATA[<p>this is cool</p>
]]></content:encoded>
	</item>
</channel>
</rss>
