[Webtest] Any way to free memory?
Lisa Crispin
webtest@lists.canoo.com
Fri, 22 Apr 2005 17:18:45 +0000
--NextPart_Webmail_9m3u9jl4l_9755_1114190325_0
Content-Type: text/plain
Content-Transfer-Encoding: 8bit
We found the reason for our mysterious problem. The results.xml file was getting huge, it was something like 120 meg, only on our build server (when running the same test on windows, results.xml is 1.3 meg). Writing to the results.xml file was apparently what chewed up the memory.
On only our build server, no where else, when a particular verifyPdfText was executed, a bunch of binary data got written into the result.xml file. The text we were verifying was a string I had copied in from the pdf file. It contained some double quotes which were funky double quotes. It has worked for months just fine, but we just installed a new version of Windward (which generates the pdf files) which uses different itext libraries. I can only think this is the reason. The solution was to take the part of the string with the quotes out of the file.
We have seen other differences in behavior between the pdf files and VerifyPdfText based on platform. But only with this latest version of Windward. We can work around it, it is just mystifying. What would cause binary data to be written to a results.xml file - in the middle of a line, instead of this:
<parameter name="text" value="The name and address of the Administrator can be found on ?Plan Highlights? attachment." />
We got this:
<parameter name="text" value="The name and address of the Administrator can be found on [a bunch of weird binary data, megabytes of it!]
thanks,
Lisa
-------------- Original message from lisa.crispin@att.net (Lisa Crispin): --------------
I will give that a try, thanks.
-- Lisa
-------------- Original message from "Ji Kim" <Ji.Kim@cnet.com>: --------------
Have you tried using separate result files to make them smaller? ( resultfile= in <config>)
I haven't read the mailing list for sometime. I am not up to date what has been changing.
Ji
From: webtest-admin@gate2.canoo.com [mailto:webtest-admin@gate2.canoo.com] On Behalf Of Lisa Crispin
Sent: Thursday, April 21, 2005 5:44 PM
To: webtest@gate2.canoo.com
Subject: [Webtest] Any way to free memory?
We seem to have hit a threshold on our build server (dual processor amd running Red Hat Fedora Core 3, 2 gig memory). When our test suite is running, the java process grows to 1.1 gig, then the suite just seems to hang. It has problems writing results.xml, which has grown to 20meg at this point (when it hangs). We can run the same suite on other machines, it runs to completion, but also the process grows - up to 600 meg on a Windows machine. This would indicate that the damn thing just grows and grows and grows.
Below is an excerpt from our build.xml. We have 43 scripts of various sizes. It would be nice if we could free memory in between each script. Is there a way to do this? We've already bumped up our ant process to 800 meg of memory, and done every suggestion we found in the mailing list archives that seemed relevant.
Please help, we've hit a wall and we are dependent on these tests running every night.
<target name="run-nightly-canoo" depends="canoo-taskdef" description="Runs c
anoo tests in nightly build only (requires running application).">
<delete dir="${resultsPath}"/>
<mkdir dir="${resultsPath}"/>
<ant antfile="${test.webtest.scripts.dir}/PlanEstTourTest.xml"/>
<ant antfile="${test.webtest.scripts.dir}/CSRUpdUserPsw.xml"/>
Thank you!
-- Lisa
--NextPart_Webmail_9m3u9jl4l_9755_1114190325_0
Content-Type: text/html
Content-Transfer-Encoding: 8bit
<html>
<!-- BEGIN WEBMAIL STATIONERY -->
<head></head>
<body>
<!-- WEBMAIL STATIONERY noneset -->
<DIV></DIV>
<DIV>We found the reason for our mysterious problem. The results.xml file was getting huge, it was something like 120 meg, only on our build server (when running the same test on windows, results.xml is 1.3 meg). Writing to the results.xml file was apparently what chewed up the memory. </DIV>
<DIV> </DIV>
<DIV>On only our build server, no where else, when a particular verifyPdfText was executed, a bunch of binary data got written into the result.xml file. The text we were verifying was a string I had copied in from the pdf file. It contained some double quotes which were funky double quotes. It has worked for months just fine, but we just installed a new version of Windward (which generates the pdf files) which uses different itext libraries. I can only think this is the reason. The solution was to take the part of the string with the quotes out of the file. </DIV>
<DIV> </DIV>
<DIV>We have seen other differences in behavior between the pdf files and VerifyPdfText based on platform. But only with this latest version of Windward. We can work around it, it is just mystifying. What would cause binary data to be written to a results.xml file - in the middle of a line, instead of this:</DIV>
<DIV> </DIV>
<DIV><SPAN class=m><FONT color=#0000ff><</FONT></SPAN><SPAN class=t><FONT color=#990000>parameter</FONT></SPAN> <SPAN class=t><FONT color=#990000>name</FONT></SPAN><SPAN class=m><FONT color=#0000ff>="</FONT></SPAN><B>text</B><SPAN class=m><FONT color=#0000ff>"</FONT></SPAN><SPAN class=t><FONT color=#990000> value</FONT></SPAN><SPAN class=m><FONT color=#0000ff>="</FONT></SPAN><B>The name and address of the Administrator can be found on ?Plan Highlights? attachment.</B><FONT color=#0000ff><SPAN class=m>"</SPAN><SPAN class=m> /></SPAN></FONT> </DIV>
<DIV> </DIV>
<DIV>We got this:</DIV>
<DIV><SPAN class=m><FONT color=#0000ff><</FONT></SPAN><SPAN class=t><FONT color=#990000>parameter</FONT></SPAN> <SPAN class=t><FONT color=#990000>name</FONT></SPAN><SPAN class=m><FONT color=#0000ff>="</FONT></SPAN><B>text</B><SPAN class=m><FONT color=#0000ff>"</FONT></SPAN><SPAN class=t><FONT color=#990000> value</FONT></SPAN><SPAN class=m><FONT color=#0000ff>="</FONT></SPAN><B>The name and address of the Administrator can be found on [a bunch of weird binary data, megabytes of it!]</B></DIV>
<DIV><STRONG></STRONG> </DIV>
<DIV><STRONG>thanks,</STRONG></DIV>
<DIV><STRONG>Lisa</STRONG></DIV><BR>
<BLOCKQUOTE style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #1010ff 2px solid">-------------- Original message from lisa.crispin@att.net (Lisa Crispin): -------------- <BR><BR><!-- BEGIN WEBMAIL STATIONERY --><!-- WEBMAIL STATIONERY noneset -->
<DIV></DIV>
<DIV>I will give that a try, thanks.</DIV>
<DIV>-- Lisa</DIV><BR>
<BLOCKQUOTE style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #1010ff 2px solid">-------------- Original message from "Ji Kim" <Ji.Kim@cnet.com>: -------------- <BR><BR><!-- BEGIN WEBMAIL STATIONERY -->
<META content="MSHTML 6.00.2900.2627" name=GENERATOR>
<DIV dir=ltr align=left><SPAN class=915390801-22042005>Have you tried using separate result files to make them smaller? (<!--StartFragment --><FONT face="Times New Roman" size=3> resultfile= in <config>)</FONT></SPAN></DIV>
<DIV><SPAN class=915390801-22042005></SPAN>I haven't read the mailing list for sometime. I am not up to date what has been changing.</DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><SPAN class=915390801-22042005></SPAN><FONT face=Arial><FONT size=2>J<SPAN class=915390801-22042005>i</SPAN></FONT></FONT><BR></DIV>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> webtest-admin@gate2.canoo.com [mailto:webtest-admin@gate2.canoo.com] <B>On Behalf Of </B>Lisa Crispin<BR><B>Sent:</B> Thursday, April 21, 2005 5:44 PM<BR><B>To:</B> webtest@gate2.canoo.com<BR><B>Subject:</B> [Webtest] Any way to free memory?<BR></FONT><BR></DIV>
<DIV></DIV><!-- WEBMAIL STATIONERY noneset -->
<DIV></DIV>
<DIV>We seem to have hit a threshold on our build server (dual processor amd running Red Hat Fedora Core 3, 2 gig memory). When our test suite is running, the java process grows to 1.1 gig, then the suite just seems to hang. It has problems writing results.xml, which has grown to 20meg at this point (when it hangs). We can run the same suite on other machines, it runs to completion, but also the process grows - up to 600 meg on a Windows machine. This would indicate that the damn thing just grows and grows and grows. </DIV>
<DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV>
<DIV>Below is an excerpt from our build.xml. We have 43 scripts of various sizes. It would be nice if we could free memory in between each script. Is there a way to do this? We've already bumped up our ant process to 800 meg of memory, and done every suggestion we found in the mailing list archives that seemed relevant. </DIV>
<DIV> </DIV>
<DIV>Please help, we've hit a wall and we are dependent on these tests running every night.</DIV>
<DIV> </DIV>
<DIV> <target name="run-nightly-canoo" depends="canoo-taskdef" description="Runs c<BR>anoo tests in nightly build only (requires running application)."><BR> <delete dir="${resultsPath}"/><BR> <mkdir dir="${resultsPath}"/><BR> <ant antfile="${test.webtest.scripts.dir}/PlanEstTourTest.xml"/><BR> <ant antfile="${test.webtest.scripts.dir}/CSRUpdUserPsw.xml"/></DIV>
<DIV> </DIV>
<DIV>Thank you!</DIV>
<DIV>-- Lisa</DIV><!-- END WEBMAIL STATIONERY --></BLOCKQUOTE><!-- END WEBMAIL STATIONERY --></BLOCKQUOTE>
<!-- END WEBMAIL STATIONERY -->
</body>
</html>
--NextPart_Webmail_9m3u9jl4l_9755_1114190325_0--