[Webtest] Any way to free memory?
Lisa Crispin
webtest@lists.canoo.com
Mon, 25 Apr 2005 15:56:34 +0000
--NextPart_Webmail_9m3u9jl4l_11264_1114444594_0
Content-Type: text/plain
Content-Transfer-Encoding: 8bit
Hi Marc,
The build server is Linux. LANG is set to en_US.UTF-8.
thanks,
Lisa
-------------- Original message from Marc Guillemot <mguillemot@yahoo.fr>: --------------
> Hi Lisa,
>
> what is the OS of the build server? If Linux (or other unix), what is the value
> of the LANG env variable?
>
> Marc.
>
> Lisa Crispin wrote:
> > We found the reason for our mysterious problem. The results.xml file was
> > getting huge, it was something like 120 meg, only on our build server
> > (when running the same test on windows, results.xml is 1.3
> > meg). Writing to the results.xml file was apparently what chewed up the
> > memory.
> >
> > On only our build server, no where else, when a particular verifyPdfText
> > was executed, a bunch of binary data got written into the result.xml
> > file. The text we were verifying was a string I had copied in from the
> > pdf file. It contained some double quotes which were funky double
> > quotes. It has worked for months just fine, but we just installed a new
> > version of Windward (which generates the pdf files) which uses different
> > itext libraries. I can only think this is the reason. The solution was
> > to take the part of the string with the quotes out of the file.
> >
> > We have seen other differences in behavior between the pdf files and
> > VerifyPdfText based on platform. But only with this latest version of
> > Windward. We can work around it, it is just mystifying. What would
> > cause binary data to be written to a results.xml file - in the middle of
> > a line, instead of this:
> >
> >
> >
> > We got this:
> > :
> > --------------
> >
> > Have you tried using separate result files to make them smaller?
> > ( resultfile= in )
> > I haven't read the mailing list for sometime. I am not up to date what
> has been changing.
> >
> > Ji
> >
> ------------------------------------------------------------------------
> > *From:* webtest-admin@gate2.canoo.com
> > [mailto:webtest-admin@gate2.canoo.com] *On Behalf Of *Lisa Crispin
> > *Sent:* Thursday, April 21, 2005 5:44 PM
> > *To:* webtest@gate2.canoo.com
> > *Subject:* [Webtest] Any way to free memory?
> >
> > We seem to have hit a threshold on our build server (dual
> > processor amd running Red Hat Fedora Core 3, 2 gig memory).
> > When our test suite is running, the java process grows to 1.1
> > gig, then the suite just seems to hang. It has problems writing
> > results.xml, which has grown to 20meg at this point (when it
> > hangs). We can run the same suite on other machines, it runs to
> > completion, but also the process grows - up to 600 meg on a
> > Windows machine. This would indicate that the damn thing just
> > grows and grows and grows.
> >
> > Below is an excerpt from our build.xml. We have 43 scripts of
> > various sizes. It would be nice if we could free memory in
> > between each script. Is there a way to do this? We've already
> > bumped up our ant process to 800 meg of memory, and done every
> > suggestion we found in the mailing list archives that seemed
> > relevant.
> >
> > Please help, we've hit a wall and we are dependent on these
> > tests running every night.
> >
> > > > description="Runs c
> > anoo tests in nightly build only (requires running application).">
> >
> >
> > > > antfile="${test.webtest.scripts.dir}/PlanEstTourTest.xml"/>
> > > > antfile="${test.webtest.scripts.dir}/CSRUpdUserPsw.xml"/>
> >
> > Thank you!
> > -- Lisa
> >
>
> _______________________________________________
> WebTest mailing list
> WebTest@lists.canoo.com
> http://lists.canoo.com/mailman/listinfo/webtest
--NextPart_Webmail_9m3u9jl4l_11264_1114444594_0
Content-Type: text/html
Content-Transfer-Encoding: 8bit
<html>
<!-- BEGIN WEBMAIL STATIONERY -->
<head></head>
<body>
<!-- WEBMAIL STATIONERY noneset -->
<DIV></DIV>
<DIV>Hi Marc,</DIV>
<DIV>The build server is Linux. LANG is set to en_US.UTF-8. </DIV>
<DIV>thanks,</DIV>
<DIV>Lisa</DIV><BR>
<BLOCKQUOTE style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #1010ff 2px solid">-------------- Original message from Marc Guillemot <mguillemot@yahoo.fr>: -------------- <BR><BR><BR>> Hi Lisa, <BR>> <BR>> what is the OS of the build server? If Linux (or other unix), what is the value <BR>> of the LANG env variable? <BR>> <BR>> Marc. <BR>> <BR>> Lisa Crispin wrote: <BR>> > We found the reason for our mysterious problem. The results.xml file was <BR>> > getting huge, it was something like 120 meg, only on our build server <BR>> > (when running the same test on windows, results.xml is 1.3 <BR>> > meg). Writing to the results.xml file was apparently what chewed up the <BR>> > memory. <BR>> > <BR>> > On only our build server, no where else, when a particular verifyPdfText <BR>> > was executed, a bunch of binary data got written into the result.xml <BR>> > file. The text we were verifying was a string I had copied in from the <BR>> > pdf file. It contained some double quotes which were funky double <BR>> > quotes. It has worked for months just fine, but we just installed a new <BR>> > version of Windward (which generates the pdf files) which uses different <BR>> > itext libraries. I can only think this is the reason. The solution was <BR>> > to take the part of the string with the quotes out of the file. <BR>> > <BR>> > We have seen other differences in behavior between the pdf files and <BR>> > VerifyPdfText based on platform. But only with this latest version of <BR>> > Windward. We can work around it, it is just mystifying. What would <BR>> > cause binary data to be written to a results.xml file - in the middle of <BR>> > a line, instead of this: <BR>> > <BR>> > <PARAMETER value="*The name and address of the <BR>> > Administrator can be found on ?Plan Highlights? attachment.*" name="*text*" /><BR>> > <BR>> > We got this: <BR>> > <PARAMETER value="*The name and address of the <BR>> > Administrator can be found on [a bunch of weird binary data, megabytes <BR>> > of it!]* <BR>> > ** <BR>> > *thanks,* <BR>> > *Lisa* <BR>> > <BR>> > -------------- Original message from lisa.crispin@att.net (Lisa <BR>> > Crispin): -------------- <BR>> > <BR>> > I will give that a try, thanks. <BR>> > -- Lisa <BR>> > <BR>> > -------------- Original message from " name="*text*" <Ji.Kim@cnet.com Kim? Ji>: <BR>> > -------------- <BR>> > <BR>> > Have you tried using separate result files to make them smaller? <BR>> > ( resultfile= in <CONFIG>) <BR>> > I haven't read the mailing list for sometime. I am not up to date what <BR>> has been changing. <BR>> > <BR>> > Ji <BR>> > <BR>> ------------------------------------------------------------------------ <BR>> > *From:* webtest-admin@gate2.canoo.com <BR>> > [mailto:webtest-admin@gate2.canoo.com] *On Behalf Of *Lisa Crispin <BR>> > *Sent:* Thursday, April 21, 2005 5:44 PM <BR>> > *To:* webtest@gate2.canoo.com <BR>> > *Subject:* [Webtest] Any way to free memory? <BR>> > <BR>> > We seem to have hit a threshold on our build server (dual <BR>> > processor amd running Red Hat Fedora Core 3, 2 gig memory). <BR>> > When our test suite is running, the java process grows to 1.1 <BR>> > gig, then the suite just seems to hang. It has problems writing <BR>> > results.xml, which has grown to 20meg at this point (when it <BR>> > hangs). We can run the same suite on other machines, it runs to <BR>> > completion, but also the process grows - up to 600 meg on a <BR>> > Windows machine. This would indicate that the damn thing just <BR>> > grows and grows and grows. <BR>> > <BR>> > Below is an excerpt from our build.xml. We have 43 scripts of <BR>> > various sizes. It would be nice if we could free memory in <BR>> > between each script. Is there a way to do this? We've already <BR>> > bumped up our ant process to 800 meg of memory, and done every <BR>> > suggestion we found in the mailing list archives that seemed <BR>> > relevant. <BR>> > <BR>> > Please help, we've hit a wall and we are dependent on these <BR>> > tests running every night. <BR>> > <BR>> > <TARGET name="run-nightly-canoo" <BR depends="canoo-taskdef">> > description="Runs c <BR>> > anoo tests in nightly build only (requires running application)."> <BR>> > <DELETE dir=${resultsPath} /><BR>> > <MKDIR dir=${resultsPath} /><BR>> > <ANT <BR>> > antfile="${test.webtest.scripts.dir}/PlanEstTourTest.xml"/> <BR>> > <ANT <BR>> > antfile="${test.webtest.scripts.dir}/CSRUpdUserPsw.xml"/> <BR>> > <BR>> > Thank you! <BR>> > -- Lisa <BR>> > <BR>> <BR>> _______________________________________________ <BR>> WebTest mailing list <BR>> WebTest@lists.canoo.com <BR>> http://lists.canoo.com/mailman/listinfo/webtest </BLOCKQUOTE>
<!-- END WEBMAIL STATIONERY -->
</body>
</html>
--NextPart_Webmail_9m3u9jl4l_11264_1114444594_0--