[Webtest] P.S. Like the 'new property tables direction' Re: WebTest digest, Vol 1 #2124 - Msg 5
Gary Fay
Gary Fay <gtf_ctim@yahoo.com>
Tue, 15 Jan 2008 06:06:38 -0800 (PST)
--0-1802219820-1200405998=:45961
Content-Type: text/plain; charset=us-ascii
P.S. I like the direction you are going in with the property table. Keep up the good work
----- Original Message ----
From: Gary Fay <gtf_ctim@yahoo.com>
To: webtest@lists.canoo.com
Cc: mguillemot@yahoo.fr
Sent: Tuesday, January 15, 2008 8:57:12 AM
Subject: Re: WebTest digest, Vol 1 #2124 - 13 msgs
Yes, this is a fairly sophisticated application, ColdFusion with CFC.
We have 12 user categories.
There are 15 major functional areas
There is a sophisticated estimates and costing
There are ordering and approving modules
There are reporting and costing modules
... more ...
This project is probably 30 times bigger than my first (previous) canoo test suite.
The smaller suite was having memory issues, so I am using subant and ant build.xml in the subdirectories.
I am using the fileset, dirset to find and automatically run clean and test targets in ALL subdirectories indescriminatly ...
*My hope was that the subant tasks would help with memory (in addition to increasing allowed memory with Environment variables.)*
- Keeping things in sync is a little painful -
Each module has about 10 visible pages and 3-8 backing objects (CFC) (on average).
I have been using Canoo on an off where I could and like most projects this complicated, stuff gets missed when testing (by hand).
I did have some success with results in subdirectory and ANT move tasks.
I built a summary module that read my runresults.xml file and manully parsed the results to build a directory pass fail module. (counts passed / counts failed)
Red background if count failed > 0, with links to the canoo report in the subdirectories.
(Directory tests like, "user type login and menu verification"; "Create, Approve, Edit Products " ; "Create, Approve, Edit Catalogs"; "Create, Approve, Edit Accounts " ... etc)
When I moved from eclipse to CMD command lines my tests started failing on invoke of the home page. At that point I got the latest version and worked through the install
instructions
I discovered the runner, reasonably nice. I am making some use of the sample app.
Anyway, yes I am expecting hundreds of tests.
--__--__--
Message: 5
Date: Fri, 04 Jan 2008 10:21:44 +0100
From: Marc Guillemot <mguillemot@yahoo.fr>
To: webtest@lists.canoo.com
Subject: Re: [Webtest] How to set up reporting and subprojects
Reply-To: webtest@lists.canoo.com
Reply-To: Marc Guillemot <mguillemot@yahoo.fr>
Hi,
how many tests do you have (do you plan to have)? Unless this is a very
large number, I would rather use the facilities of webtest.xml and
generate a single report.
Cheers,
Marc.
--
Blog: http://mguillem.wordpress.com
Gary Fay wrote:
> Hello,
>
> I am trying to work with Webtest from Canoo, specifically I am trying to
> figure out the best way to organize and run tests AND get the reporting
> to match. (I am trying to figure out the best way to organize thing, and
> I hope the following isn't confusing.
>
> Basically I would like to know, should all reports go to one directory
> outside of the project (sub projects seem to get lost) or should the
> result be in each subproject and be copied or organized in some way
> after the test complete.
>
> (I am fairly light user of ANT and am still learning things about it.
> Setting up directory and filesets seems to be my biggest stumbling block...
> )
>
> It seems like the best way to do this is to divide the project up into
> subproject so that the directories look like the project
>
> for example
> -project
> -users
> -products
> -orders
>
> Would have test code set up like
> -projectTest
> -users
> -sub - build.xml
> -products
> -sub - build.xml
> -orders
> -sub - build.xml
> build.xml (project level file
>
> with build.xml set up in each subproject.
>
> I have the master build.xml file calling clean and test tasks in each
> subproject and was wondering about the reporting ...
> A hardcoded entry such as :
> c:\reports\project\report.xml seems to dump everything into the directory,
>
> it does seem to have a lengthy result.xml and lots of html files but the
> directory structure is not preserved ...
>
> I suppose the copy tasks could be used ....
>
> I wonder if leaving the results in each directory is better?
>
> ( I am not a big user of ant but I love Canoo's reports, I guess I am
> curious how best to set up the structures.)
>
> PS I noticed several years ago performance and maintenance seem easier
> when things are broken up and there is more than one big test script ...)
>
> ------------------------------------------------------------------------
> Be a better friend, newshound, and know-it-all with Yahoo! Mobile. Try
> it now.
> <http://us.rd.yahoo.com/evt=51733/*http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ
>>
Never miss a thing. Make Yahoo your homepage.
____________________________________________________________________________________
Looking for last minute shopping deals?
Find them fast with Yahoo! Search. http://tools.search.yahoo.com/newsearch/category.php?category=shopping
--0-1802219820-1200405998=:45961
Content-Type: text/html; charset=us-ascii
<html><head><style type="text/css"><!-- DIV {margin:0px;} --></style></head><body><div style="font-family:times new roman, new york, times, serif;font-size:12pt"><DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">P.S. I like the direction you are going in with the property table. Keep up the good work<BR><BR>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">----- Original Message ----<BR>From: Gary Fay <gtf_ctim@yahoo.com><BR>To: webtest@lists.canoo.com<BR>Cc: mguillemot@yahoo.fr<BR>Sent: Tuesday, January 15, 2008 8:57:12 AM<BR>Subject: Re: WebTest digest, Vol 1 #2124 - 13 msgs<BR><BR>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> Yes, this is a fairly sophisticated application, ColdFusion with CFC.</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">We have 12 user categories.</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">There are 15 major functional areas</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">There is a sophisticated estimates and costing </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">There are ordering and approving modules</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">There are reporting and costing modules</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">... more ...</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">This project is probably 30 times bigger than my first (previous) canoo test suite.</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">The smaller suite was having memory issues, so I am using subant and ant build.xml in the subdirectories.</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">I am using the fileset, dirset to find and automatically run clean and test targets in ALL subdirectories indescriminatly ...</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">*My hope was that the subant tasks would help with memory (in addition to increasing allowed memory with Environment variables.)*</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">- Keeping things in sync is a little painful -</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">Each module has about 10 visible pages and 3-8 backing objects (CFC) (on average).</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">I have been using Canoo on an off where I could and like most projects this complicated, stuff gets missed when testing (by hand).</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">I did have some success with results in subdirectory and ANT move tasks.</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">I built a summary module that read my runresults.xml file and manully parsed the results to build a directory pass fail module. (counts passed / counts failed)</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">Red background if count failed > 0, with links to the canoo report in the subdirectories.</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">(Directory tests like, "user type login and menu verification"; "Create, Approve, Edit Products " ; "Create, Approve, Edit Catalogs"; "Create, Approve, Edit Accounts " ... etc) </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">When I moved from eclipse to CMD command lines my tests started failing on invoke of the home page. At that point I got the latest version and worked through the install</DIV></DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">instructions</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">I discovered the runner, reasonably nice. I am making some use of the sample app.</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV></DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">Anyway, yes I am expecting hundreds of tests.</DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif"> </DIV>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times, serif">--__--__--<BR><BR>Message: 5<BR>Date: Fri, 04 Jan 2008 10:21:44 +0100<BR>From: Marc Guillemot <<A href="mailto:mguillemot@yahoo.fr" target=_blank rel=nofollow ymailto="mailto:mguillemot@yahoo.fr">mguillemot@yahoo.fr</A>><BR>To: <A href="mailto:webtest@lists.canoo.com" target=_blank rel=nofollow ymailto="mailto:webtest@lists.canoo.com">webtest@lists.canoo.com</A><BR>Subject: Re: [Webtest] How to set up reporting and subprojects<BR>Reply-To: <A href="mailto:webtest@lists.canoo.com" target=_blank rel=nofollow ymailto="mailto:webtest@lists.canoo.com">webtest@lists.canoo.com</A><BR>Reply-To: Marc Guillemot <<A href="mailto:mguillemot@yahoo.fr" target=_blank rel=nofollow ymailto="mailto:mguillemot@yahoo.fr">mguillemot@yahoo.fr</A>><BR><BR>Hi,<BR><BR>how many tests do you have (do you plan to have)? Unless this is a very<BR>large number, I would rather use the
facilities of webtest.xml and<BR>generate a single report.<BR><BR>Cheers,<BR>Marc.<BR>-- <BR>Blog: <A href="http://mguillem.wordpress.com/" target=_blank rel=nofollow>http://mguillem.wordpress.com</A><BR><BR><BR>Gary Fay wrote:<BR>> Hello,<BR>> <BR>> I am trying to work with Webtest from Canoo, specifically I am trying to<BR>> figure out the best way to organize and run tests AND get the reporting<BR>> to match. (I am trying to figure out the best way to organize thing, and<BR>> I hope the following isn't confusing.<BR>> <BR>> Basically I would like to know, should all reports go to one directory<BR>> outside of the project (sub projects seem to get lost) or should the<BR>> result be in each subproject and be copied or organized in some way<BR>> after the test complete. <BR>> <BR>> (I am fairly light user of ANT and am still learning things about it.<BR>> Setting up directory and filesets
seems to be my biggest stumbling block...<BR>> )<BR>> <BR>> It seems like the best way to do this is to divide the project up into<BR>> subproject so that the directories look like the project<BR>> <BR>> for example<BR>> -project<BR>> -users<BR>> -products<BR>> -orders<BR>> <BR>> Would have test code set up like<BR>> -projectTest<BR>> -users<BR>> -sub - build.xml<BR>> -products <BR>> -sub - build.xml<BR>> -orders <BR>> -sub - build.xml<BR>> build.xml (project level file<BR>> <BR>> with build.xml set up in each subproject.<BR>> <BR>> I have the master build.xml file calling clean and test tasks in each<BR>> subproject and was wondering about the reporting ...<BR>> A hardcoded entry such as
:<BR>> c:\reports\project\report.xml seems to dump everything into the directory,<BR>> <BR>> it does seem to have a lengthy result.xml and lots of html files but the<BR>> directory structure is not preserved ...<BR>> <BR>> I suppose the copy tasks could be used ....<BR>> <BR>> I wonder if leaving the results in each directory is better?<BR>> <BR>> ( I am not a big user of ant but I love Canoo's reports, I guess I am<BR>> curious how best to set up the structures.)<BR>> <BR>> PS I noticed several years ago performance and maintenance seem easier<BR>> when things are broken up and there is more than one big test script ...)<BR>> <BR>> ------------------------------------------------------------------------<BR>> Be a better friend, newshound, and know-it-all with Yahoo! Mobile. Try<BR>> it now.<BR>> <<A
href="http://us.rd.yahoo.com/evt=51733/*http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ" target=_blank rel=nofollow>http://us.rd.yahoo.com/evt=51733/*http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ</A><BR>>><BR><BR> </DIV></DIV></DIV><BR>
<HR SIZE=1>
Never miss a thing. <A href="http://us.rd.yahoo.com/evt=51438/*http://www.yahoo.com/r/hs" target=_blank rel=nofollow>Make Yahoo your homepage.</A> </DIV><BR></DIV></div><br>
<hr size=1>Never miss a thing. <a href="http://us.rd.yahoo.com/evt=51438/*http://www.yahoo.com/r/hs"> Make Yahoo your homepage.</a>
</body></html>
--0-1802219820-1200405998=:45961--