[Webtest] Grails Plugin, Test Run Order

Wieland, Erica Wieland, Erica" <Erica_Wieland@sra.com
Wed, 2 Nov 2011 10:27:44 -0400


This is a multi-part message in MIME format.

------_=_NextPart_001_01CC996B.95E03145
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_002_01CC996B.95E03145"


------_=_NextPart_002_01CC996B.95E03145
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

We've noticed that, when running our Canoo tests using the Grails
plugin, that the individual tests seem to run in sort of alphabetical
order with a test file, but not entirely. We need our tests to run in a
consistent order, and I'm puzzled as to what the order actually is, and
how to force the order of tests.

=20

One of the most puzzling orders is this one:

=20

41=20
com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.testZZZDeleteTe
stReturn
<file:///C:\dev-env\projects\registry-nzert\target\test-reports\webtest\
041_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html>=20

42
com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.test003ReportGa
sExported
<file:///C:\dev-env\projects\registry-nzert\target\test-reports\webtest\
042_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html>=20

43
com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.test001StartRet
urnPNG
<file:///C:\dev-env\projects\registry-nzert\target\test-reports\webtest\
043_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html>=20

44
com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.test002ReportGa
sPurchased
<file:///C:\dev-env\projects\registry-nzert\target\test-reports\webtest\
044_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html>=20

45
com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.test004ReportSt
orageAdjustment
<file:///C:\dev-env\projects\registry-nzert\target\test-reports\webtest\
045_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html>=20

=20

I've tried various ways of naming the DeleteTestReturn step, so that it
runs last, and in some of my test files, it does. In most, though,
regardless of what it is named, it runs first. At one point these tests
were running in order 001, 002, 003, 004, then suddenly started running
003, 001, 002, 004.=20

=20

Any ideas for me? What am I missing here?

=20

Erica Wieland

=20


------_=_NextPart_002_01CC996B.95E03145
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta =
http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 =
(filtered medium)"><!--[if !mso]><style>v\:* =
{behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:Tahoma;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
	{mso-style-priority:99;
	mso-style-link:"Balloon Text Char";
	margin:0in;
	margin-bottom:.0001pt;
	font-size:8.0pt;
	font-family:"Tahoma","sans-serif";}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri","sans-serif";
	color:windowtext;}
span.BalloonTextChar
	{mso-style-name:"Balloon Text Char";
	mso-style-priority:99;
	mso-style-link:"Balloon Text";
	font-family:"Tahoma","sans-serif";}
.MsoChpDefault
	{mso-style-type:export-only;
	font-size:10.0pt;
	font-family:"Calibri","sans-serif";}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue =
vlink=3Dpurple><div class=3DWordSection1><p =
class=3DMsoNormal>We&#8217;ve noticed that, when running our Canoo tests =
using the Grails plugin, that the individual tests seem to run in sort =
of alphabetical order with a test file, but not entirely. We need our =
tests to run in a consistent order, and I&#8217;m puzzled as to what the =
order actually is, and how to force the order of tests.<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>One of the =
most puzzling orders is this one:<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>41<img =
width=3D10 height=3D10 id=3D"Picture_x0020_5" =
src=3D"cid:image001.gif@01CC9942.C6543380" alt=3D"Description: ok"><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\we=
btest\041_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html">com.pq=
a.nzert.webtest.PurchasingNaturalGasReturnWebTests.testZZZDeleteTestRetur=
n</a><o:p></o:p></p><p class=3DMsoNormal>42<img border=3D0 width=3D10 =
height=3D10 id=3D"Picture_x0020_4" =
src=3D"cid:image001.gif@01CC9942.C6543380" alt=3D"Description: ok"><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\we=
btest\042_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html">com.pq=
a.nzert.webtest.PurchasingNaturalGasReturnWebTests.test003ReportGasExport=
ed</a><o:p></o:p></p><p class=3DMsoNormal>43<img border=3D0 width=3D10 =
height=3D10 id=3D"Picture_x0020_3" =
src=3D"cid:image001.gif@01CC9942.C6543380" alt=3D"Description: ok"><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\we=
btest\043_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html">com.pq=
a.nzert.webtest.PurchasingNaturalGasReturnWebTests.test001StartReturnPNG<=
/a><o:p></o:p></p><p class=3DMsoNormal>44<img border=3D0 width=3D10 =
height=3D10 id=3D"Picture_x0020_2" =
src=3D"cid:image001.gif@01CC9942.C6543380" alt=3D"Description: ok"><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\we=
btest\044_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html">com.pq=
a.nzert.webtest.PurchasingNaturalGasReturnWebTests.test002ReportGasPurcha=
sed</a><o:p></o:p></p><p class=3DMsoNormal>45<img border=3D0 width=3D10 =
height=3D10 id=3D"Picture_x0020_1" =
src=3D"cid:image001.gif@01CC9942.C6543380" alt=3D"Description: ok"><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\we=
btest\045_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html">com.pq=
a.nzert.webtest.PurchasingNaturalGasReturnWebTests.test004ReportStorageAd=
justment</a><o:p></o:p></p><p class=3DMsoNormal><o:p>&nbsp;</o:p></p><p =
class=3DMsoNormal>I&#8217;ve tried various ways of naming the =
DeleteTestReturn step, so that it runs last, and in some of my test =
files, it does. In most, though, regardless of what it is named, it runs =
first. At one point these tests were running in order 001, 002, 003, =
004, then suddenly started running 003, 001, 002, 004. <o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>Any ideas =
for me? What am I missing here?<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>Erica =
Wieland<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p></div></body></html>
------_=_NextPart_002_01CC996B.95E03145--

------_=_NextPart_001_01CC996B.95E03145
Content-Type: image/gif;
	name="image001.gif"
Content-Transfer-Encoding: base64
Content-ID: <image001.gif@01CC9942.C6543380>
Content-Description: image001.gif
Content-Location: image001.gif

R0lGODlhCgAKAMT/AP///6HstIjnoHnklFbdeD7YZTnXYTPWXC7VWC3VVyjUUxvRSRPQQhLQQQ3P
PQzOPQrOOwjOOQfNOQXNNwPNNQAAAMDAwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEA
ABYALAAAAAAKAAoAQAUmoCWO4jCMh0FaiTAGE7KSw3QWzsDk8+oss9qJwBtIHKsEQ3LqzUIAOwAA
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAACAALAAAAAAKAAoAQAYwQJBw
KBQkhpAHESRBDA+dyJIo6QxADgzBgilMl5jKlNFRgBoYAyjAwSwlFs7i+w0CADs=

------_=_NextPart_001_01CC996B.95E03145--