[Webtest] Grails Plugin, Test Run Order

Dierk König Dierk König
Wed, 2 Nov 2011 22:39:04 +0100


--Apple-Mail-1-512845107
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=windows-1252

Hi Erica,

have a look at the TestSuite class and the suite() method.

You can control the sequence yourself by implementing the suite method.

happy testing
Dierk

Am 02.11.2011 um 15:27 schrieb Wieland, Erica:

> We=92ve noticed that, when running our Canoo tests using the Grails =
plugin, that the individual tests seem to run in sort of alphabetical =
order with a test file, but not entirely. We need our tests to run in a =
consistent order, and I=92m puzzled as to what the order actually is, =
and how to force the order of tests.
> =20
> One of the most puzzling orders is this one:
> =20
> =
41<image001.gif>com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.t=
estZZZDeleteTestReturn
> =
42<image001.gif>com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.t=
est003ReportGasExported
> =
43<image001.gif>com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.t=
est001StartReturnPNG
> =
44<image001.gif>com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.t=
est002ReportGasPurchased
> =
45<image001.gif>com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.t=
est004ReportStorageAdjustment
> =20
> I=92ve tried various ways of naming the DeleteTestReturn step, so that =
it runs last, and in some of my test files, it does. In most, though, =
regardless of what it is named, it runs first. At one point these tests =
were running in order 001, 002, 003, 004, then suddenly started running =
003, 001, 002, 004.
> =20
> Any ideas for me? What am I missing here?
> =20
> Erica Wieland
> =20
>=20
>=20
> 07. - 11. November 2011 | The Westin Grand M=FCnchen Arabellapark
> Treffen Sie unsere Experten bei hochkar=E4tigen Talks und an unserem =
Expo-Stand. Wir freuen uns auf Ihren Besuch!
>=20
> www.jax.de/wjax2011=20


--Apple-Mail-1-512845107
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=windows-1252

<html><head><base href=3D"x-msg://67/"></head><body style=3D"word-wrap: =
break-word; -webkit-nbsp-mode: space; -webkit-line-break: =
after-white-space; ">Hi Erica,<div><br></div><div>have a look at the =
TestSuite class and the suite() method.</div><div><br></div><div>You can =
control the sequence yourself by implementing the suite =
method.</div><div><br></div><div>happy =
testing</div><div>Dierk</div><div><br><div><div>Am 02.11.2011 um 15:27 =
schrieb Wieland, Erica:</div><br =
class=3D"Apple-interchange-newline"><blockquote type=3D"cite"><span =
class=3D"Apple-style-span" style=3D"border-collapse: separate; =
font-family: Helvetica; font-style: normal; font-variant: normal; =
font-weight: normal; letter-spacing: normal; line-height: normal; =
orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: =
none; white-space: normal; widows: 2; word-spacing: 0px; =
-webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: =
0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: =
auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div =
lang=3D"EN-US" link=3D"blue" vlink=3D"purple"><div class=3D"WordSection1" =
style=3D"page: WordSection1; "><div style=3D"margin-top: 0in; =
margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: =
11pt; font-family: Calibri, sans-serif; ">We=92ve noticed that, when =
running our Canoo tests using the Grails plugin, that the individual =
tests seem to run in sort of alphabetical order with a test file, but =
not entirely. We need our tests to run in a consistent order, and I=92m =
puzzled as to what the order actually is, and how to force the order of =
tests.<o:p></o:p></div><div style=3D"margin-top: 0in; margin-right: 0in; =
margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; font-family: =
Calibri, sans-serif; "><o:p>&nbsp;</o:p></div><div style=3D"margin-top: =
0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; =
font-size: 11pt; font-family: Calibri, sans-serif; ">One of the most =
puzzling orders is this one:<o:p></o:p></div><div style=3D"margin-top: =
0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; =
font-size: 11pt; font-family: Calibri, sans-serif; =
"><o:p>&nbsp;</o:p></div><div style=3D"margin-top: 0in; margin-right: =
0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; =
font-family: Calibri, sans-serif; =
">41<span>&lt;image001.gif&gt;</span><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\web=
test\041_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html" =
style=3D"color: blue; text-decoration: underline; =
">com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.testZZZDeleteTe=
stReturn</a><o:p></o:p></div><div style=3D"margin-top: 0in; =
margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: =
11pt; font-family: Calibri, sans-serif; =
">42<span>&lt;image001.gif&gt;</span><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\web=
test\042_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html" =
style=3D"color: blue; text-decoration: underline; =
">com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.test003ReportGa=
sExported</a><o:p></o:p></div><div style=3D"margin-top: 0in; =
margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: =
11pt; font-family: Calibri, sans-serif; =
">43<span>&lt;image001.gif&gt;</span><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\web=
test\043_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html" =
style=3D"color: blue; text-decoration: underline; =
">com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.test001StartRet=
urnPNG</a><o:p></o:p></div><div style=3D"margin-top: 0in; margin-right: =
0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; =
font-family: Calibri, sans-serif; =
">44<span>&lt;image001.gif&gt;</span><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\web=
test\044_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html" =
style=3D"color: blue; text-decoration: underline; =
">com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.test002ReportGa=
sPurchased</a><o:p></o:p></div><div style=3D"margin-top: 0in; =
margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: =
11pt; font-family: Calibri, sans-serif; =
">45<span>&lt;image001.gif&gt;</span><a =
href=3D"file:///C:\dev-env\projects\registry-nzert\target\test-reports\web=
test\045_CompqanzertwebtestPurchasingNaturalG\WebTestReport.html" =
style=3D"color: blue; text-decoration: underline; =
">com.pqa.nzert.webtest.PurchasingNaturalGasReturnWebTests.test004ReportSt=
orageAdjustment</a><o:p></o:p></div><div style=3D"margin-top: 0in; =
margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: =
11pt; font-family: Calibri, sans-serif; "><o:p>&nbsp;</o:p></div><div =
style=3D"margin-top: 0in; margin-right: 0in; margin-left: 0in; =
margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, =
sans-serif; ">I=92ve tried various ways of naming the DeleteTestReturn =
step, so that it runs last, and in some of my test files, it does. In =
most, though, regardless of what it is named, it runs first. At one =
point these tests were running in order 001, 002, 003, 004, then =
suddenly started running 003, 001, 002, 004.<o:p></o:p></div><div =
style=3D"margin-top: 0in; margin-right: 0in; margin-left: 0in; =
margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, =
sans-serif; "><o:p>&nbsp;</o:p></div><div style=3D"margin-top: 0in; =
margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: =
11pt; font-family: Calibri, sans-serif; ">Any ideas for me? What am I =
missing here?<o:p></o:p></div><div style=3D"margin-top: 0in; =
margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: =
11pt; font-family: Calibri, sans-serif; "><o:p>&nbsp;</o:p></div><div =
style=3D"margin-top: 0in; margin-right: 0in; margin-left: 0in; =
margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, =
sans-serif; ">Erica Wieland<o:p></o:p></div><div style=3D"margin-top: =
0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; =
font-size: 11pt; font-family: Calibri, sans-serif; =
"><o:p>&nbsp;</o:p></div></div><br><img =
src=3D"http://www.canoo.com/images/logos/W-JAX/wjax2011_weiss_50px.png" =
alt=3D"W-JAX 2011"><br><p style=3D"font: normal normal normal =
11px/normal Arial, sans-serif; font-size: 13px; color: rgb(0, 0, 0); =
">07. - 11. November 2011 | The Westin Grand M=FCnchen =
Arabellapark<br>Treffen Sie unsere Experten bei hochkar=E4tigen Talks =
und an unserem Expo-Stand. Wir freuen uns auf Ihren Besuch!</p><a =
href=3D"http://jax.de/wjax2011/" target=3D"_blank" style=3D"color: blue; =
text-decoration: none; font: normal normal normal 13px/normal Arial; =
border-top-style: none; border-right-style: none; border-bottom-style: =
none; border-left-style: none; border-width: initial; border-color: =
initial; ">www.jax.de/wjax2011</a><span =
class=3D"Apple-converted-space">&nbsp;</span><br></div></span></blockquote=
></div><br></div></body></html>=

--Apple-Mail-1-512845107--