[Webtest] [webtest][JIRA] Closed: (WT-379) Order of tests in report summary doesn't match run order

Marc Guillemot (JIRA) Marc Guillemot (JIRA)" <noreply@canoo.com
Mon, 21 Jan 2008 08:59:27 +0100 (CET)


     [ http://webtest-community.canoo.com/jira/browse/WT-379?page=all ]
     
Marc Guillemot closed WT-379:
-----------------------------

    Fix Version: future versions
     Resolution: Fixed
      Assign To: Marc Guillemot

This should be fixed in build 1650. 

Can you check to confirm?
(as I my java runtime behave differently, I couldn't reproduce the problem)

> Order of tests in report summary doesn't match run order
> --------------------------------------------------------
>
>          Key: WT-379
>          URL: http://webtest-community.canoo.com/jira/browse/WT-379
>      Project: WebTest
>         Type: Bug

>  Environment: 2 different JVM's on AMD-64
> java version "1.5.0_08"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_08-b03)
> Java HotSpot(TM) 64-Bit Server VM (build 1.5.0_08-b03, mixed mode)
> java version "1.6.0_03"
> Java(TM) SE Runtime Environment (build 1.6.0_03-b05)
> Java HotSpot(TM) 64-Bit Server VM (build 1.6.0_03-b05, mixed mode)
>     Reporter: Andrew Ryan
>     Assignee: Marc Guillemot
>      Fix For: future versions

>
> When I execute my webtests, I get a directory with the tests in the order I requested them to run, labeled sequentially "001_DoSomething, 002_DoAnother, 003_MoreTests...". But in the report that gets created at the end of the test run, it seems that the order of the results is somewhat random. Is there any way to insure that the order of the generated report list matches the order that the reports ran in? This would make the reports a lot easier to parse, since sometimes a failure in an early test can impact a later test, and when the order is scattered, this makes it hard to spot those situations.
> Marc G. said:
> ups!
> In fact I never noticed it before: the code producing the overview report wrongly relies on the default order of File.eachDir. This worked just find for me wit different Java runtime but as you noticed, this is not safe.
> Can you open an issue for that?

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://webtest-community.canoo.com/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira