[Webtest] [webtest][JIRA] Created: (WT-379) Order of tests in report summary doesn't match run order

[Andrew Ryan (JIRA)]

Order of tests in report summary doesn't match run order
--------------------------------------------------------

         Key: WT-379
         URL: http://webtest-community.canoo.com/jira/browse/WT-379
     Project: WebTest
        Type: Bug

 Environment: 2 different JVM's on AMD-64

java version "1.5.0_08"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_08-b03)
Java HotSpot(TM) 64-Bit Server VM (build 1.5.0_08-b03, mixed mode)

java version "1.6.0_03"
Java(TM) SE Runtime Environment (build 1.6.0_03-b05)
Java HotSpot(TM) 64-Bit Server VM (build 1.6.0_03-b05, mixed mode)

    Reporter: Andrew Ryan


When I execute my webtests, I get a directory with the tests in the order I requested them to run, labeled sequentially "001_DoSomething, 002_DoAnother, 003_MoreTests...". But in the report that gets created at the end of the test run, it seems that the order of the results is somewhat random. Is there any way to insure that the order of the generated report list matches the order that the reports ran in? This would make the reports a lot easier to parse, since sometimes a failure in an early test can impact a later test, and when the order is scattered, this makes it hard to spot those situations.

Marc G. said:
ups!
In fact I never noticed it before: the code producing the overview report wrongly relies on the default order of File.eachDir. This worked just find for me wit different Java runtime but as you noticed, this is not safe.

Can you open an issue for that?


-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://webtest-community.canoo.com/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira