[Webtest] [webtest][JIRA] Created: (WT-252) Simplify and extend report file

Marc Guillemot (JIRA) Marc Guillemot (JIRA)" <noreply@canoo.com
Wed, 20 Dec 2006 14:27:58 +0100 (CET)


Simplify and extend report file
-------------------------------

         Key: WT-252
         URL: http://webtest-community.canoo.com/jira/browse/WT-252
     Project: WebTest
        Type: Task

    Versions: 2.1    
    Reporter: Marc Guillemot
 Assigned to: Marc Guillemot 


Standard report mode generates a xml file and saves all received responses in the same directory. This works fine but...

1) report format should be simplified 
for instance 
<step>
  <parameter name="description" value="Enter the application"/>
  <parameter name="label" value="login"/>
  <parameter name="taskName" value="clickLink"/>
  <result>
    <completed duration="1668"/>
   </result>
    ...
could be simplified in something like
<step taskName="clickLink" description="Enter the application" status="completed" duration="1668">
  <parameter name="label" value="login"/>

making xslt selectors easier to write

2) Additional information could be provided in the report like:
- failure cause (more readable than stack trace - which should still be provided -)
- step locations
- unevaluated property values
- javascript warnings & errors

3) it doesn't scale very well
the result of each single test is appended to the result file (what requires complete parsing each time) producing huge result files for larger test suites.
A solution could be to create a subdirectory per <webtest> wich could contain the xml result file as well as all received responses. This would imply modification in the generation of the html reports but would bring more flexibility: possibility to simply delete all results of a single <webtest>, to add the results of an other one, ...

Such changes wouldn't impact user of the standard WebTest stylesheet for report generation but could cause problem to the one who have customized the reports. Depending of the number of persons impacted different ways can be followed:
- just perform the switch when it's ready, users of customized xslt can upgrade once they've adapted their reports
- provide the current report generator separately (for instance on the community site)
- maintain both report modes

Comments are welcome.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://webtest-community.canoo.com/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira