Search This Blog

Tuesday, May 5, 2015

XStudio 2.3: Stable version delivered

XStudio 2.3 is by far the biggest release we've made since XQual was created!

Major features are here:
http://www.xqual.com/support/roadmap.html#v2_3
Here is the list of the major candidate features scheduled for XStudio v2.3:



     New clearer, modern, simpler Graphical User Interface (incl. a new sidebar) [XQU]
     Basic report debugger (to test/debug easily your own custom report XSLTs) [XQU]
     New statistics piecharts/stackcharts on ALL the containers/folders in Requirements, Specifications, Tests and Bugs tree:
          - Status, Priority, Severity and Risk breakouts
     User preferences allowing to select/save/restore for each user: [ALL]
          - The last main window position/dimension
          - The last split positions for each tree
          - Which columns to display for each tree
     Custom fields on Tests + Test cases (rather than just test cases) [SUP][MEC]
     Add user's title to repect ISO session report format [PRE]
     Inner links in between requirements/specifications [THO]
     Option to execute a session on ANY agent [SMA]
     Risk Analysis module [AFR][ALL]
     TestNg Launcher: support for methods calls [AGE]
     SUT description [SMA]
     Bug prefilling when creating a bug from a manual test execution [ALL]
     Merge: when all the source sessions are under the same campaign, generate the merged there by default [SMA]
     Copy testcase in a different test [ORS]
     Improved JUnit launcher (to log any custom message generated by the script) [AKK]
     New Sikuli launcher for Sikuli 1.1.0/SikuliX [AKK]
     New FitNesse launcher [AKK]
     New Robot Framework launcher [AFR]
     User's title (customizable in a dedicated table) [PRE]
     Import of assets [THO]
     Ability to search by id also Teams, Schedules, Projects, Sprints, Categories and Companies
     Preset the not-executable test and test cases before the session is started
     Headless XAgent [ACP]
     Ability to run an automated test manually [AKK]
     Import tests: import both attributes, params and test/testcase's custom fields [CSC][THO]
     Customization in the user preferences of
          - The default size of the fonts in the GUI [AFR]
          - The default choice when downloading a files that already exists locally: overwrite, skip or ask user [THO] [ACT]
     The authentication Third-party connectors configuration can be overwriten per user (in the user preferences) [AFR]
     Import Test: support test custom fields, testcase custom fields, test attributes and params [THO]
     QC/ALM bug-tracking connector (still experimental) [AFR]

Refactored module to automatically select some requirements/tests (i.e. while creating a campaign) using 4 different "helpers":

    1) Ability to create or reuse an existing stored filter based on test's properties, attributes etc.
    2) Ability to select 1 or N SUTs (all requirements or tests linked to these SUTs will be automatically selected)
    3) Ability to select 1 or N requirements (all tests linked to these requirements will be automatically selected)
    4) Ability to select 1 or more assets (all tests linked to at least one of these assets will be automatically selected)
    All above filtering can be cumulated/executed several times to refine the selection.
    When cumulating filterings, a widget allows picking the rule to apply: AND or OR [SMA]

Plus many improvments on the assets management [THO]:

     Create Session: when the user selects N assets, give the option to create N sessions (1 session per asset)
          ("Create one session per asset" checkbox in the create wizard + asset name in the session name)
     Display in the tabular_manual.jar, tabular_step_manual.jar and tree_step_manual.jar launchers the information about
          the session itself (incl. the assets, the attachments, the operator and the SUT)
     Display in the tabular_manual.jar, tabular_step_manual.jar and tree_step_manual.jar launchers the test's assets
     Add the assets information in the Test and Session reports (incl. description, screenshots etc.)
     Import some assets from Excel
     Set the non-executable tests at session creation time so BEFORE the session is actually started.
     When modifying the assets in a session and if the session has not yet been executed, update the not-executable tests.


Here are the complete list of changes from 2.2sp4:
http://www.xqual.com/support/changelog.html

2.3
   * Connectors to third-party systems: ability to populate automatically the bug's name & description
     (editable of course) when creating it from a compatible manual launcher:
     - Integrated (was already available)
     - JIRA (new)
     - Bugzilla (new)
     - Mantis (new)
     - Trac (new)
   * When creating a bug directly from a test results, populate its name (editable).
   * QC Connector
   * Rename Kalistick to Kalistick/Coverity Test Advisor
   * New RobotFramework launcher (robot_framework_v2.jar)
     - support for running tests (rather than testsuites)
     - optional arguments
     - selectable extension (.txt or .robot)
   * 2 new parameters in the settings defining the max size of the attachments:
     - on standard items (SUT, requirements, tests etc.)
     - on test executions (uploaded by the launchers)
   * Nicer icon for the "Edit button" on third-party (JIRA, Clearquest, Mantis etc.) bugs
   * XContinuousIntegration: ability to provide a static name for the report
   * Bug-fix:
     - With Clearquest/VersionOne/Bugzilla/JIRA/QC bug-tracking connectors, if you create a bug while executing
       manual test and you cancel the project selection a NPE is generated.
     - When previewing/generating combinations using the pairwise/regular algorithm with both valid and invalid
       values and when some are null/empty an exception may occur
     - RobotFramework launcher, XML report deleted after the first testcase hence corrupting the next results.
     - Exception while trying to refresh a requirement tree under a coverage section when the requirements are
       connected with a third-party requirement management system
     - Create team: when the Manual folder is not selected, a suggestion popup is displayed to do so
     - When some campaigns/sessions contains only not executable tests and if you selected "ignore not-executable
       in progress and quality metrics", some exception may be thrown when caculating quality metrics.
     - Test execution's messages not rendered as HTML when they contains [b], [u] etc.
     - Exception after saving the conf locally (from a web serveur)

2.3b3
   * Add 2 parameter in the server settings to check or not the requirement and bugtracking connector before
     the user preferences are applied
   * Allows to have some incomplete third-party connector settings and force the user to set the missing
     parts in it user preference - i.e. username/password so that each user connects with his own credentials
   * Requirement and Test filters:
     - support filter on names
     - support the "contains" filter (i.e. "name contains 'abc'")
   * Report's source XML files include revision and date of the main targetted objects (requirements,
     specifications, tests, test cases and defects)
   * Bug-fix:
- SUT:
  . Results > Requirements/Specifications: depending on "ignore NA in progress and quality metrics",
    . Display or hide the NA in the tree (considered then as NE)
    . Compute requirements/specifications quality accordingly
  . Results > Tests          : show the latest results ignoring or not the NA (depending on "ignore NA
                               in progress and quality metrics")
  . Results > Testcases/steps: show the latest results ignoring or not the NA (depending on "ignore NA
                               in progress and quality metrics")
- Test Tree Category/Folder/Root:
  . Results > Tests          : show the latest results ignoring or not the NA (depending on "ignore NA
                               in progress and quality metrics")
  . Results > Testcases/steps: show the latest results ignoring or not the NA (depending on "ignore NA
                               in progress and quality metrics")
- Campaign Tree Folder:
  . Results > Tests          : show the latest results ignoring or not the NA (depending on "ignore NA
                               in progress and quality metrics")
  . Results > Testcases/steps: show the latest results ignoring or not the NA (depending on "ignore NA
                               in progress and quality metrics")
- CPanel_Campaign:
  . Results > Requirements/Specifications: depending on "ignore NA in progress and quality metrics",
    . Display or hide the NA in the tree (considered then as NE)
    . Compute requirements/specifications quality accordingly
  . Results > Tests          : show the latest results ignoring or not the NA (depending on "ignore NA
                               in progress and quality metrics")
  . Results > Testcases/steps: show the latest results ignoring or not the NA (depending on "ignore NA
                               in progress and quality metrics")
- CPanel_CampaignSession:
  . Results > Tests          : do not filter NE or NA results
  . Results > Testcases/steps: do not filter NE or NA results    
- tree_step_manual launcher: first node not automatically selected
- tree_step_manual launcher: when resetting all the results at once, currently selected node is not
 updated
- QTP/UFT launcher: couldn't close properly the test with UFT (as UFT does not support / in test path)
- Incorrect sample import file "import_assets.xls"
- With the "any agent" option selected, with tabular_step_manual launcher:
      . Results may not be restored when reexecuting
      . Reset all results may not work at all
- Typos in french translation
- Couldn't create a session or a schedule with the community edition
- NPE when trying to reference a reusable testcase in a test forgetting to select one
- Don't display anymore the "new version available" screen if currently running a beta
- Silulix launcher:
 . Generate all the output on the console (to make debug easier)
 . Parse timestamp in the log (i.e. [log (2.4.2015 22:57:59)] xxxx to export this information in the
   messages in XStudio
- Missing localization when creating a custom field with no default value

2.3b2sp1
   * Bug-fix:
     - Critical: XStudio/XAgent does not start in certain cases
   
2.3b2
   * Offline mode to skip the search for update from Internet (with commercial versions)
   * Headless XAgent (option "--headless true" in the command line or similra in the .jnlp)
   * Last login name remembered on each computer
   * Ability to execute a session (or an individual test) forcing using a specific launcher and a specific
     configuration (this can be useful for instance to temporarily execute an automated test manually).
     Feature available only with XStudio Business+ and with a specific right to do so in the user profile.
   * Customizable font size in the user preferences
   * User preferences: preferred rule when downloading some files that already exist: overwrite, skip or ask
   * Overloading of most of the connector's parameters in user preferences so that each user can provide
     his own credentials for instance. Each user can also choose which projects, status to filter etc.
   * All configurations are now sorted by default (including user preferences in database)
   * Import tests/testcases from Excel: ability to import test's custom field values, test attributes values
     and testcase's custom fields values !
   * Custom sidebar also in the UserGroup Access Rights panel
   * A few icons slightly improved
   * New (faster) way to select testcases in a testcase sub-tree
   * Bug-fix:
     - Quality index in the SUT tree was incorrect (considering only the last executed result even if the last
       result was "Not Executed")
     - When using agent with alias, a warning is displayed stating that the agent is not reachable.
     - Allway dashboard API getChannel() XML format error
     - Cast exception with the tree_step_manual launcher in some rare configurations
     - Create SUT > edit requirement filter > NPE
     - Sikulix launcher couldn't parse the "debug level" parameter
     - Sikulix launcher: "Opt. argument" parameter should NOT be marked as mandatory (!)
     - Sikulix parser of the sikuli traces

2.3b1
   * New design (new flat icons, new colors, new side bar, clearer layout, simpler GUI, better alignments etc.)
   * Risk Analysis module (wizard + manual setting, included in Search panel, reports and requirement filters)
   * Custom fields on tests and (different) custom fields on test cases
   * "ANY agent" option when creating a session (or a schedule) so that ANY agent on the network can execute
     the session
   * New statistics panel on:
     - Requirement folders (status, priority, risk break out)
     - Specification folders (status, priority break out)
     - Test folders (status, priority, testcase# break out)
     - Defect folders (status, priority, severity break out)
   * Inner relationships in between requirements
   * Inner relationships in between specifications
   * Robot Framework launcher (final)
   * Import Assets from Excel
   * User preferences: ability to overwrite some server settings on a per-user basis + save automatically some
     data such as:
     - The last main window position/dimension          
     - The last split pane positions for each tree
     - Which columns to display for each tree
   * Ability to copy a test case in a different test
   * Refactored module to automatically select some requirements/tests (i.e. while creating a campaign) using
     4 different "helpers":
- Ability to create or reuse an existing stored (test or requirement) filter based on:
  . test's properties, priority, attributes etc.
  . requirement's priority, risk etc.
- Ability to select 1-N SUTs (all requirements or tests linked to these SUTs will be ticked)
- Ability to select 1-N requirements (all tests linked to these requirements will be ticked)
- Ability to select 1 or more assets (all tests linked to at least one of these assets will be
  automatically selected)
- All above filtering can be cumulated/executed several times to refine the selection.
     - When cumulating filterings, a widget allows picking the rule to apply: AND or OR  
   * New XReportDebugger tool allowing to test easily custom XSLT reports
   * Test and requirement filters:
     - remove the type column which is useless
     - when adding a new expression, expand the parent and reselect the parent so that it's possible to
       recreate a new expresion without any additional click
     - when editing an expression, reselect it after the modification has been submitted
   * Add a title to the user (customizable in a specific table) to meet ISO's report format requirements
   * SUT rich-text description field
   * Option to create a session per asset (i.e. if you selected several environments you may want to generate
     1 session per environment)
   * Ability to search by id Teams, Schedules, Projects, Sprints, Categories and Companies
   * TestNg launcher: support for class + methods (test=class + testcase=method)
   * New FitNesse launcher
   * New Sikulix launcher
   * Collapsible panel containing all the session information (operator, SUT, attachments and assets) on:
     - tabular_manual launcher
     - tabular_step_manual launcher
     - tree_step_manual launcher
   * Display in the tabular_manual.jar, tabular_step_manual.jar and tree_step_manual.jar launchers the test's
     assets
   * Add the assets information in the Test and Session reports (incl. description, screenshots etc.)
   * Set the non-executable tests at session creation time so BEFORE the session is actually started
   * When modifying the assets in a session and if the session has not yet been executed, update the
     not-executable tests.
   * Improved copy process:
     - Copy SUT:           also links the new SUT with the source SUT's linked requirements
     - Copy requirement:   also links the new requirement with the source requirement's linked specifications
                           (or tests)
     - Copy specification: also links the new specification with the source specification's linked tests
     - Copy test:          also links the new test with the source specifications (or requirements)
     - The same applies when copying entire folders
   * Custom fields, Attributes, Params panels: always pre-select a default item so that the edit button
     does something by default
   * After editing a test case custom field, refresh the asset tree (in case there is a currently selected
     reusable test case)
   * After editing a reusable test case, also refresh the test tree (in case there is a currently selected
     test case referring this reusable test case)
   * Search tests and test cases: ability to use test and test cases custom fields as search criteria
   * Add the test and test case's custom fields in the testplan, SUT and Session paper reports
   * Add the assets information in the Test and Session reports (incl. description, screenshots etc.)
   * Merge: when all the source sessions are under the same campaign, create the merged session under this
     campaign (do NOT create a new campaign then)
   * JavaFX capabilities
   * Anchors in lists use the same mechanism than the "search by id" widget (more robust)
   * Possibility to add custom Java option in the JNLP
   * MariaDb JDB driver included by default in the REST API Server to make deployment easier
   * Attachment: prefix changed to "AT_"
   * Default configuration for manual launchers (in new installation)
   * Include the import samples in the distribution
   * Bug-fix:
     - When refining a requirement local coverage, SUT tree should be refreshed
     - When refining a specification local coverage, SUT + Requirement trees should be refreshed
     - Test dependencies: protection against selecting source test as destination test
     - Removed useless "Custom fields" panel on Assets tree
     - When there is a %20 (space), %2f/%2F (slash) in a anchor/URL/link in rich-text, the link may not work
     - In some specific cases, when clicking on an internal anchor (i.e. in a results grid) pointing to a
       test case or an external URL (i.e. in an email notification), the redirection did not work
     - NullPointerException when running XReportDebugger with a custom company logo
     - Empty folder needs Delete folder rights
     - Track the changes when emptying a folder
     - JUnit launcher save the trace file in TestRootPath to avoid any potential issue with invalid/not-writable
       test canonical path
     - Test filter: shouldn't be able to add an expression at root level
     - When modifying the option about which agent can execute a schedule, the change may not have been saved

Wednesday, January 29, 2014

XStudio 2.0: Screen capture function is delivered

It has never been as easy to create and embed some screen captures in your rich texts.

3 modes are available:

- selectable areas: just move/resize a semi-transparent frame wherever you want on your screen(s) to select exactly what you want to capture and click on the "Camera" button:



Note that you can specify a scale ratio to resize 100% automatically all the screen captures you're doing:



- One of the screen connected on the computer. If you have let's say 2 screens on your computer, just click on the Screen1 or Screen2 button and the image of the full screen is automatically embedded in the text you're editing: yes! 1 click only!

- All the screens. By clicking on this button you automatically insert an image containing ALL your connected screens.

This is available in ALL the rich-text editors in XStudio 2.0.

This will save hours when you edit your test case steps/expected results or when you'll create some bugs!!!

XStudio 2.0: Released with the TimeShifting feature!

XStudio 2.0 is a major achievement!

Not many test management solutions include a way to get back in the past on their whole traceability matrix and none is doing it as well as XStudio 2.0.

The GUI is just simple:




  • 2 buttons to create or delete TimeTags (that's the name you give to a "synchronization point").
  • 1 drop-down menu to select which TimeTag you want to synchronized to

That's it!

The latest versions of all your SUTs, requirements, tests etc. are obtained by just leaving the drop-down menu set to its default value: LATEST:



Do you know an easier/more powerfull way to go back in time?

Monday, October 14, 2013

XStudio 2.0: What about filtering and sorting?

Yes, what about filtering?

It's nice to have metrics (and XStudio provides a lot of them) but it's even better to extract some data under specific focus. And nothing's best than filtering and sorting to dig through large list of items.

Hence XStudio 2.0 includes a new simple but very effective/powerful filtering/sorting mechanism.

Here is how it looks like for instance when you select a SUT and get all the latest results obtained on this SUT (test and test case levels):



On tests, you can filter items based on ANY columns.
This includes the optional columns that you may add to the grid:



At test case level, you're able to add columns corresponding to the custom fields you defined.

Of course you can also sort (ascending or descending) the items by just clicking on the header of a column. Of course, the sorting applies on the filtered output.

Note: the filtering on string uses the very powerful Regular Expression syntax. This allows defining some very complex searches but also simple ones using some basic syntax such as: