Our documentation site has been updated to AIO Tests Knowledge Base
Release Notes
New features, enhancements and minor bug fixes are listed below for each release done so far for AIO Tests.
25th Feb, 2024 → Data Center: V4.6.0.0
Checkout this video to get a glimpse of key features in this release
New Features
New Report: Multi Cycle Execution Comparison report added to compare execution results across Cycles.
Email subscription for reports: Users can now subscribe and receive their saved reports via email at a set schedule (Daily/Monthly etc.).
AI Assistant - BETA: AI integration with AIO Tests has been introduced which will enable users to generate sample test cases with help of AI.
Enhancements
Show percentages in reports:
Percentage values will be shown now along with the count for all the Run status columns in the grid for Multi Cycle Execution Summary and Multi Cycle Execution Distribution reports.
Pending %age column added to Execution burndown report to show percentage of pending cases.
Note: Percentage value will only be shown for non-zero values.
Performance enhancements: Multi Cycle Execution Summary and Multi Cycle Execution Detail Reports have been enhanced for better performance.
Archived indicators in Reports/Gadgets - Reports/gadgets will now also show indicator for Archived Cases and Cycles.
Robot 7.0 is supported now for importing automation results using Robot framework.
Users will now be able to specify/update Folder for cases creation while importing automation results.
Dataset parameter values limit for 255 characters removed.
Cycle Execution enhancements:
Full screen view option added for a better experience while working on Cycle Execution.
Comments and attachments icons added at Case level to show all Comments/attachments attached to the case.
Performance enhancements for Run status updates.
Minor Bug Fixes
Automatic assignment of cases to happen only for Unassigned cases.
3rd Feb, 2024 → Cloud: v4.6
Checkout this video to get a glimpse of key features in this release
New Features
New Report: Multi Cycle Execution Comparison report added to compare execution results across Cycles.
Email subscription for reports: Users can now subscribe and receive their saved reports via email at a set schedule (Daily/Monthly etc.).
Enhancements
Show percentages in reports:
Percentage values will be shown now along with the count for all the Run status columns in the grid for Multi Cycle Execution Summary and Multi Cycle Execution Distribution reports.
Pending %age column added to Execution burndown report to show percentage of pending cases.
Note: Percentage value will only be shown for non-zero values.
Performance enhancements: Multi Cycle Execution Summary and Multi Cycle Execution Detail Reports have been enhanced for better performance.
Archived indicators in Reports/Gadgets - Reports/gadgets will now also show indicator for Archived Cases and Cycles.
Robot 7.0 is supported now for importing automation results using Robot framework.
Users will now be able to specify/update Folder for cases creation while importing automation results.
Dataset parameter values limit for 255 characters removed.
Cycle Execution enhancements:
Full screen view option added for a better experience while working on Cycle Execution.
Comments and attachments icons added at Case level to show all Comments/attachments attached to the case.
Performance enhancements for Run status updates.
Minor Bug Fixes
Automatic assignment of cases to happen only for Unassigned cases.
17th January, 2024 → Server: v4.5.0 & Data Center: v4.5.0.0
New Features
Run Step assignments: Users will now be able to assign users at step level.
Note: Run step assignments can be controlled at Project level and Case level.
Import automation results using Robot Framework is also supported now.
New API has been introduced for importing automation results as a batch process.
Folder Permissions: New Project Level Permissions added for Folders Creation/Renaming/Move/Deletion.
New APIs:
Update Cycle State API has been added for updating a cycle as Closed or Locked.
Update an Existing Cycle API has been added for updating details of an existing cycle.
Enhancements
Select List custom fields limit increase: Allowed list values limit for Single/Multi select list type/Color custom fields has been increased from 200 to 500.
Excel cases export enhanced to show full folder hierarchy in Folder field.
BDD/Gherkin cases: Copy Steps and Duplicate Steps options added.
Jira Panel - Execution Summary screen enhanced to show Case Title.
Multi cycle Execution Detail report enhancements:
Case and Run RTF fields (Case Description, Case Precondition & Multi line text Custom Fields) have been added to the column selector.
Note: Attachments (if any) for above fields will not be shown.Case key link will take user to the Run in the cycle instead of Case.
Public APIs Enhancements:
Get Cycle Summary API enhanced to show Total Runs count.
Upload and Attach attachments to Cycle RTF Fields API enhanced to attach attachments in the Objective and RTF custom fields.
Get Cycle Details API enhanced to fetch Attachments associated with cycle (Cycle, Objective and RTF Custom fields).
Minor Bug Fixes
Cycle creation issue from Jira panel.
Issue with Cycle load having a huge total Actual effort value.
New Line issue after a parameter name.
Text wrapping issue for long parameter values.
23rd December, 2023 → Cloud: v4.5
New Features
Run Step assignments: Users will now be able to assign users at step level.
Note: Run step assignments can be controlled at Project level and Case level.
Import automation results using Robot Framework is also supported now.
New API has been introduced for importing automation results as a batch process.
Enhancements
Select List custom fields limit increase: Allowed list values limit for Single/Multi select list type/Color custom fields has been increased from 200 to 500.
Minor Bug Fixes
Cycle creation issue from Jira panel.
Issue with Cycle load having a huge total Actual effort value.
2nd December, 2023 → Cloud: v4.4.4
New Features
Folder Permissions: New Project Level Permissions added for Folders Creation/Renaming/Move/Deletion.
New APIs:
Update Cycle State API has been added for updating a cycle as Closed or Locked.
Update an Existing Cycle API has been added for updating details of an existing cycle.
Enhancements
Excel cases export enhanced to show full folder hierarchy in Folder field.
BDD/Gherkin cases: Copy Steps and Duplicate Steps options added.
Jira Panel - Execution Summary screen enhanced to show Case Title.
Multi cycle Execution Detail report enhancements:
Case and Run RTF fields (Case Description, Case Precondition & Multi line text Custom Fields) have been added to the column selector.
Note: Attachments (if any) for above fields will not be shown.Case key link will take user to the Run in the cycle instead of Case.
Public APIs Enhancements:
Get Cycle Summary API enhanced to show Total Runs count.
Upload and Attach attachments to Cycle RTF Fields API enhanced to attach attachments in the Objective and RTF custom fields.
Get Cycle Details API enhanced to fetch Attachments associated with cycle (Cycle, Objective and RTF Custom fields).
Minor Bug Fixes
New Line issue after a parameter name.
Text wrapping issue for long parameter values.
28th November, 2023 → Server: v4.4.3, Data Center: v:4.4.3.0
New Features
My Work: Recently Accessed section on Overview page has now been renamed to ‘My Work’ and Cycles tab has been enhanced to enable users to see more information about the cycles they are working on or recently worked on.
The activity trends are now clubbed at the top and users have the option to collapse them
Execution Status Highlight options: Users will now be able to choose different colors to be set for different execution statuses.
Bulk Edit Sets and Cycles: Users will now be able to Bulk Edit Sets and Cycles in addition to other bulk actions.
Language Support: AIO Tests now supports French and German language.
Enhancements
Re-order Columns: Users will be now able to choose display order of columns for different Entities via Order option in Column selector.
PDF Export enhancements: PDF export of cases has been enhanced to preserve Rich Text Formatting and show attachments as links.
Edit Parameter Names: Users will now be able to edit parameter names for Data parametrized cases.
A new button ‘Collapse All Runs’ has been introduced on Cycles Execution tab to collapse all expanded runs in one go.
Users will now be able to Export Preconditions and Estimated effort as well while Exporting Steps and update the same while Importing Edited steps.
Single / Multi-select and Color custom fields will be alphabetically sorted for the following reports - Case distribution, Automation coverage, Execution distribution, Run distribution.
Support options clubbed together: Help and settings menu option on top right on Overview page have been re-arranged for better accessibility.
Title for cases will now show as wrapped up for longer titles.
Minor Bug Fixes
Users can now right-click and open the top navigation bar options in new tabs
Notifications will show up for unsaved comments on Case detail view
Incorrect handling of empty data set values while importing results
Linked steps to be collapsed by default on Cycles Execution
Scroll bar issue for Case steps screen
19th November, 2023 → Cloud: v4.4.3
Enhancements
AI Assistant - BETA: OpenAI model upgrade for better performance.
Minor Bug Fixes
Linked steps to be collapsed by default on Cycles Execution.
Scroll bar issue for Case steps screen.
Few AI fixes.
4th November, 2023 → Cloud: v4.4.2
New Features
AI Assistant - BETA: AI integration with AIO Tests has been introduced which will enable users to generate sample test cases with help of AI.
My Work: Recently Accessed section on Overview page has now been renamed to ‘My Work’ and Cycles tab has been enhanced to enable users to see more information about the cycles they are working on or recently worked on.
The activity trends are now clubbed at the top and users have the option to collapse them
Execution Status Highlight options: Users will now be able to choose different colors to be set for different execution statuses.
Bulk Edit Sets and Cycles: Users will now be able to Bulk Edit Sets and Cycles in addition to other bulk actions
Language Support: AIO Tests now supports French and German language
Enhancements
Re-order Columns: Users will be now able to choose display order of columns for different Entities via Order option in Column selector.
PDF Export enhancements: PDF export of cases has been enhanced to preserve Rich Text Formatting and show attachments as links.
Edit Parameter Names: Users will now be able to edit parameter names for Data parametrized cases.
A new button ‘Collapse All Runs’ has been introduced on Cycles Execution tab to collapse all expanded runs in one go.
Users will now be able to Export Preconditions and Estimated effort as well while Exporting Steps and update the same while Importing Edited steps.
Single / Multi-select and Color custom fields will be alphabetically sorted for the following reports - Case distribution, Automation coverage, Execution distribution, Run distribution
Support options clubbed together: Help and settings menu option on top right on Overview page have been re-arranged for better accessibility.
Title for cases will now show as wrapped up for longer titles.
Minor Bug Fixes
Users can now right-click and open the top navigation bar options in new tabs.
Notifications will show up for unsaved comments on Case detail view
Incorrect handling of empty data set values while importing results.
23rd October, 2023 → Server: v4.4.1, Data Center: v:4.4.1.0
New Features
Archive Cases/Cycles - User will now be able to mark Cases and Cycles as Archived and also Unarchive/Delete them as required.
Double Delete Confirmation - Users will now be able to delete cases, which are associated in current project’s set and cycles, in a single go after confirmation from user.
Run distribution report - A new report has been added to enable users to do analysis of Runs by grouping on different Case / Cycle & Run attributes as well as Run custom fields.
Failed step info in Jira Panel - User will now have the ability to view the steps of the failed case along with attachments and defects information in Jira Panel.
Enhancements
Custom fields type enhancements:
A new Custom field type Color Selector has been introduced.
Following Jira custom field types are also supported now:
Radio buttons for Select List (Single)
Checkboxes and Select List (multiple choices)
Closed/Locked cycle enhancements on Cycles Listing Grid:
A new Column and filter ‘Closed Date’ have been added to view/filter on Closed Date of Cycles.
A new column ‘Closed’ has been added to view Closed status of Cycles.
A new column ‘Locked’ has been added to view Locked status of Cycles.
Deselect All in Copy Cycle/Set - Users will now be able to Deselect All cases in one go which get added to cycle/set in Copy Cycle/Set flow.
Defects/Actual effort mandatory enhancements - Enhancements have been done to improve the experience for changing Run status in Cycle when Actual Effort or Defects are marked mandatory for them.
API enhancements- Public API’s have been enhanced to support Archived Cases/Cycles and Closed Cycle features.
23rd September, 2023 → Cloud: v4.4.1
New Features
Archive Cases/Cycles - User will now be able to mark Cases and Cycles as Archived and also Unarchive/Delete them as required.
Double Delete Confirmation - Users will now be able to delete cases, which are associated in current project’s set and cycles, in a single go after confirmation from user.
Run distribution report - A new report has been added to enable users to do analysis of Runs by grouping on different Case / Cycle & Run attributes as well as Run custom fields.
Failed step info in Jira Panel - User will now have the ability to view the steps of the failed case along with attachments and defects information in Jira Panel.
Enhancements
Custom fields type enhancements:
A new Custom field type Color Selector has been introduced.
Following Jira custom field types are also supported now:
Radio buttons for Select List (Single)
Checkboxes and Select List (multiple choices)
Closed/Locked cycle enhancements on Cycles Listing Grid:
A new Column and filter ‘Closed Date’ have been added to view/filter on Closed Date of Cycles.
A new column ‘Closed’ has been added to view Closed status of Cycles.
A new column ‘Locked’ has been added to view Locked status of Cycles.
Deselect All in Copy Cycle/Set - Users will now be able to Deselect All cases in one go which get added to cycle/set in Copy Cycle/Set flow.
Defects/Actual effort mandatory enhancements - Enhancements have been done to improve the experience for changing Run status in Cycle when Actual Effort or Defects are marked mandatory for them.
API enhancements- Public API’s have been enhanced to support Archived Cases/Cycles and Closed Cycle features.
4th September, 2023 → Server: v4.4.0, Data Center: v4.4.0.0
New Features
Dark Theme: Users can now use Dark theme with AIO Tests via My Settings → Theme page
Drill-down Capabilities in Reports/Gadgets: Automation Coverage, Execution Burndown, Execution Summary (single/multi-cycle), Execution Distribution, Traceability Summary and Case Distribution reports and related gadgets now have links on key numbers and summary cards
New Gadgets added: Automation Coverage and Automation Burndown
Cycle PDF Export: Users will now be able to Export Cycle Run/Execution data in PDF format
Public API’s added: Delete single run from a cycle and Delete multiple older runs from a cycle
Enhancements
Multi-cycle Execution Detail report: The report now has support for custom fields (case/cycle/run) along with a new filters bar and the ability to save column selection as part of saved reports. The cycle grouping (when more than 1 cycle is selected) will show the cycle fields specified.
Column selections in all grids: Column selections for custom fields will now be project specific and will be saved as users move between different projects
Run Custom Fields: Custom fields are now supported in Execute Offline also
BDD/Gherkin: Existing cases can be updated via ‘Import Feature Files’ option along with creation of new cases
Run Custom Fields: Run Custom fields are now supported in APIs also
Import automation Results: Users will now be able to create Data Parametrized cases via TestNG/Junit as well
Minor Bug Fixes
Special characters handled for Datasets
Issue with Run Statuses not getting Copied for Defects mandatory and Actual Effort while Import settings has been fixed
6th August, 2023 → Cloud: v4.4.0
New Features
New Gadgets added: Automation Coverage and Automation Burndown
Cycle PDF Export: Users will now be able to Export Cycle Run/Execution data in PDF format
Public API’s added: Delete single run from a cycle and Delete multiple older runs from a cycle
Enhancements
Run Custom Fields: Run Custom fields are now supported in APIs also
Import automation Results: Users will now be able to create Data Parametrized cases via TestNG/Junit as well
Minor Bug Fixes
Issue with Run Statuses not getting Copied for Defects mandatory and Actual Effort while Import settings has been fixed
9th July, 2023 → Cloud: v4.3.2
New Features
Dark Theme: Users can now use Dark theme with AIO Tests via My Settings → Theme page
Drill-down Capabilities in Reports/Gadgets: Automation Coverage, Execution Burndown, Execution Summary (single/multi-cycle), Execution Distribution, Traceability Summary and Case Distribution reports and related gadgets now have links on key numbers and summary cards
Enhancements
Run Custom Fields: Custom fields are now supported in Execute Offline also
BDD/Gherkin: Existing cases can be updated via ‘Import Feature Files’ option along with creation of new cases
Minor Bug Fixes
Special characters handled for Datasets
25th June, 2023 → Server: v4.3.0, Data Center: v4.3.0.0
New Features
Data Driven Cases/Scenario Outlines: Users will now be able to create Data Driven/Parameterized cases by creating Datasets for Classic Cases and Examples for BDD/Gherkin cases. Watch how to use the feature.
Custom Fields at Run Level: Users can now create custom fields to capture execution information like Environment, Build number, Browser, etc. and also make them mandatory. See details here on how to create them and here on how to access them
Case and Cycle Custom Fields support in Reports: Users can now use their case and cycle level Custom Fields in Case Distribution , Automation Coverage reports and Multi Cycle Distribution Report and Gadget.
New Gadgets added → Project Activity - Advanced, User Activity and Execution Distribution
Public APIs added → Get Custom Field types , Get Custom Fields , Post comments directly to the latest run or specify a run ID against which comments needs to be posted
Automatically assign test cases: Not Assigned cases in a cycle will now be automatically assigned to the user executing the case when the status is changed to any non-Not Run type status.
Users will now have the ability to configure Actual effort and Defects as mandatory for a particular run/dataset level status via General Preferences.
Create Set from Cycle: Users will now have the ability to create a Set from single cycle/set of cycles.
Enhancements
Dynamic Filters → Users can now set filters instead of specifying specific keys of cycles in all reports which allow input of multiple cycles - both Traceability reports, multi-cycle execution summary, detail and distribution, both Automation reports as well as Case distribution report. Same is applicable for related gadgets
Enhanced Public APIs → Following Public APIs for Cases and Cycles now support Custom Fields → Single case/cycle, cases/cycles listing, create case/cycle, search case/cycle, Project Configuration and Traceability APIs
Actual Effort in Seconds: Actual effort will now capture “seconds” too
Close/Complete a cycle: Users will now have the ability to mark a Cycle as Closed once execution is completed and also to filter out Closed cycles using ‘Closed’ filter on Cycles listing.
Duplicate Step Keyboard Shortcut: A new keyboard shortcut (Ctrl +d) has been introduced as a quick way of duplicating case steps.
Select List custom fields limit increase: Allowed list values for Single/Multi select list type custom fields has been increased from 50 to 100.
Create Cycle/Add to Cycle from Sets enhancements: Create Cycle/Add to cycle options will now also be available from Bulk menu of Sets
Date Filters have been enhanced across the app to have more options to filter by, for example- Today/Yesterday/Last 2,7,15 Days/This and Previous Month/This and Previous Year.
New Filter for Case Version: A new cycle filter has been added to allow users to filter by Latest/old case version in cycle.
Case Distribution and Automation Coverage report: A new grouping field option “Datasets” has been added in both these reports.
Multi Cycle Execution Detail Report: Two new buttons ‘Expand All’ ad ‘Collapse All' have been added for users to be able to expand/collapse their cycles execution data.
Cucumber enhancements: Users will now be able to choose while importing automation results if they want to create each example as a separate case or a single Example Based case in AIO.
Automation Updates →
While importing automation results, the corresponding cases' Automation Status would be marked as ‘Automated’
For cucumber import, if “bddforceupdate” is set to true, Title and description will also be updated
Jenkins plugin v1.8 released: while creation of new cycle, users can specify folder and Jira Tasks to be linked
Minor Bug Fixes
User will be able to rename a folder to same name with different letter-case(capitalization).
Copying links from different tabs of Cycle/Set will now re-direct users to whichever tab the link was copied from.
11th June 2023 → Cloud: v4.3.1
Enhancements
Multi-cycle Execution Detail report: The report now has support for custom fields (case/cycle/run) along with a new filters bar and the ability to save column selection as part of saved reports. The cycle grouping (when more than 1 cycle is selected) will show the cycle fields specified.
Column selections in all grids: Column selections for custom fields will now be project specific and will be saved as users move between different projects
4th June 2023 → Cloud: v4.3.0
New Features
Automatically assign test cases: Not Assigned cases in a cycle will now be automatically assigned to the user executing the case when the status is changed to any non-Not Run type status.
Public API added - Post comments directly to the latest run or specify a run ID against which comments needs to be posted
Custom Fields support in Reports/Gadgets: Users can now use their case and cycle level Custom Fields in Multi Cycle Distribution Report and Gadget.
Users will now have the ability to configure Actual effort and Defects as mandatory for a particular run/dataset level status via General Preferences.