Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Terms

Definitions

Test

A test is a collection of conditions/ steps which are used to determine whether a feature is working correctly or not. It also includes an expected result used to determine if the test case passes or fails.

Cases

Cases are used to verify compliance against requirements. A case can have many steps with data and expected results.

Steps

Specific steps/ actions in a case that a tester has to follow while execution.

Sets

A reusable set of cases which are frequently executed/ tested. Logical grouping for doing testing. A case may belong to multiple Sets.

Cycle

Set of cases which need to be executed/ tested end to end for a testing goal.

Run/ Case Execution

A Run is the execution/ instance of a Case. Cases can have multiple Runs within a cycle.

Run Steps

Specific steps/ checks of the case followed for execution. If at least one step fails, then the case/ run will fail.

Run steps contain execution information like status (pass/ fail), defects and attachments.

Depending upon the reason behind the failure, an issue or a bug can be created for the development team to work on.

Defects

Same as a bug. It is a case where a system doesn’t perform as expected.

Pre-Conditions

It is the initial conditions that must be ensured before executing the steps of the test case.

Audit Log

A chronological record of the deleted actions performed by different users on cases, sets, and cycles.

Ad-hoc Cycle

It is the default cycle. If no any cycle is set up for a version, then any test which gets executed is reported against an “ad-hoc” cycle.

Behavior-Driven Development (BDD)

BDD is a software development methodology that combines business interests and technical aspects. It creates test scenarios in a simple language which can easily be understood even by non-technical-savvy employees.

Clone

Create duplicates of various types of entities within an instance. Users can clone test cases, steps, and more.

Custom Field

Custom field is a non-standard field that the user can create to meet specific requirements.

Execution Statuses

It is the status that testers assign to test cases by looking at their results while executing. Pass, Fail, In-progress, Blocked, and Not Run are default statuses. Users can also add custom statuses.

Gherkin

Gherkin is a programming language where Cucumber developers can use native language to describe test cases.

Test Steps

Test Steps are instructions or actions that need to be performed to execute a test case. In AIO Tests, test steps can be written in classic or BDD/Gherkin.

Traceability

AIO Tests lets users trace linkages between various testing elements such as requirements, test cases, sets and issues. It allows users to have a broader view of the effect of a correction or an identified issue.

Migration Method

It is the technique or approach which is used to transfer data from one system or environment to another . It can involve various methods like data integrations, bulk imports, or APIs.

Import Data

AIO Tests allows users to import data to test management tool. This functionality allows users to bulk import test-related data, such as test cases and execution results into the system.

Issues

In AIO Tests, issues are concerns or problems encountered during the testing process. It includes bugs or defects.

Gadgets

Gadgets allow users to view testing-specific metrics.

Smoke Test

Smoke Testing is used to determine whether the development is enough to proceed with further testing or not. It involves only verifying that the most important functions of the software are working.

Regression Testing

Regression testing is a software testing to confirm that a recent program/code change has not adversely affected existing features. It is nothing but a full or partial selection of already executed test plans that are re-executed to ensure existing functionalities working properly.

Manual Testing

It is a software testing process where testers execute the test cases manually , without the help of automated testing tools or executing test scripts.

JUnit

JUnit is a unit testing open-source framework that helps you write more reliable and testable code for the Java programming language.

NUnit

NUnit is a unit-testing framework for automated testing of components in Microsoft .Net applications.

Priority

It defines the order in which one would resolve any given defect

Release

Release defines a new version of the system under test.

Automation Testing

Automation testing have the test activities that are done by scripts and tools rather than manual work by a human.

Requirements

It describes what needs to be achieved for the developed software to meet its objectives.

Project Admin

Project admin is a user who is normally assigned to a project created by the Site Admin and who has all permissions enabled on their assigned project.

Bug

Bug is a discrepancy between an application/system desired behaviour and their actual behavior.

CI/CD (Continuous Integration and Continuous Delivery)

CI/CD is the practice of automating the integration of code changes from multiple developers into a single codebase.

Functional Testing

It is a type of software testing where the basic functionalities of a software system or application are tested against predetermined set of specifications.

Actual Results

It is the result that a tester receives after executing the test cases. After executing all test cases, the actual result is compared with its expected outcome.

Ad Hoc Testing

It is an informal software testing that attempts to break the testing process in order to detect any vulnerabilities.

Tags

Tags are keywords that let users classify cases in a more flexible and informal manner. It help users in searching the test cases.

Estimated Effort

It is the expected time to complete the execution of the case. It can be entered in the given format Xh Ym.

Automation Key

The automation key is used to match AIO Tests cases with an automated case. 

Defect Management

It is a process to identify, report, prioritize, track, and resolve defects in the earlier stages of the software development lifecycle.

DevOps Testing

It is the process of automating the entire delivery lifecycle of software.

Burndown Chart

A Burndown Chart is a depiction of work left to do, and the time its completion will take.

API

API stands for Application Programming Interface. It acts as a source of communication between two or more computer applications.

Open AI

Open AI is an AI research and deployment company founded in the year 2015. It gained fame after making revolutionary AI tools like Chatgpt, Sora and DALL-E.

Sanity Testing

Sanity testing is a subset of regression testing and is done to ensure the changes in the program code are working as expected.

Unit Testing

It is a type of software testing that focuses on testing individual components of a software application to ensure the smooth running of the unit.

Integration Testing

Integration testing is defined as a software testing process where a group of software modules, components, or units are tested as a combined unit to evaluate system compliance with respect to functional requirements.

Performance Testing

Performance Testing is a type of software testing used for testing the speed, stability, scalability, reliability, response time, and resource usage of a software application under a particular workload.

Security Testing

It is a type of software testing focusing on identifying weaknesses, vulnerabilities, and potential risks in a software application’s security features.

API Testing

API testing is a software testing practice that analyzes an application program interface to verify that it fulfills its expected performance, security, functionality, and reliability.

Deprecated

Deprecated means to disapprove of something. When a case has been disapproved, its status is changed to deprecated.

Epic

An epic is a large body of work that can be broken down into a number of smaller stories, or sometimes called “Issues.”

Software Testing Life Cycle

It is the process of systematically carrying out thorough tests in different phases to ensure quality standards are met.

End-to-End testing

It is a type of testing technique where everything in the software from start to finish is meticulously tested by the testers, to ensure the application’s quality.

Support portal

A support portal is a self-serve web platform for customers to get help and resolve their problems online, it also helps the customers with their queries.

Tickets

A ticket is an issue raised by a user or customer when they find a fault in software. It is mostly used to notify the coders about a bug that needs to be fixed.

QA process

Short for the quality assurance process, the QA process is an activity performed by software testers to assess whether a product meets specific quality requirements.

Jira Cloud:

Jira Cloud is a group of cloud-based applications provided by Atlassian, designed to streamline project management and make the workflow better.

Test coverage

A technique that determines whether our test cases are covering the application code and how much code is exercised when we run those test cases

Archive

The archive is a storage place for your test cases, which are currently not in use but may be needed in the future.

Component

 A component is one of the smallest parts of a testing system that connects one part with another. A test case has three components: the purpose of the test case, the input required for the test case, and the expected result/response of the test case.

Defect Report

A defect report is a report issued addressing the problem of a case. It also explains how severe and urgent the problem is and how to find it.

Negative Testing

Negative testing is a process in which testers check the system's response for an unexpected input.

Structural Testing

It is a testing process in which the tester already knows the software’s structure and creates the test based on it. It is also known as White Box Testing.

API integration

API Integration, also known as Application Programming Interface Integration, is a connection between two or more systems through their APIs that allows them to exchange data.

TCM Applications

Test Case Management means creating, Organizing, managing, and tracking test cases while testing software. When an application does all of this, it is called a TCM Application.

Code Coverage

In testing, code coverage is the measurement metric of the percentage of a source code in a program executed when a test is run.

Maintenance testing

Maintenance testing is a type of testing where the change in performance of a software is noted when it is used in a different environment.

Operational Testing

Also known as Operational Acceptance Testing (OAT), Operational Testing is a type of testing executed to ensure and evaluate the system's performance in its operational environment.

Scalability Testing

In scalability testing, the testers run the software with different types of upgrades and evaluate whether the software is scalable or not.

Distributed Testing

Distributed Testing is the process of running software in multiple systems in parallel to check the similarities and differences in results with different inputs.

False-Positive Report

A false-positive report occurs when the result of a test run comes out to be a defect that does not exist in the system.

Visual Testing

Also known as User-interface Testing, visual testing is a testing type in which the tester evaluates the software’s visual elements, like the colour palette, font styles and size, design and layout, etc., in different systems and browsers.

Changeability

Changeability is the quality of software being changeable or accepting a change. It determines how capable a software is of modifications and implementations in its code.

Test Script

The set of instructions that are necessary to perform and test in the process of software testing is called a Test Script.

Accessibility Testing

Also known as 508 Compliance Testing, accessibility testing is a type of software testing that helps to discern how the software works from the point of view of a disabled person.

Test Analysis

Also known as Test Basis, test analysis is the process of going through the test material and finding materials to make test cases and scenarios.

Robustness Testing

A type of testing in which the testers determine the degree to which a system can work properly under stressful environments and invalid inputs.

Test Management Tool

A tool developed to manage and keep track of all the activities in the process of software testing from start to end.

Automated Testware

Automated Testware is an umbrella term for all the utilities and software required for start-to-end automation testing.

Compiler

Also known as an Interpreter, a Compiler translates high-level coding language into an easier language for the computer to understand.

Defect Masking

Defect masking is where a critical defect goes undetected due to another defect or issue.

Re-testing

Also known as Confirmation Testing, Re-testing is a type of testing done to ensure the correction of previously reported defects.

Severity

Also known as Bug Severity, Severity is the amount of impact a defect creates on the outcome of a test run.

Back-to-back testing

Back-to-back testing is a process in which two or more components are run at the same time, with the same input, under the same system environment, and then their outputs are compared to determine their difference.

False-negative

Often referred to as False Negative Error, False-negative is a situation in which a system fails to detect a defect present in the system.

Build Verification Testing

Build verification testing is a set of tests performed on the basic level before proceeding to in-depth testing procedures. It acts as a threshold that needs to be crossed before entering the test life cycle.

Chaos engineering

Chaos engineering is a process in which the tester tests the resilience of software to random defects and disruptions.

Risk Based Testing

A software testing approach in which the level of risk of different defects is measured by testers. If a defect is found to be more severe than the others, it gets more priority by testers.

Bug Leakage

Bug leakage occurs when the end users find bugs in the software instead of the testers, as the software has been pushed into the market without thorough testing

Test Summary Report

Also known as Test Closure Report, a test summary report is a document that contains a summarized version of the test outputs and evaluations. It is mostly used to give an overview of test outcomes.

Jenkins

Jenkins is an open-source automation server that runs in servlet containers such as Apache Tomcat, and it helps automate the parts of software development.

Functionality error

A type of error in which the system fails to perform the function it was intended to perform or fails to meet the specified requirements. For example, A login button isn’t allowing the users to log in

TestNG

 A testing framework inspired by JUnit and NUnit, TestNG is a framework created for the Java programming language. It covers a wide range of test categories such as end-to-end, unit, Integration, functional, etc.

Quality Control

A procedure or set of procedures performed by developers and testers to maintain the quality of their products. It is mostly done to maintain the consistency in quality of every single product made by them.

Test tool

Test tools are programs or applications developed with the purpose of testing a system, component and its component. The two types of test tools are manual test tools and automated test tools.

Bottom-up testing

Popularly known as Inductive Reasoning, Bottom-up Testing is a type of approach in software testing where the testers start the testing with the lowest component of the software and use that to test other components.

Every component is used to test the component above it and this goes on until the highest component has been tested.

Horizontal Traceability

The ability to trace requirements needed at a test level by going through the layers of test documentation is known as Horizontal Traceability.

Cucumber

Equipped with a parser language tool called Gherkin, Cucumber is a software tool that enables you to use BDD (Behaviour Driven Development).

Robot

Robot is an open-source test automation framework based on Python. It can support Acceptance Test-Driven Development (ATDD), Behavior-Driven Development (BDD), and Robotic Process Automation (RPA).

Code Inspection

A process to bring out the highest potential of an application by reviewing and resolving defects in a software on regular basis.

Continuous Testing

Often referred to as CT, continuous testing is an approach of testing in which an application is tested continuously throughout the entire SDLC (Software Development Life Cycle).

SaaS Testing

SaaS Testing, also known as Software as a Service Testing, is a process in which the software solutions posted on the internet are tested and evaluated.

Loop Testing

Loop Testing is an example of White-box testing, in which the testers validate the accuracy of a loop construction. In loop testing, a sequence of instructions is repeated until the desired outcome is achieved, which is also the reason for it to be known as Loop Testing

Test Driven Development

A developer-centric software development process in which the software requirements are made into test cases to develop the software through testing cases.

Personas

Key Entities

For a better understanding of Cases, Sets, and Cycles on AIO Tests, we have used Venn diagrams. It helps you to understand the key entities of the test management tool.

...