Cypress Cucumber via Cucumber JSON Report

AIO Tests supports importing Cypress Cucumber results in 2 ways:

AIO Tests Cypress Reporter - An NPM package plugin for Cypress. As a cypress plugin, it can be configured to report results to AIO Tests directly from cypress.
Via Cucumber.json Report- The Cypress Cucumber preprocessor not only helps to run Cucumber tests in Cypress but also generates a JSON report compatible with AIO Tests.

Using the Cypress Cucumber report, scenarios can be mapped to existing cases or new ones can be created from the Cucumber results JSON file.
This document provides an overview of how you can generate the Junit report from Cypress runs and upload it to AIO Tests.

In this documentation, you’ll understand:

1 Required Cypress Setup
- 1.1 Sample Cucumber Scenario
2 Running Cucumber Tests
3 Generating Cucumber.json Report
4 Status Mapping Cucumber → AIO Tests
5 Mapping Cucumber tests to AIO Tests
6 Importing Results

Required Cypress Setup

Node.js 12 or 14 and above
cd /your/project/path
npm init
npm install cypress --save-dev
npm install @badeball/cypress-cucumber-preprocessor
Download Cucumber Standalone JSON Formatter
Configure your preferred bundler to process feature files. See examples/ for how-to using Browserify, Esbuild or Webpack.
For the current example, we would be using Webpack.

Sample package.json dependencies:

"dependencies": {
    "@badeball/cypress-cucumber-preprocessor": "^12.1.0",
    "@cypress/webpack-preprocessor": "latest",
    "cypress": "^10.6.0"
  },

Sample Cucumber Scenario

Gherkin uses a set of keywords to formalize a behavior. Most lines start with one of the keywords.

Cucumber tests can be structured as Features. A feature can look at encapsulating a particular functionality of a system.

Features are made of Scenarios, which are essentially different user flows of the functionality being tested.

Scenarios are made of Steps. Each step starts with Given, When, Then or And.

Feature: Capture the number of trees planted and show relation to global warming

  @P0 
  Scenario: Trees effect on global warming
    Given There are no trees numbered in a given region
    When Each user plants a tree and updates
    Then The temperature is updated in the temperature log
    When Temperature is captured over a few days
    Then The graph should show the relation between the number of trees and temperature

Running Cucumber Tests

Configure specPattern with "**/*.feature", in cypress.config.js.
import { defineConfig } from "cypress"; export default defineConfig({ e2e: { specPattern: "**/*.feature" } });
Configure your preferred bundler to process feature files. The below example uses Webpack.
Run your tests cypress run --spec cypress/e2e/*

Generating Cucumber.json Report

This requires you to have downloaded and installed the cucumber-json-formatter as shown in the setup. Add the downloaded formatter to your PATH.
JSON reports can be enabled using the json.enabled property in package.json. Add the below to your package.json.
Register the cypress-cucumber-preprocessor module in your cypress.config.js as below:

The report is written to cucumber-report.json in the project directory but can be configured through the json.output property.

Consolidated Cypress config File

Screenshots in Report

Screenshots are automatically added to JSON reports, including those of failed tests (unless you have disabled screenshotOnRunFailure). However, while importing, AIO Tests only import artifacts for failed cases.

Cucumber Sample JSON Report

The JSON report generated by Cucumber gives a detailed step-by-step report as follows :

Status Mapping Cucumber → AIO Tests

To understand the status mapping from Cucumber results to AIO Tests run statuses, click here.

Mapping Cucumber tests to AIO Tests

To understand how to map automated cases to cases in AIO Tests, click here.

Importing Results

Post execution of cucumber tests, the result file can be imported to AIO Tests via the REST APIs or the Jenkins plugin or manually via the Cycles screen. Read about all possible options @ Importing Results in AIO Tests.

For further queries and suggestions, feel free to reach out to our customer support via help@aiotests.com.