{"type":"doc","content":[{"type":"paragraph","content":[{"text":"AIO Tests supports importing Karate Framework results through its support for Cucumber reports.","type":"text"}]},{"type":"paragraph","content":[{"text":"Karate","type":"text","marks":[{"type":"strong"},{"type":"link","attrs":{"href":"https://github.com/karatelabs/karate"}}]},{"text":" is an open-source general-purpose test-automation framework that can script calls to HTTP end-points and assert that the responses are valid. It also supports ","type":"text"},{"text":"UI Automation","type":"text","marks":[{"type":"link","attrs":{"href":"https://github.com/karatelabs/karate/tree/master/karate-core"}}]},{"text":". ","type":"text"},{"text":"Karate","type":"text","marks":[{"type":"strong"}]},{"text":" is implemented in Java but test scripts are written in Gherkin since ","type":"text"},{"text":"Karate","type":"text","marks":[{"type":"strong"}]},{"text":" was originally an extension of the Cucumber ","type":"text"},{"text":"framework","type":"text","marks":[{"type":"strong"}]},{"text":".","type":"text"}]},{"type":"paragraph","content":[{"text":"Karate can generate ","type":"text"},{"text":"Cucumber reports","type":"text","marks":[{"type":"link","attrs":{"href":"https://github.com/karatelabs/karate#parallel-execution"}}]},{"text":", which can then be imported into AIO Tests, to report results from Karate runs to AIO Tests. This document provides an overview of how you can generate the Cucumber report from Karate and upload it to AIO Tests.","type":"text"}]},{"type":"paragraph","content":[{"text":"In this documentation, you’ll understand:","type":"text"}]},{"type":"extension","attrs":{"layout":"default","extensionType":"com.atlassian.confluence.macro.core","extensionKey":"toc","parameters":{"macroParams":{"style":{"value":"none"}},"macroMetadata":{"macroId":{"value":"1948e3bc-3783-448f-a144-f01b5db37a16"},"schemaVersion":{"value":"1"},"title":"Table of Contents"}},"localId":"1e6d6b9b-c689-4224-9fbf-c59c4811ecb4"}},{"type":"heading","attrs":{"level":2},"content":[{"text":"Required Karate Setup","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Java 8 + Maven","type":"text","marks":[{"type":"code"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Use the karate archetype to generate a sample project.","type":"text"}]},{"type":"codeBlock","content":[{"text":"mvn archetype:generate \\\n-DarchetypeGroupId=com.intuit.karate \\\n-DarchetypeArtifactId=karate-archetype \\\n-DarchetypeVersion=1.2.0 \\\n-DgroupId=com.aiotests \\\n-DartifactId=aio-karate-tests","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"To start using Karate, please follow the ","type":"text"},{"text":"Get Started","type":"text","marks":[{"type":"link","attrs":{"href":"https://github.com/karatelabs/karate#maven"}}]},{"text":" documentation.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Sample Case","type":"text"}]},{"type":"paragraph","content":[{"text":"This document will work on the below sample case, which demos a simple AIO Tests API test.","type":"text"}]},{"type":"expand","attrs":{"title":"demo.feature"},"content":[{"type":"codeBlock","content":[{"text":"Feature: AIO Tests Demo Karate file\n\n Scenario: get all users and then get the first user by id\n Given url baseUrl\n Given header Authorization = auth\n Given path '/project/',projectKey,'/config/testcase/status'\n When method get\n Then status 200\n * def first = response[0]\n And print first\n Then assert first.name == 'Draft'\n Then assert first.description == 'The test is being worked upon and'","type":"text"}]},{"type":"paragraph","content":[{"text":" ","type":"text"}]}]},{"type":"paragraph","content":[{"text":"The archetype also generates a Karate configurations file ","type":"text"},{"text":"(karate-config.js)","type":"text","marks":[{"type":"em"}]},{"text":", which can hold variables per environment or define actions to be executed in different environments. Global variables accessible to all cases can be defined in this file.","type":"text"},{"type":"hardBreak"},{"text":"The sample case above is using the below variables:","type":"text"}]},{"type":"expand","attrs":{"title":"karate-config.js"},"content":[{"type":"codeBlock","content":[{"text":"function fn() {\n//Setting showLog to false, to avoid cluttering response docstrings\n// with response objects\n karate.configure('report',{ showLog: false, showAllSteps: true }\n var config = {\n baseUrl: \"https://tcms.aiojiraapps.com/aio-tcms/api/v1\",\n auth: 'AioAuth ',\n projectKey: 'NVTES'\n }\n \n return config;\n}","type":"text"}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Running the Sample Case and Generating Cucumber JSON Report","type":"text"}]},{"type":"paragraph","content":[{"text":"For running the cases and generating the cucumber report, the following class identifies what needs to run.","type":"text"}]},{"type":"paragraph","content":[{"text":"Note the addition of ","type":"text"},{"text":".outputCucumberJson(true)","type":"text","marks":[{"type":"code"}]},{"text":" to generate the cucumber.report.","type":"text"}]},{"type":"codeBlock","content":[{"text":"import com.intuit.karate.Results;\nimport com.intuit.karate.Runner;\nimport static org.junit.jupiter.api.Assertions.*;\nimport org.junit.jupiter.api.Test;\n\nclass AIOAPITests {\n\n @Test\n void testParallel() {\n Results results = Runner.path(\"classpath:examples\")\n .outputCucumberJson(true)\n .parallel(5);\n assertEquals(0, results.getFailCount(), results.getErrorMessages());\n }\n\n}","type":"text"}]},{"type":"paragraph","content":[{"text":"Running the above generates the following results file:","type":"text"}]},{"type":"expand","attrs":{"title":"result.json"},"content":[{"type":"codeBlock","content":[{"text":"\n[\n {\n \"line\": 1,\n \"elements\": [\n {\n \"start_timestamp\": \"2022-07-21T07:39:44.005Z\",\n \"line\": 4,\n \"name\": \"get all users and then get the first user by id\",\n \"description\": \"\",\n \"id\": \"get-all-users-and-then-get-the-first-user-by-id\",\n \"type\": \"scenario\",\n \"keyword\": \"Scenario\",\n \"steps\": [\n {\n \"name\": \"url baseUrl\",\n \"result\": {\n \"duration\": 800214,\n \"status\": \"passed\"\n },\n \"match\": {\n \"location\": \"karate\",\n \"arguments\": [\n \n ]\n },\n \"keyword\": \"Given\",\n \"line\": 5\n },\n {\n \"name\": \"header Authorization = auth\",\n \"result\": {\n \"duration\": 263396,\n \"status\": \"passed\"\n },\n \"match\": {\n \"location\": \"karate\",\n \"arguments\": [\n \n ]\n },\n \"keyword\": \"Given\",\n \"line\": 6\n },\n {\n \"name\": \"path '\\/project\\/',projectKey,'\\/config\\/testcase\\/status'\",\n \"result\": {\n \"duration\": 10339103,\n \"status\": \"passed\"\n },\n \"match\": {\n \"location\": \"karate\",\n \"arguments\": [\n \n ]\n },\n \"keyword\": \"Given\",\n \"line\": 7\n },\n {\n \"name\": \"method get\",\n \"result\": {\n \"duration\": 1397104805,\n \"status\": \"passed\"\n },\n \"match\": {\n \"location\": \"karate\",\n \"arguments\": [\n \n ]\n },\n \"keyword\": \"When\",\n \"line\": 8,\n \"doc_string\": {\n \"content_type\": \"\",\n \"value\": \"13:09:44.361 request:\\n1 > GET https:\\/\\/tcms.aiojiraapps.com\\/aio-tcms\\/api\\/v1\\/project\\/NVTES\\/config\\/testcase\\/status\\n1 > Authorization: AioAuth auth \\n1 > Host: tcms.aiojiraapps.com\\n1 > Connection: Keep-Alive\\n1 > User-Agent: Apache-HttpClient\\/4.5.13 (Java\\/11.0.15)\\n1 > Accept-Encoding: gzip,deflate\\n\\n\\n13:09:45.522 response time in milliseconds: 1142\\n1 < 200\\n1 < content-type: application\\/json;charset=utf-8\\n1 < date: Thu, 21 Jul 2022 07:39:45 GMT\\n1 < strict-transport-security: max-age=31536000; includeSubDomains;\\n1 < cache-control: no-store\\n1 < pragma: no-cache\\n1 < x-xss-protection: 1; mode=block;\\n1 < x-content-type-options: nosniff\\n1 < transfer-encoding: chunked\\n1 < vary: Accept-Encoding\\n1 < Set-Cookie: JSESSIONID=s2~63888A01EE477F43FC7632C29C7A9798; Domain=tcms.aiojiraapps.com; Secure\\n[{\\\"ID\\\":1465,\\\"name\\\":\\\"Draft\\\",\\\"description\\\":\\\"The test is being worked upon\\\"},{\\\"ID\\\":1466,\\\"name\\\":\\\"Under Review\\\",\\\"description\\\":\\\"The test is under review\\\"},{\\\"ID\\\":1467,\\\"name\\\":\\\"Published\\\",\\\"description\\\":\\\"The test is ready for execution\\\"},{\\\"ID\\\":1468,\\\"name\\\":\\\"Deprecated\\\",\\\"description\\\":\\\"The test is no longer valid\\\"}]\\n\\n\",\n \"line\": 8\n }\n },\n {\n \"name\": \"status 200\",\n \"result\": {\n \"duration\": 18013,\n \"status\": \"passed\"\n },\n \"match\": {\n \"location\": \"karate\",\n \"arguments\": [\n \n ]\n },\n \"keyword\": \"Then\",\n \"line\": 9\n },\n {\n \"name\": \"def first = response[0]\",\n \"result\": {\n \"duration\": 18558295,\n \"status\": \"passed\"\n },\n \"match\": {\n \"location\": \"karate\",\n \"arguments\": [\n \n ]\n },\n \"keyword\": \"*\",\n \"line\": 10\n },\n {\n \"name\": \"print first\",\n \"result\": {\n \"duration\": 36007471,\n \"status\": \"passed\"\n },\n \"match\": {\n \"location\": \"karate\",\n \"arguments\": [\n \n ]\n },\n \"keyword\": \"And\",\n \"line\": 11,\n \"doc_string\": {\n \"content_type\": \"\",\n \"value\": \"13:09:45.613 [print] {\\n \\\"ID\\\": 1465,\\n \\\"name\\\": \\\"Draft\\\",\\n \\\"description\\\": \\\"The test is being worked upon\\\"\\n}\\n \\n\",\n \"line\": 11\n }\n },\n {\n \"name\": \"assert first.name == 'Draft'\",\n \"result\": {\n \"duration\": 10294256,\n \"status\": \"passed\"\n },\n \"match\": {\n \"location\": \"karate\",\n \"arguments\": [\n \n ]\n },\n \"keyword\": \"Then\",\n \"line\": 12\n },\n {\n \"name\": \"assert first.description == 'The test is being worked upon and'\",\n \"result\": {\n \"duration\": 559825,\n \"error_message\": \"did not evaluate to 'true': first.description == 'The test is being worked upon and'\\nclasspath:examples\\/aiodemo\\/demo.feature:13\",\n \"status\": \"failed\"\n },\n \"match\": {\n \"location\": \"karate\",\n \"arguments\": [\n \n ]\n },\n \"keyword\": \"Then\",\n \"line\": 13,\n \"doc_string\": {\n \"content_type\": \"\",\n \"value\": \"13:09:45.626 classpath:examples\\/aiodemo\\/demo.feature:13\\nThen assert first.description == 'The test is being worked upon and'\\ndid not evaluate to 'true': first.description == 'The test is being worked upon and'\\nclasspath:examples\\/aiodemo\\/demo.feature:13\\n\",\n \"line\": 13\n }\n }\n ],\n \"tags\": [\n {\n \"name\": \"@NVTES-TC-13241\",\n \"line\": 3\n }\n ]\n }\n ],\n \"name\": \"examples\\/aiodemo\\/demo.feature\",\n \"description\": \"AIO Tests Demo Karate file\",\n \"id\": \"aio-tests-demo-karate-file\",\n \"keyword\": \"Feature\",\n \"uri\": \"examples\\/aiodemo\\/demo.feature\"\n }\n]","type":"text"}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Mapping Cases with AIO Tests","type":"text"}]},{"type":"paragraph","content":[{"text":"AIO Tests supports creating tests using the cucumber reports as well as mapping existing cases. Cases can simply be mapped using the AIO Tests Case keys as tags on features.","type":"text"}]},{"type":"paragraph","content":[{"text":"The mapping of cases follows the same convention as Cucumber. To learn more, ","type":"text"},{"text":"click here","type":"text","marks":[{"type":"link","attrs":{"href":"https://aiosupport.atlassian.net/wiki/spaces/AioTests/pages/2025848968/Cucumber#neww"}}]},{"text":". ","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Importing Results","type":"text"}]},{"type":"paragraph","content":[{"text":"Post execution of a suite, the TEST-.xml file can be uploaded either via","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"AIO Tests REST API","type":"text","marks":[{"type":"link","attrs":{"href":"https://aiosupport.atlassian.net/wiki/spaces/AioTests/pages/2026569775"}}]},{"text":" calls using multipart form data to upload file","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Cycle options in the Cycles Tab inside AIO Tests","type":"text","marks":[{"type":"link","attrs":{"href":"https://aiosupport.atlassian.net/wiki/spaces/AioTests/pages/2026700831"}}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"via ","type":"text"},{"text":"AIO Tests Jenkins Plugin","type":"text","marks":[{"type":"link","attrs":{"href":"https://plugins.jenkins.io/aio-tests/"}}]}]}]}]},{"type":"paragraph","content":[{"text":"Please follow the above links to continue to import results using either of the options.","type":"text"}]},{"type":"paragraph"},{"type":"paragraph","content":[{"text":"For further queries and suggestions, feel free to reach out to our customer support via ","type":"text","marks":[{"type":"strong"}]},{"text":"help@aiotests.com","type":"text","marks":[{"type":"underline"},{"type":"strong"},{"type":"link","attrs":{"href":"mailto:help@aiotests.com"}}]},{"text":".","type":"text","marks":[{"type":"strong"}]}]}],"version":1}