{"type":"doc","content":[{"type":"paragraph","content":[{"text":"AIO Tests allows easy reporting of NUnit results by supporting the import of the NUnit results xml.","type":"text"}]},{"type":"paragraph","content":[{"text":"With AIO Tests NUnit integration, developers and testers can report their execution results to existing AIO Tests or directly create testcases which do not yet exist in AIO Tests.","type":"text"}]},{"type":"paragraph","content":[{"text":"This article discusses how to import NUnit XML results and how to map existing cases or create new ones from NUnit results.","type":"text"}]},{"type":"extension","attrs":{"layout":"default","extensionType":"com.atlassian.confluence.macro.core","extensionKey":"toc","parameters":{"macroParams":{},"macroMetadata":{"macroId":{"value":"1e035679-3c27-446b-9fc9-83e729d7297f"},"schemaVersion":{"value":"1"},"title":"Table of Contents"}},"localId":"644c3e55-67ec-4e13-ac3b-1ab5baad1e75"}},{"type":"heading","attrs":{"level":2},"content":[{"text":"NUnit","type":"text"}]},{"type":"paragraph","content":[{"text":"NUnit","type":"text","marks":[{"type":"link","attrs":{"href":"https://nunit.org/"}}]},{"text":" is an open source unit-testing framework for all .Net languages. It has strong support for parallel runs and data driven tests, with a rich set of assertions to support all kinds of verifications. NUnit uses a rich set of custom attributes to identify tests. Attributes also help to achieve flexible setup and teardown for the tests. All NUnit attributes are contained in the NUnit.Framework namespace. ","type":"text"},{"type":"hardBreak"},{"text":"NUnit tests can be run via command line or via GUI. NUnit results are captured in a xml file, which can provide information on the status, duration and failures of the tests.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"NUnit Reporting","type":"text"}]},{"type":"paragraph","content":[{"text":"NUnit 3.0 report structure can be found @ ","type":"text"},{"type":"inlineCard","attrs":{"url":"https://docs.nunit.org/articles/nunit/technical-notes/usage/Test-Result-XML-Format.html"}},{"text":". AIO Tests supports the latest 3.0 version of the report and does not support any previous versions.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Sample NUnit XML Report","type":"text"}]},{"type":"paragraph","content":[{"text":"Below is a sample NUnit 3.0 XML report with just one testcase, which gives an idea of the structure of ther report. It captures a failing test, along with the failure and it’s stacktrace.","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":"\n \n \n \n \n \n \n \n \n Expected: <{[24 CHF][15 USD]}>\n But was: <{[24 CHF][14 USD]}>\n\n at Money.MoneyTest.BagMultiply() in /Users/varshneyn/aiotcms/automation-demo-repos/nunit-aiotests-demo/nunit-aiotests-demo/MoneyTest.cs:line 47\n\n \n \n \n \n \n \n","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Status Mapping NUnit → AIO Tests","type":"text"}]},{"type":"table","attrs":{"layout":"default","localId":"c8fc5ee6-9cd9-4c59-8d03-800d31d5710e"},"content":[{"type":"tableRow","content":[{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[157.0]},"content":[{"type":"paragraph","content":[{"text":"NUnit XML result value in test-case","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[350.0]},"content":[{"type":"paragraph","content":[{"text":"Description","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[253.0]},"content":[{"type":"paragraph","content":[{"text":"AIO Tests Mapping","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[157.0]},"content":[{"type":"paragraph","content":[{"text":"Passed","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[350.0]},"content":[{"type":"paragraph","content":[{"text":"Passed case","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[253.0]},"content":[{"type":"paragraph","content":[{"text":"Passed","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[157.0]},"content":[{"type":"paragraph","content":[{"text":"Failed","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[350.0]},"content":[{"type":"paragraph","content":[{"text":"Failed","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[253.0]},"content":[{"type":"paragraph","content":[{"text":"Not Run","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[157.0]},"content":[{"type":"paragraph","content":[{"text":"Inconclusive","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[350.0]},"content":[{"type":"paragraph","content":[{"text":"Indicates the assumption in a Theory failed or an Assert.Inconclusive was used","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[253.0]},"content":[{"type":"paragraph","content":[{"text":"Skipped","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[157.0]},"content":[{"type":"paragraph","content":[{"text":"Skipped","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[350.0]},"content":[{"type":"paragraph","content":[{"text":"Indicates either the test was ignored or marked as explicitly skipped ","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[253.0]},"content":[{"type":"paragraph","content":[{"text":"Skipped","type":"text"}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Mapping automated NUnit tests to AIO Tests","type":"text"}]},{"type":"paragraph","content":[{"text":"In going with the simplicity advantage of AIO Tests, the NUnit integration has been designed as a simple and non-intrusive integration, without any extra dependency or coding required, utilising the core NUnit features of Attributes.","type":"text"}]},{"type":"mediaSingle","attrs":{"layout":"center"},"content":[{"type":"media","attrs":{"width":820,"id":"19ad3094-6963-4a08-a772-94c4abff96cb","collection":"contentId-1900879575","type":"file","height":116}}]},{"type":"paragraph","content":[{"text":"There are 3 ways that a NUnit case is mapped to an AIO Case.","type":"text"},{"type":"hardBreak"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"NUnit Property Attribute: ","type":"text","marks":[{"type":"strong"}]},{"text":"If a case has been created in AIO Tests, The Property attribute can be used with AIO property name : ","type":"text"},{"text":"aioCaseKey","type":"text","marks":[{"type":"code"}]}]},{"type":"codeBlock","content":[{"text":"[Test]\n[Property(\"aiocasekey\", \"RAM-TC-1\")]\n[Category(\"SimpleTests\")]\npublic void PassingTest()\n{\n Assert.Pass();\n}","type":"text"}]},{"type":"paragraph"}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Testcase key in Underscores in test name :","type":"text","marks":[{"type":"strong"}]},{"text":" Since many languages do not allow hyphens in their method signatures, AIO Tests allows case keys with underscores as valid mapping. The AIO Test key can be used in the method name by replacing the hyphen with underscores. eg. if AT-TC-123 is being automated by a test, the test method can be named as ","type":"text"},{"text":"verifyNotNullType_AT_TC_123","type":"text","marks":[{"type":"code"}]},{"text":" and the results of this method will be marked against AT-TC-123.","type":"text"},{"type":"hardBreak"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Automation Key: ","type":"text","marks":[{"type":"strong"}]},{"text":"The mapping of an AIO Case to an automated NUnit case can happen through a field Automation Key, which can be specified in the Case in AIO Tests app as shown below. The automation key is the fully qualified name of the test method i.e fullname from the results xml. ","type":"text"},{"type":"hardBreak"},{"type":"emoji","attrs":{"id":"atlassian-info","text":":info:","shortName":":info:"}},{"text":" ","type":"text"},{"text":"This can be useful at places where you do not want to add AIO case keys in the name or annotations or where automation is happening first without a manual case being created in AIO Tests.","type":"text","marks":[{"type":"em"}]}]}]}]},{"type":"mediaSingle","attrs":{"layout":"center"},"content":[{"type":"media","attrs":{"width":998,"id":"ddb745a1-57c6-4c53-a7cb-3d221ef3f551","collection":"contentId-1900879575","type":"file","height":102}}]},{"type":"paragraph"},{"type":"heading","attrs":{"level":2},"content":[{"text":"Examples","type":"text"}]},{"type":"paragraph","content":[{"text":"Below are few examples of how to achieve mapping in various cases:","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"1. Normal standalone case - Use property aioCaseKey","type":"text","marks":[{"type":"strong"},{"type":"em"}]}]},{"type":"codeBlock","content":[{"text":"[Test]\n[Property(\"aiocasekey\", \"RAM-TC-1\")] \n[Category(\"SimpleTests\")]\npublic void PassingTest()\n{\nAssert.Pass();\n}\n\n[Test]\n[Property(\"aiocasekey\", \"SCRUM-TC-421\")] //cross-project case\n[Category(\"SimpleTests\")]\npublic void Test_Failed_Retry()\n{\n Assert.Fail(\"I failed coz I wanted to fail\");\n}","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2. Normal standalone case - Use case key in method name","type":"text","marks":[{"type":"strong"},{"type":"em"}]}]},{"type":"paragraph","content":[{"text":"The below case will update the status of SCRUM-TC-22 in AIO Tests as passed.","type":"text"}]},{"type":"codeBlock","content":[{"text":"[Test]\n [Category(\"LongRun\")]\n public void MyTest_SCRUM_TC_22()\n {\n Assert.Pass();\n }","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"3. Data driven cases [ using TestCaseSource attribute]","type":"text","marks":[{"type":"strong"},{"type":"em"}]}]},{"type":"paragraph","content":[{"text":"Below example shows how data driven cases can be mapped to different cases in AIO Tests.","type":"text"}]},{"type":"codeBlock","content":[{"text":"[TestFixture]\n[Category(\"DDTests\")]\npublic class DataDrivenTests {\n [TestCaseSource(typeof(MyDataClass), nameof(MyDataClass.TestCases))]\n public int DivideTest(int n, int d, String tcId)\n {\n return n / d;\n }\n}\n\npublic class MyDataClass {\n public static IEnumerable TestCases\n {\n get\n {\n yield return new TestCaseData(12, 3,\"SCRUM-TC-15\").Returns(4);\n yield return new TestCaseData(12, 2,\"SCRUM-TC-423\").Returns(6);\n yield return new TestCaseData(12, 4,\"SCRUM-TC-1615\").Returns(3);\n }\n }\n}","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4. Data driven cases [ using TestCase attribute]","type":"text","marks":[{"type":"strong"},{"type":"em"}]}]},{"type":"paragraph","content":[{"text":"Below example shows how data driven cases can be mapped to different cases in AIO Tests with TestCase attribute","type":"text"}]},{"type":"codeBlock","content":[{"text":"[TestFixture]\n[Category(\"DDTests\")]\npublic class DataDrivenTests { \n [TestCase(12, 3, 4, \"SCRUM-TC-13194\")]\n [TestCase(12, 2, 1, \"SCRUM-TC-13195\")]\n [TestCase(12, 4, 3, \"SCRUM-TC-13196\")]\n public void DivideTest(int n, int d, int q, String tcId)\n {\n Assert.AreEqual(q, n / d);\n }\n}","type":"text"}]},{"type":"panel","attrs":{"panelType":"info"},"content":[{"type":"paragraph","content":[{"text":"If Case key is not provided at TestCase level and instead, is provided as Property aioCaseKey, then depending upon user’s choice at time of import, either one run would be created per data set or the same run would be updated thrice based on status and the last status update would remain.","type":"text"}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5. Mapping case to multiple cases","type":"text","marks":[{"type":"strong"},{"type":"em"}]}]},{"type":"paragraph","content":[{"text":"Below example shows how to map a case if an automated case covers multiple cases","type":"text"}]},{"type":"codeBlock","content":[{"text":"[Test]\n[Category(\"Multitest\")]\n[Property(\"aiocasekey\", \"RAM-TC-2,RAM-TC-3\")]\npublic void TestEquality()\n{\n String eq1 = \"AIO\";\n String eq2 = \"aio\";\n Assert.AreEqual(eq1, eq2);\n if (eq1 != null && eq2 != null)\n Assert.AreEqual(eq1.GetHashCode(), eq2.GetHashCode());\n}","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Importing Results","type":"text"}]},{"type":"paragraph","content":[{"text":"Post execution of a NUnit suite, the xml file can be uploaded either via","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Import Results - REST API","type":"text","marks":[{"type":"link","attrs":{"href":"/wiki/spaces/NAT/pages/1900880129"}}]},{"text":" - REST API call using multipart form-data to upload file","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Import Results- Cycle Tab","type":"text","marks":[{"type":"link","attrs":{"href":"/wiki/spaces/NAT/pages/1900879982"}}]},{"text":" - Importing results file from Cycles tab of AIO Tests app","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"via ","type":"text"},{"text":"AIO Tests Jenkins Plugin","type":"text","marks":[{"type":"link","attrs":{"href":"https://plugins.jenkins.io/aio-tests/"}}]}]}]}]},{"type":"paragraph","content":[{"text":"Please follow the above links to continue to import results using either of the options.","type":"text"}]}],"version":1}

Browser not supported