Test automation

Content:

One of the most important QA Craft features is the possibility to manage the automation tests. Thanks to that, you are allowed to connect QA Craft and Jira with chosen CI server.

Video shortcut

Overall

Test Automation is based on special objects called Test Runs. They point to all chosen Test Cases with their statuses or perform dates. The execution relies on sending specific packets into the CI server where the tests are made.  The result is returned to QA Craft and saved as Test Results.

General settings

General settings of connection with CI server you can find on the plugin settings page. There can be set:

• URL to CI server
• username and password for authentication
• maximal length of URL (for security and proper working)
• test execution interval
• job cron

Additionally, you can set root for finding automation test files, available folders and limit access to files.

Test Plan Panel

On the Test Plan page, there is a panel QA Craft Automation Test Runs.

Test Run

A table contains the details of all Test Runs.

Moreover, there is an option to create a new Test Run

To create TR, you can choose:

• Linked Issue - connected issue, e.g. requirements
• Test Run Status - how Test Run will be started. Possible options: Draft, Run now and Schedule (when you can set an execution date)
• Select test run template - chosen template. More about Test Runs Templates you will find below.
• Issue structure - all automation Test Cases connected to the current Test Plan. You can choose which tests will be executed.

Test Run Templates

A table that contains Test Run Templates. They help to automate executing groups of tests. Thanks to that, you won't need to create a similar Test Run manually for every execution.

Test Automation Parameters

Specific settings for current Test Plan. The filled fields will override general settings. Thanks to that, you can restrict access to only necessary spaces.

Test Result

Test Result is an isolated Jira issue that serves as only information. There you can find a tree with a tested structure with its results.

REST API communication

A POST request in JSON format with the following example structure will be sent to the selected endpoint.

{
	"testRunId":676,
	"testPlan":
	{
		"id":34960,
		"key":"QC-1"
	},
	"testCases":
	[
		{
			"id":997,
			"key":"QC-4",
			"autoTestReference":"/Mock_Test_Passed.feature"
		},
		{
			"id":998,
			"key":"QC-3",
			"autoTestReference":"/Mock_Test_Failed.feature"
		}
	]
}

Data received in the commissioning request can be freely processed, e.g. at the Jenkins Pipeline level, by your own vision and ideas for the architecture of the test environment.
QA Craft plugin uses feedback from the following endpoints:

GET, Basic Auth, example: 

http://jira-cluster-ip-service:8080/rest/qacraft/1.0/TestCase/changeTestCaseResolution?testCaseIssueKey=QC-3&resolution=in%20progress&result=in%20progress&testPlanIssueKey=QC-1&testRunId=676
or:
http://jira-cluster-ip-service:8080/rest/qacraft/1.0/TestCase/changeTestCaseResolution?testCaseIssueKey=QC-3&resolution=Failed&result=Done&testPlanIssueKey=QC-1&testRunId=676
Those endpoints are used to change the status of the Test Cases.

Example of the connection

Combine Continuous Testing Toolkit

Jenkins