Content:
Definition
Test Suite is a collection of test cases that share some similar elements. It also contains a test coverage.
Dedicated fields
Test Plan
A custom field that keeps a handle to the "parent" Test Plan.
Available Panels
QA Craft Reports
General Metrics
Test Suite content and overall metrics
A main metric table. It shows the overall progress of the actions of the test. In the columns, there are:
| Column | Description |
|---|---|
| TC | Test Case key. You can go to that TC page by clicking on it. |
| Summary | Test Case summary |
| Priority | Test Case priority |
| Status | Test Case status |
| Step Progress | Current Test Case progress. It shows graphically various steps statuses described on that issue. |
| Iteration | Current Test Case iteration |
| Assignee | The current user, which is responsible for that test. |
| REQ_ID | Key of connected requirement. |
| Total Bugs | The number of unique Bugs reported to that Test Cases. You can list them by clicking on them. |
Open Bugs | The number of unique unresolved Bugs reported to that Test Cases. You can list them by clicking on them. |
| Soft v. | Software version |
| Env | Test environment |
All values could be sorted or filtered by choosing the right option from the column caption. In the last row, you can find a summary, counting all objects per column. When you select some rows, there will be presented a summary of selected Test Cases.
The grid content could be downloaded as a .csv file.
Test Case Metrics
Test Cases execution - grouped by day (idle days excluded)
Analogically to Test Plan, the table contains information about executed Test Cases. It daily summarizes the number of Test Cases split between their resolutions.
| Column | Description |
|---|---|
| Date | Date when the Test Cases was executed. |
| Total TC | The number of all executed Test Cases. You can list them by clicking on them. |
| Passed | The number of passed Test Cases. You can list them by clicking on them. |
| Failed | The number of failed Test Cases. You can list them by clicking on them. |
| Blocked | The number of blocked Test Cases. You can list them by clicking on them. |
| Skipped | The number of skipped Test Cases. You can list them by clicking on them. |
Additionally, there is a checkbox Show only current iterations. Thanks to that, you can include or ignore previous Test Cases iterations.
The grid content could be downloaded as a .csv file.
Test Cases history
The table presents the whole history of Test Case execution.
| Column | Description |
|---|---|
| Execution Date | Date when the Test Cases was executed. |
| Test Case | Test Case key. You can go to that TC page by clicking on it. |
| Summary | Test Case summary |
| Tester | User assigned to the Test Case |
| Iteration | The current Test Case iteration |
| Version | Software version |
| Environment | Test environment |
| Status | Test Case resolution |
| Requirement | The requirement, which is connected to Test Case. You can go to that page by clicking on it. |
Some rows are grayed out. They contain the previous iteration of the Test Case.
Additionally, there are some available actions:
| Action | Description |
|---|---|
| Show current iterations | Hides previous Test Case iterations when they are visible |
| Show all iterations | Shows all Test Case iteration when they are hidden |
| Group by Test Case | Groups all Test Case according to its key |
| Reset filtering and sorting | Resets filtering and sorting to default settings |
The grid content could be downloaded as a .csv file.
Test Cases execution - grouped by day charts
The charts show Test Case execution in the last days with the specified resolution. They could be downloaded as a .png file.
Test Cases statistic charts
The pie charts present all Test Cases' statuses (left) and the Test Case resolutions (right) of the done TCs. They could be downloaded as a .png file.
Bug metrics
Bugs group by priority
The table presents all bugs reported during tests split between priorities and statuses.
| Column | Description |
|---|---|
| Status | Bug status |
| Priority | Bug priority |
| Quantity | Numer of found bugs. |
| Issue List | List of found bug keys. You can go to that issue page by clicking on them. |
Additionally, there are some available actions:
| Action | Description |
|---|---|
| Open bugs | It shows only open bugs |
| Closed bugs | It shows only closed bugs |
| All bugs | Shows all bugs |
| Show summaries | On the issue list, there are shown the summaries of the issues |
| Hide summaries | On the issue list, there are shown the keys of the issues |
The grid content could be downloaded as a .csv file.
Bugs history
The table contains a history of all connected bugs.
| Column | Description |
|---|---|
| Creation Date | Bug creation date |
| Bug | Bug key. You can go to that page by clicking on it. |
| Summary | Bug summary |
| Priority | Bug priority |
| Status | Bug status |
| Resolution | Bug resolution |
| Resolution Date | Date of setting bug resolution |
The grid content could be downloaded as a .csv file.
Bugs created and resolved chart
A chart that shows all bugs created and resolved for the last days. It could be downloaded as a .png file.
Bugs created and resolved cumulative chart
A chart that shows the number of all bugs created and resolved for the last days. It could be downloaded as a .png file.
Bugs statistic charts
The pie charts present the statuses (left) and the priorities (right) of all Bugs. They could be downloaded as a .png file.
Test Coverage Metrics
Test coverage grid
The table contains all requirements connected to Test Case requirements in a current Test Plan.
| Column | Description |
|---|---|
| REQ ID | Requirement key. You can go to that page by clicking on it. |
| Summary | Requirement summary |
| Priority | Requirement priority |
| Status | Requirement status |
| TC Progress | Current Requirement progress. It shows graphically various Test Case statuses connected to that Requirement. |
| Total | The number of all Test Cases connected to the Requirement. |
| TC Passed | The number of passed Test Cases. |
| TC Failed | The number of failed Test Cases. |
| TC Blocked | The number of blocked Test Cases. |
| TC Skipped | The number of skipped Test Cases. |
| TC None | The number of Test Cases without resolution. |
| Bug Open | The number of unique unresolved Bugs reported to connected Test Cases. |
| Bug Total | The number of unique Bugs reported to connected Test Cases. |
The grid content could be downloaded as a .csv file.
Test Cases execution - grouped by requirements
The column chart shows the Test Case resolutions for requirements connected to the current Test Plan. It could be downloaded as a .png file.
Test Cases execution - grouped by requirements priority
The column chart shows the Test Case resolutions for requirements connected to the current Test Plan, grouped by priority. It could be downloaded as a .png file.
Bugs created vs. resolved - grouped by requirements
The column chart shows the bugs state for requirements connected to the current Test Plan. It could be downloaded as a .png file.
Available Actions
Create Test Case
The main additional option for Test Suite is creating subordinated Test Case. It will show you a traditional Create Issue view with blocked some fields that are filled to connect new TC to Test Suite. The rest of that process is analogical to the typical.
Add to structure
That operation allows connecting the current Test Suite to any Test Plan. If the TS is an orphan, it will be connected to the new parent. In the other case, its parent will be changed.
Disconnect from structure
There is also a possibility to detach the Test Suite from the structure. Choose that option will require your confirmation.