Functional Testing Report of TIMCAN Project

Hanna Alatalo
Jarkko Kuivanen
Elisa Nauha
Jere Ojala
Kimmo Urtamo

Version 1.0.0
Public
5.6.2019

University of Jyväskylä
Faculty of Information Technology
Jyväskylä

1. Test Session Identifications

Identifying information of the test session are presented in the following table:

Tester(s)	Hanna Alatalo
Date	6.5.2019
Test plan version	TIMCAN Project Functional Testing Plan Version 0.1.3
Test cases	1.1-4.7
Test data	testaustesti1

2. Testing Environment

Application and version: TIM version 6.5.2019 of TIMCAN branch

Operating System: Windows 10 Enterprise version 1809

Hardware setup: Dell OptiPlex Desktop PC, with a keyboard, a computer mouse and a computer screen.

Browser: Google Chrome Version 73.0.3683.86
Testing Server: https://timdevs01-2.it.jyu.fi

3. Test Cases for Building a Test

The test session results for the test cases for building a test are presented in the following table.

Case ID	Task and input	Conclusion	Details
1.1	Instruction page	Note	Defaults rights for this is not the same as rights for this folder.
1.2	Task 1	OK
1.3	Task 2	OK
1.4	End page of test	Note	The markdown code font in the test plan is unclear.

4. Test Cases for Student Answering the Test

The test session results for the test cases for answering the test as a student are presented in the following table.

Case ID	Task and input	Conclusion	Details
2.1	Beginning a test	Note	The permission was denied (see Details in test case 1.1). The tester had to return to the test case 1.1 to set proper rights.
2.2	Correct streak	OK
2.3	Final feedback level	Note	Only four feedback levels were achieved due to the outdated test plan.
2.4	Not choosing options	Note	No warning was given about empty practice item in both tasks. The error is in the outdated test plan.

5. Test Cases for Report Exporting

The test session results for the test cases for exporting the test results are presented in the following table.

Case ID	Task and input	Conclusion	Details
3.1	Exporting with default	OK
3.2	Whole Test, Only username	OK
3.3	Anonymous username	OK
3.4	Tab-delimiters	OK
3.5	|-delimiters	OK
3.6	Comma-delimiter	OK
3.7	Decimal comma	OK
3.8	Only one visible user	OK
3.9	Two visible users	OK
3.10	Only visible user when empty list	OK
3.11	Only selected user	OK
3.12	Only selected user when empty list	OK
3.13	Cancel	OK

6. Building Task with Errors

The test session results for the test cases for error handling in the test are presented in the following table.

Case ID	Task and input	Conclusion	Details
4.1	Differing number of feedback levels	Note	Error is not presented in red. The error is in the test plan.
4.2	Building task with no link to next task	OK
4.3	No instruction plugin	Note	The error did not appear. Error in the test plan.
4.4	No right answer defined	Note	The error message is hard to notice.
4.5	Wrong names for plugins	OK
4.6	No default feedback	OK
4.7	No feedback	Note	The only YAML error is diplayed. The error is in the test plan.

7. Summary

Executed test cases	28
Unexecuted test cases	0
Total test cases	28
OK conclusions	19
Note conclusions	9
Error conclusions	0
Total conclusions	28
Test session conclusion	Pass

8. Recommended Procedures

Most of the problems were with the testing plan. The problems with the plan should be corrected. In the application itself the error messages were changed temporarily at the time of the testing, but changed back to the same as it was at the time of Preliminary Testing.