Structural-Test: Add a new parameter to limit the number of shown test for a given testcase.
Add a parameter that limits the number of test results shown for a GreyBox- or IO-tests. To not overwhelm students with an excess of feedback the number of test feedbacks for a given test case can be limited by adding the parameter max_test_results
. For example max_test_results: 3
would limit the number of test results for this test case to 3. At the end of the shown test results an additional message is given indicating how many tests failed in total.
In total 5 tests for 'my_pow_int' failed. Only 3 test results are shown!
Example (feedback with max_test_results: 3
for my_pow_int
, my_pow_float
and my_pow_double
):
'my_pow_int':
=============
Did you try 'b = -4' and 'n = 2'?
*b: Expected: '16' Actual : '-2'
Did you try 'b = -4' and 'n = 3'?
*b: Expected: '-64' Actual : '-1'
Did you try 'b = 2' and 'n = 3'?
*b: Expected: '8' Actual : '5'
In total 5 tests for 'my_pow_int' failed. Only 3 test results are shown!
'my_pow_float':
===============
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 2.0' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 2.5' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 2.0' and 'n = -3'
In total 12 tests for 'my_pow_float' failed. Only 3 test results are shown!
'my_pow_double':
================
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 2' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = -2' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 4' and 'n = -2'
In total 11 tests for 'my_pow_double' failed. Only 3 test results are shown!
Example (feedback before the introduction of max_test_results: 3
or with max_test_results: 0
)
'my_pow_int':
=============
Did you try 'b = -4' and 'n = 2'?
*b: Expected: '16' Actual : '-2'
Did you try 'b = -4' and 'n = 3'?
*b: Expected: '-64' Actual : '-1'
Did you try 'b = 2' and 'n = 3'?
*b: Expected: '8' Actual : '5'
Did you try 'b = 4' and 'n = 8'?
*b: Expected: '65536' Actual : '12'
Did you try 'b = -3' and 'n = 5'?
*b: Expected: '-243' Actual : '2'
'my_pow_float':
===============
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 2.0' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 2.5' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 2.0' and 'n = -3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = -4.0' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = -4.0' and 'n = 2'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 4.0' and 'n = 8'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = -3.0' and 'n = 5'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 0.25' and 'n = -2'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 32.0' and 'n = 4'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 32.0' and 'n = -4'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = 5.5' and 'n = 5'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_float(b, n)
Parameters: '*b = -5.5' and 'n = 5'
'my_pow_double':
================
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 2' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = -2' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 4' and 'n = -2'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 2.5' and 'n = 3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 2' and 'n = -3'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 4' and 'n = 8'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = -3' and 'n = 5'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 0.25' and 'n = -2'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 32' and 'n = 4'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 32' and 'n = -4'
Error occurred during execution! Exit code: 11
This exit code might indicate that your program tries to read and write outside the memory that is allocated for it.
Function call: my_pow_double(b, n)
Parameters: '*b = 5.5' and 'n = 5'