[SECURITY] Update dependency pytest to v9.0.3#100
Open
specmatic-builder wants to merge 1 commit into
Open
GitHub Actions / Test Report (Python 3.12)
failed
Apr 14, 2026 in 0s
1305 tests run, 731 passed, 0 skipped, 574 failed.
Annotations
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [1] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c3ffbf0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [2] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'book' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344d6b5280>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [3] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'food' from enum AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2acb30>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [4] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'other' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2aff80>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [5] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2acc80>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [6] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2ad070>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [7] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'book' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2ac8f0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [8] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'book' from enum AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2aca40>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [9] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'food' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2ad130>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [10] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'food' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2af620>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [11] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'other' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2ac200>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [12] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'other' from enum AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2af1d0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [13] +ve Scenario: GET /findAvailableProducts -> 200 with the request from the example 'SUCCESS' where REQUEST.PARAMETERS.HEADER contains the header 'pageSize' AND REQUEST.PARAMETERS.QUERY contains the param 'type'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2ad820>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [14] +ve Scenario: GET /findAvailableProducts -> 200 with the request from the example 'SUCCESS' where REQUEST.PARAMETERS.HEADER contains the header 'pageSize'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2af560>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [15] +ve Scenario: GET /findAvailableProducts -> 503 with the request from the example 'TIMEOUT'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c42a000>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [16] +ve Scenario: POST /orders -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c428e90>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [19] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY has been omitted
Failed: java.lang.AssertionError: Testing scenario "POST /products. Response: Product created"
API: POST /products -> 400
>> RESPONSE.STATUS
Received 415, but the specification does not contain a 4xx response, hence unable to verify this response
at io.specmatic.test.SpecmaticJUnitSupport.dynamicTestStream$lambda$0$0(SpecmaticJUnitSupport.kt:529)
at java.base/java.util.Optional.ifPresent(Optional.java:178)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2ae960>
def test_fail(self):
> pytest.fail(error)
E Failed: java.lang.AssertionError: Testing scenario "POST /products. Response: Product created"
E API: POST /products -> 400
E
E >> RESPONSE.STATUS
E
E Received 415, but the specification does not contain a 4xx response, hence unable to verify this response
E at io.specmatic.test.SpecmaticJUnitSupport.dynamicTestStream$lambda$0$0(SpecmaticJUnitSupport.kt:529)
E at java.base/java.util.Optional.ifPresent(Optional.java:178)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [20] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2add00>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [21] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to number AND type is set to 'book' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2ae450>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [22] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to boolean AND type is set to 'food' from enum AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2adf40>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [23] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND type is set to 'other' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2acad0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [24] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2acb90>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [25] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c2af2f0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [26] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND type is set to 'book' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344d6b4350>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.12)
TestContract.test [27] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND type is set to 'book' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7f344c3fe2d0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Loading