[SECURITY] Update dependency pytest to v9.0.3#100
Open
specmatic-builder wants to merge 1 commit into
Open
GitHub Actions / Test Report (Python 3.11)
failed
Apr 14, 2026 in 0s
1305 tests run, 731 passed, 0 skipped, 574 failed.
Annotations
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [1] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b919d90>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [2] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'book' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b9196d0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [3] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'food' from enum AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b9190d0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [4] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'other' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b919690>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [5] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b8c8a90>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [6] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b8c8750>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [7] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'book' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b8d7910>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [8] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'book' from enum AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b8d4e10>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [9] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'food' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b8d4250>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [10] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'food' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b8d4990>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [11] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'other' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd8887106d0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [12] +ve Scenario: POST /products -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key type is set to 'other' from enum AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd888800850>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [13] +ve Scenario: GET /findAvailableProducts -> 200 with the request from the example 'SUCCESS' where REQUEST.PARAMETERS.HEADER contains the header 'pageSize' AND REQUEST.PARAMETERS.QUERY contains the param 'type'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd8886e6050>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [14] +ve Scenario: GET /findAvailableProducts -> 200 with the request from the example 'SUCCESS' where REQUEST.PARAMETERS.HEADER contains the header 'pageSize'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b92ef90>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [15] +ve Scenario: GET /findAvailableProducts -> 503 with the request from the example 'TIMEOUT'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd888746310>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [16] +ve Scenario: POST /orders -> 201 with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd888746b10>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [19] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY has been omitted
Failed: java.lang.AssertionError: Testing scenario "POST /products. Response: Product created"
API: POST /products -> 400
>> RESPONSE.STATUS
Received 415, but the specification does not contain a 4xx response, hence unable to verify this response
at io.specmatic.test.SpecmaticJUnitSupport.dynamicTestStream$lambda$0$0(SpecmaticJUnitSupport.kt:529)
at java.base/java.util.Optional.ifPresent(Optional.java:178)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88b91b010>
def test_fail(self):
> pytest.fail(error)
E Failed: java.lang.AssertionError: Testing scenario "POST /products. Response: Product created"
E API: POST /products -> 400
E
E >> RESPONSE.STATUS
E
E Received 415, but the specification does not contain a 4xx response, hence unable to verify this response
E at io.specmatic.test.SpecmaticJUnitSupport.dynamicTestStream$lambda$0$0(SpecmaticJUnitSupport.kt:529)
E at java.base/java.util.Optional.ifPresent(Optional.java:178)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [20] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd888745ed0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [21] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to number AND type is set to 'book' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd888744f90>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [22] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to boolean AND type is set to 'food' from enum AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd888747710>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [23] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND type is set to 'other' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd888747b50>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [24] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88872b1d0>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [25] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND inventory is set to the largest possible value
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd888728b90>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [26] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND type is set to 'book' from enum
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88872b050>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Check failure on line 1 in TestContract
github-actions / Test Report (Python 3.11)
TestContract.test [27] -ve Scenario: POST /products -> 4xx with the request from the example 'SUCCESS' where REQUEST.BODY contains all the keys AND the key name is mutated from string to null AND type is set to 'book' from enum AND inventory is set to the smallest possible value '1'
Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Raw output
self = <test.config.test_with_config_file_having_json_extn.TestContract object at 0x7fd88872ab10>
def test_fail(self):
> pytest.fail(error)
E Failed: org.opentest4j.AssertionFailedError: One or more API Coverage report's success criteria were not met.
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.assertSuccessCriteria(OpenApiCoverageReportProcessor.kt:87)
E at io.specmatic.test.reports.OpenApiCoverageReportProcessor.process(OpenApiCoverageReportProcessor.kt:36)
E at io.specmatic.test.SpecmaticJUnitSupport.report(SpecmaticJUnitSupport.kt:231)
E at java.base/java.lang.reflect.Method.invoke(Method.java:568)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
E at java.base/java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092)
E at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
specmatic/generators/pytest_generator.py:26: Failed
Loading