Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scan spec item from test report #183

Open
redcatbear opened this issue Oct 30, 2018 · 3 comments
Open

Scan spec item from test report #183

redcatbear opened this issue Oct 30, 2018 · 3 comments

Comments

@redcatbear
Copy link
Collaborator

As a quality engineer
I want to check whether the test covering a requirement were executed and succeeded
in order to make sure that tests not only exist, but are in fact used and come back green.

Implementation Idea

Since #159 we are using JUnit5 as unit testing framework it should be possible to find or write a JUnit5 extension that lets us add the specification item ID to the test name so that it will appear in test reports.

OFT should then scan the test results and correlate them with the tests, allowing for even deeper coverage checks.

@redcatbear redcatbear added this to TODO in OpenFastTrace (deprecated) via automation Oct 30, 2018
@redcatbear
Copy link
Collaborator Author

@kaklakariada, I think this would be quite an advantage over a lot of existing systems.

@kaklakariada
Copy link
Contributor

Good idea. I propose to use a custom annotation on test methods. This will require an additional importer.

@redcatbear
Copy link
Collaborator Author

Exactly. We then also need a priority mechanism that makes sure that if there are two competing importers for one source, the that is assumed better is tried first.

If that fails to produce any items, we fall back to the next.

@redcatbear redcatbear added feature and removed story labels Feb 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: 📫 Backlog
Development

No branches or pull requests

2 participants