The Wayback Machine - http://web.archive.org/web/20220223224426/https://github.com/hasura/graphql-engine/issues/7138
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

server: improve pytest integration test signal:noise ratio #7138

Open

sassela opened this issue Jun 28, 2021 · 0 comments
Open

server: improve pytest integration test signal:noise ratio #7138

sassela opened this issue Jun 28, 2021 · 0 comments

Comments

@sassela
Copy link
Member

@sassela sassela commented Jun 28, 2021

Issue split from #6951

our pytest output has a pretty low signal:noise ratio, and it's often difficult to understand the cause of a test failure, if there is one. Example: a 8600-line log for what turned out to be a flaky test that passed on a second run.

suggested improvements

  • there's almost certainly some pytest configuration that would help with this. Adjust circleci config and local testing scripts to reduce verbosity.
  • better isolate (or reduce) stateful tests.
@sassela sassela changed the title server: reduce pytest integration test signal:noise ration server: reduce pytest integration test signal:noise ratio Jun 28, 2021
@sassela sassela changed the title server: reduce pytest integration test signal:noise ratio server: improve pytest integration test signal:noise ratio Jun 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
1 participant