Skip to content

Test suite source validation #1096

@petertrr

Description

@petertrr

After test suite source is fetched, we should store and display validations, including among others:

  • Whether source contains suites with plugins that have zero tests
  • Whether source contains suites with wildcard mode (not handled well by save-cloud currently?)

This includes calculating these validations, storing them in the storage and support them on the frontend


Tasks, as discussed with @nulls:

  • Front-end
  • Back-end
    • TBD
  • Preprocessor
    • Wrap blocking operations into blockingToMono {} #1778
    • Implement test suite validators on the preprocessor side #1955
    • Get rid of type aliases #1956
    • Refactor TestSuitesPreprocessorController#doFetchTests() and the underlying calls
      • The snapshot should be always saved (TestPreprocessorToBackendBridge#saveTestsSuiteSourceSnapshot()), even in case of validation errors. This is necessary, so that a malformed snapshot is never re-fetched again.
      • The tests_source_snapshot table, along with the corresponding DTO, should be enriched with isSuccessful and errorMessage fields
      • TestDiscoveringService#detectAndSaveAllTestSuitesAndTests() should perform the following operations, in order:
        1. detect test suites and tests
        2. validate test suites and tests
        3. update the saved snapshot with status and error messages, if any
        4. save test suites and tests, if the validation succeeded

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions