`test` should warn when multiple test frameworks are on the classpath

[scarf005]

Version(s)
Scala code runner version: 1.7.1
Scala version (default): 3.6.4

Describe the bug

adding //> using toolkit default to scalatest file

To Reproduce

main.test.scala

//> using test.dep org.scalatest::scalatest::3.2.19

import org.scalatest.flatspec.AnyFlatSpec

class ExampleSpec extends AnyFlatSpec:
    "example" should "work" in { assertResult(1)(1) }

scala --cli-version 1.7.1 test .
Compiling project (test, Scala 3.6.4, JVM (23))
Compiled project (test, Scala 3.6.4, JVM (23))
ExampleSpec:
example
- should work
Run completed in 221 milliseconds.
Total number of tests run: 1
Suites: completed 1, aborted 0
Tests: succeeded 1, failed 0, canceled 0, ignored 0, pending 0

//> using test.dep org.scalatest::scalatest::3.2.19
//> using toolkit default

import org.scalatest.flatspec.AnyFlatSpec

class ExampleSpec extends AnyFlatSpec:
    "example" should "work" in { assertResult(1)(1) }

scala --cli-version 1.7.1 test .
Compiling project (test, Scala 3.6.4, JVM (23))
Compiled project (test, Scala 3.6.4, JVM (23))

Expected behaviour

importing toolkits shouldn't prevent scalatest from working silently.

[Gedochao]

Now, this is actually expected.
Scala Toolkit includes Munit, while the reproduction also imports ScalaTest.
As a result, there are 2 test frameworks on the classpath and Scala CLI doesn't know which one it should use.
You can state the test framework explicitly, like this:

//> using test.dep org.scalatest::scalatest::3.2.19
//> using toolkit default
//> using testFramework org.scalatest.tools.Framework

import org.scalatest.flatspec.AnyFlatSpec

class ExampleSpec extends AnyFlatSpec:
    "example" should "work" in { assertResult(1)(1) }

That being said, I would agree a warning should be raised in such a situation, possibly mentioning the test frameworks available in the project.

[tgodzik]

We should be able to use multiple test frameworks in a single target. Maybe we generate just one in Bloop config instead of both of them? Or is the test being run separetely without Bloop?

[Gedochao]

We should be able to use multiple test frameworks in a single target. Maybe we generate just one in Bloop config instead of both of them? Or is the test being run separetely without Bloop?

We don't run tests with Bloop.
Rather, we have a dedicated test runner module.

[Gedochao]

Actually... perhaps we could just run all the test frameworks we can find, unless a framework is explicitly specified.
I now wonder why the current implementation doesn't do that already.
Let me try some stuff.