Claude finished @strawgate's task —— View job

Investigation Complete ✓

Recommendation

Add a new make test-concise target that uses pytest's --tb=no and -q flags to produce minimal output while still showing errors. Update AGENTS.md to reference this new command for AI agents.

Findings

Current Test Output Verbosity

The current make test command produces extremely verbose output:

Shows every test as it runs with full file paths
Uses -vv (very verbose) flag (Makefile:95-97)
Displays worker scheduling details from pytest-xdist
Shows platform/plugin information
For 4112 tests, this creates thousands of lines of output

Example from current output:

platform linux -- Python 3.10.19, pytest-8.4.2, pluggy-1.6.0 -- /home/runner/work/py-key-value/py-key-value/.venv/bin/python
cachedir: .pytest_cache
rootdir: /home/runner/work/py-key-value/py-key-value/key-value/key-value-aio
configfile: pyproject.toml
plugins: anyio-4.11.0, dotenv-0.5.2, inline-snapshot-0.30.1, timeout-2.4.0, asyncio-1.2.0, xdist-3.8.0, mock-3.15.1
timeout: 10.0s
timeout method: signal
timeout func_only: False
asyncio: mode=auto, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
created: 4/4 workers
4 workers [4112 items]

scheduling tests via LoadFileScheduling

key-value/key-value-aio/tests/stores/mongodb/test_mongodb.py::test_managed_entry_document_conversion_native_mode 
key-value/key-value-aio/tests/stores/valkey/test_valkey.py::TestValkeyStore::test_store[7.2.5-with_ctx_manager] <- tests/stores/base.py 
[gw0] [  0%] PASSED key-value/key-value-aio/tests/stores/mongodb/test_mongodb.py::test_managed_entry_document_conversion_native_mode
...

Current Makefile Test Targets

The Makefile (lines 89-111) defines these test targets:

make test: Runs all tests with -vv (very verbose)
make test-aio: Runs async tests with -vv
make test-sync: Runs sync tests with -vv
make test-shared: Runs shared tests with -vv

All use the -vv flag which produces maximum verbosity.

pytest Configuration

Found in key-value/key-value-aio/pyproject.toml (lines 53-64):

[tool.pytest.ini_options]
asyncio_mode = "auto"
addopts = [
    "--inline-snapshot=disable",
    "-n=auto",
    "--dist=loadfile",
    "--maxfail=5"
]
markers = [
    "skip_on_ci: Skip running the test when running on CI",
]
timeout = 10

Solution: Concise Test Output

Pytest supports several flags for concise output:

-q or --quiet: Decrease verbosity (shows dots for passing tests)
--tb=no: Don't show tracebacks for failures (just show which tests failed)
--tb=line: Show one line per failure (minimal but still shows errors)
--tb=short: Show short tracebacks (good middle ground)

For AI agents, the best combination is:

-q --tb=line: Minimal output with one-line error summaries
OR -q --tb=short: Slightly more detail for debugging

This would produce output like:

============================= test session starts ==============================
...........................................................................
...........................................................................
FAILED tests/stores/redis/test_redis.py::TestRedisStore::test_something - AssertionError: expected X but got Y
...........................................................................
============================== 4000 passed, 1 failed in 45.67s ===============

Detailed Action Plan

Step 1: Add `test-concise` target to Makefile

Add a new target after the existing test targets (around line 112):

# Concise test output for AI agents - supports PROJECT parameter
test-concise:
ifdef PROJECT
	@echo "Testing $(PROJECT) (concise output)..."
	@cd $(PROJECT) && uv run pytest tests . -q --tb=line
else
	@echo "Testing all packages (concise output)..."
	@uv run pytest key-value/key-value-aio/tests -q --tb=line
	@uv run pytest key-value/key-value-sync/tests -q --tb=line
	@uv run pytest key-value/key-value-shared/tests -q --tb=line
endif

# Convenience targets for specific packages with concise output
test-aio-concise:
	@echo "Testing key-value-aio (concise output)..."
	@uv run pytest key-value/key-value-aio/tests -q --tb=line

test-sync-concise:
	@echo "Testing key-value-sync (concise output)..."
	@uv run pytest key-value/key-value-sync/tests -q --tb=line

test-shared-concise:
	@echo "Testing key-value-shared (concise output)..."
	@uv run pytest key-value/key-value-shared/tests -q --tb=line

Options for error display:

--tb=line: Most concise, one line per failure
--tb=short: Slightly more detail, shows short tracebacks
--tb=auto: Default behavior but quieter with -q

Recommendation: Start with --tb=line for maximum conciseness.

Step 2: Update `.PHONY` declaration

Add the new targets to the .PHONY declaration at the top of the Makefile (lines 1-2):

.PHONY: bump-version bump-version-dry codegen lint typecheck sync precommit test build help
.PHONY: install test-aio test-sync test-shared test-concise test-aio-concise test-sync-concise test-shared-concise docs-serve docs-build docs-deploy

Step 3: Update help target

Add documentation for the new targets in the help message (around line 17):

	@echo "  make test-concise      - Run all tests (concise output for AI agents)"
	@echo "  make test-aio-concise  - Run async package tests (concise)"
	@echo "  make test-sync-concise - Run sync package tests (concise)"
	@echo "  make test-shared-concise - Run shared package tests (concise)"

Step 4: Update AGENTS.md

Add the new command to the "Make Commands Reference" table (around line 250):

| Command | Purpose |
|---------|---------|
| `make sync` | Install all dependencies |
| `make install` | Alias for `make sync` |
| `make lint` | Lint Python + Markdown |
| `make typecheck` | Run Basedpyright type checking |
| `make test` | Run all test suites (verbose) |
| `make test-concise` | Run all test suites (concise output for AI) |
| `make test-aio` | Run async package tests |
| `make test-aio-concise` | Run async package tests (concise) |
| `make test-sync` | Run sync package tests |
| `make test-sync-concise` | Run sync package tests (concise) |
| `make test-shared` | Run shared package tests |
| `make test-shared-concise` | Run shared package tests (concise) |
| `make codegen` | Generate sync library from async |
| `make precommit` | Run lint + typecheck + codegen |
| `make build` | Build all packages |

Also add a note in the "Testing Requirements" section (around line 23):

### Testing Requirements

- All new features require tests in both async and sync packages
- Run `make test` to execute all test suites (verbose output)
- Run `make test-concise` for minimal output (recommended for AI agents)
- Run `make test-aio` for async package tests only
- Run `make test-sync` for sync package tests only
- Test coverage should be maintained

Step 5: Test the implementation

Run the new commands to verify they work:

make test-concise
make test-aio-concise
make test-sync-concise
make test-shared-concise

Compare output length with the verbose versions to confirm the improvement.

Related Issues and Pull Requests

Repository	Issue or PR	Relevance
strawgate/py-key-value	#220: Allow Agents to run make test	Recent PR that enabled agents to run tests by installing dependencies in CI workflows
strawgate/py-key-value	#213: Allow Claude to run tests	Issue about enabling Claude to run tests, resolved by PR #220

Related Files

File	Relevance	Lines
Makefile	Contains all test targets that need to be updated with concise variants	89-111 (test targets), 1-2 (.PHONY), 8-35 (help)
AGENTS.md	Documentation for AI agents that needs to reference the new concise test command	248-262 (Make Commands Reference), 23-29 (Testing Requirements)
key-value/key-value-aio/pyproject.toml	Contains pytest configuration showing current test setup	53-64

Problems Encountered During Investigation

None - all investigation tools were accessible and provided comprehensive information about the codebase and test infrastructure.

add make test-concise #226

Description

Metadata

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Issue actions

add `make test-concise` #226