"Test result not found" if cwd is a subdirectory in the workspace

[adri0]

VS Code version

1.62.2

Extension version

v2021.11.1422169775

OS type

macOS

OS version

10.15.7

Python distribution

python.org

Python version

Python 3.9.5

Language server

None or Disabled

Expected behaviour

Test results should show after running tests using Testing sidebar.

Actual behaviour

Exception raised after test finished running:

Test result not found for: ./tests/test_mod.py::test_1

Steps to reproduce

Structure of the repository that reproduces the issue:

.
├── .gitignore
├── README.md
├── backend
│   ├── .python-version
│   ├── Pipfile
│   ├── Pipfile.lock
│   ├── src
│   │   └── testmod
│   │       └── __init__.py
│   └── tests
│       ├── conftest.py
│       └── test_mod.py
└── test-pytest.code-workspace

I included in the repository the settings.json used. That shows:

{
    "python.defaultInterpreterPath": "/Users/adri0/.local/share/virtualenvs/backend-kdNxFSnI",
    "python.terminal.activateEnvironment": true,
    "python.terminal.activateEnvInCurrentTerminal": true,
    "python.testing.cwd": "${workspaceFolder}/backend",
    "python.testing.pytestEnabled": true,
    "python.testing.unittestEnabled": false,
    "python.testing.pytestArgs": [
        "tests/"
    ]
}

I noticed that if I change the cwd to ${workspaceFolder} and move the tests folder to the repository root, it works.

Logs

cwd: ~/code/test-pytest-clone/backend
> ~/.local/share/virtualenvs/backend-kdNxFSnI/bin/python ~/.vscode/extensions/ms-python.python-2021.11.1422169775/pythonFiles/testing_tools/run_adapter.py discover pytest -- --rootdir ~/code/test-pytest-clone/backend -s --cache-clear tests/

Code of Conduct

• I agree to follow this project's Code of Conduct

[karthiknadig]

@adri0 Here are the changes I made to get this working see if it works for you:
This is the structure:

The "tests" are out side of the src folder.

Remove the settings.json, as you can see I don't have a .vscode folder.

This is my workspace.code-workspace:

{
    "folders": [
        {
            "path": "."
        }
    ],
    "settings": {
        "python.defaultInterpreterPath": "/Users/adri0/.local/share/virtualenvs/backend-kdNxFSnI",
        "python.terminal.activateEnvironment": true,
        "python.terminal.activateEnvInCurrentTerminal": true,
        "python.testing.cwd": "${workspaceFolder}",
        "python.testing.pytestEnabled": true,
        "python.testing.unittestEnabled": false,
        "python.testing.pytestArgs": ["tests"]
    }
}

I did some minor tweaks to the cwd and pytestAtgs settings.

It seems to be working:

[karthiknadig]

Let me know if the above changes work for you.

[adri0]

The problem does go away when I change the folder structure for the one proposed. The issue with it is that in some real life projects it's not an option for me to have the tests folder directly under the root directory, as the Python code is a component of a bigger project.

Thus I thought, why not change the python.testing.cwd config to match the folder structure, given I'm allowed to change it. When I notice this prevents the tests to work properly I thought this behaviour could be a bug.

[adri0]

Thanks about the settings in the workspace file tip. It does simplify things. I'll update the sample project.

[adri0]

I made an edit in the first comment. The actual folder structure should be ./backend/tests instead of ./tests.

[stilren]

I am also seeing issues with this. We have a very nested directory structure since we are deploying aws lambdas and each lambda has its own test folder

├── .gitignore
├── README.md
├── app
│   ├── lambda1
│   │   └── src
│   │       └── handler1.py
│   └── tests
│       ├── conftest.py
│       └── test_handler1.py
│   ├── lambda2
│   │   └── src
│   │       └── handler2.py
│   └── tests
│       ├── conftest.py
│       └── test_handler2.py

setting
"python.testing.cwd": "${workspaceFolder}/app"

throws the same type of error.

Here is a minimal example showing this error:

Folder structure

├── src
│   └── test_example.py

contents of test_example.py

from unittest import TestCase

class ExampleTest(TestCase):
    def test_example_test(self):
        assert 1 == 1

contents of settings.json

{
    "python.testing.unittestArgs": [
        "-v",
        "-s",
        ".",
        "-p",
        "test_*.py"
    ],
    "python.testing.pytestEnabled": true,
    "python.testing.unittestEnabled": false,
    "python.testing.cwd": "${workspaceFolder}/src"
}

[tinix0]

I can also confirm the same. We have tests in a subdirectory of the workspace with code directly in root.
Settings:
"python.testing.cwd": "${workspaceFolder}/unit_tests"