Expected HTTP Status Code: 200 (OK). Actual Status Code: 404 (Not Found)

[Jeroenhuisjes]

It does work with a fresh magento dev version. It seems like it can't find the webshop url and perform an assertion.

Preconditions

1. Ubuntu 7.10
2. Selenium 3.9
3. Magento 2.2-master. Installed the testing framework manually.

Steps to reproduce

1. Local Magento installation with nginx

Expected result

1. The default functional tests should run

Actual result

In IsEqual.php line 140:

Expected HTTP Status Code: 200 (OK). Actual Status Code: 404 (Not Found)
Failed asserting that 404 matches expected 200.

run [-o|--override OVERRIDE] [-e|--ext EXT] [--report] [--html [HTML]] [--xml [XML]] [--tap [TAP]] [--json [JSON]] [--colors] [--no-colors] [--silent] [--steps] [-d|--debug] [--coverage [COVERAGE]] [--coverage-html [COVERAGE-HTML]] [--coverage-xml [COVERAGE-XML]] [--coverage-text [COVERAGE-TEXT]] [--coverage-crap4j [COVERAGE-CRAP4J]] [--coverage-phpunit [COVERAGE-PHPUNIT]] [--no-exit] [-g|--group GROUP] [-s|--skip SKIP] [-x|--skip-group SKIP-GROUP] [--env ENV] [-f|--fail-fast] [--no-rebuild] [--] [] []

PHP Fatal error: Uncaught RuntimeException: Command Did Not Finish Properly in /home/jeroen/public_html/magento2/dev/tests/acceptance/vendor/codeception/codeception/src/Codeception/Subscriber/ErrorHandler.php:101
Stack trace:
#0 [internal function]: Codeception\Subscriber\ErrorHandler->shutdownHandler()
#1 {main}
thrown in /home/jeroen/public_html/magento2/dev/tests/acceptance/vendor/codeception/codeception/src/Codeception/Subscriber/ErrorHandler.php on line 101

[Jeroenhuisjes]

Any ideas?

[okolesnyk]

Hi @Jeroenhuisjes.
We'll figure it out.
Can provide command you used to run tests?
There are lots of possible issues can be and first of all I want to be sure you didn't try to run skipped tests.

[okolesnyk]

Also this error can occur if Magento is not using URL Rewrites.
If your link to Magento backend is : magento.local/index.php/admin then you should specify in .env file MAGENTO_BASE_URL=http://magento.local/index.php/.
Otherwise it should be MAGENTO_BASE_URL=http://magento.local/

[Jeroenhuisjes]

Hi @okolesnyk!
Hmm we do use url rewrites on our local environments so that doesn't seem to be the problem. They run with nginx though. On my own laptop where I just run Apache it seems to work just fine.

We tried vendor/bin/codecept run and variations of this and we tried different vendor/bin/robo commands.
We use a local Selenium install. Looks like phpunit fails some kind of assertion or can't make a connection with the shop?

[okolesnyk]

Hey @Jeroenhuisjes
I finally figured out what is wrong.
This is our bug we should resolve.
The problem is in this file: https://github.com/magento/magento2-functional-testing-framework/blob/develop/src/Magento/FunctionalTestingFramework/Module/MagentoRestDriver.php#L120

We didn't properly test it with nginx. Because I can only reproduce this with nginx webserver.

[okolesnyk]

Hi @Jeroenhuisjes. Thank you for the report. We created internal ticket MQE-897 to track the progress. We will update you here about progress on this issue.

[Jeroenhuisjes]

@okolesnyk Thanks!

[okolesnyk]

Hi @Jeroenhuisjes
After a while I can not reproduce this issue anymore.
We did some changes and probably we fixed it.
Can you please verify that this issue has gone?
If you still facing same problem, please make sure you using latest MFTF v. 2.1.2.