Magento 2.1.0 - "General system exception happened" on Import .csv

[githeat]

Preconditions

1. PHP 7.0.11
2. MySQL 5.6.30
3. Magento 2.1.0 CE
4. Ubuntu 14.04.1 LTS

Steps to reproduce

1. Login to Magento admin panel
2. Select "System" -> "Import"
3. Entity type = "products", Import Behaviour = "Add/Update" - "Stop on error", Allowed errors count = "10", Field Seperator = ",", Multi value seperator ",", Select file to import = myfile, Image files directory = "pub/media/import/"

(Remove quotation marks).

Expected result

1. .CSV should be validated successfully, with 4065 lines (not including headers). Then the products should be imported successfully after clicking "Import"

Actual result

1. After uploading .CSV, I see a red "General system exception happened"
   

My .CSV is encoded (Using Notepad++) in "UTF-8-BOM". I have also tried "UTF-8".

Magento has been updated to 2.1.0.

I have checked:
/var/log/apache2/error.log - No related entries
/var/log/mysql/error.log - No related entries
/var/www/html/magento/var/log/system.log - No related entries
/var/www/html/magento/var/log/debug.log - No related entries

/var/www/html/magento/pub/media/import has 777 permissions to rule out permission issue.
Images inside /var/www/html/magento/pub/media/import have 775 permissions to rule out permissions issue.

In php.ini - upload size is 8mb (.csv is only 4mb).
In php.ini - uploads are enabled

Aside from this, I don't understand the issue. My .CSV is valid because I have been able to import products before, and I can import 1 product at a time. When I try and import 4k+ I get the issue, but it's unfeasable to try and do it by batches of 100.

Thanks for your time

[sevos1984]

Could you please share file that you try to import?

[wclsandipan]

Hi,

We are having the same error. We are using the version Magento 2.1.0 CE.
While we are using the default sample csv.
CSV has been attached below. (in zip format)

Thanks
catalog_product.csv.zip

[sevos1984]

Attached file is working for me, no error appear. Try update to latest magneto version.

[wclsandipan]

Thanks!!

[sevos1984]

@githeat Have you tried updating your code base?

[wclsandipan]

No. It worked with 2.1.0 CE as well, there would be some issue with server configuration I guess, as we have transferred the site to another server, it started working. I need to ask the server administrator about the difference.
I guess you can close ticket as the original author of this ticket is not responding.

[koenner01]

This issue shouldn't be closed as there was no response to @githeat his post.
We are having this issue with MG2.1.4 CE, importing a file containing 4k+ products (data for 2 storeviews) with about 10 columns per row.

There should REALLY be something logged to the logs files because now there is not a single trace of what the problem could be...

[koenner01]

I've done some more digging and the place where the problem lies is in the validateSource function in Magento\ImportExport\Model\Import where the exception in the try catch is not being logged / outputted

public function validateSource(\Magento\ImportExport\Model\Import\AbstractSource $source)
{
    $this->addLogComment(__('Begin data validation'));
    try {
        $adapter = $this->_getEntityAdapter()->setSource($source);
        $errorAggregator = $adapter->validateData();
    } catch (\Exception $e) {
        $errorAggregator = $this->getErrorAggregator();
        $errorAggregator->addError(
            \Magento\ImportExport\Model\Import\Entity\AbstractEntity::ERROR_CODE_SYSTEM_EXCEPTION,
            ProcessingError::ERROR_LEVEL_CRITICAL,
            null,
            null,
            null,
            $e->getMessage()
        );
    }

    $messages = $this->getOperationResultMessages($errorAggregator);
    $this->addLogComment($messages);

    $result = !$errorAggregator->getErrorsCount();
    if ($result) {
        $this->addLogComment(__('Import data validation is complete.'));
    }
    return $result;
}

In our case the Magento\Framework\Stdlib\StringUtils was throwing a warning during strlen function because of an incorrect character

[miguelBarreiro85]

Same issue "General system exception happened", on magento 2.1.5, made a sample file download in the admin zone and tried to import it, just for testing, same error.

Just have logs on debug.log: main.DEBUG cache_invalidate

Does anyone know how to solve this?