Server ota updates

[PeWos]

It is possible to update my esp32 via ota from a server like the esp8266. I have read this page http://esp8266.github.io/Arduino/versions/2.0.0/doc/ota_updates/ota_updates.html#http-server but the function can't be compiled with esp32.

Thanks in advance

[gellis12]

You can use the included BasicOTA example, but you need to add #include <Update.h> to the top of the file. Once you add that, it should work fine.

Edit: My answer seems to be irrelevant after PeWos edited the question.

[PeWos]

Hi @gellis12 I edited the question before you answered me, i had write bad a word. I have tried adding the update library but it only works in local with the arduino ide. What function do I have to add that is like the ESP8266 ESPhttpUpdate function?

[copercini]

I am porting it to ESP32, but actually have 2 working versions: the only http one (using WifiClient) and the only https one(using WifiClientSecure). So I am trying to unify both (to keep closer to ESP8266) and make a PR.

[vvs551]

Could you publish http version of OTA update?

[PhilColbert]

Any chance of publishing a working version ? :) thanks

[copercini]

Sorry for say that, but it's still missing some important functions for full port, like:

• SPIFFS
• Verify magic bytes (WiFiClient doesn't peek bytes)
• getSketchMD5, getFreeSketchSpace and getSketchSize functions

I think it's too early to release but HTTPClient port is one step closer...

[PhilColbert]

Ok thanks, am just looking for an easy way to do OTA updates - if it works at all, that would be great !

[inforaudio]

So we are looking for OTA Updates for ESP32 in Arduino IDE. Something can help me?

[skateone]

there is a nice example i used called AWS_S3_OTA_Update.ino
its part of the arduino esp32 bundle and works the same as the ESP-IDF updater.

hope this helps.

[peterzcruz]

does AWS_S3_OTA_Update.ino really work?

here is the serial reply on my test:

[code]
rst:0x10 (RTCWDT_RTC_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0x00
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:1
load:0x3fff0008,len:8
load:0x3fff0010,len:160
load:0x40078000,len:10632
load:0x40080000,len:252
entry 0x40080034
Connecting to 1900acOpenWRT
...
Connected to 1900acOpenWRT
Connecting to: esp32-testbucket.s3.ap-south-1.amazonaws.com
Fetching Bin: /StartCounter.ino.bin
contentLength : 0, isValidContentType : 0
There was no content in the response
[/code]

1. my S3 bucket is on https. is there a way to convert it to non secure http?
   there is a note on the sample:
   "Non https. For HTTPS 443. As of today, HTTPS doesn't work."

2. something is off with my test. there is no indication that i got connected to s3.
   im expecting this line on my serial terminal:

   • Serial.println("Connection to " + String(host) + " failed. Please check your setup");

   but i did not see that, nor the indication that i got connected, starting from this line:

   • Serial.println("Fetching Bin: " + String(bin));

ota sample from esp32-idf is working fine in my test.

any suggestion?
thanks

[lbernstone]

Peter-
S3 is pretty slow. The delay is only 100 ms in the example. I'd bump that up to 500ms or else loop a few times until client.available() is true.

[copercini]

For NonSSL as @lbernstone say, 100ms is too low for almost servers response.

For SSL mbedtls still doesn't peek bytes so WiFiClientSecure can't get the magic header from new firmware and updater fail at this part

[peterzcruz]

Thank you very much for the replies.

I changed the delay to this:

unsigned long timeout = millis();
while (client.available() == 0) {
    if (millis() - timeout > 5000) {
        Serial.println(">>> Client Timeout !");
        client.stop();
        return;
    }
}

s3 bucket is http accessible even if it gave me https link to the bin file after upload.

here is the reply I got in my terminal, added:
Serial.println(line);
after:
line.trim();

HTTP/1.1 200 OK
x-amz-id-2: 3prqlD2UPukbLhG4uY4KUqTOgF+Df9Cgxhwv3YAftxGIzGIa9dl0YpXX8pUj6OQaCcfusgnyJ24=
x-amz-request-id: 41588F5E690964D3
Date: Tue, 18 Jul 2017 10:27:21 GMT
Last-Modified: Tue, 18 Jul 2017 00:36:24 GMT
ETag: "ba994d72b01c874c7f5191d314d3009f"
Accept-Ranges: bytes
Content-Type: application/macbinary
Content-Length: 500976
Server: AmazonS3
Connection: close

End of line

Got 500976 bytes from server
Got application/macbinary payload.

contentLength : 500976, isValidContentType : 1
Begin OTA. This may take 2 - 5 mins to complete. Things might be quite for a while.. Patience!
Written only : 0/500976. Retry?
Error Occurred. Error #: 8

here is the code used to get headers:

while(client.available()) {
    String line = client.readStringUntil('\r');
    line.trim();
    Serial.println(line);
    if (!line.length()) {
        Serial.println("End of line");
        breal;
    }
    if (line.startsWith("HTTP/1.1")) {
        if (line.indexOf("200") < 0) {
            Serial.println("Got a non 200 status code from server. Exiting OTA Update.");
            break;
        }
    }
    if (line.startsWith("Content-Type: ")) {
        contentType = getHeaderValue(line, "Content-Type: ");
        //if (contentType == "application/octet-stream") {
        if (contentType == "application/macbinary") {
            isValidContentType = true;
        }
    }
    
    if (line.startsWith("Content-Length: ")) {
        contentLength = atoi((getHeaderValue(line, "Content-Length: ")).c_str());
    }
}
Serial.println("");
Serial.println("Got " + String(contentLength) + " bytes from server");
if (isValidContentType) {
    Serial.println("Got " + contentType + " payload.");
}
Serial.println("");
Serial.println("contentLength : " + String(contentLength) + ", isValidContentType : " + String(isValidContentType));

from the original code, I added:

   Serial.println("End of line");

to indicate im getting end of line

rearranged so I clearly see the header reply:

Serial.println("");
Serial.println("Got " + String(contentLength) + " bytes from server");
if (isValidContentType) {
    Serial.println("Got " + contentType + " payload.");
}
Serial.println("");
Serial.println("contentLength : " + String(contentLength) + ", isValidContentType : " + String(isValidContentType));

content type from my S3 header is "application/macbinary", so I changed that also, just to set the isValidContentType

if (line.startsWith("Content-Type: ")) {
    contentType = getHeaderValue(line, "Content-Type: ");
    //if (contentType == "application/octet-stream") {
    if (contentType == "application/macbinary") {
        isValidContentType = true;
    }
}

the remaining codes is unchanged, but I get this always:

contentLength : 500976, isValidContentType : 1
Begin OTA. This may take 2 - 5 mins to complete. Things might be quite for a while.. Patience!
Written only : 0/500976. Retry?
Error Occurred. Error #: 8

[peterzcruz]

tried also with my EC2 as the file server
(EC2 content type is application/octet-stream)

here is the reply in my terminal:

HTTP/1.1 200 OK
Date: Tue, 18 Jul 2017 21:57:49 GMT
Server: Apache/2.4.6 (Red Hat Enterprise Linux) PHP/5.4.16
Last-Modified: Tue, 18 Jul 2017 00:12:56 GMT
ETag: "7a4f0-5548c6093b200"
Accept-Ranges: bytes
Content-Length: 500976
Connection: close
Content-Type: application/octet-stream

End of line

Got 500976 bytes from server
Got application/octet-stream payload.

contentLength : 500976, isValidContentType : 1
Begin OTA. This may take 2 - 5 mins to complete. Things might be quite for a while.. Patience!
Written only : 0/500976. Retry?
Error Occurred. Error #: 8

am always getting Error Occurred. Error #: 8

Im using EC2 server on esp32-idf ota sample without problem

any suggestions?
thanks