Zigbee devices no longer working in 2023.6.2

[octomobiki]

The problem

This (Zigbee devices stop working/reporting) started to happen as soon as I upgraded to the latest 2023.6.2 and for whatever reason I also can't revert the setup to the previous to try downgrading it.

Essentially if I reboot the entire VM cold, the zigbee integration works for... under an hour, then stops and won't until rebooting the VM again. Z-wave is working on the same stick seemingly without issues for now.

Silicon_Labs_HubZ_Smart_Home_Controller_715003AA-if01-port0, s/n: 715003AA - Silicon Labs - 10C4:8A2A for zha
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 387, in async_setup
    result = await component.async_setup_entry(hass, self)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/zha/__init__.py", line 122, in async_setup_entry
    await zha_gateway.async_initialize()
  File "/usr/src/homeassistant/homeassistant/components/zha/core/gateway.py", line 220, in async_initialize
    raise exc
  File "/usr/src/homeassistant/homeassistant/components/zha/core/gateway.py", line 205, in async_initialize
    self.application_controller = await app_controller_cls.new(
                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/zigpy/application.py", line 219, in new
    await app.startup(auto_form=auto_form)
  File "/usr/local/lib/python3.11/site-packages/zigpy/application.py", line 193, in startup
    await self.connect()
  File "/usr/local/lib/python3.11/site-packages/bellows/zigbee/application.py", line 131, in connect
    self._ezsp = await bellows.ezsp.EZSP.initialize(self.config)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/bellows/ezsp/__init__.py", line 150, in initialize
    await ezsp._startup_reset()
  File "/usr/local/lib/python3.11/site-packages/bellows/ezsp/__init__.py", line 141, in _startup_reset
    await self.reset()
  File "/usr/local/lib/python3.11/site-packages/bellows/ezsp/__init__.py", line 170, in reset
    await self._gw.reset()
TimeoutError

I think I also see... is any of this helpful? never contributed a bug report before.

Silicon_Labs_HubZ_Smart_Home_Controller_715003AA-if01-port0, s/n: 715003AA - Silicon Labs - 10C4:8A2A for zha
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 387, in async_setup
    result = await component.async_setup_entry(hass, self)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/zha/__init__.py", line 122, in async_setup_entry
    await zha_gateway.async_initialize()
  File "/usr/src/homeassistant/homeassistant/components/zha/core/gateway.py", line 220, in async_initialize
    raise exc
  File "/usr/src/homeassistant/homeassistant/components/zha/core/gateway.py", line 205, in async_initialize
    self.application_controller = await app_controller_cls.new(
                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/zigpy/application.py", line 219, in new
    await app.startup(auto_form=auto_form)
  File "/usr/local/lib/python3.11/site-packages/zigpy/application.py", line 193, in startup
    await self.connect()
  File "/usr/local/lib/python3.11/site-packages/bellows/zigbee/application.py", line 131, in connect
    self._ezsp = await bellows.ezsp.EZSP.initialize(self.config)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/bellows/ezsp/__init__.py", line 150, in initialize
    await ezsp._startup_reset()
  File "/usr/local/lib/python3.11/site-packages/bellows/ezsp/__init__.py", line 141, in _startup_reset
    await self.reset()
  File "/usr/local/lib/python3.11/site-packages/bellows/ezsp/__init__.py", line 170, in reset
    await self._gw.reset()
TimeoutError

I built a new VM and installed 2023.6.1 - after a little finagling zigbee is back to stable.

Stability for me looks like this setup:

What version of Home Assistant Core has the issue?

core-2023.6.2

What was the last working version of Home Assistant Core?

core-2023.6.1

What type of installation are you running?

Home Assistant OS

Integration causing the issue

ZHA

Link to integration documentation on our website

No response

Diagnostics information

home-assistant_zha_2023-06-16T09-17-07.745Z.log

Example YAML snippet

No response

Anything in the logs that might be useful for us?

No response

Additional information

No response

[octomobiki]

Additional info:

#94614 (comment)

this person described my issue better than I did originally.

[home-assistant]

Hey there @dmulcahey, @Adminiuga, @puddly, mind taking a look at this issue as it has been labeled with an integration (zha) you are listed as a code owner for? Thanks!

Code owner commands

Code owners of zha can trigger bot actions by commenting:

• @home-assistant close Closes the issue.
• @home-assistant rename Awesome new title Renames the issue.
• @home-assistant reopen Reopen the issue.
• @home-assistant unassign zha Removes the current integration label and assignees on the issue, add the integration domain after the command.

_{^{(message by CodeOwnersMention)}}

---

zha documentation
zha source
_{^{(message by IssueLinks)}}

[puddly]

Essentially if I reboot the entire VM cold, the zigbee integration works for... under an hour, then stops and won't until rebooting the VM again.

What the error specifically is saying is that the serial port isn't working. ZHA will try to reconnect to the coordinator indefinitely but if it never does and only a reboot fixes it, this is a problem with either the OS or your hypervisor. I'm leaning towards the latter.

[octomobiki]

would a way of ruling this in or out be to take my 'fresh' install of 2023.06.01 and upgrading to 2023.06.02 and see what happens?

[puddly]

If you can consistently replicate the problem with one specific setup and not with another, that would be a place to start. I suspect it would have to do with the version of Home Assistant OS itself, not of Core.

[DavidGeorge528]

I'm encountering the same problem. Since upgrading earlier today, ZHA will not start and just says Failed to set up. I was also encountering a similar problem with Thread based devices connected through Homekit Controller, where they simply would not connect to HA.

After some diagnosing, I found that it stemmed back to the Silicon Labs Multiprotocol addon, which is allowing both Zigbee and Thread to run on my SkyConnect. The problem seems to be that there is some underlying issue with Zigbee and ZHA since this release, which then has a knock-on effect on Thread when the addon is running. If I restart the addon and don't restart ZHA, then my Thread network comes back up and works fine. But as soon as I try reloading the ZHA integration (Which always fails), my Thread network goes down and I lose control of all devices, requiring another restart of the Silicon Labs Multiprotocol addon.

I can also confirm that neither restoring the backup created just before the update nor restoring a nightly backup fixes this problem. Something in the update has had a permanent impact on ZHA, SkyConnect, and/or the Silicon Labs Multiprotocol addon to the point where restoring a backup cannot fix it.

[octomobiki]

A few hours ago on my restore'd NEW vm, i upgraded the OS back to 2023.06.02 - ZHA has been working much longer than it has been. so my timeline here is:

• Upgraded to 2023.06.02 on original VM yesterday (or possibly the day before)
• Since this upgrade zigbee would only work for the first few minutes of the VM restarting, then it would error out like the above
• I created a new VM, utilizing the latest as a base (2023.06.02)
• Using the backup I had from before upgrading to 2023.06.02, I restore'd that on the new VM (2023.06.01). At this point ZHA/zigbee works.
• Hours later I re-upgraded back to 2023.06.02 on the new VM, so far no issues.

[cpdowsett]

Hi same issue for me, have rolled back to 2023.6.1 for now will have a look at doing the above fix later.
Thanks

[JMoro-GH]

Hi all, I have the same problem. I am using a Conbee II stick and running HA OS as VM on Unraid. ZHA stopped working after an update, about 2 weeks ago (I don't remember exactly which OS version).

Here are some evidence of the problem:

The hardware is listed in the HA hardware section.

... and listed when trying to reconfigure ZHA

but I still get the unable to connect error.

Here is the log:
2023-06-17 12:00:41.075 DEBUG (MainThread) [zigpy_deconz.uart] Connecting to /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2225577-if00
2023-06-17 12:00:41.076 DEBUG (MainThread) [zigpy_deconz.uart] Connection made
2023-06-17 12:00:41.076 DEBUG (MainThread) [zigpy_deconz.uart] Connected to /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2225577-if00
2023-06-17 12:00:41.076 DEBUG (MainThread) [zigpy_deconz.api] Command Command.read_parameter (1, <NetworkParameter.protocol_version: 34>, b'')
2023-06-17 12:00:41.077 DEBUG (MainThread) [zigpy_deconz.uart] Send: 0x0a02000800010022
2023-06-17 12:00:42.889 WARNING (MainThread) [zigpy_deconz.api] No response to 'Command.read_parameter' command with seq id '0x02'
2023-06-17 12:00:42.890 ERROR (MainThread) [zigpy.application] Couldn't start application
Traceback (most recent call last):
File "/usr/local/lib/python3.11/asyncio/tasks.py", line 490, in wait_for
return fut.result()
^^^^^^^^^^^^
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/zigpy/application.py", line 193, in startup
await self.connect()
File "/usr/local/lib/python3.11/site-packages/zigpy_deconz/zigbee/application.py", line 81, in connect
self.version = await api.version()
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/zigpy_deconz/api.py", line 457, in version
(self._proto_ver,) = await self.read_parameter(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/zigpy_deconz/api.py", line 422, in read_parameter
r = await self._command(Command.read_parameter, 1 + len(data), param, data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/zigpy_deconz/api.py", line 306, in _command
return await asyncio.wait_for(fut, timeout=COMMAND_TIMEOUT)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/asyncio/tasks.py", line 492, in wait_for
raise exceptions.TimeoutError() from exc
TimeoutError

Looks like

Some additional infos:

• I can connect to the stick using Deconz add on, which then I disabled to avoid the known conflicts with ZHA
• I updated the stick firmware
• I tried to connect the ID using the /dev/ttyACM0 path as well as by ID.
• I tried to downgrade the OS but the issue subsist

It's about w weeks that I am unable to use any Zigbee device... and I am really struggling to find a solution.

Anyone managed to fix it? Someone has an idea of what to do?

Thanks for the support!

[dereitz]

same problem here!