31.0: protoc linking fails due to missing `upb_AllExts` symbols

[mtelka]

What version of protobuf and what language are you using?
Version: 31.0
Language: N/A

What operating system (Linux, Windows, ...) and version?
OpenIndiana Hipster

What runtime / compiler are you using (e.g., python version or gcc version)
GCC 14

What did you do?
I'm trying to compile protobuf 31.0 on OpenIndiana.

What did you expect to see
The compilation complete successfully (as it did with versions 24.4, 29.3, 30.1, 30.2).

What did you see instead?

[ 50%] Linking CXX executable protoc
Undefined                       first referenced
 symbol                             in file
__stop_linkarr_upb_AllExts          libprotoc.so.31.0.0  (symbol scope specifies local binding)
__start_linkarr_upb_AllExts         libprotoc.so.31.0.0  (symbol scope specifies local binding)
ld: fatal: symbol referencing errors. No output written to protoc-31.0.0
collect2: error: ld returned 1 exit status

Anything else we should know about your project / environment
This is with native illumos (Solaris) linker, not GNU ld.

[mtelka]

I bisected the issue to the move of the upb minitable code generator into protoc. Particularly, the following set of changes is causing the problem:

dce6b0f
b90cc56
7229ef1

[acozzette]

We are actually getting ready to move the minitable code generator back out of protoc, so I think that should fix the problem. Unfortunately, though, that probably won't happen until the 32.0 release scheduled for July.

[mtelka]

The 32.0 timeframe is okay and fully acceptable. We will simply skip the 31.x line. Thank you.

[acozzette]

Actually I realized that this will not automatically be fixed in 32.0. We're moving the upb minitable generator out of protoc but introducing a new upb dependency in the Rust generator, so the problematic symbols are still going to be there in protoc.

It seems to me like the Illumos linker probably doesn't support linker arrays or at least doesn't support them the way we are currently using them.

Is there a macro we could check to determine if we're on an Illumos build so that we could just disable our use of linker arrays? We don't use them for anything in protoc, so that could be an easy way to fix this build.

[scpeters]

We are actually getting ready to move the minitable code generator back out of protoc, so I think that should fix the problem. Unfortunately, though, that probably won't happen until the 32.0 release scheduled for July.

it looks like this was done in #21886

Actually I realized that this will not automatically be fixed in 32.0. We're moving the upb minitable generator out of protoc but introducing a new upb dependency in the Rust generator, so the problematic symbols are still going to be there in protoc.

but it sounds like this change may not fix the problem

[mtelka]

Is there a macro we could check to determine if we're on an Illumos build so that we could just disable our use of linker arrays? We don't use them for anything in protoc, so that could be an easy way to fix this build.

You can check for __illumos__ (see https://www.illumos.org/issues/13726 for more info).