Library can not be used in android (arm64)

[atopavirgil]

Not sure why, maybe some building flags. The library is build using VCPKG and works under Windows and Linux x64. However build using an android triplet when linked in an execurable or another shared library getting this for a static build:

/home/adrian/Dev/android/android-ndk-r23b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/lib/aarch64-linux-android/21/liblog.so -llog -landroid -static-libstdc++ -latomic -lm && :
ld: error: /home/cc/Dev/vcpkg/installed/arm64-android/lib/libtommath.a(bn_mp_abs.o) is incompatible with aarch64linux
ld: error: /home/cc/Dev/vcpkg/installed/arm64-android/lib/libtommath.a(bn_mp_add.o) is incompatible with aarch64linux
ld: error: /home/cc/Dev/vcpkg/installed/arm64-android/lib/libtommath.a(bn_mp_and.o) is incompatible with aarch64linux
ld: error: /home/cc/Dev/vcpkg/installed/arm64-android/lib/libtommath.a(bn_mp_clear.o) is incompatible with aarch64linux
...

If a dynamic build is used, same aerror but reffering to the full lib.

Any build flags missing ? Does the library work under arm64 ?

[czurnieden]

Sorry for the long delay!

Is this still a problem or did you find a solution?

If it is still a problem I need to replicate the problem so I need the data of your environment (version numbers etc) and how you came to it, that is what were your individual steps.

And yes, it is most likely a matter of build flags (probably LDFLAGS?). ARM64 itself is supported.

[atopavirgil]

Yes still not solved the problem. The library builds and can be used in Linux and Windows. We are trying to port the project using it to Android. I'm using latest NDK, and the triplet used is this one:
set(VCPKG_TARGET_ARCHITECTURE arm64)
set(VCPKG_CRT_LINKAGE static)
set(VCPKG_LIBRARY_LINKAGE dynamic)
set(VCPKG_CMAKE_SYSTEM_NAME Android)

All libraries required build in VCPKG properly. Even this library builds, I get both a static and a shared library.
If I'm using the static library and linking it on another static library it works. However if my main library is dynamic the link fails with this error.( I tried to link with the dynamic build of libtommath, to check, same error but this time refers to all library, not to functions. I'm using a few other libraries build with the same triplet in VCPKG and I do not get any link errors, so something is different with this one. I'm new to Android build, so maybe I miss something.

Thanks for your help.

[atopavirgil]

This is the port file used in VCPKG to build the library:

vcpkg_from_github(
OUT_SOURCE_PATH SOURCE_PATH
REPO libtom/libtommath
REF v1.2.0
SHA512 500bce4467d6cdb0b014e6c66d3b994a8d63b51475db6c3cd77c15c8368fbab4e3b5c458fcd5b35838b74c457a33c15b42d2356964f5ef2a0bd31fd544735c9a
HEAD_REF develop
)

if(VCPKG_TARGET_IS_WINDOWS)
vcpkg_check_linkage(ONLY_STATIC_LIBRARY)

if(VCPKG_CRT_LINKAGE STREQUAL "dynamic")
    set(CRTFLAG "/MD")
else()
    set(CRTFLAG "/MT")
endif()

# Make sure we start from a clean slate
vcpkg_execute_build_process(
    COMMAND nmake -f ${SOURCE_PATH}/makefile.msvc clean
    WORKING_DIRECTORY ${SOURCE_PATH}
    LOGNAME clean-${TARGET_TRIPLET}-dbg
)

#Debug Build
vcpkg_execute_build_process(
    COMMAND nmake -f ${SOURCE_PATH}/makefile.msvc CFLAGS="${CRTFLAG}d"
    WORKING_DIRECTORY ${SOURCE_PATH}
    LOGNAME build-${TARGET_TRIPLET}-dbg
)

file(INSTALL
    ${SOURCE_PATH}/tommath.lib
    DESTINATION ${CURRENT_PACKAGES_DIR}/debug/lib
)

# Clean up necessary to rebuild without debug symbols
vcpkg_execute_build_process(
    COMMAND nmake -f ${SOURCE_PATH}/makefile.msvc clean
    WORKING_DIRECTORY ${SOURCE_PATH}
    LOGNAME clean-${TARGET_TRIPLET}-rel
)

vcpkg_execute_build_process(
    COMMAND nmake -f ${SOURCE_PATH}/makefile.msvc CFLAGS="${CRTFLAG}"
    WORKING_DIRECTORY ${SOURCE_PATH}
    LOGNAME build-${TARGET_TRIPLET}-rel
)

file(INSTALL
    ${SOURCE_PATH}/tommath.lib
    DESTINATION ${CURRENT_PACKAGES_DIR}/lib
)

file(INSTALL
    ${SOURCE_PATH}/tommath.h
    DESTINATION ${CURRENT_PACKAGES_DIR}/include
)

else()
if(VCPKG_LIBRARY_LINKAGE STREQUAL "dynamic")
set(MAKE_FILE "makefile.shared")
else()
set(MAKE_FILE "makefile")
endif()

vcpkg_execute_build_process(
    COMMAND make -f ${MAKE_FILE} clean
    WORKING_DIRECTORY ${SOURCE_PATH}
)

vcpkg_execute_build_process(
    COMMAND make -j${VCPKG_CONCURRENCY} -f ${MAKE_FILE} PREFIX=${CURRENT_PACKAGES_DIR}/debug COMPILE_DEBUG=1 install
    WORKING_DIRECTORY ${SOURCE_PATH}
)
file(REMOVE_RECURSE "${CURRENT_PACKAGES_DIR}/debug/include")

vcpkg_execute_build_process(
    COMMAND make -f ${MAKE_FILE} clean
    WORKING_DIRECTORY ${SOURCE_PATH}
)

vcpkg_execute_build_process(
    COMMAND make -j${VCPKG_CONCURRENCY} -f ${MAKE_FILE} PREFIX=${CURRENT_PACKAGES_DIR} install
    WORKING_DIRECTORY ${SOURCE_PATH}
)

endif()

file(INSTALL
${SOURCE_PATH}/LICENSE
DESTINATION ${CURRENT_PACKAGES_DIR}/share/${PORT} RENAME copyright
)

[atopavirgil]

Any suggestion what needs to be changed in this "port" file to fix the problem ? As I mentioned, the port file and the library work for an x86 standard Linux build, the problem is only when trying to use the library on an Android ARM64 build, when I get the errors. The build is cross-compiled from Linux using the android NDK tools, which works properly for other libraries build., except this one so the toolchain is properly setup.

[czurnieden]

I tried your triplet and port (you just changed VCPKG_LIBRARY_LINKAGE in $(vcpkg)/triplets/community/arm64-android.cmake and nothing in $(vcpkg)/ports/libtommath/portfile.cmake if I read it correctly?) and was not able to build for ARM64, it builds x86 binaries. But I don't use VCPKG for ARM development, so I might have made something wrong.

There should be a file $(vcpkg)/buildtrees/libtommath/stdout-arm64-android.log and two files $(vcpkg)/buildtrees/libtommath/build-*.log if you didn't change it. Would you do me a favor and post them here?

And please run objdump -f $(vcpkg)/installed/arm64-android/lib/libtommath.so.1.2.0 (path and name may vary, I mean the build dynamic version), too, while you are at it, thanks.

[czurnieden]

Can you use the develop branch instead?
You would need to change the vcpkg_from_github function in the portfile to:

vcpkg_from_github(
    OUT_SOURCE_PATH SOURCE_PATH
    REPO libtom/libtommath
    REF 04e9d1e7a0493910b2eb5e757d623870692ada04
    SHA512 804d1c1b416eebb27f78a6c67d7d0c0b120e4c73c0876f4b6002c4dc6759b2e08407fceb89f642435041a9ca2ccaa91ef41c1f64e9430b5c4a7e598643b34150
    HEAD_REF develop
)

to do so.

[atopavirgil]

I think this is the problem. Looking at objdump, for libtommath and the other libraries build in the same folder, it looks like libtommath is not cross-compiled but build for x86 ? See the architecture for other libs (all build with the same triplet, in the same environment). All are using same triplet/environment and I did not touch the port file for any libs. What is different which may explain something, the build triplet asks for "dynamic build". For libtommath the build generates both a static and a dynamic library (I think in Windows we just get the static one, this is why we link with the static one in every environment). I suppose the static one is also not cross-compiled.

adrian@HX90-MINT:~/Dev/vcpkg/installed/arm64-android/lib$ objdump -f libtommath.so.1.2.0

libtommath.so.1.2.0: file format elf64-x86-64
architecture: i386:x86-64, flags 0x00000150:
HAS_SYMS, DYNAMIC, D_PAGED
start address 0x0000000000005090

adrian@HX90-MINT:~/Dev/vcpkg/installed/arm64-android/lib$ objdump -f libgtest.so

libgtest.so: file format elf64-little
architecture: UNKNOWN!, flags 0x00000150:
HAS_SYMS, DYNAMIC, D_PAGED
start address 0x00000000000cd4cc

adrian@HX90-MINT:~/Dev/vcpkg/installed/arm64-android/lib$ objdump -f libz.so

libz.so: file format elf64-little
architecture: UNKNOWN!, flags 0x00000150:
HAS_SYMS, DYNAMIC, D_PAGED
start address 0x0000000000008a54

adrian@HX90-MINT:~/Dev/vcpkg/installed/arm64-android/lib$ objdump -f libcrypto.so

libcrypto.so: file format elf64-little
architecture: UNKNOWN!, flags 0x00000150:
HAS_SYMS, DYNAMIC, D_PAGED
start address 0x00000000000f923c

adrian@HX90-MINT:~/Dev/vcpkg/installed/arm64-android/lib$ objdump -f libssl.so.1.1

libssl.so.1.1: file format elf64-little
architecture: UNKNOWN!, flags 0x00000150:
HAS_SYMS, DYNAMIC, D_PAGED
start address 0x000000000003418c

[atopavirgil]

stdout-arm64-android.log
stdout-arm64-android.log

[atopavirgil]

build-out.log

build-out.log

[atopavirgil]

I will try later with the "develop" branch, if you think that fixes the problem.

I tried ( changed the port file, remove, install libtommath again in vcpkg). I hope this used the modified port file (the file did not changed, it stayed as the modified one, I hope it did get used for the new install, I see in downloads a libtom package with 04e9... in name so probably did) but the objdump still shows an x86 build. I think the use of libtool is breaking the cross compiling, the other libs do not seem to use it.

[atopavirgil]

I did the dump for the static lib, and also for another static build one Goggle "benchmark". The "benchmark" lib is also build as static only even if the triplet requires dynamic build, but I don't think it uses libtool, and it is correct. Libtommath builds however for x86 not for ARM64. Can the build be fixed and not use libtool (just build the static lib same as benchmark ? I'm not familiar with the procedure. I also think that cross-compile with libtool is a known problem, not sure if it was solved or not)

Here is the dump file:

staticdump.txt

[czurnieden]

Thanks for the dumps, were helpful!

I also think that cross-compile with libtool is a known problem, not sure if it was solved or not

Yes, it is still not easy.

The port-file does the standard build only. We would need to set CC to the correct compiler (from the Android-NDK) and the linker, too, of course. Path to the NDK is assumed to be in the shell variable ANDROID_NDK_HOME. Binaries are in $(android-ndk)/toolchains/llvm/prebuilt/$(local-architectur)/bin/ (scripts, actually, calling the compiler with the correct arguments). You need aarch64. There are also optimizing versions for 10 different Android versions. I don't know which one you need, would use 31.

I doubt it would be as easy as to just set CC to one of the NDK scripts and manipulate libtool to use the NDK linker, so it might need a couple of tries, especially the libtool part. Are you willing and able to help me out with it? The "trying" part I mean?

BTW: your objdump does not seem to know the ARM architecture, you can try the llvm-objdump in the NDK.

One of the main reasons for the complex build-process of LibTomMath is the broad support: about a dozen operating systems for about a dozen architectures.

[sjaeckel]

Can you please try out if using the add-cmake-support branch solves your issue?

I guess this also simplifies your build recipe a lot.

[atopavirgil]

Can you please try out if using the add-cmake-support branch solves your issue?

I guess this also simplifies your build recipe a lot.

Thank I will try. I will have to move the project out of the vcpkg build and build it separately but if it solves the problem it's worth the effort. I have a combination of projects some are available in vcpkg (great!), other not. Most if not all of other projects I encountered are build using CMake.

[atopavirgil]

You are correct , the path to NDK is in the environment variable. In fact there is a good description here for building Android via VCPKG , and it works well for all other projects I tried.

https://vcpkg.readthedocs.io/en/latest/users/android/

For the second question. of course. Would be great to get this fixed, and if works get the port updated in VCPKG also, may help others. The cross-compile problem can be in any environment not only Android (can be also for Apple M1, if same procedure is used).