Skip to content

[DO NOT MERGE] Testing on staging runners #3059

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
ababushk wants to merge 12 commits into
base: master
Choose a base branch
from
Draft

[DO NOT MERGE] Testing on staging runners #3059

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
abf25c8
Testing on staging runners
ababushk Nov 22, 2025
3d9503d
Trying to isolate the problem
ababushk Nov 23, 2025
8b0d5d4
Revert "Trying to isolate the problem"
ababushk Nov 23, 2025
0c37511
Reapply "Trying to isolate the problem"
ababushk Nov 24, 2025
1bc6777
Disable mac, no need to run that
ababushk Nov 24, 2025
6dd345d
trying to filter out passing tests to isolate the problem
ababushk Nov 24, 2025
9d1ad4b
Merge branch 'master' into new_runners_testing
ababushk Nov 25, 2025
2aa5008
Revert "trying to filter out passing tests to isolate the problem"
ababushk Nov 25, 2025
7a9523b
Revert "Reapply "Trying to isolate the problem""
ababushk Nov 25, 2025
0a2df9b
Merge branch 'master' into new_runners_testing
ababushk Dec 1, 2025
5e91dcf
use linux 8 cores 32 gb instead of 64 gb
ababushk Dec 3, 2025
b2e2654
Testing specialized Windows runners
ababushk Dec 3, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/cleanup_caches.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ permissions: read-all
jobs:
Cleanup_OV_CACHE:
name: Cleanup OV_CACHE
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
if: ${{ github.repository_owner == 'openvinotoolkit' }}
container:
image: openvinogithubactions.azurecr.io/dockerhub/ubuntu:20.04
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/coverity.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-medium
runs-on: aks-linux-medium-st
container:
image: 'openvinogithubactions.azurecr.io/openvino_provider:0.1.0'
volumes:
Expand Down Expand Up @@ -70,7 +70,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-16-cores-64gb
runs-on: aks-linux-16-cores-64gb-st
container:
image: openvinogithubactions.azurecr.io/ov_build/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down
48 changes: 24 additions & 24 deletions .github/workflows/linux.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-medium
runs-on: aks-linux-medium-st
container:
image: 'openvinogithubactions.azurecr.io/openvino_provider:0.1.0'
volumes:
Expand Down Expand Up @@ -124,7 +124,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_build/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -175,14 +175,14 @@ jobs:
-S ${{ env.SRC_DIR }} \
-B ${{ env.BUILD_DIR }}
cmake --build ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --parallel $(nproc) --verbose

# Need to remove the default Python 3.11 in /venv from the Path so that CMake uses the correct one from newly created venv$py_version
export PATH=${PATH/:\/venv\/bin/}

for py_version in "3.10" "3.11" "3.12" "3.13"
do
rm -rf ${{ env.BUILD_DIR }}/CMakeCache.txt

echo "Creating venv for python$py_version"
python$py_version -m venv venv$py_version
source venv$py_version/bin/activate
Expand All @@ -195,12 +195,12 @@ jobs:
-S ${{ env.SRC_DIR }} \
-B ${{ env.BUILD_DIR }}
echo "Configuring cmake done for python$py_version"

cmake --build ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --parallel $(nproc) --verbose
cmake --install ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --prefix ${{ env.INSTALL_DIR }}
deactivate
done

cmake --install ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --prefix ${{ env.INSTALL_TOOLS_DIR }} --component tools_bin
cmake --install ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --prefix ${{ env.INSTALL_TESTS_DIR }} --component tests

Expand Down Expand Up @@ -247,7 +247,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_build/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -298,7 +298,7 @@ jobs:
- name: Build WWB Wheel
run: python -m pip wheel -v --no-deps --wheel-dir ${{ env.WHEELS_DIR }} ${{ env.SRC_DIR }}/tools/who_what_benchmark
working-directory: ${{ env.OV_INSTALL_DIR }}

- name: Build GenAI Wheel
run: |
for py_version in "3.10" "3.11" "3.12" "3.13"
Expand All @@ -310,7 +310,7 @@ jobs:
${{ env.SRC_DIR }}
done
working-directory: ${{ env.OV_INSTALL_DIR }}

- name: Upload Wheels
if: ${{ always() }}
uses: actions/upload-artifact@330a01c490aca151604b8cf639adc76d48f6c5d4 # v5.0.0
Expand All @@ -329,7 +329,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-medium
runs-on: aks-linux-medium-st
container:
image: openvinogithubactions.azurecr.io/library/python:3.12-slim
volumes:
Expand Down Expand Up @@ -383,7 +383,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_build/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -454,7 +454,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_build/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -554,7 +554,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-8-cores-64gb
runs-on: aks-linux-8-cores-32gb-st
container:
image: openvinogithubactions.azurecr.io/ov_test/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -608,36 +608,36 @@ jobs:
marker: 'llm'
cmd: 'tests/python_tests/samples'
run_condition: ${{ fromJSON(needs.smart_ci.outputs.affected_components).LLM_samples.test }}
runner: 'aks-linux-4-cores-16gb'
runner: 'aks-linux-4-cores-16gb-st'
- name: 'Whisper'
marker: 'whisper'
cmd: 'tests/python_tests/samples'
run_condition: ${{ fromJSON(needs.smart_ci.outputs.affected_components).Whisper_samples.test }}
runner: 'aks-linux-4-cores-16gb'
runner: 'aks-linux-4-cores-16gb-st'
- name: 'dreamlike_anime_1_0'
marker: 'dreamlike_anime_1_0'
cmd: 'tests/python_tests/samples'
run_condition: ${{ fromJSON(needs.smart_ci.outputs.affected_components).Image_generation_samples.test }}
runner: 'aks-linux-8-cores-32gb'
runner: 'aks-linux-8-cores-32gb-st'
- name: 'LCM_Dreamshaper_v7_int8_ov'
marker: 'LCM_Dreamshaper_v7_int8_ov'
cmd: 'tests/python_tests/samples'
run_condition: ${{ fromJSON(needs.smart_ci.outputs.affected_components).Image_generation_samples.test }}
runner: 'aks-linux-4-cores-16gb'
runner: 'aks-linux-4-cores-16gb-st'
- name: 'VLM'
marker: 'vlm'
cmd: 'tests/python_tests/samples'
run_condition: ${{ fromJSON(needs.smart_ci.outputs.affected_components).VLM_samples.test }}
runner: 'aks-linux-8-cores-64gb'
runner: 'aks-linux-8-cores-32gb-st'
- name: 'Rag'
marker: 'rag'
cmd: 'tests/python_tests/samples'
runner: 'aks-linux-4-cores-16gb'
runner: 'aks-linux-4-cores-16gb-st'
run_condition: ${{ fromJSON(needs.smart_ci.outputs.affected_components).RAG_samples.test }}
- name: 'Speech generation'
marker: 'speech_generation'
cmd: 'tests/python_tests/samples'
runner: 'aks-linux-4-cores-16gb'
runner: 'aks-linux-4-cores-16gb-st'
run_condition: ${{ fromJSON(needs.smart_ci.outputs.affected_components).Speech_generation_samples.test }}

timeout-minutes: 120
Expand Down Expand Up @@ -741,7 +741,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_test/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -814,7 +814,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_test/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -879,8 +879,8 @@ jobs:
timeout-minutes: 45
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
shell: bash
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_build/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down
11 changes: 5 additions & 6 deletions .github/workflows/mac.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
name: macOS (14, Python 3.11)
on:
workflow_dispatch:
pull_request:
merge_group:
push:
branches:
Expand Down Expand Up @@ -71,7 +70,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-medium
runs-on: aks-linux-medium-st
container:
image: 'openvinogithubactions.azurecr.io/openvino_provider:0.1.0'
volumes:
Expand Down Expand Up @@ -146,7 +145,7 @@ jobs:
restore-keys: |
${{ runner.os }}-${{ runner.arch }}-ccache-${{ env.TARGET_BRANCH }}-${{ matrix.build-type }}-cpack
path: ${{ env.CCACHE_DIR }}

- name: Generate product manifest
id: create_manifest
uses: openvinotoolkit/openvino/.github/actions/create_manifest@master
Expand All @@ -159,7 +158,7 @@ jobs:

- name: Clean ccache stats
run: ccache --zero-stats --show-config

- name: CMake Build
run: |
source ${{ env.OV_INSTALL_DIR }}/setupvars.sh
Expand Down Expand Up @@ -205,7 +204,7 @@ jobs:
name: genai_tests_${{ matrix.build-type }}
path: ${{ env.INSTALL_TESTS_DIR }}
if-no-files-found: 'error'

- name: Upload manifest
if: always()
uses: actions/upload-artifact@330a01c490aca151604b8cf639adc76d48f6c5d4 # v5.0.0
Expand Down Expand Up @@ -263,7 +262,7 @@ jobs:
restore-keys: |
${{ runner.os }}-${{ runner.arch }}-ccache-${{ env.TARGET_BRANCH }}-wheel
path: ${{ env.CCACHE_DIR }}\

- name: Set CI environment
id: create_manifest
uses: openvinotoolkit/openvino/.github/actions/create_manifest@master
Expand Down
26 changes: 13 additions & 13 deletions .github/workflows/manylinux_2_28.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-medium
runs-on: aks-linux-medium-st
container:
image: 'openvinogithubactions.azurecr.io/openvino_provider:0.1.0'
volumes:
Expand Down Expand Up @@ -124,7 +124,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_build/manylinux_2_28:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -176,7 +176,7 @@ jobs:
for py_version in "3.10" "3.11" "3.12" "3.13"
do
rm -rf ${{ env.BUILD_DIR }}/CMakeCache.txt

python_exec_path=$(python$py_version -c "import sys; print(sys.executable)")

echo "Configuring cmake for python$py_version"
Expand All @@ -187,12 +187,12 @@ jobs:
-S ${{ env.SRC_DIR }} \
-B ${{ env.BUILD_DIR }}
echo "Configuring cmake done for python$py_version"

/usr/bin/cmake --build ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --parallel $(nproc) --verbose
/usr/bin/cmake --install ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --prefix ${{ env.INSTALL_DIR }}
done
/usr/bin/cmake --install ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --prefix ${{ env.INSTALL_TOOLS_DIR }} --component tools_bin
/usr/bin/cmake --install ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --prefix ${{ env.INSTALL_TESTS_DIR }} --component tests
/usr/bin/cmake --install ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --prefix ${{ env.INSTALL_TESTS_DIR }} --component tests
env:
CXXFLAGS: "-Wno-dangling-reference -fno-lto" # bug in gcc-14: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=107532, https://gcc.gnu.org/bugzilla/show_bug.cgi?id=113485
CFLAGS: "-Wno-dangling-reference -fno-lto" # bug in gcc-14: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=107532, https://gcc.gnu.org/bugzilla/show_bug.cgi?id=113485
Expand All @@ -209,7 +209,7 @@ jobs:
name: genai_archive_${{ matrix.build-type }}
path: ${{ env.BUILD_DIR }}/${{ env.GENAI_ARCHIVE_NAME }}
if-no-files-found: 'error'

- name: Upload Tools
if: always()
uses: actions/upload-artifact@330a01c490aca151604b8cf639adc76d48f6c5d4 # v5.0.0
Expand Down Expand Up @@ -241,7 +241,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_build/manylinux_2_28:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -322,7 +322,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_build/manylinux_2_28:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -360,7 +360,7 @@ jobs:
CXXFLAGS: "-Wno-dangling-reference -fno-lto" # bug in gcc-14: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=107532, https://gcc.gnu.org/bugzilla/show_bug.cgi?id=113485
CFLAGS: "-Wno-dangling-reference -fno-lto" # bug in gcc-14: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=107532, https://gcc.gnu.org/bugzilla/show_bug.cgi?id=113485
LDFLAGS: "-fno-lto" # bug in gcc-14: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=113485

- name: Build GenAI Node.js bindings
run: /usr/bin/cmake --build ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --parallel $(nproc) --verbose

Expand All @@ -385,7 +385,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-medium
runs-on: aks-linux-medium-st
container:
image: openvinogithubactions.azurecr.io/library/python:3.12-slim
volumes:
Expand Down Expand Up @@ -440,7 +440,7 @@ jobs:
storage_dir: ${{ env.BASE_PRODUCT_TYPE }}_${{ matrix.build-type }}
storage_root: ${{ env.ARTIFACTS_SHARE }}
product_name: ${{ github.event.repository.name }}

genai_tests_wheel:
name: Python (${{ matrix.test.name}}) Tests (wheel)
needs: [ smart_ci, openvino_download, genai_build_wheel ]
Expand Down Expand Up @@ -495,7 +495,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-8-cores-64gb
runs-on: aks-linux-8-cores-32gb-st
container:
image: openvinogithubactions.azurecr.io/ov_test/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down Expand Up @@ -545,7 +545,7 @@ jobs:
defaults:
run:
shell: bash
runs-on: aks-linux-4-cores-16gb
runs-on: aks-linux-4-cores-16gb-st
container:
image: openvinogithubactions.azurecr.io/ov_test/ubuntu_22_04_x64:${{ needs.openvino_download.outputs.docker_tag }}
volumes:
Expand Down
Loading
Loading