Skip to content

Expose start profiling API #8080

Expose start profiling API

Expose start profiling API #8080

Triggered via pull request November 26, 2025 03:10
Status Failure
Total duration 55m 4s
Artifacts

linux_ci.yml

on: pull_request
Build Linux x64 Debug (ASan)  /  build_test_pipeline
31m 36s
Build Linux x64 Debug (ASan) / build_test_pipeline
Build Linux x64 Release  /  build_test_pipeline
30m 37s
Build Linux x64 Release / build_test_pipeline
Build Linux x64 Release with training  /  build_test_pipeline
31m 1s
Build Linux x64 Release with training / build_test_pipeline
Build Linux arm64 Debug  /  build_test_pipeline
50m 12s
Build Linux arm64 Debug / build_test_pipeline
Build Linux arm64 Release  /  build_test_pipeline
25m 0s
Build Linux arm64 Release / build_test_pipeline
Fit to window
Zoom out
Zoom in

Annotations

20 errors and 21 warnings
Build Linux arm64 Release / build_test_pipeline
Action failed with error: Command "docker run --rm --volume /mnt/vss/_work/onnxruntime/onnxruntime:/onnxruntime_src --volume /mnt/vss/_work/_temp:/onnxruntime_src/build --volume /home/cloudtest/.cache:/home/onnxruntimedev/.cache --volume /data/onnx:/data/onnx:ro --volume /data/models:/data/models:ro --volume /home/cloudtest/.onnx:/home/onnxruntimedev/.onnx -w /onnxruntime_src -e ALLOW_RELEASED_ONNX_OPSET_ONLY=0 -e NIGHTLY_BUILD=1 -e RUNNER_TEMP=/onnxruntime_src/build ghcr.io/microsoft/onnxruntime/onnxruntimecpubuildpythonaarch64:sha256-414e395c9aeb695e438e6484ed85793f09a75661b6d856008a168114c4131183 /bin/bash -c set -ex; PATH=/opt/python/cp310-cp310/bin:$PATH && python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt && python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test" failed with exit code 1
Build Linux arm64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.3 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-11-26 03:34:27,795 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-11-26 03:34:27,801 build [INFO] - Build started 2025-11-26 03:34:27,801 build [DEBUG] - create symlink /data/models -> build/Release/models 2025-11-26 03:34:27,801 build [INFO] - Running tests for Release configuration 2025-11-26 03:34:27,801 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 Errors while running CTest Output from these tests are in: /onnxruntime_src/build/Release/Release/Testing/Temporary/LastTest.log Use "--rerun-failed --output-on-failure" to re-run the failed cases verbosely. Traceback (most recent call last): File "/onnxruntime_src/tools/ci_build/build.py", line 2714, in <module> sys.exit(main()) File "/onnxruntime_src/tools/ci_build/build.py", line 2621, in main run_onnxruntime_tests(args, source_dir, ctest_path, build_dir, configs) File "/onnxruntime_src/tools/ci_build/build.py", line 1750, in run_onnxruntime_tests run_subprocess(ctest_cmd, cwd=cwd, dll_path=dll_path) File "/onnxruntime_src/tools/ci_build/build.py", line 148, in run_subprocess return run(*args, cwd=cwd, capture_stdout=capture_stdout, shell=shell, env=my_env) File "/onnxruntime_src/tools/python/util/run.py", line 50, in run completed_process = subprocess.run( File "/opt/python/cp310-cp310/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/usr/bin/ctest', '--build-config', 'Release', '--verbose', '--timeout', '10800']' returned non-zero exit status 8.
Build Linux arm64 Release / build_test_pipeline
stdout: Ignoring numpy: markers 'python_version >= "3.14"' don't match your environment Ignoring protobuf: markers 'python_version >= "3.14"' don't match your environment Collecting numpy==2.2.6 (from -r tools/ci_build/github/linux/python/requirements.txt (line 1)) Using cached numpy-2.2.6-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (63 kB) Collecting mypy (from -r tools/ci_build/github/linux/python/requirements.txt (line 3)) Using cached mypy-1.18.2-cp310-cp310-manylinux2014_aarch64.manylinux_2_17_aarch64.manylinux_2_28_aarch64.whl.metadata (2.2 kB) Collecting pytest (from -r tools/ci_build/github/linux/python/requirements.txt (line 4)) Using cached pytest-9.0.1-py3-none-any.whl.metadata (7.6 kB) Requirement already satisfied: setuptools>=68.2.2 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 5)) (80.9.0) Requirement already satisfied: wheel in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 6)) (0.45.1) Collecting protobuf==4.25.1 (from -r tools/ci_build/github/linux/python/requirements.txt (line 7)) Using cached protobuf-4.25.1-cp37-abi3-manylinux2014_aarch64.whl.metadata (541 bytes) Collecting sympy==1.14 (from -r tools/ci_build/github/linux/python/requirements.txt (line 9)) Using cached sympy-1.14.0-py3-none-any.whl.metadata (12 kB) Collecting flatbuffers (from -r tools/ci_build/github/linux/python/requirements.txt (line 10)) Using cached flatbuffers-25.9.23-py2.py3-none-any.whl.metadata (875 bytes) Collecting psutil (from -r tools/ci_build/github/linux/python/requirements.txt (line 11)) Using cached psutil-7.1.3-cp36-abi3-manylinux2014_aarch64.manylinux_2_17_aarch64.manylinux_2_28_aarch64.whl.metadata (23 kB) Collecting onnxscript==0.5.3 (from -r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached onnxscript-0.5.3-py3-none-any.whl.metadata (13 kB) Collecting onnx-ir==0.1.10 (from -r tools/ci_build/github/linux/python/requirements.txt (line 13)) Using cached onnx_ir-0.1.10-py3-none-any.whl.metadata (3.6 kB) Collecting jinja2 (from -r tools/ci_build/github/linux/python/requirements.txt (line 14)) Using cached jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB) Collecting markupsafe (from -r tools/ci_build/github/linux/python/requirements.txt (line 15)) Using cached markupsafe-3.0.3-cp310-cp310-manylinux2014_aarch64.manylinux_2_17_aarch64.manylinux_2_28_aarch64.whl.metadata (2.7 kB) Collecting onnx==1.19.1 (from -r tools/ci_build/github/linux/python/requirements.txt (line 16)) Using cached onnx-1.19.1-cp310-cp310-manylinux2014_aarch64.manylinux_2_17_aarch64.whl.metadata (7.0 kB) Collecting mpmath<1.4,>=1.1.0 (from sympy==1.14->-r tools/ci_build/github/linux/python/requirements.txt (line 9)) Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB) Collecting ml_dtypes (from onnxscript==0.5.3->-r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached ml_dtypes-0.5.4-cp310-cp310-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl.metadata (8.9 kB) Requirement already satisfied: packaging in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from onnxscript==0.5.3->-r tools/ci_build/github/linux/python/requirements.txt (line 12)) (25.0) Collecting typing_extensions>=4.10 (from onnxscript==0.5.3->-r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached typing_extensions-4.15.0-py3-none-any.whl.metadata (3.3 kB) Collecting mypy_extensions>=1.0.0 (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 3)) Using cached mypy_extensions-1.1.0-py3-none-any.whl.metadata (1.1 kB) Collecting pathspec>=0.9.0 (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 3)) Using cached pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) Requirement already satisfied: tomli>=1.1.0 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 3))
Build Linux arm64 Release / build_test_pipeline
Command failed with exit code 1
Build Linux x64 Release / build_test_pipeline
Action failed with error: Command "docker run --rm --volume /mnt/vss/_work/onnxruntime/onnxruntime:/onnxruntime_src --volume /mnt/vss/_work/_temp:/onnxruntime_src/build --volume /home/cloudtest/.cache:/home/onnxruntimedev/.cache --volume /data/onnx:/data/onnx:ro --volume /data/models:/data/models:ro --volume /home/cloudtest/.onnx:/home/onnxruntimedev/.onnx -w /onnxruntime_src -e ALLOW_RELEASED_ONNX_OPSET_ONLY=0 -e NIGHTLY_BUILD=1 -e RUNNER_TEMP=/onnxruntime_src/build ghcr.io/microsoft/onnxruntime/onnxruntimecpubuildpythonx64:sha256-b01d6f8dcc2dedf83896e007074f04338d3aa34b3bafbf2922081d8bc7995cac /bin/bash -c set -ex; PATH=/opt/python/cp310-cp310/bin:$PATH && python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt && python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test" failed with exit code 1
Build Linux x64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.3 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-11-26 03:47:48,178 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-11-26 03:47:48,182 build [INFO] - Build started 2025-11-26 03:47:48,182 build [DEBUG] - create symlink /data/models -> build/Release/models 2025-11-26 03:47:48,182 build [INFO] - Running tests for Release configuration 2025-11-26 03:47:48,182 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 Errors while running CTest Output from these tests are in: /onnxruntime_src/build/Release/Release/Testing/Temporary/LastTest.log Use "--rerun-failed --output-on-failure" to re-run the failed cases verbosely. Traceback (most recent call last): File "/onnxruntime_src/tools/ci_build/build.py", line 2714, in <module> sys.exit(main()) File "/onnxruntime_src/tools/ci_build/build.py", line 2621, in main run_onnxruntime_tests(args, source_dir, ctest_path, build_dir, configs) File "/onnxruntime_src/tools/ci_build/build.py", line 1750, in run_onnxruntime_tests run_subprocess(ctest_cmd, cwd=cwd, dll_path=dll_path) File "/onnxruntime_src/tools/ci_build/build.py", line 148, in run_subprocess return run(*args, cwd=cwd, capture_stdout=capture_stdout, shell=shell, env=my_env) File "/onnxruntime_src/tools/python/util/run.py", line 50, in run completed_process = subprocess.run( File "/opt/python/cp310-cp310/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/usr/bin/ctest', '--build-config', 'Release', '--verbose', '--timeout', '10800']' returned non-zero exit status 8.
Build Linux x64 Release / build_test_pipeline
stdout: Ignoring numpy: markers 'python_version >= "3.14"' don't match your environment Ignoring protobuf: markers 'python_version >= "3.14"' don't match your environment Collecting numpy==2.2.6 (from -r tools/ci_build/github/linux/python/requirements.txt (line 1)) Using cached numpy-2.2.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB) Collecting mypy (from -r tools/ci_build/github/linux/python/requirements.txt (line 3)) Using cached mypy-1.18.2-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.2 kB) Collecting pytest (from -r tools/ci_build/github/linux/python/requirements.txt (line 4)) Using cached pytest-9.0.1-py3-none-any.whl.metadata (7.6 kB) Requirement already satisfied: setuptools>=68.2.2 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 5)) (80.9.0) Requirement already satisfied: wheel in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 6)) (0.45.1) Collecting protobuf==4.25.1 (from -r tools/ci_build/github/linux/python/requirements.txt (line 7)) Using cached protobuf-4.25.1-cp37-abi3-manylinux2014_x86_64.whl.metadata (541 bytes) Collecting sympy==1.14 (from -r tools/ci_build/github/linux/python/requirements.txt (line 9)) Using cached sympy-1.14.0-py3-none-any.whl.metadata (12 kB) Collecting flatbuffers (from -r tools/ci_build/github/linux/python/requirements.txt (line 10)) Using cached flatbuffers-25.9.23-py2.py3-none-any.whl.metadata (875 bytes) Collecting psutil (from -r tools/ci_build/github/linux/python/requirements.txt (line 11)) Using cached psutil-7.1.3-cp36-abi3-manylinux2010_x86_64.manylinux_2_12_x86_64.manylinux_2_28_x86_64.whl.metadata (23 kB) Collecting onnxscript==0.5.3 (from -r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached onnxscript-0.5.3-py3-none-any.whl.metadata (13 kB) Collecting onnx-ir==0.1.10 (from -r tools/ci_build/github/linux/python/requirements.txt (line 13)) Using cached onnx_ir-0.1.10-py3-none-any.whl.metadata (3.6 kB) Collecting jinja2 (from -r tools/ci_build/github/linux/python/requirements.txt (line 14)) Using cached jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB) Collecting markupsafe (from -r tools/ci_build/github/linux/python/requirements.txt (line 15)) Using cached markupsafe-3.0.3-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.7 kB) Collecting onnx==1.19.1 (from -r tools/ci_build/github/linux/python/requirements.txt (line 16)) Using cached onnx-1.19.1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (7.0 kB) Collecting mpmath<1.4,>=1.1.0 (from sympy==1.14->-r tools/ci_build/github/linux/python/requirements.txt (line 9)) Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB) Collecting ml_dtypes (from onnxscript==0.5.3->-r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached ml_dtypes-0.5.4-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (8.9 kB) Requirement already satisfied: packaging in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from onnxscript==0.5.3->-r tools/ci_build/github/linux/python/requirements.txt (line 12)) (25.0) Collecting typing_extensions>=4.10 (from onnxscript==0.5.3->-r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached typing_extensions-4.15.0-py3-none-any.whl.metadata (3.3 kB) Collecting mypy_extensions>=1.0.0 (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 3)) Using cached mypy_extensions-1.1.0-py3-none-any.whl.metadata (1.1 kB) Collecting pathspec>=0.9.0 (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 3)) Using cached pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) Requirement already satisfied: tomli>=1.1.0 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 3)) (2.2.1) Collect
Build Linux x64 Release / build_test_pipeline
Command failed with exit code 1
Build Linux x64 Debug (ASan) / build_test_pipeline
Action failed with error: Command "docker run --rm --volume /mnt/vss/_work/onnxruntime/onnxruntime:/onnxruntime_src --volume /mnt/vss/_work/_temp:/onnxruntime_src/build --volume /home/cloudtest/.cache:/home/onnxruntimedev/.cache --volume /data/onnx:/data/onnx:ro --volume /data/models:/data/models:ro --volume /home/cloudtest/.onnx:/home/onnxruntimedev/.onnx -w /onnxruntime_src -e ALLOW_RELEASED_ONNX_OPSET_ONLY=0 -e NIGHTLY_BUILD=1 -e RUNNER_TEMP=/onnxruntime_src/build ghcr.io/microsoft/onnxruntime/onnxruntimecpubuildcix64:sha256-f9c8ecc16a474e228f57b4b8b7e612ad949a91ea610918031e8712dc67bb0583 /bin/bash -c set -ex; python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --test" failed with exit code 1
Build Linux x64 Debug (ASan) / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --test 2025-11-26 03:49:17,283 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --test 2025-11-26 03:49:17,285 build [INFO] - Build started 2025-11-26 03:49:17,285 build [DEBUG] - create symlink /data/models -> build/Debug/models 2025-11-26 03:49:17,285 build [INFO] - Running tests for Debug configuration 2025-11-26 03:49:17,285 build [INFO] - /usr/bin/ctest --build-config Debug --verbose --timeout 10800 Errors while running CTest Output from these tests are in: /onnxruntime_src/build/Debug/Debug/Testing/Temporary/LastTest.log Use "--rerun-failed --output-on-failure" to re-run the failed cases verbosely. Traceback (most recent call last): File "/onnxruntime_src/tools/ci_build/build.py", line 2714, in <module> sys.exit(main()) ^^^^^^ File "/onnxruntime_src/tools/ci_build/build.py", line 2621, in main run_onnxruntime_tests(args, source_dir, ctest_path, build_dir, configs) File "/onnxruntime_src/tools/ci_build/build.py", line 1750, in run_onnxruntime_tests run_subprocess(ctest_cmd, cwd=cwd, dll_path=dll_path) File "/onnxruntime_src/tools/ci_build/build.py", line 148, in run_subprocess return run(*args, cwd=cwd, capture_stdout=capture_stdout, shell=shell, env=my_env) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/onnxruntime_src/tools/python/util/run.py", line 50, in run completed_process = subprocess.run( ^^^^^^^^^^^^^^^ File "/usr/lib64/python3.12/subprocess.py", line 571, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/usr/bin/ctest', '--build-config', 'Debug', '--verbose', '--timeout', '10800']' returned non-zero exit status 8.
Build Linux x64 Debug (ASan) / build_test_pipeline
stdout: UpdateCTestConfiguration from :/onnxruntime_src/build/Debug/Debug/DartConfiguration.tcl UpdateCTestConfiguration from :/onnxruntime_src/build/Debug/Debug/DartConfiguration.tcl Test project /onnxruntime_src/build/Debug/Debug Constructing a list of tests Done constructing a list of tests Updating test list for fixtures Added 0 tests to meet fixture requirements Checking test dependency graph... Checking test dependency graph end test 1 Start 1: onnxruntime_test_all 1: Test command: /onnxruntime_src/build/Debug/Debug/onnxruntime_test_all "--gtest_output=xml:/onnxruntime_src/build/Debug/Debug/onnxruntime_test_all.Debug.results.xml" 1: Working Directory: /onnxruntime_src/build/Debug/Debug 1: Test timeout computed to be: 10800 1: Debug (cpuinfo): parsed kernel_max value of 8191 from /sys/devices/system/cpu/kernel_max 1: Warning in cpuinfo: kernel_max value of 8191 parsed from /sys/devices/system/cpu/kernel_max exceeds platform-default limit 1023 1: Debug (cpuinfo): system maximum processors count: 8192 1: Debug (cpuinfo): maximum possible processors count: 16 1: Debug (cpuinfo): maximum present processors count: 16 1: Debug (cpuinfo): unknown /proc/cpuinfo key: vendor_id 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cpu family 1: Debug (cpuinfo): unknown /proc/cpuinfo key: model 1: Debug (cpuinfo): unknown /proc/cpuinfo key: model name 1: Debug (cpuinfo): unknown /proc/cpuinfo key: stepping 1: Debug (cpuinfo): unknown /proc/cpuinfo key: microcode 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cpu MHz 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cache size 1: Debug (cpuinfo): unknown /proc/cpuinfo key: physical id 1: Debug (cpuinfo): unknown /proc/cpuinfo key: siblings 1: Debug (cpuinfo): unknown /proc/cpuinfo key: core id 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cpu cores 1: Debug (cpuinfo): unknown /proc/cpuinfo key: initial apicid 1: Debug (cpuinfo): unknown /proc/cpuinfo key: fpu 1: Debug (cpuinfo): unknown /proc/cpuinfo key: fpu_exception 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cpuid level 1: Debug (cpuinfo): unknown /proc/cpuinfo key: wp 1: Debug (cpuinfo): unknown /proc/cpuinfo key: flags 1: Debug (cpuinfo): unknown /proc/cpuinfo key: bugs 1: Debug (cpuinfo): unknown /proc/cpuinfo key: bogomips 1: Debug (cpuinfo): unknown /proc/cpuinfo key: TLB size 1: Debug (cpuinfo): unknown /proc/cpuinfo key: clflush size 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cache_alignment 1: Debug (cpuinfo): unknown /proc/cpuinfo key: address sizes 1: Debug (cpuinfo): Line power management: in /proc/cpuinfo is ignored: value contains only spaces 1: Debug (cpuinfo): unknown /proc/cpuinfo key: vendor_id 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cpu family 1: Debug (cpuinfo): unknown /proc/cpuinfo key: model 1: Debug (cpuinfo): unknown /proc/cpuinfo key: model name 1: Debug (cpuinfo): unknown /proc/cpuinfo key: stepping 1: Debug (cpuinfo): unknown /proc/cpuinfo key: microcode 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cpu MHz 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cache size 1: Debug (cpuinfo): unknown /proc/cpuinfo key: physical id 1: Debug (cpuinfo): unknown /proc/cpuinfo key: siblings 1: Debug (cpuinfo): unknown /proc/cpuinfo key: core id 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cpu cores 1: Debug (cpuinfo): unknown /proc/cpuinfo key: initial apicid 1: Debug (cpuinfo): unknown /proc/cpuinfo key: fpu 1: Debug (cpuinfo): unknown /proc/cpuinfo key: fpu_exception 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cpuid level 1: Debug (cpuinfo): unknown /proc/cpuinfo key: wp 1: Debug (cpuinfo): unknown /proc/cpuinfo key: flags 1: Debug (cpuinfo): unknown /proc/cpuinfo key: bugs 1: Debug (cpuinfo): unknown /proc/cpuinfo key: bogomips 1: Debug (cpuinfo): unknown /proc/cpuinfo key: TLB size 1: Debug (cpuinfo): unknown /proc/cpuinfo key: clflush size 1: Debug (cpuinfo): unknown /proc/cpuinfo key: cache_alignment 1: Debug (cpuinfo): unknown /proc/cpuinfo key: address sizes 1: Debug (cpuinfo): Line power management: in /proc/cpuinfo is ignored: value contains only spaces 1: Debug (cpuinfo): unknown
Build Linux x64 Debug (ASan) / build_test_pipeline
Command failed with exit code 1
Build Linux x64 Release with training / build_test_pipeline
Action failed with error: Command "docker run --rm --volume /mnt/vss/_work/onnxruntime/onnxruntime:/onnxruntime_src --volume /mnt/vss/_work/_temp:/onnxruntime_src/build --volume /home/cloudtest/.cache:/home/onnxruntimedev/.cache --volume /data/onnx:/data/onnx:ro --volume /data/models:/data/models:ro --volume /home/cloudtest/.onnx:/home/onnxruntimedev/.onnx -w /onnxruntime_src -e ALLOW_RELEASED_ONNX_OPSET_ONLY=0 -e NIGHTLY_BUILD=1 -e RUNNER_TEMP=/onnxruntime_src/build ghcr.io/microsoft/onnxruntime/onnxruntimecpubuildpythonx64:sha256-b01d6f8dcc2dedf83896e007074f04338d3aa34b3bafbf2922081d8bc7995cac /bin/bash -c set -ex; PATH=/opt/python/cp310-cp310/bin:$PATH && python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt && python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test" failed with exit code 1
Build Linux x64 Release with training / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.3 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-11-26 03:57:12,169 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-11-26 03:57:12,172 build [INFO] - Build started 2025-11-26 03:57:12,172 build [DEBUG] - create symlink /data/models -> build/Release/models 2025-11-26 03:57:12,172 build [INFO] - Running tests for Release configuration 2025-11-26 03:57:12,172 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 Errors while running CTest Output from these tests are in: /onnxruntime_src/build/Release/Release/Testing/Temporary/LastTest.log Use "--rerun-failed --output-on-failure" to re-run the failed cases verbosely. Traceback (most recent call last): File "/onnxruntime_src/tools/ci_build/build.py", line 2714, in <module> sys.exit(main()) File "/onnxruntime_src/tools/ci_build/build.py", line 2621, in main run_onnxruntime_tests(args, source_dir, ctest_path, build_dir, configs) File "/onnxruntime_src/tools/ci_build/build.py", line 1750, in run_onnxruntime_tests run_subprocess(ctest_cmd, cwd=cwd, dll_path=dll_path) File "/onnxruntime_src/tools/ci_build/build.py", line 148, in run_subprocess return run(*args, cwd=cwd, capture_stdout=capture_stdout, shell=shell, env=my_env) File "/onnxruntime_src/tools/python/util/run.py", line 50, in run completed_process = subprocess.run( File "/opt/python/cp310-cp310/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/usr/bin/ctest', '--build-config', 'Release', '--verbose', '--timeout', '10800']'
Build Linux x64 Release with training / build_test_pipeline
stdout: Ignoring numpy: markers 'python_version >= "3.14"' don't match your environment Ignoring protobuf: markers 'python_version >= "3.14"' don't match your environment Collecting numpy==2.2.6 (from -r tools/ci_build/github/linux/python/requirements.txt (line 1)) Using cached numpy-2.2.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB) Collecting mypy (from -r tools/ci_build/github/linux/python/requirements.txt (line 3)) Using cached mypy-1.18.2-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.2 kB) Collecting pytest (from -r tools/ci_build/github/linux/python/requirements.txt (line 4)) Using cached pytest-9.0.1-py3-none-any.whl.metadata (7.6 kB) Requirement already satisfied: setuptools>=68.2.2 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 5)) (80.9.0) Requirement already satisfied: wheel in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 6)) (0.45.1) Collecting protobuf==4.25.1 (from -r tools/ci_build/github/linux/python/requirements.txt (line 7)) Using cached protobuf-4.25.1-cp37-abi3-manylinux2014_x86_64.whl.metadata (541 bytes) Collecting sympy==1.14 (from -r tools/ci_build/github/linux/python/requirements.txt (line 9)) Using cached sympy-1.14.0-py3-none-any.whl.metadata (12 kB) Collecting flatbuffers (from -r tools/ci_build/github/linux/python/requirements.txt (line 10)) Using cached flatbuffers-25.9.23-py2.py3-none-any.whl.metadata (875 bytes) Collecting psutil (from -r tools/ci_build/github/linux/python/requirements.txt (line 11)) Using cached psutil-7.1.3-cp36-abi3-manylinux2010_x86_64.manylinux_2_12_x86_64.manylinux_2_28_x86_64.whl.metadata (23 kB) Collecting onnxscript==0.5.3 (from -r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached onnxscript-0.5.3-py3-none-any.whl.metadata (13 kB) Collecting onnx-ir==0.1.10 (from -r tools/ci_build/github/linux/python/requirements.txt (line 13)) Using cached onnx_ir-0.1.10-py3-none-any.whl.metadata (3.6 kB) Collecting jinja2 (from -r tools/ci_build/github/linux/python/requirements.txt (line 14)) Using cached jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB) Collecting markupsafe (from -r tools/ci_build/github/linux/python/requirements.txt (line 15)) Using cached markupsafe-3.0.3-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.7 kB) Collecting onnx==1.19.1 (from -r tools/ci_build/github/linux/python/requirements.txt (line 16)) Using cached onnx-1.19.1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (7.0 kB) Collecting mpmath<1.4,>=1.1.0 (from sympy==1.14->-r tools/ci_build/github/linux/python/requirements.txt (line 9)) Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB) Collecting ml_dtypes (from onnxscript==0.5.3->-r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached ml_dtypes-0.5.4-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (8.9 kB) Requirement already satisfied: packaging in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from onnxscript==0.5.3->-r tools/ci_build/github/linux/python/requirements.txt (line 12)) (25.0) Collecting typing_extensions>=4.10 (from onnxscript==0.5.3->-r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached typing_extensions-4.15.0-py3-none-any.whl.metadata (3.3 kB) Collecting mypy_extensions>=1.0.0 (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 3)) Using cached mypy_extensions-1.1.0-py3-none-any.whl.metadata (1.1 kB) Collecting pathspec>=0.9.0 (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 3)) Using cached pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) Requirement already satisfied: tomli>=1.1.0 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 3)) (2.2.1) Collect
Build Linux x64 Release with training / build_test_pipeline
Command failed with exit code 1
Build Linux arm64 Debug / build_test_pipeline
Action failed with error: Command "docker run --rm --volume /mnt/vss/_work/onnxruntime/onnxruntime:/onnxruntime_src --volume /mnt/vss/_work/_temp:/onnxruntime_src/build --volume /home/cloudtest/.cache:/home/onnxruntimedev/.cache --volume /data/onnx:/data/onnx:ro --volume /data/models:/data/models:ro --volume /home/cloudtest/.onnx:/home/onnxruntimedev/.onnx -w /onnxruntime_src -e ALLOW_RELEASED_ONNX_OPSET_ONLY=0 -e NIGHTLY_BUILD=1 -e RUNNER_TEMP=/onnxruntime_src/build ghcr.io/microsoft/onnxruntime/onnxruntimecpubuildciaarch64:sha256-4247a79fdc6beca30bf58c2428eae13fd34d81fe49755428e7d4bfdce7a427ed /bin/bash -c set -ex; python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_shared_lib --test" failed with exit code 1
Build Linux arm64 Debug / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_shared_lib --test 2025-11-26 03:41:50,834 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_shared_lib --test 2025-11-26 03:41:50,837 build [INFO] - Build started 2025-11-26 03:41:50,837 build [DEBUG] - create symlink /data/models -> build/Debug/models 2025-11-26 03:41:50,837 build [INFO] - Running tests for Debug configuration 2025-11-26 03:41:50,838 build [INFO] - /usr/bin/ctest --build-config Debug --verbose --timeout 10800 Errors while running CTest Output from these tests are in: /onnxruntime_src/build/Debug/Debug/Testing/Temporary/LastTest.log Use "--rerun-failed --output-on-failure" to re-run the failed cases verbosely. Traceback (most recent call last): File "/onnxruntime_src/tools/ci_build/build.py", line 2714, in <module> sys.exit(main()) ^^^^^^ File "/onnxruntime_src/tools/ci_build/build.py", line 2621, in main run_onnxruntime_tests(args, source_dir, ctest_path, build_dir, configs) File "/onnxruntime_src/tools/ci_build/build.py", line 1750, in run_onnxruntime_tests run_subprocess(ctest_cmd, cwd=cwd, dll_path=dll_path) File "/onnxruntime_src/tools/ci_build/build.py", line 148, in run_subprocess return run(*args, cwd=cwd, capture_stdout=capture_stdout, shell=shell, env=my_env) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/onnxruntime_src/tools/python/util/run.py", line 50, in run completed_process = subprocess.run( ^^^^^^^^^^^^^^^ File "/usr/lib64/python3.12/subprocess.py", line 571, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/usr/bin/ctest', '--build-config', 'Debug', '--verbose', '--timeout', '10800']' returned non-zero exit status 8.
Build Linux arm64 Debug / build_test_pipeline
stdout: UpdateCTestConfiguration from :/onnxruntime_src/build/Debug/Debug/DartConfiguration.tcl UpdateCTestConfiguration from :/onnxruntime_src/build/Debug/Debug/DartConfiguration.tcl Test project /onnxruntime_src/build/Debug/Debug Constructing a list of tests Done constructing a list of tests Updating test list for fixtures Added 0 tests to meet fixture requirements Checking test dependency graph... Checking test dependency graph end test 1 Start 1: onnxruntime_test_all 1: Test command: /onnxruntime_src/build/Debug/Debug/onnxruntime_test_all "--gtest_output=xml:/onnxruntime_src/build/Debug/Debug/onnxruntime_test_all.Debug.results.xml" 1: Working Directory: /onnxruntime_src/build/Debug/Debug 1: Test timeout computed to be: 10800 1: Debug (cpuinfo): parsed kernel_max value of 255 from /sys/devices/system/cpu/kernel_max 1: Debug (cpuinfo): system maximum processors count: 256 1: Debug (cpuinfo): maximum possible processors count: 8 1: Debug (cpuinfo): maximum present processors count: 8 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "dcpop" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "asimddp" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "dcpop" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "asimddp" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "dcpop" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "asimddp" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "dcpop" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "asimddp" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "dcpop" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "asimddp" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "dcpop" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "asimddp" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "dcpop" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "asimddp" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "dcpop" is ignored 1: Warning in cpuinfo: unexpected /proc/cpuinfo feature "asimddp" is ignored 1: Debug (cpuinfo): parsed processor 0 MIDR 0x413fd0c1 1: Debug (cpuinfo): parsed processor 1 MIDR 0x413fd0c1 1: Debug (cpuinfo): parsed processor 2 MIDR 0x413fd0c1 1: Debug (cpuinfo): parsed processor 3 MIDR 0x413fd0c1 1: Debug (cpuinfo): parsed processor 4 MIDR 0x413fd0c1 1: Debug (cpuinfo): parsed processor 5 MIDR 0x413fd0c1 1: Debug (cpuinfo): parsed processor 6 MIDR 0x413fd0c1 1: Debug (cpuinfo): parsed processor 7 MIDR 0x413fd0c1 1: Warning in cpuinfo: chipset detection failed: /proc/cpuinfo Hardware string did not match known signatures 1: Warning in cpuinfo: No SVE support on this machine 1: Warning in cpuinfo: No SME support on this machine 1: Note (cpuinfo): failed to open /sys/devices/system/cpu/cpu0/cpufreq/cpuinfo_max_freq: No such file or directory 1: Warning in cpuinfo: failed to parse max frequency for processor 0 from /sys/devices/system/cpu/cpu0/cpufreq/cpuinfo_max_freq 1: Note (cpuinfo): failed to open /sys/devices/system/cpu/cpu0/cpufreq/cpuinfo_min_freq: No such file or directory 1: Note (cpuinfo): failed to parse min frequency for processor 0 from /sys/devices/system/cpu/cpu0/cpufreq/cpuinfo_min_freq 1: Debug (cpuinfo): parsed package id value of 36 for logical processor 0 from /sys/devices/system/cpu/cpu0/topology/physical_package_id 1: Note (cpuinfo): failed to open /sys/devices/system/cpu/cpu1/cpufreq/cpuinfo_max_freq: No such file or directory 1: Warning in cpuinfo: failed to parse max frequency for processor 1 from /sys/devices/system/cpu/cpu1/cpufreq/cpuinfo_max_freq 1: Note (cpuinfo): failed to open /sys/devices/system/cpu/cpu1/cpufreq/cpuinfo_min_freq: No such file or directory 1: Note (cpuinfo): failed to parse min frequency for processor 1 from /sys/devices/system/cpu/cpu1/cpufreq/cpuinfo_min_freq 1: Debug (cpuinfo): parsed package id value of 36 for logical processor 1 from /sys/devices/system/cpu/cpu1/top
Build Linux arm64 Debug / build_test_pipeline
Command failed with exit code 1
Build Linux arm64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux arm64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.3 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-11-26 03:13:53,595 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-11-26 03:13:53,600 build [INFO] - Build started 2025-11-26 03:13:53,600 build [INFO] - Building targets for Release configuration 2025-11-26 03:13:53,600 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j8 2025-11-26 03:33:53,344 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: MIT License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. This deprecation is overdue, please update your project and remove deprecated calls to avoid build errors in the future. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ***
Build Linux arm64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux arm64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.3 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-11-26 03:13:02,331 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-11-26 03:13:02,336 build [INFO] - Build started 2025-11-26 03:13:02,336 build [INFO] - Generating CMake build tree 2025-11-26 03:13:02,351 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_CLIENT_PACKAGE_BUILD=OFF -Donnxruntime_BUILD_MS_
Build Linux arm64 Release / build_test_pipeline
stderr: WARNING! Your password will be stored unencrypted in /home/cloudtest/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store
Build Linux x64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux x64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.3 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-11-26 03:39:28,849 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-11-26 03:39:28,852 build [INFO] - Build started 2025-11-26 03:39:28,852 build [INFO] - Building targets for Release configuration 2025-11-26 03:39:28,852 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j16 2025-11-26 03:47:08,728 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: MIT License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. This deprecation is overdue, please update your project and remove deprecated calls to avoid build errors in the future. S
Build Linux x64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux x64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.3 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-11-26 03:35:22,731 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-11-26 03:35:22,735 build [INFO] - Build started 2025-11-26 03:35:22,735 build [INFO] - Generating CMake build tree 2025-11-26 03:35:22,747 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnx
Build Linux x64 Release / build_test_pipeline
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'. Configure a credential helper to remove this warning. See https://docs.docker.com/go/credential-store/
Build Linux x64 Debug (ASan) / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --build 2025-11-26 03:40:45,017 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --build 2025-11-26 03:40:45,019 build [INFO] - Build started 2025-11-26 03:40:45,019 build [INFO] - Building targets for Debug configuration 2025-11-26 03:40:45,019 build [INFO] - /usr/bin/cmake --build build/Debug/Debug --config Debug -- -j16 2025-11-26 03:48:44,832 build [INFO] - Build complete
Build Linux x64 Debug (ASan) / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --update 2025-11-26 03:33:31,514 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --update 2025-11-26 03:33:31,516 build [INFO] - Build started 2025-11-26 03:33:31,516 build [INFO] - Generating CMake build tree 2025-11-26 03:33:31,527 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/usr/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=OFF -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_CLIENT_PACKAGE_BUILD=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_WGSL_TEMPLATE=static -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_JSPI=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_FLOAT4_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -Donnxruntime_CUDA_MINIMAL=OFF -Donnxruntime_USE_KLEIDIAI=ON -Donnxruntime_USE_SVE=ON -DCMAKE_TOOLCHAIN_FILE=/usr/local/share/vcpkg/scripts/buildsystems/vcpkg.cmake -G Ninja -DCMAKE_C_FLAGS=-g -O0 -fsanitize=address -fstack-clash-protection -fcf-protection -DCMAKE_CXX_FLAGS=-g -O0 -fsanitize=address -fstack-clash-protection -fcf-protection -DCMAKE_EXE_LINKER_FLAGS_INIT=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now -Wl,-z,noexecstack -fsanitize=address -DCMAKE_MODULE_LINKER_FL
Build Linux x64 Debug (ASan) / build_test_pipeline
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'. Configure a credential helper to remove this warning. See https://docs.docker.com/go/credential-store/
Build Linux x64 Release with training / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux x64 Release with training / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.3 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-11-26 03:46:48,510 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-11-26 03:46:48,514 build [INFO] - Build started 2025-11-26 03:46:48,514 build [INFO] - Building targets for Release configuration 2025-11-26 03:46:48,514 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j16 2025-11-26 03:56:24,825 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build --enable_training --enable_training_apis /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: MIT License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. This deprecation is overdue, please update your project and re
Build Linux x64 Release with training / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux x64 Release with training / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.3 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-11-26 03:42:04,893 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-11-26 03:42:04,897 build [INFO] - Build started 2025-11-26 03:42:04,897 build [INFO] - Generating CMake build tree 2025-11-26 03:42:04,909 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime
Build Linux x64 Release with training / build_test_pipeline
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'. Configure a credential helper to remove this warning. See https://docs.docker.com/go/credential-store/
Build Linux arm64 Debug / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_shared_lib --build 2025-11-26 03:25:11,597 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_shared_lib --build 2025-11-26 03:25:11,600 build [INFO] - Build started 2025-11-26 03:25:11,600 build [INFO] - Building targets for Debug configuration 2025-11-26 03:25:11,601 build [INFO] - /usr/bin/cmake --build build/Debug/Debug --config Debug -- -j8 2025-11-26 03:41:47,959 build [INFO] - Build complete
Build Linux arm64 Debug / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_shared_lib --update 2025-11-26 03:16:57,293 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_shared_lib --update 2025-11-26 03:16:57,296 build [INFO] - Build started 2025-11-26 03:16:57,296 build [INFO] - Generating CMake build tree 2025-11-26 03:16:57,308 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/usr/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=OFF -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_CLIENT_PACKAGE_BUILD=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_WGSL_TEMPLATE=static -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_JSPI=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_FLOAT4_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -Donnxruntime_CUDA_MINIMAL=OFF -Donnxruntime_USE_KLEIDIAI=ON -Donnxruntime_USE_SVE=ON -DCMAKE_TOOLCHAIN_FILE=/usr/local/share/vcpkg/scripts/buildsystems/vcpkg.cmake -G Ninja -DCMAKE_C_FLAGS=-g -O0 -DCMAKE_CXX_FLAGS=-g -O0 -DCMAKE_EXE_LINKER_FLAGS_INIT=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now -Wl,-z,noexecstack -DCMAKE_MODULE_LINKER_FLAGS_INIT=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now -Wl,-z,noexecstack -D
Build Linux arm64 Debug / build_test_pipeline
stderr: WARNING! Your password will be stored unencrypted in /home/cloudtest/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store