Skip to content

Conversation

@Jefffrey
Copy link
Contributor

@Jefffrey Jefffrey commented Nov 14, 2025

Closes #18692 (hopefully)

Trying to get CI to pass consistently, try various techniques.

@github-actions github-actions bot added the development-process Related to development process of DataFusion label Nov 14, 2025
@Jefffrey
Copy link
Contributor Author

Jefffrey commented Nov 14, 2025

Oh not sure it (jlumbroso/free-disk-space) works if the action runs in a container 🤔

Edit: jlumbroso/free-disk-space#21

@Jefffrey Jefffrey changed the title Use jlumbroso/free-disk-space in CI setup-builder step CI: try free up space in Rust / cargo test (amd64) action Nov 14, 2025
@Jefffrey
Copy link
Contributor Author

Taking inspiration from examples:

- name: Remove unnecessary preinstalled software
run: |
echo "Disk space before cleanup:"
df -h
apt-get clean
rm -rf /__t/CodeQL
rm -rf /__t/PyPy
rm -rf /__t/Java_Temurin-Hotspot_jdk
rm -rf /__t/Python
rm -rf /__t/go
rm -rf /__t/Ruby
echo "Disk space after cleanup:"
df -h

Which usually cleans about 5gb:

Run echo "Disk space before cleanup:"
Disk space before cleanup:
Filesystem      Size  Used Avail Use% Mounted on
overlay          72G   58G   14G  81% /
tmpfs            64M     0   64M   0% /dev
shm              64M     0   64M   0% /dev/shm
/dev/root        72G   58G   14G  81% /__t
tmpfs           3.2G  1.2M  3.2G   1% /run/docker.sock
tmpfs           7.9G     0  7.9G   0% /proc/acpi
tmpfs           7.9G     0  7.9G   0% /proc/scsi
tmpfs           7.9G     0  7.9G   0% /sys/firmware
Disk space after cleanup:
Filesystem      Size  Used Avail Use% Mounted on
overlay          72G   53G   19G  74% /
tmpfs            64M     0   64M   0% /dev
shm              64M     0   64M   0% /dev/shm
/dev/root        72G   53G   19G  74% /__t
tmpfs           3.2G  1.2M  3.2G   1% /run/docker.sock
tmpfs           7.9G     0  7.9G   0% /proc/acpi
tmpfs           7.9G     0  7.9G   0% /proc/scsi
tmpfs           7.9G     0  7.9G   0% /sys/firmware

But also adding what was suggested here: jlumbroso/free-disk-space#21

Combine together, seems to clean 24gb:

Run echo "Disk space before cleanup:"
Disk space before cleanup:
Filesystem      Size  Used Avail Use% Mounted on
overlay          72G   55G   18G  77% /
tmpfs            64M     0   64M   0% /dev
shm              64M     0   64M   0% /dev/shm
/dev/root        72G   55G   18G  77% /__t
tmpfs           3.2G  1.2M  3.2G   1% /run/docker.sock
tmpfs           7.9G     0  7.9G   0% /proc/acpi
tmpfs           7.9G     0  7.9G   0% /proc/scsi
tmpfs           7.9G     0  7.9G   0% /sys/firmware
Disk space after cleanup:
Filesystem      Size  Used Avail Use% Mounted on
overlay          72G   31G   42G  43% /
tmpfs            64M     0   64M   0% /dev
shm              64M     0   64M   0% /dev/shm
/dev/root        72G   31G   42G  43% /__t
tmpfs           3.2G  1.2M  3.2G   1% /run/docker.sock
tmpfs           7.9G     0  7.9G   0% /proc/acpi
tmpfs           7.9G     0  7.9G   0% /proc/scsi
tmpfs           7.9G     0  7.9G   0% /sys/firmware

🤯

@Jefffrey Jefffrey marked this pull request as ready for review November 14, 2025 16:40
Copy link
Contributor

@2010YOUY01 2010YOUY01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the fix!

I suggest we merge it after CI passes, many recent PRs failed CI due to this reason.

@Jefffrey
Copy link
Contributor Author

Thank you for the fix!

I suggest we merge it after CI passes, many recent PRs failed CI due to this reason.

Thanks, looks like there's been 3 consecutively successful runs so the fix seems to work.

@Jefffrey Jefffrey added this pull request to the merge queue Nov 15, 2025
Merged via the queue into apache:main with commit 302dbc8 Nov 15, 2025
28 checks passed
@Jefffrey Jefffrey deleted the fix-ci-123 branch November 15, 2025 02:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

development-process Related to development process of DataFusion

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CI failing on main due to storage issues

2 participants