Skip to content

gh-113858: Cut down ccache size#113945

Merged
encukou merged 1 commit into
python:mainfrom
encukou:gha-ccache
Jan 12, 2024
Merged

gh-113858: Cut down ccache size#113945
encukou merged 1 commit into
python:mainfrom
encukou:gha-ccache

Conversation

@encukou

@encukou encukou commented Jan 11, 2024

Copy link
Copy Markdown
Member
  • Only save the ccache in the main reusable builds, not on builds that don't use special build options:
    • Generated files check
    • OpenSSL tests
    • Hypothesis tests
  • Halve the max cache size, to 200M

- Only save the ccache in the main reusable builds, not on builds that
  don't use special build options:
  - Generated files check
  - OpenSSL tests
  - Hypothesis tests
- Halve the max cache size, to 200M
@encukou encukou changed the title Cut down ccache size gh-113858: Cut down ccache size Jan 11, 2024
@encukou

encukou commented Jan 11, 2024

Copy link
Copy Markdown
Member Author

The previous commit helped, but it's not enough.
This disables saving ccache for some builds that build CPython with same settings as the main reusable-ubuntu.
It also reduces the max size.

For reference, I did some local builds, starting with a clean cache. The size was:

  • 53M after building main
  • 81M after building 3.12 (with the cache from main kept)
  • 110M after 3.11 (cache from previous builds kept)
  • 137M after 3.10 ('')
  • 154M after 3.9 ('')
  • 170M after 3.8 ('')

I reckon about 150M should be enough to keep bugfix branches in the cache even with an occasional deeper backport. I added 50M as room to grow.

@encukou
encukou merged commit fcb4c8d into python:main Jan 12, 2024
@encukou
encukou deleted the gha-ccache branch January 12, 2024 09:48
encukou added a commit to encukou/cpython that referenced this pull request Jan 15, 2024
Cut down ccache size

- Only save the ccache in the main reusable builds, not on builds that
  don't use special build options:
  - Generated files check
  - OpenSSL tests
  - Hypothesis tests
- Halve the max cache size, to 200M
encukou added a commit that referenced this pull request Jan 16, 2024
…) (GH-114082)

This backports 3 PRs:

- #113859

  Only save ccache on pushes

- #113945

  Cut down ccache size

  - Only save the ccache in the main reusable builds, not on builds that
    don't use special build options:
      - Generated files check
    - OpenSSL tests
    - Hypothesis tests
  - Halve the max cache size, to 200M

- #114113

  Fixup for the above

Co-authored-by: Hugo van Kemenade <hugovk@users.noreply.github.com>
kulikjak pushed a commit to kulikjak/cpython that referenced this pull request Jan 22, 2024
Cut down ccache size

- Only save the ccache in the main reusable builds, not on builds that
  don't use special build options:
  - Generated files check
  - OpenSSL tests
  - Hypothesis tests
- Halve the max cache size, to 200M
aisk pushed a commit to aisk/cpython that referenced this pull request Feb 11, 2024
Cut down ccache size

- Only save the ccache in the main reusable builds, not on builds that
  don't use special build options:
  - Generated files check
  - OpenSSL tests
  - Hypothesis tests
- Halve the max cache size, to 200M
jessecomeau87 pushed a commit to jessecomeau87/Python that referenced this pull request May 20, 2024
This backports 3 PRs:

- python/cpython#113859

  Only save ccache on pushes

- python/cpython#113945

  Cut down ccache size

  - Only save the ccache in the main reusable builds, not on builds that
    don't use special build options:
      - Generated files check
    - OpenSSL tests
    - Hypothesis tests
  - Halve the max cache size, to 200M

- python/cpython#114113

  Fixup for the above

Co-authored-by: Hugo van Kemenade <hugovk@users.noreply.github.com>
Glyphack pushed a commit to Glyphack/cpython that referenced this pull request Sep 2, 2024
Cut down ccache size

- Only save the ccache in the main reusable builds, not on builds that
  don't use special build options:
  - Generated files check
  - OpenSSL tests
  - Hypothesis tests
- Halve the max cache size, to 200M
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants