Skip to content

Rsync store backend#88

Merged
talex5 merged 3 commits intoocurrent:masterfrom
patricoferris:rsync
Nov 18, 2021
Merged

Rsync store backend#88
talex5 merged 3 commits intoocurrent:masterfrom
patricoferris:rsync

Conversation

@patricoferris
Copy link
Copy Markdown
Contributor

This PR extracts the rsync backend from #87 into a separate PR. The most notable change is the -H passed to rsync to preserve hardlinks. This is what was causing the stress test to fail as when copying the extracted busybox image with rsync -a it would go from ~1MB to ~400MB because of however /bin works in busybox which meant that the stress test ended up taking tens of GB...

Copy link
Copy Markdown
Contributor

@talex5 talex5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. I think the Fmt changes got lost in the rebase though!

CI is failing on zfs, but I think you're investigating that separately?

 cannot promote 'zfs/cache-tmp/0-c-c1': not a cloned filesystem
stress: internal error, uncaught exception:
        (Failure
          "\"sudo\" \"zfs\" \"promote\" \"zfs/cache-tmp/0-c-c1\" failed with exit status 1")

Co-authored-by: Thomas Leonard <talex5@gmail.com>
@patricoferris
Copy link
Copy Markdown
Contributor Author

Yep thanks for fixing them :) And yes, I'm looking into ZFS too 👍

@talex5 talex5 merged commit c89b876 into ocurrent:master Nov 18, 2021
@talex5
Copy link
Copy Markdown
Contributor

talex5 commented Nov 18, 2021

Thanks!

@patricoferris patricoferris mentioned this pull request Dec 1, 2021
6 tasks
tmcgilchrist added a commit to tmcgilchrist/opam-repository that referenced this pull request Jun 17, 2022
CHANGES:

- Use GNU tar format instead of UStar for `copy` operations (@TheLortex ocurrent/obuilder#82, reviewed @dra27).
  This enables copying from sources containing long file names (>100 characters).

- Add support for secrets (@TheLortex ocurrent/obuilder#63, reviewed by @talex5).
  The obuilder spec's `run` command supports a new `secrets` fields, which allows to temporarily
  mount secret files in an user-specified location. The sandbox build context has an additional
  `secrets` parameter to provide values for the requested keys.

- Limit permissions on temporary directories (@talex5 ocurrent/obuilder#67)

- Check Linux kernel version support for btrfs (@kit-ty-kate ocurrent/obuilder#68)

- Generalise obuilder sandbox, removing runc/linux specifc pieces and
  making the S.SANDBOX interface more general
  (@patricoferris ocurrent/obuilder#58, reviewed by @talex5, @avsm, @MisterDA)

- Convert --fast-sync back to a flag (@talex5 ocurrent/obuilder#72)

- Support Fmt.cli and Logs.cli flags. (@MisterDA ocurrent/obuilder#74, reviewed by @talex5)
  For Fmt the new options are --color=always|never|auto
  For Log the new options are:
    -v, --verbose Increase verbosity
    --verbosity=LEVEL (absent=warning)
        Be more or less verbose. LEVEL must be one of quiet, error,
        warning, info or debug. Takes over -v.

- Minor cleanup changes (@talex5 ocurrent/obuilder#76)

- Fix deprecations in Fmt 0.8.10 (@tmcgilchrist ocurrent/obuilder#80)

- Remove travis-ci and replace with Github Actions (@MisterDA ocurrent/obuilder#84)

- Add RSync store backend for obuilder to support macOS builders (@patricoferris ocurrent/obuilder#88, reviewed @talex5)

- Fixes for ZFS tests in CI (@patricoferris ocurrent/obuilder#91)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants