summaryrefslogtreecommitdiff
path: root/guix/scripts/offload.scm
Commit message (Collapse)AuthorAge
* offload: Exit with code 100 upon build failures.Ludovic Courtès2014-03-31
| | | | | * guix/scripts/offload.scm (transfer-and-offload): Exit with code 100 upon build failure.
* offload: Remove erroneous 'close-pipe' call.Ludovic Courtès2014-03-26
| | | | | * guix/scripts/offload.scm (send-files): Remove 'close-pipe' call from 'guard' handler ('pipe' here referred to Guile's 'pipe' procedure.)
* offload: Wait for the processes involved in 'guix archive --missing'.Ludovic Courtès2014-03-26
| | | | | * guix/scripts/offload.scm (send-files): Keep the second return value of 'filtered-port'. Call 'waitpid' on it.
* offload: Allow one transfer in each direction simultaneously.Ludovic Courtès2014-03-26
| | | | | | * guix/scripts/offload.scm (transfer-and-offload): Use 'upload' lock instead of 'bandwidth' around 'send-files' calls, and 'download' lock around 'retrieve-files' call.
* offload: Disable SSH-level compression.Ludovic Courtès2014-03-26
| | | | | | | | | * guix/scripts/offload.scm (remote-pipe): Remove '-z' lsh command line argument. This makes transfers almost an order of magnitude slower. OpenSSH's ssh(1) man page notes: "Compression is desirable on modem lines and other slow connections, but will only slow down things on fast networks." See also <http://www.spikelab.org/blog/transfer-largedata-scp-tarssh-tarnc-compared.html>.
* offload: Compress files being sent/retrieved.Ludovic Courtès2014-03-24
| | | | | | | | * guix/scripts/offload.scm (send-files): Add "xz -dc |" to the remote pipe command. Pass PIPE through 'call-with-compressed-output-port'. Remove 'close-pipe' call. (retrieve-files): Add "| xz -c" to the remote pipe command. Pass PIPE through 'call-with-decompressed-port'. Remove 'close-pipe' call.
* offload: Send build logs to file descriptor 4.Ludovic Courtès2014-03-19
| | | | | | | | | * guix/scripts/offload.scm (with-error-to-port): New macro. (remote-pipe): Add #:error-port parameter. Use 'with-error-to-port' around 'open-pipe*' call. (build-log-port): New procedure. (offload): Change #:log-port to default to (build-log-port). Call 'remote-pipe' with #:error-port LOG-PORT.
* offload: Fix 'choose-build-machine' for several machines.Ludovic Courtès2014-03-13
| | | | | * guix/scripts/offload.scm (choose-build-machine)[undecorate]: Turn into a two-argument procedure.
* offload: Convert the port number to a string when invoking lsh.Ludovic Courtès2014-03-13
| | | | | * guix/scripts/offload.scm (remote-pipe, send-files): Pass the result of 'build-machine-port' to 'number->string'.
* offload: Allow build machines to specify a port number.Ludovic Courtès2014-03-13
| | | | | * guix/scripts/offload.scm (<build-machine>): Add 'port' field. (remote-pipe, send-files): Use lsh's '-p' option when invoking it.
* offload: Honor absolute build timeouts.Ludovic Courtès2014-03-09
| | | | | | | | * guix/scripts/offload.scm (offload): Remove default value for 'build-timeout'. Pass '--timeout' to the remote 'guix build' process. (transfer-and-offload, process-request): Remove default value for 'build-timeout'.
* offload: Move macro definitions before use.Ludovic Courtès2014-03-09
| | | | | | * guix/scripts/offload.scm (lock-file, unlock-file, with-file-lock, with-machine-lock, machine-slot-file, acquire-build-slot, release-build-slot): Move definitions above their first use.
* offload: Distinguish between 'decline' and 'postpone'.Ludovic Courtès2014-03-09
| | | | | | | | * guix/scripts/offload.scm (transfer-and-offload): New procedure, with core formerly in 'process-request'. (choose-build-machine): Remove 'requirements' parameter. (process-request): Reply 'decline' when none of MACHINES matches the requirements, and 'postpone' when MACHINES are busy.
* offload: Prevent locked files from being GC'd.Ludovic Courtès2014-03-08
| | | | | * guix/scripts/offload.scm (%slots): New variable. (choose-build-machine): Add SLOT to '%slots'.
* offload: Fix thinko.Ludovic Courtès2014-03-08
| | | | | * guix/scripts/offload.scm (choose-build-machine)[machine+slots]: Use 'filter-map', not 'filter'.
* offload: Make 'parallel-builds' a hard limit.Ludovic Courtès2014-03-08
| | | | | | | | | * guix/scripts/offload.scm (machine-choice-lock-file, machine-slot-file, acquire-build-slot, release-build-slot): New procedures. (choose-build-machine): Operate with (machine-choice-lock-file) taken. Acquire a build slot for each of MACHINES. Release those not used.
* offload: Further generalize lock files.Ludovic Courtès2014-03-08
| | | | | | | * guix/scripts/offload.scm (lock-machine, unlock-machine): Remove. (lock-file, unlock-file): New procedures. (with-file-lock): New macro. (with-machine-lock): Rewrite in terms of 'with-file-lock'.
* offload: Generalize the machine lock mechanism.Ludovic Courtès2014-03-08
| | | | | | | | * guix/scripts/offload.scm (lock-machine): Add 'hint' parameter. (unlock-machine): Remove 'machine' parameter. (with-machine-lock): Add 'hint' parameter, and pass it down. (process-request): Adjust uses of 'with-machine-lock' to pass the 'bandwidth hint.
* offload: Serialize file transfers to build machines.Ludovic Courtès2014-03-06
| | | | | | | | * guix/scripts/offload.scm (machine-lock-file, lock-machine, unlock-machine): New procedures. (with-machine-lock): New macro. (process-request): Wrap 'send-files' and 'retrieve-files' calls in 'with-machine-lock'.
* offload: Comment out attempt to set up an lsh gateway.Ludovic Courtès2014-03-01
| | | | | * guix/scripts/offload.scm (open-ssh-gateway): Comment out. (process-request): Remove call to 'open-ssh-gateway' and to 'kill'.
* offload: 'remote-pipe' uses the right SSH key.Ludovic Courtès2014-03-01
| | | | | * guix/scripts/offload.scm (remote-pipe): Pass -i when invoking %LSHG-COMMAND.
* offload: Take the target machine load into account.Ludovic Courtès2014-03-01
| | | | | | | * guix/scripts/offload.scm (machine-load, machine-less-loaded?, machine-less-loaded-or-faster?): New procedures. (choose-build-machine): Use 'machine-less-loaded-or-faster?' when sorting. Return the head of MACHINES unless it's loaded is >= 2.
* offload: Have 'build-machines' honor its argument.Ludovic Courtès2014-02-02
| | | | * guix/scripts/offload.scm (build-machines): Honor FILE.
* offload: Do not try to retrieve anything upon build failure.Ludovic Courtès2014-01-27
| | | | | | | | * guix/scripts/offload.scm (offload): Add 'log-port' keyword parameter. Handle log display here. Return the result of (close-pipe pipe). (process-request): Adjust 'offload' call site accordingly. Call 'retrieve-files' only when 'offload' returns zero; exit when 'offload' returns non-zero.
* Add 'guix offload' as a daemon build hook.Ludovic Courtès2014-01-24
* nix/nix-daemon/guix-daemon.cc (GUIX_OPT_NO_BUILD_HOOK): New macro. (options): Add '--no-build-hook'. (parse_opt): Handle it. (main)[HAVE_DAEMON_OFFLOAD_HOOK]: Set 'useBuildHook' by default. Set $NIX_BUILD_HOOK to our offload hook unless otherwise specified. [!HAVE_DAEMON_OFFLOAD_HOOK]: Clear 'useBuildHook'. * pre-inst-env.in: Set and export NIX_BUILD_HOOK. * nix/scripts/offload.in, guix/scripts/offload.scm: New files. * guix/ui.scm (show-guix-help)[internal?]: Add "offload". * config-daemon.ac: Call 'GUIX_CHECK_UNBUFFERED_CBIP'. Instantiate 'nix/scripts/offload'. Set 'BUILD_DAEMON_OFFLOAD' conditional, and optionally define 'HAVE_DEAMON_OFFLOAD_HOOK' cpp macro. * daemon.am (nodist_pkglibexec_SCRIPTS)[BUILD_DAEMON_OFFLOAD]: Add it. * Makefile.am (MODULES)[BUILD_DAEMON_OFFLOAD]: Add 'guix/scripts/offload.scm'. (EXTRA_DIST)[!BUILD_DAEMON_OFFLOAD]: Likewise. * m4/guix.m4 (GUIX_CHECK_UNBUFFERED_CBIP): New macro. * doc/guix.texi (Setting Up the Daemon): Move most of the body to... (Build Environment Setup): ... this. New subsection. (Daemon Offload Setup): New subsection.
generated by cgit v1.2.3 (git 2.45.2) at 2024-08-21 14:22:50 +0000