12 KiB
Using Nix Development Shell for xrpld Development
This guide explains how to use Nix to set up a reproducible development environment for xrpld. Using Nix eliminates the need to manually install utilities and ensures consistent tooling across different machines.
The Nix development shell is the recommended way to develop xrpld. It unifies the development environment for everyone and synchronizes updates: the same tooling and compiler versions are used both here and in CI. Any custom environment (Homebrew packages or anything else) will continue to work, but then it is up to you to keep it in sync with the environment used in CI.
Benefits of Using Nix
- Reproducible environment: Everyone gets the same versions of tools and compilers
- Matches CI: The Linux CI runs in Docker images built from this exact Nix environment, and CI builds some macOS configurations in it as well
- No system pollution: Dependencies are isolated and don't affect your system packages
- Consistent compilers: The GCC and Clang shells use the same versions as CI
- Quick setup: Get started with a single command
- Works on Linux and macOS: Consistent experience across platforms
Install Nix
Please follow the official installation instructions of nix package manager for your system.
Entering the Development Shell
Basic Usage
From the root of the xrpld repository, enter the default development shell:
nix --experimental-features 'nix-command flakes' develop
This will:
- Download and set up all required development tools (CMake, Ninja, Conan, etc.)
- Configure the appropriate compiler for your platform:
- Linux: GCC (provided by Nix)
- macOS: Clang (provided by Nix)
The first time you run this command, it will take a few minutes to download and build the environment. Subsequent runs will be much faster.
Platform notes
- Linux:
nix developgives you a shell with all the tooling necessary to develop xrpld and with the same GCC/glibc toolchain that Nix builds for CI. See Choosing a different compiler for the custom-vs-plain toolchain trade-off. - macOS:
nix developgives you a full environment too, with Clang (and every other tool, including Conan) provided by Nix. To use your system-wide Apple Clang instead, enternix develop .#apple-clang. Conan has no binary in the Nix cache for macOS, so it is built from source the first time you enter the shell, which makes the initial setup slower (this is handled automatically; seenix/devshell.nix).
Tip
To avoid typing
--experimental-features 'nix-command flakes'every time, you can permanently enable flakes by creating~/.config/nix/nix.conf:mkdir -p ~/.config/nix echo "experimental-features = nix-command flakes" >> ~/.config/nix/nix.confAfter this, you can simply use
nix developinstead.
Note
The examples below assume you've enabled flakes in your config. If you haven't, add
--experimental-features 'nix-command flakes'after eachnixcommand.
Choosing a different compiler
A compiler can be chosen by providing its name with the .# prefix, e.g. nix develop .#clang.
On Linux, .#gcc and .#clang provide the exact toolchain CI uses:
the compiler (pinned in nix/packages.nix)
rebuilt against the pinned custom glibc (see nix/linux.nix).
Building that toolchain the first time is slow unless it is fetched from a Nix binary cache.
If you don't need the custom glibc, the Linux-only .#gcc-plain and .#clang-plain
give you the stock nixpkgs compilers of the same versions.
On macOS there is no custom glibc, so .#gcc and .#clang are already the plain nixpkgs toolchain,
and the -plain variants do not exist.
Use nix flake show to see all the available development shells.
Use nix develop .#no-compiler to use the compiler from your system.
Example Usage
# Use GCC — same toolchain as CI (custom glibc on Linux)
nix develop .#gcc
# Use Clang — same toolchain as CI (custom glibc on Linux)
nix develop .#clang
# Use default for your platform
nix develop
# Stock nixpkgs GCC/Clang, Linux only — skips the custom-glibc build, but does not match CI
nix develop .#gcc-plain
nix develop .#clang-plain
Using a different shell
nix develop opens bash by default. To use another shell, pass it with the -c flag — this works with any shell, e.g. zsh or fish:
# Use zsh
nix develop -c zsh
# Use fish
nix develop -c fish
# Use your login shell
nix develop -c "$SHELL"
Warning
Your shell's interactive startup files (e.g.
config.fish,.zshrc) may prepend other directories — most commonly Homebrew — to$PATH, which can shadow the tools provided by the Nix shell. After entering, verify that tools resolve into the Nix store:command -v cmake # should print a /nix/store/... pathIf it doesn't, either adjust your shell configuration so it doesn't override
$PATH, or use direnv (below), which loads the environment after your shell config and so takes precedence regardless of the shell you use.
Building xrpld in the Nix shell
Once inside the Nix development shell, follow the standard build instructions. The Nix shell provides all necessary tools (CMake, Ninja, Conan, etc.).
Coverage builds (-Dcoverage=ON) work in the gcc shell (and gcc-plain on Linux):
each ships a gcov matching its compiler, since Nix's cc-wrapper does not expose one.
The clang shells do not include llvm-cov, so use a gcc shell for coverage.
Builds of the Rust crates (-Drust=ON) also work out of the box: every shell
provides the Rust toolchain pinned in
rust-toolchain.toml (see
Rust), plus the cargo-audit, cargo-llvm-cov and
cargo-nextest plugins.
Conan configuration
The shell runs conan/init.sh on entry, so
Set Up Conan is already done for you. It installs
into the shell's own Conan home: CONAN_HOME=~/.conan2-nix.
Prebuilt packages
On Linux, the binaries on the xrplf remote are built in this same Nix
environment — CI runs in Docker images that bundle the dev shell's toolchain (see
nix/docker) — so .#gcc and .#clang can reuse them. The
-plain shells do not match that toolchain's glibc, so binaries from the remote
are not a reliable match there.
On macOS, CI also builds in this Nix environment, in Debug and Release (the
macos-arm64-*-nix configurations — Debug because the profile defaults to it).
The Nix build resolves to compiler=clang, so it gets its own package IDs,
separate from the Apple Clang ones. The
dependency upload publishes them
on pushes to develop and on manual runs — its nightly run rebuilds everything
from source but uploads nothing — so once a set has been published nix develop
can reuse it instead of compiling every dependency locally. These configurations
run outside the reduced pull-request matrix, so label a PR Full CI build when it
touches flake.lock or nix/.
To compile everything from source, add --build '*' to the conan install
command.
Why the nixpkgs revision is not part of the package ID
A Conan package ID records the compiler and its major version, but nothing about
the nixpkgs revision the toolchain came from — and flake.lock moves far more
often than the toolchain meaningfully changes, so folding it in would rebuild
every dependency on every bump for nothing.
That is safe as long as no cached artifact resolves a /nix/store path at run
time, because store paths change on every update and the old ones disappear with
nix-collect-garbage. With the clang toolchain macOS CI and the dev shell use,
they do not: it links against /usr/lib/libc++ and /usr/lib/libSystem, and
store paths reach the .a files only through debug info, which nothing resolves
at link or run time.
Warning
This does not hold for
nix develop .#gccon macOS. There is no system libstdc++, so GCC links its own from the store and every binary keeps a/nix/storereference. That shell is fine for tooling, but it is not a build configuration CI covers, and no dependency binaries are published for it.
This is checked rather than assumed.
bin/check-nix-store-refs.sh takes one file
or directory and fails if a binary under it resolves a store path at run time.
CI runs it over the build output and the Conan cache, and again in the upload job
before anything is published. You can run it yourself:
bin/check-nix-store-refs.sh build
bin/check-nix-store-refs.sh ~/.conan2-nix
It works on Linux too, but asserts something narrower there: the toolchain always
writes the store into PT_INTERP and RUNPATH, and CI builds inside an image
whose store is fixed for its lifetime, so that is fine. Only the binaries
PatchNixBinary.cmake retargets to the
system loader have to be clean, and those are what CI checks:
bin/check-nix-store-refs.sh build/xrpld
The libresolv stub
This is not hypothetical: xrpld used to be caught by it. The c-ares package
tells the linker to pass -lresolv, and nixpkgs keeps libresolv out of the
macOS SDK and ships it as an ordinary store dylib — so every Nix-built xrpld
recorded a /nix/store/…-libresolv-93/lib/libresolv.9.dylib load command and
stopped running once that path was collected. Nothing in the link uses a single
symbol from it.
Both environments now put a stub on the linker search path
(libresolvSystemStub in nix/darwin.nix): the
same library with its install name set to /usr/lib/libresolv.9.dylib, which is
exactly the load command the Apple Clang build records.
Package IDs did not change, so Conan keeps serving anything built before the
stub landed. If a binary fails to start with Library not loaded: /nix/store/…,
see that entry
in the troubleshooting guide.
Automatic Activation with direnv
direnv or nix-direnv can automatically activate the Nix development shell when you enter the repository directory.
This is also the most robust way to use the environment from any shell (bash, zsh, fish, …): direnv stays in your current shell and loads the environment after your shell's startup files have run, so the Nix-provided tools take precedence over anything your shell configuration adds to $PATH.
The repository already ships an .envrc at its root that activates the Nix flake development shell, so you don't need to create one. To use it:
- Install direnv and hook it into your shell (bash, zsh, fish, …). Installing nix-direnv as well is recommended: it caches the shell so that activation is near-instant after the first run.
- Run
direnv allowonce in the repository root. direnv will then load (and reload) the Nix development shell automatically whenever you enter the directory.
Note
direnv only caches the
.direnvdirectory (already listed in.gitignore); no other repository files are affected.
Updating flake.lock file
To update flake.lock to the latest revision use nix flake update command.
Tooling snapshots
The tool versions in each Nix environment are recorded in
nix/check-tools/ and verified by CI. If you change the
environment (bump the CI image tag, update flake.lock, or edit the tool list in
bin/check-tools.sh), CI fails until you regenerate and commit the affected
snapshot — see nix/check-tools/README.md.
Troubleshooting
See Troubleshooting Nix problems for common issues,
such as nix develop failing inside Git worktrees.