Shoutout to nix:numtide/llm-agents.nix to make testing all ai multiplexers so easy
numtide/llm-agents.nix
1 like · 122 views
[quote="juipeltje, post:5, topic:80768"]
technically you could do that manually as well and then still install the package on the user level, but i feel like you may as well just install it natively on the host system at that point).
[/quote]
Or you could use system-manager on the foreign distro to install them!
My main laptop runs on Pop!_OS+system-manager+home-manager because I gradually transitioned onto Nix and didn't want to reinstall on my 1 machine with all my files.
3 likes
Similar here, I've just ate the eval times (usually 1-2min for me on my X1E2) with my 71 flake.lock nodes.
The problem is that I do rely on stuff that's not in nixpkgs (for example, firefox-nightly to get unsigned extensions for my firefox-extensions-declarative extension forks, epireyn/niri-flake for niri config, reaper-flake, system-manager, etc), several custom programs, software patches, etc.
github.com/bitbloxhub/nixos-config/blob/28ff71d8d…
I do try to avoid import nixpkgs and similar things, though.
1 comment
@joschelboschel btw, did you see the work that we did with numtide/cargo-nix-plugin ? i think both projects are complementary and there is probably some code we could share.
1 like · 42 views
@bereknyei Some of this:
* Stop doing calls to the nix-daemon during eval
* More compact in-memory representation
* Arena allocation instead of GC
* Multi-threading with fibers
* // unions instead of merges
* Bunch of tricks with thunks
github.com/numtide/iets/blob/main/docs/explanatio…
8 likes · 1 repost · 91 views
My preferred Nix package for this patches at least that behavior out, afaict:
github.com/numtide/llm-agents.nix/blob/dc285bfd94…
numtide/llm-agents.nix
This kind of stuff often breaks for applications packaged with Nix, so it's often removed from Nix packages for compatibility reasons. Both behaviors you mention are helpfully patched out of the Claude Code package I use: github.com/numtide/llm-agents.nix/blob/dc285bfd94…
As a result, I never knew that Claude Code does a nasty thing like this, either. :-\
Fwiw, packages in that repo get version bumped each day, so if that's a fast enough pace for you it may be a good alternative.
@SyntaxError2505 no i use the numtide package
numtide/llm-agents.nix
2 likes · 39 views
@domenkozar if you're building a new nix interpreter as well, we can share the conformance test suite: numtide/nix-conformance . It would be nice to standardize the language.
3 likes · 49 views
Mentions
Shoutout to nix:numtide/llm-agents.nix to make testing all ai multiplexers so easy numtide/llm-agents.nix
[quote="juipeltje, post:5, topic:80768"] technically you could do that manually as well and then still install the package on the user level, but i feel like you may as well just install it natively on the host system at that point). [/quote] Or you could use system-manager on the foreign distro to install them! My main laptop runs on Pop!_OS+system-manager+home-manager because I gradually transitioned onto Nix and didn't want to reinstall on my 1 machine with all my files.
Similar here, I've just ate the eval times (usually 1-2min for me on my X1E2) with my 71 flake.lock nodes. The problem is that I do rely on stuff that's not in nixpkgs (for example, firefox-nightly to get unsigned extensions for my firefox-extensions-declarative extension forks, epireyn/niri-flake for niri config, reaper-flake, system-manager, etc), several custom programs, software patches, etc. github.com/bitbloxhub/nixos-config/blob/28ff71d8d… I do try to avoid import nixpkgs and similar things, though.
@joschelboschel btw, did you see the work that we did with numtide/cargo-nix-plugin ? i think both projects are complementary and there is probably some code we could share.
@bereknyei Some of this: * Stop doing calls to the nix-daemon during eval * More compact in-memory representation * Arena allocation instead of GC * Multi-threading with fibers * // unions instead of merges * Bunch of tricks with thunks github.com/numtide/iets/blob/main/docs/explanatio…
My preferred Nix package for this patches at least that behavior out, afaict: github.com/numtide/llm-agents.nix/blob/dc285bfd94… numtide/llm-agents.nix
This kind of stuff often breaks for applications packaged with Nix, so it's often removed from Nix packages for compatibility reasons. Both behaviors you mention are helpfully patched out of the Claude Code package I use: github.com/numtide/llm-agents.nix/blob/dc285bfd94… As a result, I never knew that Claude Code does a nasty thing like this, either. :-\ Fwiw, packages in that repo get version bumped each day, so if that's a fast enough pace for you it may be a good alternative.
@SyntaxError2505 no i use the numtide package numtide/llm-agents.nix
@domenkozar if you're building a new nix interpreter as well, we can share the conformance test suite: numtide/nix-conformance . It would be nice to standardize the language.