| ▲ | Show HN: Xmloxide – an agent made rust replacement for libxml2(github.com) |
| 54 points by jawiggins 8 hours ago | 51 comments |
| Recently several AI labs have published experiments where they tried to get AI coding agents to complete large software projects. - Cursor attempted to make a browser from scratch: https://cursor.com/blog/scaling-agents - Anthropic attempted to make a C Compiler: https://www.anthropic.com/engineering/building-c-compiler I have been wondering if there are software packages that can be easily reproduced by taking the available test suites and tasking agents to work on projects until the existing test suites pass. After playing with this concept by having Claude Code reproduce redis and sqlite, I began looking for software packages where an agent-made reproduction might actually be useful. I found libxml2, a widely used, open-source C language library designed for parsing, creating, and manipulating XML and HTML documents. Three months ago it became unmaintained with the update, "This project is unmaintained and has
[known security issues](https://gitlab.gnome.org/GNOME/libxml2/-/issues/346). It is foolish to use this software to process untrusted data.". With a few days of work, I was able to create xmloxide, a memory safe rust replacement for libxml2 which passes the compatibility suite as well as the W3C XML Conformance Test Suite. Performance is similar on most parsing operations and better on serialization. It comes with a C API so that it can be a replacement for existing uses of libxml2. - crates.io: https://crates.io/crates/xmloxide - GitHub release: https://github.com/jonwiggins/xmloxide/releases/tag/v0.1.0 While I don't expect people to cut over to this new and unproven package, I do think there is something interesting to think about here in how coding agents like Claude Code can quickly iterate given a test suite. It's possible the legacy code problem that COBOL and other systems present will go away as rewrites become easier. The problem of ongoing maintenance to fix CVEs and update to later package versions becomes a larger percentage of software package management work. |
|
| ▲ | yobbo 4 minutes ago | parent | next [-] |
| The code might be a little verbose which is tiresome for humans to read and follow. Structure and functions look idiomatic. It seems to be using xml parser idioms which makes it readable. It could be doing double checks in both tokeniser and parser and things like that. Actually looks like a good starting point and reference for someone working on xml parsers in rust. |
|
| ▲ | mdavid626 2 hours ago | parent | prev | next [-] |
| Can you add “made with AI” to the GitHub repo? It’s time to make this mandatory. Nothing against AI - just to inform people about quality, maintainability and future of this library. No human has mental model of the code, so don’t waste your time creating it - the original author didn’t either. |
| |
| ▲ | agentifysh 42 minutes ago | parent [-] | | what would be the point ? why should this be mandatory ? none of your arguments make sense here | | |
| ▲ | kelnos 40 minutes ago | parent [-] | | GP literally tells you the point in the last paragraph. Makes perfect sense to me. | | |
| ▲ | agentifysh 36 minutes ago | parent [-] | | and why should that be solved by "made by AI" being mandatory label when pretty much all of coding now involves it | | |
| ▲ | mdavid626 27 minutes ago | parent [-] | | Involves and made only by, are 2 different things. I use agentic coding in my daily work. I do make mental model of the code I write and I also test the code, exactly the same way, as when written completely manually. | | |
| ▲ | agentifysh 19 minutes ago | parent [-] | | Ah, so the code doesn't need an AI label as long as you promise you thought really hard about it before copy-pasting. |
|
|
|
|
|
|
| ▲ | wooptoo 6 hours ago | parent | prev | next [-] |
| A comment on libxml, not on your work:
Funny how so many companies use this library in production and not one steps in to maintain this project and patch the issues.
What a sad state of affairs we are in. |
| |
| ▲ | jawiggins 6 hours ago | parent | next [-] | | Yeah I agree, maintaining OS projects has been a weird thing for a long time. I know a few companies have programs where engineers can designate specific projects as important and give them funds. But it doesn't happen enough to support all the projects that currently need work, maybe AI coding tools will lower the cost of maintenance enough to improve this. I do think there are two possible approaches that policy makers could consider. 1) There could probably be tax credits or deductions for SWEs who 'volunteer' their time to work on these projects. 2) Many governments have tried to create cyber reserve corps, I bet they could designate people as maintainers of key projects that they rely on to maintain both the projects as well as people skilled with the tools that they deem important. | | |
| ▲ | da_chicken 3 hours ago | parent [-] | | There should be public works grants to maintain them, or else a foundation specifically to maintain them funded with donations, grants, etc. The alternative is another XZ backdoor. |
| |
| ▲ | socalgal2 16 minutes ago | parent | prev | next [-] | | funny how this myth won't die. Checking the commit history plenty of companies are contributing redhat, apple, samsung, huawei, google, etc... | |
| ▲ | ddlsmurf 3 hours ago | parent | prev | next [-] | | we need a tax on companies using or selling anything OSS, the funds of which go into OSS, the wealth it generated is insane, and it's nearly all just donations of experts | | |
| ▲ | skybrian 2 hours ago | parent [-] | | That's a bit unclear on the concept. It's not open source if you have to pay for it. How about charging money for your code instead? | | |
| ▲ | saintfire an hour ago | parent | next [-] | | Well that's not strictly true. OSS is allowed to make money and there are projects that require paid licenses for commerical use. The source is available and collaborative. Qt states this on their site:
Simply put, this is how it works: In return for the value you receive from using Qt to create your application, you are expected to give back by contributing to Qt or buying Qt. | |
| ▲ | capitol_ 2 hours ago | parent | prev [-] | | There is nothing in the open source licensees that prevents charging money, in fact, non-commercial clauses are seen as incompatible with the Debian Free Software Guidelines. And there is a lot of companies out there that make their money based on open source software, red hat is maybe the biggest and most well known. | | |
| ▲ | skybrian an hour ago | parent [-] | | I meant in the sense that someone else can redistribute the source for free, not that the company has to do it. > The license shall not restrict any party from selling or giving away the software as a component of an aggregate software distribution containing programs from several different sources. The license shall not require a royalty or other fee for such sale. https://opensource.org/osd |
|
|
| |
| ▲ | da_chicken 4 hours ago | parent | prev [-] | | Feels like tragedy of the commons. | | |
| ▲ | wrboyce 3 hours ago | parent [-] | | Feels more like you don’t understand the concept of the tragedy of the commons. EDIT: Sorry, I’ve had a shitty day and that wasn’t a helpful comment at all. I should’ve said that as I understand it TOTC primarily relates to finite resources, so I don’t think it applies here. Sorry again for being a dick. | | |
| ▲ | em-bee 36 minutes ago | parent [-] | | the finite resource here is the unpaid developer time. everyone takes advantage of it until the developer burns out. |
|
|
|
|
| ▲ | kburman 7 hours ago | parent | prev | next [-] |
| Amazing work! I'd love to hear more details about your workflow with Claude Code. As a side note and this isn't a knock on your project specifically. I think the community needs to normalize disclaimers for "vibe-coded" packages. Consumers really need to understand the potential risks of relying on agent-generated code upfront. |
| |
| ▲ | nine_k 3 hours ago | parent | next [-] | | Even more interesting is how much did the effort cost. Unlike the development work of old (pre-2025), work with high-end models incurs a very direct monetary cost, one burns tokens which cost money, and you can't have something as powerful to be running locally (even if you happened to have a Mac Pro Ultra with RAM maxed out). Some of my friends burned through hundreds of dollars a day while doing large amounts of (allegedly efficient) work with Claude Code. | |
| ▲ | socalgal2 10 minutes ago | parent | prev | next [-] | | Do they? Tons of extremely popular human generated libraries are absolute trash. Just as an example, nearly all of the JS zip file libraries are dumpers fires. Same with QR code libraries and command line parsing libraries. This feels like if you want to know if the code is good or bad, read the code and check the tests. Assuming human = good, LLM = bad does not make much sense given the amount of bad human code I've seen. Sure, if the code is from a repuatable company or creator then I'd take that as a strong signal quality over an LLM but I wouldn't take a random human programmer as a strong signal over generated. | |
| ▲ | jawiggins 6 hours ago | parent | prev [-] | | Yeah its a fair point. I wondered if it might be irresponsible to publish the package because it was made this way, but I suspect I'm not the first person to try and develop a package with Claude Code, so I think the best I can do is be honest about it. As for the workflow, I think the best advice I can give is to setup as many guardrails and tools as possible, so Claude and do as many iterations before needing any intervention. So in this case I setup pre-commit hooks for linting and formatting, gave it access to the full testing suite, and let it rip. The majority of the work was done in a single thinking loop that lasted ~3 hours where Claude was able to run the tests, see what failed, and iterate until they all passed. From there, there was still lots of iterations to add features, clean up, test, and improve performance - but allowing Claude to iterate quickly on it's own without my involvement was crucial. | | |
| ▲ | kelnos 35 minutes ago | parent | next [-] | | I don't think it was irresponsible to publish it, but I do think it was irresponsible to publish it without clearly disclosing at the top of the crates.io README that it was built entirely by AI, and that you haven't reviewed the code (assuming you haven't). If I were looking for an XML parser/generator library, I might stumble across this and think it might be production-quality, and assume it was built by humans, or at least that humans had fully vetted and understand the code. | |
| ▲ | tonyedgecombe an hour ago | parent | prev [-] | | Yes, if you tripped across this package in crates.io the readme gives the impression of a serious piece of software but your comments here imply it is a one off experiment rather than something you plan to maintain for the next decade. |
|
|
|
| ▲ | hrtla 3 hours ago | parent | prev | next [-] |
| Yes, you can rip off any sucker who published a test suite when the AI is trained on existing code as well. Congratulations, you will be showered with praise and AI mafia money. |
|
| ▲ | agentifysh 38 minutes ago | parent | prev | next [-] |
| lot of weird comments here getting upset AI was used but thanks for doing this libxml2 is always one of those libraries that i used to have trouble with for different platforms I think its great that more and more OSS projects get attention now with ai coding agents |
|
| ▲ | alexhans 6 hours ago | parent | prev | next [-] |
| > I do think there is something interesting to think about here in how coding agents like Claude Code can quickly iterate given a test suite. This is a point I've tried to advocate for a while. Specially to empower non coders and make them see that we CAN approach automation with control. Some aspects will be the classic unit or integration tests for validation. Others, will be AI Evals [1] which to me could be the common language for product design for different families/disciplines who don't quite understand how to collaborate with each other. The amount of progress in a short time is amazing to see. - [1] https://ai-evals.io/ |
| |
| ▲ | koakuma-chan 5 hours ago | parent [-] | | Please stop spreading this "AI evals" terminology. "evals" is what providers like OpenAI and Anthropic do with their models. If you wrote a test for a feature that uses an LLM, it's just a test, there's no need to say "evals." Having a separate term only further confuses people who already have no idea what that actually means. |
|
|
| ▲ | blegge 7 hours ago | parent | prev | next [-] |
| > arena-based tree with zero unsafe in the public API Why "in the public API"? Does this imply it's using unsafe behind the hood? If so, what for? |
| |
| ▲ | gpm 5 hours ago | parent | next [-] | | I agree the wording is a bit strange, but a quick grep of the repo shows that it doesn't imply that. The only usages of unsafe are in src/ffi, which is only compiled when the ffi feature is enabled. ffi is fundamentally unsafe ("unsafe" meaning "the compiler can't automatically verify this code won't result in undefined behavior") so using it there is reasonable, and the rest of the crate is properly free of unsafe. | |
| ▲ | fulafel 5 hours ago | parent | prev | next [-] | | It provides a libxml2-compatible C API and that accepted pointers, this would seem to necessitate unsafe at least. | |
| ▲ | DetroitThrow 6 hours ago | parent | prev [-] | | Yeah I'm a bit confused because you can have an entirely unsafe code base with just the public interface marked as safe. No unsafe in the interface isn't a measure of safety at all. | | |
| ▲ | mirashii 6 hours ago | parent [-] | | It is a measure of the intended level of care that the users of your interface have to take. If there's no unsafe in the interface, then that implies that the library has only provided safe interfaces, even if it uses unsafe internally, and that the interface exposed enforces all necessary invariants. It is absolutely a useful distinction on whether your users need to deal with unsafe themselves or not. | | |
| ▲ | kelnos 33 minutes ago | parent | next [-] | | It's useful, to be sure, but I wouldn't want to use a library with a safe public interface that is mostly unsafe underneath (unless it's a -sys crate, of course). I think "this crate has no unsafe code" or "this crate has a minimal amount of carefully audited unsafe code" are good things to see, in general. | |
| ▲ | ahepp 4 hours ago | parent | prev | next [-] | | I guess I don't write enough rust to say this with confidence, but isn't that the bare minimum? I find it difficult to believe the rust community would accept using a library where the API requires unsafe. | | |
| ▲ | cstrahan an hour ago | parent | next [-] | | Not at all. Some things are fundamentally unsafe. mmap is inherently unsafe, but that doesn’t mean a library for it shouldn’t exist. If you’re thinking of higher level libraries, involving http, html, more typical file operations, etc, what you’re saying may generally be true. But if you’re dealing with Direct Memory Access, MCU peripherals, device drivers, etc, some or all of those libraries have two options: accept unsafe in the public interface, or simply don’t exist. (I guess there’s a third option: lie about the unsafety and mark things as safe when they fundamentally, inherently are not and cannot be safe) | |
| ▲ | DetroitThrow 4 hours ago | parent | prev [-] | | >I guess I don't write enough rust to say this with confidence, but isn't that the bare minimum I have some experience and yes, unless you're putting out a library for specifically low-level behavior like manual memory management or FFI. Trivia about the unsafe fn keyword missed the point of my comment entirely. |
| |
| ▲ | DetroitThrow 5 hours ago | parent | prev [-] | | Sure, it's a useful distinction for whether users need to care about safety but not whether the underlying code is safe itself, which is what I wrote about. No or very little but verified unsafe internal code is the bar for many Rust reimplementations. It would also be what keeps the code memory safe. |
|
|
|
|
| ▲ | mkj 3 hours ago | parent | prev | next [-] |
| Intriguing work! Does it panic on any bad inputs? That's better than memory unsafety of libxml2, but still a DoS concern for some servers. |
|
| ▲ | dmitrygr 4 minutes ago | parent | prev | next [-] |
| cool, now do it without the test suite that some human made for you |
|
| ▲ | nicoburns 7 hours ago | parent | prev | next [-] |
| How does it compare to the original in terms of source code size (number of lines of code?) |
| |
| ▲ | jawiggins 6 hours ago | parent [-] | | It's significantly smaller. Because Rust doesn't require header files or memory management, xmloxide is ~40k lines while libxml2 is ~150k lines. |
|
|
| ▲ | fourthark 7 hours ago | parent | prev | next [-] |
| Does it fix the security flaws that caused the original project to be shut down? |
| |
| ▲ | jawiggins 6 hours ago | parent | next [-] | | Because it was written in C, libxml2's CVE history has been dominated by use-after-free, buffer overflows, double frees, and type confusion. xmloxide is written in pure Rust, so these entire vulnerability classes are eliminated at compile time. | | |
| ▲ | sarchertech 4 hours ago | parent [-] | | Only if it doesn’t use any unsafe code, which I don’t think is the case here. | | |
| ▲ | jawiggins 4 hours ago | parent [-] | | Is that true? I thought if you compiled a rust crate with, `#[deny(unsafe_code)]`, there would not be any issues. xmloxide has unsafe usage only in the the C FFI layer, so the rest of the system should be fine. |
|
| |
| ▲ | blegge 7 hours ago | parent | prev | next [-] | | https://gitlab.gnome.org/GNOME/libxml2/-/commit/0704f52ea4cd... Doesn't seem to have shut down or even be unmaintained. Perhaps it was briefly, and has now been resurrected? | |
| ▲ | notpushkin 6 hours ago | parent | prev [-] | | If by flaws you mean the security researchers spamming libxml2 with low effort stuff demanding a CVE for each one so they can brag about it – no, I don’t think anybody can fix that. | | |
| ▲ | bawolff 6 hours ago | parent [-] | | Based on context, i kind of imagine they are more thinking of the issues surounding libxslt. |
|
|
|
| ▲ | benatkin 5 hours ago | parent | prev [-] |
| It would be interesting to try this approach out with mQuickJS, QuickJS or micropython. They could potentially run hoops around the ones that were first coded in Rust, such as Boa or RustPython. |