• 0 Posts
  • 326 Comments
Joined 3 years ago
cake
Cake day: July 29th, 2023

help-circle
  • Some folks, who may be familiar to some or more of you, accidentally discovered that if your git repo symlinks CLAUDE.MD to, say, /dev/urandom, it breaks Claude code.

    the reason why this works is exactly the reason why claude code sucks so bad. there are protections against this in the file reading tool. however because everything in claude code is implemented in 5 million different ways, those protections are a completely orthogonal set of codepaths from how CLAUDE.md files are read. conversely, the file read tool seems to be completely naive to symlinks while the CLAUDE.md reader is not. this is the fucking swiss cheese security model of the fucking gold standard of what AI programming can do.

    https://neuromatch.social/@jonny/116779793188712173

    The thread is actually about trying to attract and manipulate autonomous coding agents, but they’ve only had limited success so far, which may have been slowed down by the above symlink trick.


  • I think part of the issue is that historical software quality was an artefact of its time… if you can’t easily patch your released products, you need to work harder to ensure they’re functional. If the only way for people to learn about how your product works in the documentation you ship with it, the docs need to be useful and comprehensive.

    The combination of software needing no guarantee of merchantability or fitness for any particular purpose and the internet rendered those pressures obsolete. Ship shit, fix later. Mass-scale a/b testing over past decade or two shows that most people seemingly don’t care if their software runs like absolute garbage, and is covered in adverts, and harvests all their personal data and the leaks all of it that wasn’t sold.

    An incident-to-pr ratio that’s up by 250% is unfortunate, but it is not yet so bad that the end-users actually care enough to do anything about it, even assuming they can do anything.


  • This is by an llm-boosting firm, so be aware that it’ll have a lot of marketing in it. It doesn’t say nice things about vibe code (presumably because the authors want to sell you a solution) but the numbers are interesting even so.

    https://www.faros.ai/blog/ai-acceleration-whiplash-takeaways

    A few choice snippets, none of which will surprise anyone here:

    1. For every code change merged, the probability of a production incident has more than tripled.

    The incidents-to-PR ratio is up 242.7% as teams move from low to high AI adoption.

    1. Bugs are accelerating, not stabilizing.

    In our 2025 AI engineering report on the AI Productivity Paradox, bugs per developer were up 9% as AI adoption grew. In this dataset, that figure has risen to 54%

    1. The most experienced people in your organization are being buried.

    Median time to first PR review is up 156.6%. Average time spent in code review is up 199.6%. Median time in review is up 441.5%. The engineers with the deepest knowledge of the system are spending their most valuable hours unraveling plausible-looking code that should never have reached them in the state it did.




  • because there’s no economic incentive to hire them to do that kind of work.

    isn’t that the old “basic science is boring and unsexy” issue though? There are economic incentives, but not in a short term-big-bux sort of way, so capitalism can’t be trusted with it.

    To conjure up a recent example, something like “The number of curves of genus two with elliptic differentials”, published back in 1997, probably had limited commercial value at the time, but 20 years later completely sunk a promising post-quantum cryptography algorithm (“An efficient key recovery attack on SIDH”) which might have had some non-trivial commercial implications if SIKE had got through the key exchange algorithm competition.

    Anyway, the Erdős problems are good candidates for llm work because they have been specified in a careful and formal way, which requires a reasonably competent mathematician to do. That then opens up mathematics to the same deskilling problem that other sectors afflicted with llms have, and because capitalism is shortsighted and stupid we don’t know what the future economic impact of that will be, right?













  • instead of making little money (by making fuel) why not make more money? (by setting there energy intensive manufacture) this seems to be current meta, with places like iceland and norway making aluminum and nitrogen fertilizers respectively. this can continue in other places and maybe extended to some other industries.

    Because now you have to establish a complex supply chain and potentially large worker base in a place that’s potentially quite inconvenient for both, instead of a much simpler supply chain and smaller workforce.

    this requires massive renewables buildout, which means electricity is cheap for regular people

    Well, not necessarily. Because as I said, there are places which are very sunny and/or windy which are also a long way away from the people and industries which would like to consume the power that could be produced there.

    Long distance power transmission is an very expensive infrastructure to build, and unless you’re building even more expensive modern HVCD systems you can get significant transmissions losses to the point where your distant renewables aren’t really much good. If you can convert the power to something transportable, either on-site or nearby, then you can avoid the transmission losses and giant infrastructure projects.

    Much as I do not like the oil industry, there is a significant amount of equipment and expertise out there for storing, transporting and converting flavours of hydrocarbons into other flavours. Some use could be made of it.

    then you have to compete with biofuels

    I’m not so sure about that. They’re a whole ecological catastrophe in and of themselves, and another cash crop that rich nations can extract from the poorer ones, ultimately to everyone’s detriment. They’re also going to be feeling the squeeze from climate change which is going to make them harder to grow economically as time goes on.

    There might be a breakthrough ethanol-brewing algae which might suddenly change everything, but I don’t anyone has the bioengineering chops for that yet.

    hydrogen costs

    I strongly feel that hydrogen is even more of a dead-end technology than these e-fuels. It is a right pain to store and transport and has rubbish energy density. There’s no future in the hydrogen economy. I’d bet we’re more likely to jump to artificial photosynthesis and fancy fuel cells than we are to see any substantial hydrogen infrastructure.


  • So, the idea isn’t entirely as stupid as it initially sounds. There are two things that you gain from this approach:

    • You can more easily separate your energy generation and consumption. Power lines are lossy, and there are a lot of very sunny and very windy places that are a long way away from where people actually want to live. Massive HVDC infrastructure buildout isn’t cheap or easy.
    • Energy density of chemical fuels is higher than batteries. Being able to travel long distances without convenient nearby power sources is useful… long distance high speed rail isn’t always convenient to electrify, but also long haul flights and rocketry are Quite Difficult to run on batteries.

    FWIW, I suspect the cost will end up being even higher, because you’ll start losing the economies of scale that modern vehicle infrastructure has, because normal people will just use EVs.

    It can only ever be an intermediate technology anyway. Artificial photosynthesis and more sophisticated fuel cells seem like much more plausible longer-term futures.


  • I wonder why this blog post was brazen enough to talk about these problems. Perhaps by throwing in a little humility, they can make the hype pill that much easier to swallow.

    I feel this is an artefact of the near complete collapse of mainstream journalism, combined with modern tech business practises that are about securing investment and cashing out, and every other concern is secondary or even entirely absent. It’s all just selling vibes.

    People only ever report the hype, the investors see everyone else following the hype and panic that they might be left out and bury you in cash. When it all turns sour and people ask pointed questions about the exact nature of the magic beans you were promising to grow, you can just point at the blog post that no-one read (or at least, only poor people read, and they’re barely people if you think about it) and point out that you never hid anything.