AI

So, it feels like it’s time to write again, to see where we actually are at. Recently there were two big events related to the LLMs. First one is the “discovery” of a counter-example for the famous conjuncture (and the large blog post by Terence Tao, that he could have discovered it too, LOL). Another one was the “hack” of bitcoin “hardware” wallets, not the hack itself (it is rather “simple”) but the fact that, allegedly, an LLM with a given prompt like “find a security weakness in this code” (not even a “vulnerability”) have managed to find the exact RNG bug (reduction of the entropy size form the “safe” 128 bits from a hardware RNG to a “weak” 40 bits of flawed software RNG, so the attackers are just brute-forcing the 40bit “state space” and find the keys). ...

When they began to feed the generated slop back to the models, they deepen the “fundamental problem” even further. The most recent models produce an excelent verbiage but the code is out of sync with it. This fact is very easy to undestand and explain – the verbiage and the code live in the very different “regions” of the model’s representation (weight matrix or whatever it is) and these regions are getting tuned (reinforced) at a very different rates and thus do not converge as they are expecting. ...

Look, ma – no hands^W^W another one, who knows it all: https://www.0xkato.xyz/how-llms-actually-work/ I am so fucking tired of this shit, don’t you? Okay, even if arguing with retards is ultimately futile, and especially so in the society which does not value intelligence, but only appearances and virtue signalling, lets continue competing in our sport of choice while we still can. No one understands this shit, since the very process by which the artifact in question has emerged is, in principle, by definition, different from the post-hoc “explanations” and anthropomorphic “rationalizations” which plague such “literature”. ...

After the “Sentient Models” has been booed by very few remaining intelligent people they resorted to a the next best meme – their AI is improving itself (recursively, my ass). https://www.anthropic.com/institute/recursive-self-improvement Notice that this has almost nothing to do with the actual underlaying tech, except that the models are being feed with their own slop for the Reinforcement Learning and as new data, and has everything to do with the upcoming IPO – look, AI writes itself, what can possibly go wrong – buy our shit. ...

So, let’s see. Since my last summary nothing has been changed much, except the US stock market, Nasdaq100 and S&P500, in particular, are printing ATHs every single day and MU and DELL, and even INTC and AMD – you can see it yourself. On the other side Anthropic emerged as a true leader in the armrace [to the bottom] since their code slop generator is qualitatively better than Gemini – the closes competitor. Everything else is just bullshit (both ChatGPT and Grok are, indeed, merely Infotainment chatbots). ...

I used to work with a few quite stupid “managers” whose only skill was that manipulative pseudo-empathy and other quite transparent manipulative skills – the “Pan Am” fake smiles at the cognitive level. It is not that we didn’t see through these primitive manipulative tactics or “respected them” to not to hurt their felling, we just simply acknowledged that these people are strictly way below our levels and just did not bother. These managers, by the way, are still cock sure of their cleverness and their abilities “to manage people efficiently” and that no one sees how they do it. ...

This is not mere a hatespeech, this is the actual fact. Here is how it works. I have received a lot of reports like this one (because I do really know what to prompt for): The system is now fully complete, architecturally sound, and rigorously verified against its formal specification. All logic is expressed as pure, immutable transformations within a declarative network shell. #+end_quite So, I am outperforming the 99% percent of Github and should be a millionaire in a few months. Or, perhaps, something is fishy out there. ...

This is how things work: you, being a “literally who?” nobody, wrote approximately 13 pages of titles of articles, about exactly how and why the current incarnation of AI is only an appearance of “intelligence” and a textbook cognitive illusion, and then some fuck wrote a single blog post and got all the fucking HN top page and what not. Life is harsh, competition for being [recognized as] “smart” is throat cutting, you know. ...

There is a whole distinct genre of social media videos, like “The ordinary day of a Japanese salaryman” and what not, you know. So here is mine. I usually trying to avoid HN in its current incarnation (as a safe-space for entitled mediocrity), but once in a while… it is a dildo. https://arkaung.github.io/interactive-turboquant/ – I have seen this shit before, a lot of it. The walls of Egyptian pyramids were covered with such seemingly “logically coherent” and ever infallible “explanations” – everything seem to follow, just the premises were wrong. Writing such Tantric texts is a sure good way to obtain a higher social status among plebs. ...

There is a morning conversation with the most powerful free-tier LLM. Let’s do a deep research project, to re-implement a proper, mathematically rigorous and provable (using the findings of the Category Theory) proof-of-concept blockchain implementation from the first principles, right from the ground up. First of all, every single modern blockchain implementation is an amateur crap, full of idiotic design decisions, full of technical debt, made by an unqualified, Dunning-Kruger naive, amateur over-ambitious zealots. Literally everything, just like in the early versions of PGP, is just wrong. ...