AUTHOR: <lngnmn2@yahoo.com> When I was a kid they told me not to stare at the sun I had this vision, that the brain structures are sort of like trees, while the “branches” are just like patches thorough our yard after fresh snow. Some of them remain thin, just someone walked across it absentmindedly, some gets broadened by a heavy re-use. Who would plow through a fresh snow while one could take follow the path that is already here....
The shitstorm is of the highest category and pleasing to watch. The main issue is that there is models can be produced (trained) at a fraction of the costs by just good and hardworking graduate students who did their homework. It reminds me of legendary Andrew Ng, who was way above everyone else just by being smart, hardworking and systematic in building everything(deriving all the math) from scratch. The Deepseek success has the same vibes....
DESCRIPTION: Memes and mirrors. Nowadays things are moving way too fast. It is not just controlled trial-and-error, it is literally throwing everything at the wall (to see what sticks). It started with that meme “Attention Is All You Need”, when they just came up with an “architecture” that sticks. That “attention” and “multi head attention” turned out to be just a few additional layers of a particular kind. No one can explain the actual mechanisms of how exactly or even why the layers are as they are (abstract bullshit aside)....
This is the difference between a LLM and an expert. An LLM spews out a “propaganda” from the web. ### what are the unique properties of a Haskell program 1. **Statically Typed**: Haskell has a strong, static type system that ensures type safety at compile time. 2. **Purely Functional**: Haskell programs are expressions, and functions have no side effects. This leads to code that's easy to reason about, test, and debug....
There is another shitstorm around Rust – the just announced meme-effort to verify approximately 7500 unstafe functions in the Rust standard library. First of all, what a joke! I never thought there are that many of em. It is easily more than the whole SML, Ocaml and Haskell standard libraries combined. Or at least of the same order. If we want, however, to put memes aside for a while, the way to safety begins with the proper and sound principles, so the “unsoundness bugs” will never appear again....
DATE: <2024-11-20 Wed> Lets write a few paragraphs which will destroy the current LLM narrative (naive bullshit), while neither any single piece nor the whole article can be refuted. This is a high-level proper (classic Eastern) philosophy, which is many levels away from simple logical forms, but it still can be reduced to these, if one wants to. The Proper Philosophy isn’t dead, not even it is dying. It cannot, lmao....
There is a meaningful HN thread once in a while, due to being populated by the actual ex-googlers and facebookers. https://news.ycombinator.com/item?id=40818809 First of all, FB approach is “The Worse Is Better” all over again. If you write a quick crap to be replaced by something else very soon, the meme of “Move Fast and Break Things” (which is a polite name for “Just Pile Up more and more Crap, who cares LOL”) will “work” in the short run Otherwise it is guaranteed to accumulate all sorts of “technical debt” (a polite wording for “now costly or impossible to fix early quick idiotic and incompetent decisions”) – just look at Shittereum and ask shitalik – the champion of quick incompetent decisions....
What is a pattern? A properly captured by the Mind (of an external observer) into a named abstraction “frequently emerging arrangement”. There are obvious weather patterns, seasonal patterns, social patterns, and so on. The most “concrete” emergent patterns are the “structural patterns” – rivers, trees, proteins, biological species. The most fundamental structural patterns has been captured as abstractions: linear sequences trees (acyclic directed graphs) tables (lookup tables) More abstractions has been derived...
Recently I have poisoned myself by watching some talking heads on YouTube. The topic was “something something structural system design”. There is a “correspondence” (not a true isomorphism, but still) between the structural patterns in molecular and cell biology and patterns in a pure functional code – an augmented Lambda Calculus. Both “systems” are heavily constrained by the execution environment (molecular structures of cell biology is the code and the data, the Universe (in a particular locality) is the runtime)....
Just like Max Cohen stated in “Pi”, there are patterns everywhere. Not, however, because of mathematics (which he called “the language of the Universe”), but, and this is crucial – prior to it. Having the maths “after” Reality (What Is), not “prior” to it, like “esoterics” (or rather plain idiots) put it is the only proper philosophy (of the ancient East), which puts everything into their right places. What mathematics is really?...