This is sort of an answer to this question. https://news.ycombinator.com/item?id=38425475 So, what if you are late to the party? Unfortunately, nowadays it is even much harder to get through all the utter bullshit and hype, but there is a sort of a shortcut or “the Hard Way”. There are two and a half key figures: Geoffrey Hinton, who did most of the mathematical heavy lifting, Andrew Ng, who not just did all the derivations, but became the most famous practitioner, and Andrej Karpathy who us just a narcissistic asshole, similar to Lex Friedman. ...

Another day – another bullshit from some Chud. https://thewaltersfile.substack.com/p/bootstrapping-self-awareness-in-gpt Self-awareness and awareness is general is not at a language level (or information level). Animals, obviously, have awareness, but not a “language level awareness” due to the fact that their brains lack any language areas. The series of mutations and subsequent developments that lead to a human language is unique to humans. All other animals are using just “voices” - pitch, volume, distinct cries, etc. ...

This is a hugely controversal topic, with a lot of bullshit, both on the theoretical side and on the side of a popular culture (they just label everything as “autistic”). I, however, “learned it by doing”, so to speak, by using introspection as much as I could. Keep in mind that it is almost impossible to introspect (observe your own states of the mind and body) when one is grossly overwhelmed, swayed by emotions. Introspection requires calmness and a lack of distrurbing emotions. ...

The only reasonable and even proven correct point of applying deep-learning is that the algorithm “learns” so-called “hidden patterns”, which escape (literally) from a biologically limited human intelligence. The causality is so complex that even to list correctly the major factors (not missing anything relevant) is nearly an impossible task. Social media creates whole waves of bullshit, including the idiotic memes about the US interest rates, and other poorly understood and dynamic macro-economic factors. ...

Social media make us stupid. To be precise - they encourage production and emission of a useless verbiage as a from of virtue signaling. The cultural change is that being “wrong” is ok for some talking heads, and nowadays it is even possible to argue that “there is no wrong”, just an “imperfect information”, you know. The older cultures were better. They had a common sense notion of “you have no idea what you are talking about”. Yeah, this is ok for a bar room conversation, but something is wrong within the systems when “people of knowledge” produce an utter parrot-the-bird like bullshit. ...

This is a short follow-up to this post https://lawrencecpaulson.github.io/2023/11/01/Foundations.html To define the foundations of mathematics mere symbols are not enough. We have to consider the actual existence of what we call “reality” or “Universe” which has some observable properties. the “Mind (of an external observe)”, which actually builds and maintains a “map” (which is not a territory). the actual existence of a language-based shared human culture which stores the “previous results” invention of a symbolic notations and formal methodologies for creating “system” So, yes, intuitionists were right, and yes, the set theory is jsut another system, generalizing from what the Mind observes. ...

There is a sad fact: We lost the ancient art of a proper language usage. Due to the blogs, and especially social media, really crappy written language is everywhere. It seems like unimportant, until we realize that people of the past have bootstrapped themeselves on mostly good, end sometimes even exceptionally good books, including poetry. The quality of writing reflects the “quality” of thought, so, slowly but steadily, good writing trains the mind to be more accurate and disciplined in how it thinks and speaks. ...

There are a few ancient sayings about going around the world, looking for the Truth (which us Out There, you know) and then returning back home only to find It right there. Other ancient thinkers have suggested to look no further than onto your own self (to find all the answers). And, of course, the ultimate resit is I Am That from the Upanishads. There are some manifestations Truths I found going around the world. ...

There is a typical quote from some random Chud on the internet: The location within the [high-dimensional hyper-] space represents the semantic meaning of the content, according to the embedding model’s weird, mostly incomprehensible understanding of the world. This is bullshit at so many levels, and in a such “lecturing” tone. First of all, there is no “understanding” whatsoever and it is not “of the world”. “The world” is at a fundamentally different level of abstraction from what has been used as “inputs” to a language model. ...

DESCRIPTION: There is no “I” in your AI. Lets put all the memes and bullshit aside, for a moment and talk serously about GAI (hello, mr. Carmack, sir). There is what every “AI researcher” should know about Knowledge and Intelligence (yes, both capitalized). There is so-called “reality” prior to any knowledge or intelligence. Any reasonable thinker has been arrived at the ultimate reality. “I am That” (“That Thou Art”) of Chandogya Upanishad is the “end of knowledge” and the “arrival” to the ultimate “truth”, with implies existence of “That” and one being just a sub-process (a wave) in It. ...