This is, without exaggeration, probably the fiftieth blog post or long-form comment about how someone is using an LLM for "complex learning", and I'd just really like to see at least one of these to be accompanied by a statement saying what are the kinds of problems the author can now confidently solve that they couldn't before.<p>In my experience, LLMs are really good for taking up your time and making you feel like you're learning, in the same way that many of the popular educational videos on YouTube are fun to watch and don't really teach you anything.<p>If you ask an LLM to give you a 500-word summary of quantum physics, it'll give you an oversimplification that probably leans on a hodgepodge of pop-sci metaphors. And if you start drilling down, you risk drilling down on these ELI5 metaphors, which can get you farther away from truth.
I personally don't get this attitude. For one thing, nobody on earth can give you a 500-word summary of quantum physics in a way that lets you internalize even a tiny bit of it. That's not how you learn anything.<p>Here's how I do it: I open Baby Rudin (3rd ed.), second chapter, and read the main text - absolute brutality. I unpack almost every sentence with Claude/GPT until I finally get what's going on. No ELI5 nonsense, just examples and counterexamples galore while absorbing the techniques and the way of thinking in analysis/topology. How do I know I've learned the material? By solving every single problem in that chapter. Here's the thing, though: the problems in Rudin can be brutal and decoupled from what's in the text, so if you can handle them, you've definitely mastered the material. No 500-word summary of analysis here.
Baby Rudin is a special textbook: it comes from a time when mathematics textbooks were not at all judged by their pedagogical value, but instead by their aesthetic appeal to mathematicians (a la Bourbaki).<p>If you actually want to learn analysis, there are a nearly infinite number of friendlier resources (e.g., Understanding Analysis by Abbott).<p>Learning to unpack difficult text on one’s own is a valuable skill. Research papers often require a similar amount of suffering, and at the frontier of knowledge, despite all the advances we’ve seen, LLMs seem to have absolutely no understanding or intuition. They are much better at things that have been expounded at length by humans before.<p>I would argue that if you’re going to use an LLM to make Rudin easier to understand, you are not learning how to absorb difficult material, nor are you learning analysis efficiently.
Your argument sound remarkably familiar. Humor me:<p>"For this invention will produce forgetfulness in the minds of those who learn to use it, because they will not practice their memory.“<p>-Socrates, on writing. From Phaedrus<p>Secondary source: <a href="https://www.historyofinformation.com/detail.php?id=3439" rel="nofollow">https://www.historyofinformation.com/detail.php?id=3439</a>
ChatGPT also offered this:<p>"For the correct analogy for the mind is not a vessel that needs filling, but wood that needs igniting - no more - and then it motivates one towards originality and instils the desire for truth. Suppose someone were to go and ask his neighbours for fire and find a substantial blaze there, and just stay there continually warming himself: that is no different from someone who goes to someone else to get some of his rationality, and fails to realize that he ought to ignite his innate flame, his own intellect, but is happy to sit entranced by the lecture, and the words trigger only associative thinking and bring, as it were, only a flush to his cheeks and a glow to his limbs; but he has not dispelled or dispersed, in the warm light of philosophy, the internal dank gloom of his mind."<p>-Plutarch, on listening <a href="https://books.google.com/books?id=0U-hsAonP1AC&lpg=PA50&dq=plutarch%20mind%20vessel%20igniting&pg=PA50#v=onepage&q&f=false" rel="nofollow">https://books.google.com/books?id=0U-hsAonP1AC&lpg=PA50&dq=p...</a><p>I didn't read the whole passage, but it seems to be talking about the same thing.
Is that meaningfully different from the study methods of the past? That doesn't require an LLM, and using one risks correctness in exchange for speed. You might not even get that speed if you're stuck in the weeds often enough.<p>A decade ago, a google search for study guides written by another professor would have been slightly slower. A decade before that, you'd be even slower fumbling through several books. Every single word could at least be trusted. You don't get that from an LLM.
> Is that meaningfully different from the study methods of the past?<p>The fundamental service a teacher provides is personalized feedback, quickly identifying where you are stuck and focusing the explanations and exercises on that area, drastically increasing the speed and quality of learning versus the self-supervised route.<p>The lack of this closed loop effectively killed the high hopes that were placed in e-learning and MOOCs 15-20 years ago, TV learning in the 1960s and many other failed revolutions, seems every generation has its own version.<p>It appears to me LLMs have a real potential to close this loop and become the failed educational revolution of our own generation.
> personalized feedback, quickly identifying where you are stuck and focusing the explanations and exercises on that area,<p>This has been a huge blocker when I tried to study advanced math myself. Many of the exercise books don't have worked out answers, so often you're either stuck or you have to hunt a variety of sources online for solutions and advice. It kills flow.
If you have an actual mathematics professor to ask questions to then sure do that, but most people don't have that luxury. Also the error rate of frontier LLMs on textbook highschool/college level mathematics is going to be extremely low.<p>It is also significantly more engaging and fun.
When studying a mathematics text, it is good practice to question what you are reading, trying to prove things to yourself etc., which IMO makes the problem of trusted sources much less than it is in things which you are not able to verify e.g. historical accounts.
I certainly would only trust my textbook as the authoritative source, but i can see that in the absence of an expert teacher it's nice to have something that can critique a proof. Imo the fact that it's hard to verify that your own proof is correct is one of the main barriers in self-studying math, especially if one is at a level where one is not completely fluent in applying the various techniques. This also applies to judging answers to open-ended questions in any other field.
I'm a private math tutor specializing in exactly this sort of material, and I agree with this very strongly. Knowing what "counts" as a proof is one of the most common gaps I see in students who come to me after self-studying, and most students do need some back-and-forth with an expert to really get that skill down. I imagine that LLM's could be very helpful for this if they were used judiciously!
I’ve found it helpful to ask LLMs specific questions about your knowledge gaps, or ask for concrete worked examples that illustrate the ideas you’re learning about.<p>In [0], I ask: „When applying Hidden Markov Models to POS tagging in NLP, what do the latent states and observations usually represent?” I then follow up with some specific questions and requests for walkthrough. You can’t see it from this conversations, but I have Wikipedia and a bunch of other resources open in separate pages, cross-reading, and I follow up with a handwritten toy implementation of a Viterbi-based POS tagger once my mental model crystallizes. This is very different from a 500-word summary of quantum physics, and I still had to put in effort (this is unescapable!), but I found the experience rewarding. Also note that this is relearning of a topic that was part of my uni curriculum but long forgotten.<p>In [1] and [2], I’m learning Spanish by reading García Lorca’s poems. Here again I’m going through the texts with a dictionary, and augmenting my learning with what a dictionary won’t tell me: given the usage of a word or phrase in this specific poem, is it something that could occur in everyday speech, or is it poetical?<p>[0]: <a href="https://chatgpt.com/share/6a743bc7-d0dc-83eb-acc9-8f2faaffc420" rel="nofollow">https://chatgpt.com/share/6a743bc7-d0dc-83eb-acc9-8f2faaffc4...</a><p>[1]: <a href="https://chatgpt.com/share/6a731be6-26bc-83eb-8d21-c965da5364b0" rel="nofollow">https://chatgpt.com/share/6a731be6-26bc-83eb-8d21-c965da5364...</a><p>[2]: <a href="https://chatgpt.com/share/6a731c01-5604-83eb-a5b8-cd1295d0efc5" rel="nofollow">https://chatgpt.com/share/6a731c01-5604-83eb-a5b8-cd1295d0ef...</a>
100% agree. They are not good teachers. Nevertheless I've been using LLMs more and more to learn complex topics, but my learning is always anchored in something else:<p>- Getting through textbooks and lecture notes. LLMs have gotten very good at answering basic questions on quite advanced material (e.g. representation theory and quantum field theory). By asking a very specific question or even giving the LLM a screenshot, I can get unstuck a lot faster.<p>- Learning e.g. new python packages. Instead of hunting for examples on Stack Exchange, now I ask an LLM to write a minimal working example and then build off of that. By writing most of the remaining code myself and only using the LLM to answer questions, I've been able to learn new packages significantly faster.<p>In both cases, the LLM isn't providing the curriculum or guiding what I learn. The textbooks, papers and coding tasks are. But now I can pick these things up much more efficiently.
I think it depends on what you want to learn and what your definition of "learnt" is.<p>The other day I realised I had no idea how DNA and life works. I guess I studied it at high school (25 years ago), but maybe it didn't go into much detail or it just didn't click.<p>So I asked ChatGPT to explain it to me, I came up with my own mental model from it's explanation, told it that, then it corrected me where I misunderstood things. We went backwards and forwards for an hour, me asking questions, it correcting me, until I felt like I understood the whole picture.<p>Am I going to become a biologist and study the origins of life from that? Definatley not! But if my kids need help on their biology homework, I now understand the basics of it.
>So I asked ChatGPT to explain it to me, I came up with my own mental model from it's explanation, told it that, then it corrected me where I misunderstood things. We went backwards and forwards for an hour, me asking questions, it correcting me, until I felt like I understood the whole picture.<p>If you're only checking your understanding against the one source you used to obtain it, how can you tell whether your understanding coincides with reality (or rather, with general scientific understanding), and not just with the source you read? And I'm not asking just about ChatGPT; the same question could apply to any source. Books are not exempt from containing errors.
Concrete high-profile example: in "Surely You're Joking, Mr. Feynman!", Feynman told of a ball which, in a Brazilian college-level physics book, was described as having a 40% higher acceleration that it would actually have in practice.<p>Turns out that the author had done a thought experiment but neglected to factor in the rotational inertia.
How can you really say you you've learnt the alphabet if you haven't read the document in which the first use of the letter Y appeared?
Same question applies if you only check it against your children's biology books
Self-consistency and consistency with your lived experience are good heuristics. <i>Reality</i> is self-consistent, so anything that doesn't add up indicated an error in the source or your understanding of it (or both).<p>EDIT:<p>I <i>think</i> it's a kind thing you need to tune yourself into. OTOH, I've observed many (most?) people seemingly being completely oblivious to self-consistency issues of their beliefs and mental models, or even texts they're reading or instructions they're following, and yet... somehow they're generally more successful at life because of it ¯\_(ツ)_/¯.
> I've observed many (most?) people seemingly being completely oblivious to self-consistency issues of their beliefs and mental models, or even texts they're reading or instructions they're following, and yet... somehow they're generally more successful at life because of it<p>What do you mean by "successful at life" here? Genuine happiness, fulfillment in life? Or in the sense of doing well by what society holds as it's current interpretion of what one should strive for, and otherwise just kinda drifting through life?<p>Because if it's the latter, I'd say that is to be expected. It's much simpler to put your energy into fulfilling the expectations of whoever is your superior in your current group, mostly get the expected reward, and then just coast. Reflection and experimentation, which is required to get to self-consistent views, takes effort and and the willingness to question existing beliefs, which will also be uncomfortable times.
How do you do that with topics not directly experimenceable, like quantum mechanics or, as in this case, silicon manufacture?
The very first thing I mention: <i>self-consistency</i>. It's the only thing you have if you don't have any empirical data. It's the only thing anyone has, really. QM scientists reading QM papers and experiment reports of other people, and talking with each other, are still relying on self-consistency to sniff their own (or other people's) mistakes.
Not the OP, but I don't think you can. The understanding someone manufacturing silicon has will be not be attainable by reading about it etc. Similar for QM, no replacement for doing (some of) the math yourself, be involved in experiments etc.
Reality is most likely self-consistent, but as we can only experience a tiny part of it it‘s impossible to tell. Also, parts of reality may appear to be contradictory with each other when some pieces are not known.
> <i>Also, parts of reality may appear to be contradictory with each other when some pieces are not known.</i><p>Exactly. This tells you where something is off. The problem may be your lack of understanding or wrong understanding, or it may be with the source, or the framing, or you may have hit a genuine lack of data - still, the puzzles don't fit in some area.<p>And yes, not all self-consistent understanding is correct. But all inconsistent understanding is incorrect. And the more knowledge you gain, the less likely it is that it'll all connect self-consistently, but still be very wrong.
> But all inconsistent understanding is incorrect.<p>Why do you believe that?<p>Even if we assume that reality itself is self-consistent (what does that even mean?), why would that imply that we humans are able to find a self-consistent representation of it? Maybe reality is self-consistent in some sense but cannot even be represented by the tools we use for theory building.<p>My point being, the ultimate target of our understanding may be self-consistent, but the way we _necessarily_ have to reduce it to lossy theories means that we can only ever approach it with a non-zero error. And a theory focusing on one aspect, minimizing representational error from one direction of approaching it, necessarily has to make assumptions that will contradict those made by another theory trying to minimize representational error coming from another direction / domain.
> consistency with your lived experience<p>Aka confirmation bias.<p>We like explanations that fit what we expect, even if they're completely wrong.
Can you say in all honesty that a read of the Wikipedia article for DNA would have been less helpful? It's less convenient perhaps, but definitely more authoritative.
Wikipedia is a great _reference_ but not necessarily the best way to learn about a topic. Of course, this depends on the topic, on who has been writing the page, etc<p>A particularly bad example is higher maths - a wiki pages on a complex mathematics topic often reads like "A gruncheon is a worch in the brashation of plusters" and each of these words is a separate page or topic. Of course, you _can_ in theory 'just' click through all the tree of linked pages to understand a concept ...<p>For DNA the page (scanning it now) is well laid out, with images (including a spinning Rasmol? image) and lots of detail. However, the detail could be a drag on understanding for some : There are 'nucleotides' and 'nucleosides' and 'nucleobases'? There are non-canonical bases? Supercoiling? Z-DNA? While I know (most) of these things, it is because I've learned about them in other contexts, or by direct instruction.<p>I'm not saying it is impossible to understand DNA from that page, but it is likely to be harder (for some?) than a more conversational approach to learning.
If only Wikipedia contained like an easier-to-digest version of Wikipedia, using planer language: <a href="https://simple.wikipedia.org/wiki/DNA" rel="nofollow">https://simple.wikipedia.org/wiki/DNA</a><p>I just asked Opus to "explain DNA to me in simple language" and the two are not even in the same league in terms of quality.
Fair point - but I wonder how many people that have visited Wikipedia know about simple wiki. I was probably aware of it, but not enough to remember to suggest it as an alternative!<p>I mean - it is certainly better ... but it is still a lot of stuff. For example:<p>> Part of an organism's DNA is "non-coding DNA" sequences. They do not code for protein sequences. Some noncoding DNA is transcribed into non-coding RNA molecules, such as transfer RNA, ribosomal RNA, and regulatory RNAs.<p>Do you _need_ to know about tRNA, rRNA, and operons (?) to understand DNA? The thing about an encyclopedia/wiki entry is that it has to cover the whole topic. This is a strength for reference, as you can scan it and find the bit you need. For learning from scratch, I can see that a conversational approach (with a human or LLM) has advantages where the learner can direct the level of detail and path through the material.<p>Ultimately, both are worthwhile, but I can also see the strengths/weaknesses of both ways to learn.
Just reading something is a fundamentally different experience that being actively involved in a conversation about the thing.
Wikipedia is completely non-interactive so of course the experience is different. Do you want to look up something like <a href="https://en.wikipedia.org/wiki/Principal_component_analysis" rel="nofollow">https://en.wikipedia.org/wiki/Principal_component_analysis</a> and try and understand that from Wikipedia? If you don't understand it, you have to try and click elsewhere. With an LLM, I can be very specific, "I understand x, y, z about PCA but I don't understand why we have to do it? What happens if I don't apply it?" and the LLM most of the time will give very approachable explanations that can be refined further if I still don't get it.<p>I am studying for a Masters degree in Computer Science with AI and the lecture notes are like Wikipedia sometimes. Incomplete, perhaps assume pre-knowledge that lots of Masters students won't have. All of these I have taken to ChatGPT and got great explanations, diagrams, graphs etc.
Or do you? Cause if you went back and forth with ChatGPT for an hour it definitely hallucinated and lied to you at some point. Maybe consider using something else like Brilliant.org if you want to learn a topic, yanno, so you don’t propagate whatever hallucination from ChatGPT to your kids.
These days online courses like Brilliant and such are likely largely LLM generated. Are they actually vetted by experts before publication? Who knows. My money is on no, or at least, not until someone complains.<p>Its easy enough to prompt ChatGPT for primary sources when doing research to validate any claims its making.
This would be a valid point maybe 3 years ago, but most chatbots will now query and verify direct sources, especially in research mode.<p>This is very simple to validate and verify. You could argue it may find false primary sources.<p>You can condemn models for a variety of other things, but acting as if this is still reality shows a lack of understanding as to modern model capabilities
Your comment is phrased as if it somehow refutes their point but it doesn't.<p>> Cause if you went back and forth with ChatGPT for an hour it definitely hallucinated and lied to you at some point.<p>If you're asserting that this is not the case today then that's going to be require pretty extraordinary evidence. "Chatbots use Google now" is not evidence that the information they provide is in fact correct.<p>They don't hallucinate <i>all the time</i> like they used to, no, but I'd be very surprised if the majority of these sorts of conversations were free of major factual errors.<p>I frequently notice <i>degradation</i> in the model model's ability to remain coherent when it searches for information online. For example I might ask Sonnet 5 "how do I build a shed" and during its search it presumably comes across an article which talks about building a shed out of paper mache, then the model responds with something like "I caution you against your plan to build a shed out of paper mache" -- Wait, what? Who said anything about building it out of paper mache?
Firstly, I can't refute a point that's little more than an opinion - my doubt is that a modern frontier model is significantly hallucinating within a relatively short conversation that can easily be verified. There is no way to refute or accept the point without a complete conversation log. I am criticizing the hyperbolic nature of the comment.<p>I doubt you are getting to the context level of model degredation where it reaches context limits within a verbal hour conversation.<p>I've just tried to recreate your example on sonnet 5, and as someone who has done DIY projects it reads completely appropriate, but I'm happy for criticism from a shed builder. It never once tells me about paper machie or creates a silly example.<p>This is via a prompt requesting tools and materials, and could be further improved, unfortunately, I can't paste the markdown formatting provided.<p>"""
Reference size used below: 8x10 ft shed. Scale material quantities to your dimensions.<p>Step 1: Check Regulations & Plan
Materials: None yet — just your design/plan (graph paper or free shed-plan software)<p>Tools: None<p>Skills to find:
None required, but if your shed is large or near a boundary, a quick chat with your local planning/building department saves headaches later<p>What to do: Confirm permit requirements, setback distances from boundaries, and max height/size allowed without permission. Sketch your design and finalize dimensions.<p>Step 2: Prepare the Site
Materials:
Landscape fabric (weed barrier)
Gravel/crushed stone (for drainage base, ~4-6 in depth)
Marking spray paint or stakes + string<p>Tools:
Shovel & spade
Wheelbarrow
Rake
Hand tamper or plate compactor
Spirit level (4 ft) or laser level
Tape measure
Builder's square (for squaring corners)<p>Skills to find:
Basic site leveling — not hard, but a laser level rental helps a lot if the ground has any slope
If you have poor drainage/heavy clay soil, worth asking a landscaper for advice
What to do: Clear vegetation, mark the footprint, excavate and level, add compacted gravel base for drainage.<p>...
"""<p>I won't include the whole document, can share it further but anyone can replicate just by asking sonnet<p>I just don't understand the need for such hyperbole, and pretending that models are still gpt3, when you can get counter evidence in seconds.<p>It reminds me of the craze teachers had against trusting Wikipedia - yes, you shouldn't take all claims at face value, but arguing that nothing from Wikipedia could be useful just makes the argument silly.
I would trust ChatGPT more than the average elementary school biology teacher.
It's like YouTube "Explainer" personalities, like Hank Green and Adam Neely. They do the kind of "learning theater" that makes you feel like you're learning something when you're actually just providing views and ad revenue. You'll come away from a video feeling like you gained knowledge, but:<p>1) there's a good chance it was subtly misleading (or just wrong)<p>2) you probably won't ever use the information in any meaningful way and will likely forget all relevant details in a few days<p>3) you almost certainly could have spent that time better actually <i>doing</i> or <i>creating</i> something - actually doing <i>real</i> learning and making <i>real</i> progress
<i>If you ask an LLM to give you a 500-word summary of quantum physics, it'll give you an oversimplification that probably leans on a hodgepodge of pop-sci metaphors.</i><p>That's what you'd get if you asked a leading physicist too, so are you saying LLMs have achieved human-level intelligence?
RE: On agents taking up your time<p>One thing I've begun to notice is that LLMs list of a bunch of interesting stuff and raise all these thing you consider but often sometimes you just want a more focused response, so these scatter responses kind of lead you to being overwhelmed and losing focus on what you really wanted to do. At least I've started noticing this.<p>Like I'd ask about some statical approach taken in a paper and suddenly i'm being bombard with all these potential pivots and things I really need to consider, I kind of just want to consider 1 thing at a time and come to things once I fixed the immediate issue. Sure I have no doubt these other pieces of information are useful but it's just not the most useful information I need right now.<p>This is less of a problem with coding agents more so putting learning related questions to an LLM, like is the method covered in this paper, yes no? instead I get an exhaustive but overwhelming and indirect response that contains part of the answer. I just wanted to know if it was worth my time going through the paper but now I'm being bombarded told all this tangential information, which is unclear to me if I need to consider right at this moment, it's really distracting.<p>Maybe this is something others adapted to but i've resorted speaking past it saying, "this is the question please stay on topic" or literally "one thing at a time please" and then it narrows in, but they really stretch your attention thin if you're not more aggressive with keeping them on topic. The smarter models are better, and if you use max compute it does a better job.<p>I think they can definitely be helpful for learning, but you got play an active role, you can't just consume what it says like content.
I’ve used the following teach skill by mattpocock to learn Java concurrency concepts in 20 bite-sized hands-on lessons starting from creating a new thread to building a Thread-safe Connection pool. I’m pretty sure I can adapt this to learn Concurrency in any language like Go or Rust.<p><a href="https://github.com/mattpocock/skills/tree/main/skills/productivity/teach" rel="nofollow">https://github.com/mattpocock/skills/tree/main/skills/produc...</a><p>The point is not that I’m learning Concurrency in a better way using LLMs, it’s that I can apply this style of learning using bite-sized, hands-on, visual explanations, quiz to any topic in the future. The lessons it generates are just code, and you can ask it to type check the examples, validate with recent libraries, use analogies to learn something better.<p>Try it before thinking it’s just ELI5 or Summarization or assuming it’ll be hallucinating without verifying facts.
> I'd just really like to see at least one of these to be accompanied by a statement saying what are the kinds of problems the author can now confidently solve that they couldn't before.<p>I've spent a lot of time with LLMs for the last two years. Something I've tried, almost for decades, is to learn enough CUDA programming to be productive with it when needed. About 6 months ago, after again banging my head against it for weeks, something finally clicked and I feel like I've overcome the initial step of at least grokking the needed ideas so I know where to go next, and I can actually write + compile + use kernels made for my use cases. I won't claim to understand everything, but I couldn't do what I can today, before I learnt the things I now know.<p>~2 years ago, because of my very weak math foundation, I basically said "Well, CUDA looks really interesting and really fun, but it's too difficult, lets focus on other things", even after reading some starting resources and stuff. But, by asking countless of dumb questions to LLMs, forcing it to steer me in the right direction, when I'm otherwise just driving on the highway or what not, I finally feel like I have a grasp on something I earlier only dreamed about understanding, and I'm able to be productive with it now.
To be fair the entry barrier got a lot lower over the past ~5 years. Now you can write very good CUDA kernels with just a few lines of python DSL code. Zero cpp boilerplate and zero explicit compiler calls.<p>Stuff like Triton, nvidia warp (the language), numba, cupy jax/pallas and so many others really paved the way. You can start out really high-level, run a profiler and then dive deep into the bottlenecks.<p>TL,DR: Keep going, it's a great time to have fun with GPUs.
> To be fair the entry barrier got a lot lower over the past ~5 years. Now you can write very good CUDA kernels with just a few lines of python DSL code. Zero cpp boilerplate and zero explicit compiler calls.<p>Well, yeah, but what I've being doing is learning proper CUDA, not "Python-compiled-to-CUDA" (otherwise it'd take like a just a week to understand enough :P ) and that's looking more or less the same today (although bunch of more complicated stuff piled on top of the fundamentals) as it used to, AFAIK.<p>With that said, the environment is a lot simpler to setup today at least :)
I wouldn't call one proper CUDA and the other one some dumbed down version. Nvidia really seems to be pushing for these DSLs to be first class within the ecosystem. In some cases probably even more cutting edge than the nvcc frontend, since it's easier to do some experimenting on a new niche package than on the tool everyone relies on.<p>I believe more and more production code is running kernels which didn't originate from the traditional cuda cpp route.
> I wouldn't call one proper CUDA and the other one some dumbed down version. Nvidia really seems to be pushing for these DSLs to be first class within the ecosystem.<p>I wouldn't say one is dumbed down either, just different, at least the entrypoints and how you end up using the different solutions.<p>I'm currently experimenting with cuda-oxide for some new simulations, and managed to keep the entire simulation within just Rust essentially, while going the "traditional" (maybe better term than "proper"?) way I've ended up with a bunch of .cu files and then integrating them (via cudarc usually). Kernels themselves feel the same across both, but the integration clearly makes them different enough that I think it's worth distinguishing them, at least for clarity if nothing else.<p>If someone else already knew Rust but not C++, wanted to get into CUDA programming, going the cuda-oxide route would probably be easier and more familiar, than cudarc, I'd guess. Personally I'm not sure what route I prefer yet, both (as always?) have tradeoffs.
> don't really teach you anything<p>Dunno, I've been learning a lot of Rust in the past few days. Just dove right into a project and asked AI to teach me stuff on a need to know basis. I'm actually getting used to Rust by now.
Learning programming languages is quite trivial. Many years ago I counted 16 that I had used professionally, now they are more.<p>It takes way more time to master and be very comfortable with a language due to its ecosystem, though. Some languages are more likely to click with a person, yet underneath they are all the same (minus the functional languages that form their own group), e.g. some performance issues may require looking at the generate assembly code.
A programming language is a skill with an accessible source of irrefutable feedback. If the program doesn't work, then you did something wrong. What happens if you try to learn something less concrete or less testable, like quantum mechanics, as the GP suggested?
I agree with you. I'm also using AI to help me learn electronics so I can finally make some real stuff I can hold in my hands. Lots of hard engineering involved so I'm a lot less confident in my ability to spot the AI's own mistakes.<p>However, saying you can't learn "anything" is just too strong. I'm definitely managing to distill the AI's weights into my own brain.
It's true in a very real sense, though. Without calibration, how can you tell whether you're learning something real or something fictitious? Imagine trying to learn a language from a single teacher, without ever talking to or corresponding with a native speaker. How could you tell whether you're actually learning the language, or the teacher's unique dialect? Yes, you indeed "learned" something, it's just something that might not bear much resemblance to the real thing.
Yep. This is the key. You need some kind of knowledge of what the end result should look like to really learn something from LLMs. Otherwise it's a deep dark forest with no way out.
Same. I setup a practice skill that has a curriculum/list of topics, teaching methodology, approach to drills, progress tracking and spaced repetition.<p>Additionally I asked it to also give me problems relevant in my business domain so that I learn how to directly apply the knowledge in a realistic scenario.<p>I am getting much more comfortable writing rust than I was barely two weeks ago. More than I was just reading tutorials.
AI is a super polarising topic. Even now there are people who are like “it’s all AI slop so it’s all useless” along with the “OMG AI!!! OMG we will have AGI soon!!!” people.<p>The truth, as always, is in between. There’s loads of people using it for useful things, learning, automation and getting good results. But it’s also wrong enough that you need to deploy it carefully sometimes.<p>Don’t worry about either group. Keep objective and use AI where it helps and do it yourself where you are better. That’s all.
I like to use them to generate me tutorial series for technical topics I want to learn or improve. So I start a prompt like this:<p>> I want you to create a tutorial series about X for me. The prime objective is that I improve in topic X so never provide a solution but guide and teach. (for programming never write code).
First create a question catalog to assess my current level.<p>Then I would ask it to structure the tutorial challenges in the following way:
- Goal
- Concept
- Instructions<p>I figured that if I don't need to read any additional material on the topic the LLM is giving me too much information and I need to change the prompt.
Works for me and I used this too learn topics I feel now comfortable with, like nushell, opencyper, elisp, boot loaders etc.
But maybe you don't consider this "complex"
I think the key difference here is that you're using the LLM to create exercises, not to replace the learning material
Curious: Why not pick up a book or two on the topic, and use the LLM to help you through it [0]? To me, prompting the LLM without grounding it sounds like a sure shot way to end up learning "pop-sci", as GP puts it, instead of the actual science?<p>If today's top LLMs are reliable enough (without grounding) to academically learn "complex topics" from, may be I need to adjust my priors. I must say, I do find myself chatting about other topics (without the need for grounding) that I'm trying to "absorb" (not really learn), like Behavioural Psychology & Philosophy.<p>[0] Products like NotebookLM are built specifically for such usecases.
I use books to accompany my learning, but I really need something that _forces_ me to think and solve problems in that space on my own.
Books can sometimes give me the illusion of learning something, but then, when needed, I've notice that I haven't really learned it.<p>LLMs give me structure based on my current skill level. And basically always I accompany this with books, I love reading. It's a nice combination for me.
I would love to see the "depth" of your knowledge in those topics.<p>You literally proved the OP's point ... thinking you're learning. More like scratching the surface, with lots of invalid data while not being able to recognize what's invalid.<p>It's like with latest vector of attacks being spamming Github with malware injected in proper looking code in hope of AI to index it.<p>Then you paste the code because you don't understand it, but you take it as working and only doing what you've asked for.
This feels like an impossible assessment - yes, a model probably can't give you the education that a advanced/expert book on a topic will, but implying that having a verifiable goal is somehow fake learning feels like an intractable problem.<p>What level of evidence would be sufficient for you to accept that a model may be able to teach a concept?<p>I'm happy to take on this challenge with a topic of your choosing, but I don't believe there will be an evidence base that satisfies you that the knowledge is earned or deep enough.
I really wonder where this assessment is coming from? It's not that I use LLM written code for something (in those exercises at least), in fact I don't let the LLM write code (see my prompt example).<p>It's about guiding me in _doing_ exercises so I learn and I can evaluate if I learned something if I can apply the learning myself.
This is not a silver bullet that will make everyone a genius. Not even the best human tutor can do that. But it can be a massive clearer of certain roadblocks for people with no better human help available. Countless people have to resort to learning from teachers who themselves are confused and know the material only shallowly and give confused and wrong explanations that can be very hard to untie for the learner. For most undergrad level things, LLMs have a breadth and depth of knowledge and online search capability that it can make you unstuck on some misunderstanding quite effectively. You still have to work. It's not magic. But the goalpost cannot be to catapult the median person to become Einstein. It's a tool.<p>Luckily I had my dad available who is a scientist, during my high school and he corrected several fundamental mis-explanations of my teacher that even to my mind logically simply didn't add up. I learned not to relay this back to the teacher of course and sometimes regurgitated the wrong answer in tests. Not everyone is so lucky. This has been my frustration quite often. Textbooks are sometimes wrong, both because the author really doesn't have good expertise on that slice of the topic or out of didactic simplification reasons. Having an LLM that can consult the real grownup literature and give the full story, not the birds-and-bees is quite useful.
> many of the popular educational videos on YouTube are fun to watch and don't really teach you anything.<p>As a tangent, I think the concept of pop science has wasted so much time of what could be considered brilliant minds. I can't believe how much YouTube people I consider really smart consume under the guise of "learning stuff." And the videos are always designed to be addicting and to entice you to watch other of their stuff, which makes sense, because theyre a business, not a school.<p>I'm guilty of wasting time on YouTube as much as anyone else (I like watching stand-up routines and Red Bull extreme sports) but I am never under the guise that I'm doing anything productive with my time. Its okay to have fun learning, but I always felt that entertainment and education should be kept separate. You gotta learn something intentionally, not just get it served to you via algorithm.<p>Note im talking about the educational "shorts" not the 60+ minute deep dives that are basically a college level lecture.
I really like the term "edutainment" for this.<p>It's the kind of high-brow entertainment that makes you feel like you learn something.<p>For me, most "push" things are edutainment, whether that'd be Youtube videos or public-broadcaster television programs. Things you seek out yourself are not.<p>In a similar vein, there's "newstertainment" (news that makes you feel like it's important to watch, but actually changes nothing tangible about your life).
Well everyone needs some downtime, and then I think it's important to acknowledge that there is a range of quality within the category of "educational entertainment." You can learn a lot of interesting things from 3BlueOneBrown and Veritasium, even though neither compares to working through a textbook.
I’m a bit too old for the YouTube generation (can’t stand the fast cuts and permanently agitated voices), but am absolutely guilty of reading a lot of pop-sci books. I feel like they do a better job at teaching stuff for the most part, but probably also make you fall into the trap of believing you actually learnt something…<p>On the other hand, I’m fine with not being an expert on topics outside of my domain, as long as I retain some basic knowledge and fun party facts. So there’s that.
There's a spectrum between "barely scientific entertainment" and "dry technical reference". Also, it's not fully a zero-sum tradeoff, great authors have written serious textbooks that are quite entertaining to read, and there are pop-sci books that do a great job at covering advanced material.
I can't watch Mark Rober's content because of this. He dilutes his remarkable engineering stunts into ADHD internet memes.
I do appreciate the literal college lectures on there. Hard to get the algorithm to surface them but they’re golden for learning. Of course I would be unshocked if the authenticity signals I’m tracking (AB.203 Lecture 3 video title, general hubbub and shuffling of chairs at start of video, university affiliated channel) are all faked by grifters 6 months from now.
In reality, I would just ask LLM to give me a technical explanation of quantum physics, and ask any vocab and equation I do not understand in the response.
I agree. If it's not followed by a test/exam, then it's entertainment, not learning.
Learning is not about what you put in, it is about what you can take out. It is also not zero-sum, but rather exists on a wide spectrum for any given knowledge domain. A good idea could be to prompt the LLMs to keep quizzing you on what you have read and test on both recall and understanding.<p>Also learning is not just about truth, it is about curiosity as well. The pop-sci metaphors could actually good for satisfying the curiosity of let's say a 10-year old. What to learn and how to learn is ultimately at the judgement of the learner. The better the judgement, the more the learner can stay closer to the exact scientific details.
Agree. Just pay attention to the follow up questions a learner is asking to see the progress. If the follow up is just "continue", "go on", "next" or a non-sequitur then it is smell of a stall. If it is challenging or filling a gap in the answer then it is progress. So production from the learner is the only signal of worth here not the quality of LLM response, the time spent or the ability of the learner to reproduce the facts given by the LLM.
Idk about other people but the way I usefully use llms to help with study is to treat them as a good tutor. If you are stuck on a problem or need an explanation of a concept it helps greatly. Much of the actual process of studying Math, Physics, CS, etc in University is sitting in a room working on problem sets and now you can do that with the equivalent of a highly competent Grad Student to bug with any issue you run in to. However yes trying to get an LLM to draft a 1000 ft view of an entire field and calling that learning is a poor use case.
My trick is to let agents make an University Course Curriculum based of books and papers. Then if I don't understand something, I ask AI to simplify the book/paper until I get it.
prompt: if a family has four boys, would a bayesian conclude that their next child would most likely be a boy?<p>fable taught me about the beta binomial and large observational studies that came down on both sides of the question about whether per family births are truly binomial. it also told me about countries like the uk and uae that are inching towards national genetic registries that might answer such questions definitively in time. as well as the efforts in Cyprus in this 80s to reduce beta thalassemia through voluntary testing of couples pre marriage.
> many of the popular educational videos on YouTube are fun to watch and don't really teach you anything.<p>I really enjoyed and learn a lot of things from Karpathy's and Andrew Ng's video. sure many don't really teach you anything, but I could say many others are useful too. Maybe it depends on the way we're prompting as well? it seems useful for some like Terence's message that was shared few weeks ago<p><a href="https://news.ycombinator.com/item?id=49010345">https://news.ycombinator.com/item?id=49010345</a>
I would tend to agree in the case that someone is using LLMs as their primary source for learning. But I've found a lot of use in having a claude project containing the PDF of a textbook I'm working through so that I can ask it to clarify or help me through parts I find confusing. I would definitely say that's greatly accelerated my learning - or at least greatly accelerated the speed at which I integrate information from textbooks.
The test I'd like to see: take a problem set or task you couldn't solve beforehand, learn the topic this way, then try to solve it without the LLM in the loop
I like to rephrase things in my own words when I read new concepts. The LLM can tell me if my version is totally off.
as ever the real problem is formulating questions, which requires clarity on the next discrete layer of missing comprehension, which requires self-reflection and genuine insight into your own mind.
Three magic words:<p>"use Socratic method"
Have you actually tried? I refreshed a ton of arguments which I had studied or briefly encountered before, so it's less likely to fool me than if I knew 0. And the fact that I can frame a question precisely and as deep as I like is truly unique and incredible.<p>For some things you still need videos and practice but cmon, I don't get this generalised hate on LLMs, they are based on what us human wrote anyway.
> In my experience, LLMs are really good for taking up your time and making you feel like you're learning, in the same way that many of the popular educational videos on YouTube are fun to watch and don't really teach you anything.<p>You wrote a wall of text just to say you struggle with learning when using some media. That's fine, each one of us struggles with different things. However, I hardly think it's fair to extrapolate your personal struggles with learning styles to everyone in such a sweeping approach, or that this is relevant to the topic.<p>If you want to go back to the basics, LLMs in the very least work as chatbots that you can use to follow the Socratic method to guide your way through your learning journey. If you still struggle with learning when asking questions and getting specific answers to them then it's safe to say LLMs are not a factor.
To learn from an LLM with all the hallucinations they have...it requires courage.
[dead]
I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tried to use the LLM to fix this by having it generate a web page with diagrams and organized information flow. It's an improvement, but I still run into the issues I described in my first pint - LLM prose is annoyingly dense, and the useful information gets lost in a bunch of noise. You can direct it do something like "use plain English and avoid LLM prose - provide only as much information as necessary to demonstrate the point", but it is once again only a marginal improvement.<p>And then I begin to think to myself that I should just read a book on the topic written by a trusted source who put a lot of effort into teaching the topic properly and presenting the information in a thoughtful way. So, I am back to books and mostly try to use LLMs to clarify certain questions or ideas I have.
It's much better to feed the book to the LLM and ask questions as you read along, instead of asking the LLM to basically write a custom book for you from scratch.
I have to agree with this. Completely relying on LLM for all your learning needs is a disaster. But being absolutely against use of LLMs isn't doing you any favors. This is where you don't have a formula but rely on you judgement and evidence of your having learnt something.<p>For example having an LLM summarize a dense topic and to find books so that you can filter faster and spend time reading those books works way better than having the LLM summarize the books or the topic (or even relying on second hand information). Another one is having the LLM quiz you on your topics of interest. With questions tailored to attack specific areas that you struggle with. Its wonderful at this, nothing I've used comes close to what an LLM can do here.<p>You define for yourself what your goals are, slowly refining them as you learn more, and use LLM as a tool. This ,I find works best for learning.
Make it your goal to teach a room full of other humans that topic. I guarantee you will know that material cold. I've done lots of technical training in my career and after teaching a class two or three times I find myself to be very competent in the topic.<p>It's long been the case that the best way to learn something is to teach something.
> It's long been the case that the best way to learn something is to teach something<p>Which is pretty unfortunate for those that want to learn. I used to enjoy writing documentation at work, it was my favorite part of the job. And it did feel like it benefited me more than it benefited all the people that were (or weren't) reading my documentation. Now I can't really justify spending much time on docmentation when LLM's can do it in a fraction of the time and it's "good enough"
I got started as a software engineer working in the nuclear industry in the 80s. We measured our documentation in inches not pages, and it was all written by hand. And I'll bet you the documentation in the nuclear industry is still written by hand and not by LLMs.
There is still value in experts distilling knowledge and crafting it to the audience. I'm a consultant in cybersecurity and someone asked me "give me a best practice framework for good policy hygiene". I'm sure an LLM could spit out some tips, but I've been on the industry 15 years and can write in 5 pages what an LLM wouldn't conceive of in that space.
> Another one is having the LLM quiz you on your topics of interest<p>This is a great idea. I'm going to try it.
Even with the latest models today, the hallucination rate is absurdly high on anything deeper than surface level knowledge or something that can be directly scraped from reddit.<p>And you notice when it's a topic you know well or something like software where you can immediately tell the options it's giving you don't exist on the page. Leading to the amusing statement "LLMs are bad at what I do but great at everything else".
I've (elsewhere) written about this diminishing return effect on LLM utility in relation to increasing expertise.<p>The question: what's the net positive gain of turning people who know nothing in a given field into sub-novices, while weighing actual experts down with work slop and marginal returns?<p>And I wonder what the true cost is of arming so many novices with that level of dangerous knowledge.
The fact that some people get genuine value from LLMs when learning doesn’t contradict the fact that they’re Dunning-Krueger “expertise” generators. The fact that the person learning from them is in charge of ensuring they aren’t full of shit, which they frequently are, is an <i>inescapable flaw</i> in this process. I honestly think that reduces the value of these things to just above what you can find out with a search engine with most topics. Hey, great. An improvement is an improvement right? Is it an improvement worth trillions of dollars and screwing over writers and artists worldwide? Fuck no.
I think the true cost will be some catastrophic failures.<p>Just hoping folks don’t get hurt due to people not understanding what they’re doing with these things but believing they’re competent.
I came across the socratic method recently, and have used it to learn a couple of topics that I was having trouble getting to stick. There are some SKILL.md's available for it. It works for concepts as opposed to facts, and causes the model to guide you to answers through your own reasoning, which is both much more engaging than reading a wall of LLM text and helps the information stick.
Can you link the Skills.md?
The "Socratic Method" (aka maieutic) skills annoy me, precisely because when you read them they are the kind of low-effort, low-expertise crap someone who over relies on AI would naively come up with when tasked with the problem of coming up with skills for learning. "Hey the Platonic dialogues are pretty cool and smart, let's do that".<p>The body of literature on learning theory, and beyond that on specific types of learning and specific mediums such as learning from text is so rich there are <i>way</i> more useful models to draw from. Believe it or not, prellm, researchers in the textual learning field had already demonstrated you can achieve performance equal or better than novice tutors using pretty basic computer aids that follow specific hint/pump interaction structures. Guiding an LLM to use these findings has evidence backing it and is way better than telling it "i guess be like socrates". The problem is, to realize there might be richer more effective and highly researched ways of tackling the problem beyond the first fart of a thought you had one afternoon requires the deep respect for expertise and specialization that precisely basically everyone in the AI space right now fundamentally lacks.
> I came across the socratic method recently<p>This statement would out you as someone who didn't attend an elite school.
I was so annoyed I made a Socratic wrapper based on predefined curriculum:<p><a href="https://adaptive.bounded.cc" rel="nofollow">https://adaptive.bounded.cc</a><p>Trying to diagrams/animations didn't yield good results even with frontier models. But pure text, any model does a decent job.
what a time to be alive! "if you're having trouble understanding what your robot tutor is trying to teach you, you can ask it to guide you to the concepts using your own reasoning. This is both much more engaging than reading a wall of the robot's text and helps the information stick."
Whats funny about LLMs is they are trained from books, but they are also trained to not output books, so how much of an LLM skews its output because a perfectly normal sentence could be a quote in like 300 different books?
i threw the entire sanderson cosmere into a RAG graph sorta deal just to see how it would do if i questioned an mcp server for it about a universe i know decently well. it was actually astoundingly good. was able to find easter eggs acrossed different books and answer dumb questions like "why is kaladin emo"
If you don't know why kaladin is emo, did you truly read the books lol. Every character has to deal with the stresses of war and most don't come equipped with good mental health to begin with, they're just normal people
Sanderson is 100% in the training data
I also agree with this. LLMs are a great companion when reading a book to clarify things and dive into specific topics.<p>I'd imagine an application that uses LLMs will be created that better manages learning. It's just not clear what that UX is yet- it's obviously not just a chatbot
dumb question, but what is the best way to feed the book to the llm?<p>i run into context window limits, or practical limitations of digitizing the book
You need a non DRMd copy of the book. You don't have to feed it all at once, although with a 1M context limit it is doable. A few chapters at a time is enough, in my experience. An easy alternative is using NotebookLM (now Gemini Notebook), and that has worked brilliantly for me, but I haven't tested it for technical topics (for that I like the LLM to create graphs and e.g. interact with Mathematica, so I haven't tried it).
Hoping you get answer to this. I have the same question.
I prefer to have the LLM ask me the questions
This. Ask it to quiz you if you are feeling it.
LLM is still too verbose, a real person Socratic conversation can interact a couple sentences at a time, not spew 1-3 windowfuls of low density bullet points.<p>I even wonder if this behavior is due to next-token prediction architectures, somehow.
I don't understand some previous complaints. It's dense and verbose seem at ends to me.<p>I know you probably don't consider it dense but wondering if someone can shed insight.<p>I find them like empty calories, like programming youtube tutorials. They maximize for feeling learnt instead of steady progress
There are ways to ground an LLM to be concise, and Socratic (method of inquiry, back and forth dialogue)
This. This is exactly how I use them and I have had no issues so far. I read the book myself, then I point the LLM at it to ask questions about notions I might be struggling with.
I'm sorry, but why not just read the fucking book if you're interested?
[dead]
LLMs can't "read the room" and infer how much context the audience already has, so they try include everything.<p>human conceptual thinking is very much a multi-dimensional graph, which relies on light "approximate" concepts that are "good enough". LLM AR token generation is extremely one dimensional and doesnt care about the "weight" of the concept behind a token.<p>LLMs hold billions of parameters in "mind" at once. humans hold like four "concepts".<p>This is the essential mismatch and the primary reason LLM conversation can be so painful and exhausting.<p>Explaining this and limiting "concepts" to four at a time tops is one of the very few AGENTS.md / system prompts I always use, and it has proven invaluable time and again.<p>Thinking traces show how effective this is at forcing the LLM to simplify its thinking.<p>[edit] Also, myself and nearly all of my peers are struggling to choke down the flaws of LLM tooling along with the benefits. the speed at which LLM adoption is being forced, without truly crafting them into quality tools first, is not ok, and not normal.<p>LLMs have stirred an inhumane hunger and fear. the tech is fine, but the way tech companies (creators and consumers) are behaving should be deeply questioned.<p>it's NOT normal. it's not ok.
Would you be willing to provide an example (even a contrived one) of how this "four at a time" prompt changes the LLM's behavior?<p>I just want to understand more.<p>Also, would you be willing to share the actual text of it that you put in AGENTS.md?
I’m curious where you get the estimate that humans hold “like four” parameters in their mind at once?
Cowan (2001) is an oft-cited paper proposing three to five "chunks" of capacity in human attention: <a href="https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/magical-number-4-in-shortterm-memory-a-reconsideration-of-mental-storage-capacity/44023F1147D4A1D44BDC0AD226838496" rel="nofollow">https://www.cambridge.org/core/journals/behavioral-and-brain...</a><p>The full PDF is worth a read (Figure 1 may be of interest to many here): <a href="https://www.cambridge.org/core/services/aop-cambridge-core/content/view/44023F1147D4A1D44BDC0AD226838496/S0140525X01003922a.pdf/the-magical-number-4-in-short-term-memory-a-reconsideration-of-mental-storage-capacity.pdf" rel="nofollow">https://www.cambridge.org/core/services/aop-cambridge-core/c...</a><p>If "attention is all you need" then it's something we do indeed lack, in comparison to LLMs! But it's an interesting question: might machine cognition benefit from similar bottlenecks in an attention algorithm? Advancements like Kimi Linear seem to indicate that we're far from the finish line: <a href="https://arxiv.org/abs/2510.26692" rel="nofollow">https://arxiv.org/abs/2510.26692</a>
updated the comment. i meant four "concepts". i dont reason about my own thinking in terms of parameters.
><i>I really don't want to read anything generated by something like Opus 5 at this point.</i><p>Personally, I find that its generated prose tends to have an undue weight to it, almost as if every topic I ask about somehow bears a heavy burden, or is otherwise <i>load-bearing</i>, to use its parlance.<p>Quite puzzling, really.
Yes!<p>I have a personal theory: LLMs are *fundamentally* handicapped at perceiving what's going on in the mind of the human (this can't be "innovated away") and that's at the root of what makes them suck at conversation.<p>Next time you're chatting with someone, notice how much understanding is shared without anything being said. E.g. the other person might share something deeply disappointing, and they can tell without you even saying anything whether you get what they're going through. This unspoken-yet-communicated information guides the conversation. Or as another example: humans can read the room -- you walk into a room and immediately adjust your demeanor based on what you see and sense.<p>LLMs are totally blind to things like this, and this adds an <i>inescapable</i> awkwardness to interacting with them. I don't believe they'll ever grow out of this. Which thankfully implies more long term demand for humans instead of robots. :)
Very well observed. I found one more thing: they fail to consider what a 3rd person might understand from your conversation, so when you ask it to dump stuff into a Documentation, they keep making references to facts you had previously discussed or to the train of thought, completely irrelevant to bystander.
Tech guy discovers conversations with humans.
Even over phone calls you get a sense so unless it's in timing it isnt demeanor either
No, they're just trained to impress the C-suite motherfuggers with dense vocab.
It has a sort of metronomic quality. It never slows down or speeds up or modulates its tone. It plods forward at a relentless pace and never has a light touch with anything.<p>I think this is one reason why LLM text is pretty exhausting to read for long stretches.
I never used office hours as a student, which I later regretted because it made me work longer and harder to perhaps achieve somewhat better understanding in some classes, but also I dropped every proof-based math course I ever took. Overall I think my education would have been stronger by attending office hours.<p>I view LLMs in education similarly to office hours. Some people abuse it to get homework answers without grappling with the material, but the optimal amount is not zero.<p>LLM certainly not a replacement for a book, where you get someone’s extended personal approach to a topic, thoughtfully organized, reviewed and edited, often times actual courses taught based on it, with answers checked and errata available online.
I completely agree. I have vibe coded what i would consider to be some pretty weird things in the name of learning facilitation.<p>Perhaps the best example has been a native macOS app that is a completely custom text editor with built-in debugger, lsp support, fuzzy finder, etc stuff you'd expect. Inside the same app is a library of books i can read within the app completely formatted and for every chapter/section of each book that is a quiz to take (LLM generated of course), a "recitation" tab where i am asked a question and say outloud my response to the AI to evaluate me on and then finally practice problems to do within the custom text editor (these are usually programming books). The reader also has ai re-write built in.<p>As neat as this is, and i worked through K&R like this, i have ultimately fallen back on "just read the damn book and go to the AI when you've got questions."
I have had very similar experience! I wanted to learn Probablistic ML, checked out a couple of MOOCs, but didn't find any that were at my level - some were too advanced, some too beginner level. Claude was unable to one-shot a course, so I am now asking it to generate it module by module. But even here, it is not doing a very good job. I muddle through the concepts that it has written, do a whole bunch of back-and-forth, which tbh is exhausting, and then rewrite everything in my words so it actually makes sense to another human being.<p>> I get exhausted reading LLM prose<p>So much this! If I see one more sentence with the words "genuinely" juxtaposed with "load bearing" my head is going to explode!<p>btw, I am building the tutorial here for anybody interested in this topic: <a href="https://github.com/avilay/learn-probml" rel="nofollow">https://github.com/avilay/learn-probml</a>
I've decided that the main thing I'm building is my own mental model. You can take notes, create docs, put graphs and websites together, but unless I'm just trying to generate some reference material the only real objective is to develop the understanding and intuitions inside my own brain.<p>So I have the LLM offer a very short explanation of something, and from there's it's just me asking questions. Anything that feels fuzzy or not fully internalized is something I poke at until I'm satisfied.<p>It really has helped me develop a sensitivity to what I understand vs what I don't, and the ability to drill into any part of it is amazing.
I do this too. I use Claude. I picked a voice I like. I go on a three mile walk. I will ask it questions about a topic that I want to learn about. If it starts telling me more than I want to hear right then, I will say "stop". It doesn't get offended. I then ask it something else. I find this very effective. I control it so it only explains to me what I want explained. If what it says sparks questions on a related topic I jump to a brand new topic. No personal tutor could keep up with this or adjust to exactly how I want to be addressed like Claude does. I'm very excited about the progress I'm making mastering new topics.<p>And yes, it is not that it is just presenting the facts. By me taking control of the direction the questions and answers go, I can flesh out my mental model. I won't retain every little thing it tells me. But I am much farther ahead than before.
Good to know other people who get migrane reading LLMs dense prose. I started reading books again recently, since everything online is polluted by LLM prose. What i realise, is that a human author, especially a teacher understands the learning pathways of new learners, they motivate the learning, and start from simplest concepts (a spherical cow), and then building all the complexities. This helps us to emphasize on most important concepts, while throwing away unnecessary complexities. While reading LLM prose is like reading a research article, that is written to an expert in the area, that talks about bleeding edge, with full of jargons, caveats, that just is not conducive to the learning process for a new learner.
Also they tend to assemble complex jargon in obtuse or meaningless ways, which makes reading and parsing and understanding much more difficult. Tends to reveal that LLMs fundamentally do not have "understanding", just likely word generation
To me, it's just Claude. The other models have their quirks but nothing is quite like Claude.<p>But even with Claude, it's it's really the prose getting in the way you can install the caveman plugin or tell it to use that "standard technical English" thing.
Can you elaborate more on juxtaposing Claude's terrible prose with other LLMs?<p>Any more detail you can share? Do the others feel more "human"? Are there any that are particularly digestible/human-friendly?<p>I've been wondering for a while if this is just Claude because I mostly use Claude, so this is very telling.
I wish I had something more methodical I could show. It's all subjective, but GLM-5.2 feels more human to me. Even GPT-5.6 Sol tends to be easier on the eyes for me (though the stereotype of it overengineering and no common sense are still true).<p>I tried using a new agent service recently and could tell immediately that it's powered by Claude due to the way it writes.
The sycophancy is also a concern, it’s not really an impartial teacher, all its training is to suck up and maximize engagement rather than learning. The incentives are wrong.
I have been using LLMs to help me turn my journals into interconnected notes and sometimes it is so confusing to read the notes that it doesn't resemble any human would write. Its like the models are getting stronger while also losing its touch to write human sounding sentences on complex topics.
I use the LLM to point me at relevant books and papers. But there is still a trust problem: I am trusting the LLM to point me at reliable, trustworthy sources.<p>I'm not sure I'm better off with humans though -- I'm not qualified to judge whether a source is a proper authority, not an I qualified to judge whether someone knows enough to point me to a reliable source.<p>It seems this is a fundamental epistemological problem to which there may never be an answer.
I have the exact same experience, so reassuring to know I'm not the only person who feels this way.<p>I will say, opus 5 is an <i>egregiously</i> bad case of this, but other LLMs have this too, just less bad.
I had the same problem - Opus models past 4.7 tend to inflate output tokens for no good reasons, introduce innumerable jargons and is a pain to read. Then, I cam across this: <a href="https://github.com/ayghri/i-have-adhd/blob/main/skills/i-have-adhd/SKILL.md" rel="nofollow">https://github.com/ayghri/i-have-adhd/blob/main/skills/i-hav...</a><p>You can either install that skill or put the Rules section directly in your Global CLAUDE.md for Claude or Personalization setting for Codex and it should cut down the output verbosity by quite a fair bit.
> First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point.<p>Agreed.<p>I find Opus 5, and even Fable, to be overly wordy in eg PR descriptions and code comments.<p>However, I suspect that's more to do with what they are trained to do by default than LLMs in general. I have a little setup where I tell Claude to work together with Codex to tighten up prose and comments, and for me that produces much more palatable text that needs less human editing afterwards.
I think one problem is that books are not customizable, and many books are aimed at people with some certain knowledge. With LLMs, you can tell it what your knowledge level is and ask it to customize the answer for you. This is difficult to achieve with books.
You should read this article sir! Just scroll to the top of all these comments and check the title!
> I get exhausted reading LLM prose.<p>While my advice is specific to learning about codebases, the way I do it is to have it generate mock data and put it in the local development environment, and give me some exploratory commands, and then ask away. It's a machine after all, so I don't have to read its preceding prose to understand whether it did tell me something, it can just repeat it however many times I ask it, and the hands on commands etc. give me something to actually try and implement.
You can make something like the link below. I'd say it's a more than marginal improvement. It's still tiring, but it's much better according to my taste. I imagine everyone would have their own version of this for their own preferences.<p>It's a loop that uses adversarial review to check several dimensions of the writing:<p><a href="https://github.com/Vibecodelicious/llm-conductor/blob/main/writing_guidance%2Fllm_writing_guidelines.md" rel="nofollow">https://github.com/Vibecodelicious/llm-conductor/blob/main/w...</a>
> I really don't want to read anything generated by something like Opus 5 at this point.<p>Recently switched to OpenAI and I've gotta say Sol is so much better at writing than Claude. Opus has a distinctive sentence structure and Fable somehow manages to be even more obtuse. The personality of these models really does come through...
Claude code has a „fork“ feature where you can fork an existing conversation and keep talking in the fork and then you can go back to the original of the fork. You can fork as many times as you want and let LLMs write to a markdown file to keep important facts and learnings - also good for agents to do research without expanding the context window
> LLM prose is annoyingly dense, and the useful information gets lost in a bunch of noise<p>This is my biggest gripe with reading AI-generated text as well (ignoring the meta issue of whether it's worth taking the time to read something that an author didn't think was worth the time to write). It's gotten to the point that weird AI-style analogies just take me completely out of the text and kill my interest.<p>And I can usually tolerate a lot of purple prose.
Have you tried using the caveman skill ? :D Might be worth a try if you dont like long prose <a href="https://github.com/JuliusBrussee/caveman" rel="nofollow">https://github.com/JuliusBrussee/caveman</a>
I think there's an underrated difference between information generation and pedagogy here. LLMs are very good at producing more explanation, yet "more explanation" is often exactly what you don't need when learning something difficult
Even if you tell the LLM not to use LLM pros they (still) do it. If you feed the Wikipedia article on signs of AI writing and tell them to use none of those signs they will also (still) do it. I have tried (many times) to get an LLM to explain a concept to me, or a process, or an algorithm or what have you, and every time they cannot help themselves. Either they use LLM pros, or they get so verbose that it all just becomes noise and I spend more time filtering out unnecessary jargon than I do reading let alone learning anything.
I ask them to use Simple English and a jargon of the domain. This seems to work best for me.
For Gemini 3 this seems bit to be the case. If you use gems you get completely different personalities - so different that its almost scary. You can create gems which are really insulting, gaslighting or seemingly of a specific profession
> generate a web page with diagrams and organized information flow.<p>Sounds like you'd be just as well off link-surfing Wikipedia?
> First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point.<p>I’ve found the tone of Kimi K3 to be less obnoxious. Unfortunately it doesn’t wholly solve the issue, I don’t think any LLMs out there have a truly pleasant writing style, but at least not every assumption is “load bearing”.
I've found it helpfull to ask the LLM to generate a sylybus for the topic. treat the sylybus as a design doc for a price of software. i find they do much better when they have subtasks to focus on. they can do big picture and small picture, but they can't do both at the same time.
Same. I usually just read the book along and ask questions on a specific part, rather than trying to get the LLM to produce an entire study guide for me. It seems to work better as a Q&A than a "teach me" advisor
Yeah, I am currently trying to work with Opus 5 to refresh myself on deep learning fundamentals, and... it's a mixed bag. I'm glad I already am familiar with the subject matter, as I can prompt for refinement and improvement. It is kinda following the Karpathy videos so far (a couple lessons in) but adding more math/derivations, which was what I asked for. It has trouble staying on topic, presenting information in a coherent/meaningful order, and providing all the context necessary to move through steps in its "course notes".<p>Like I said, I'm essentially continually prompting to refine the material. LLMs certainly continue to append, and never cut back. It just keeps spitting out additional content at me. So that's a bit annoying too. But I can basically get figure out what's going on with a few extra promps.<p>If youre curious what i've got so far... just be warned it is quite literally AI slop plus me continually prompting for clarification/cleanup etc. : <a href="https://github.com/cmoscardi/ai-for-ai" rel="nofollow">https://github.com/cmoscardi/ai-for-ai</a>
I have been using this tool for the past few months that was posted on here: <a href="https://github.com/devenjarvis/lathe" rel="nofollow">https://github.com/devenjarvis/lathe</a><p>It generates tutorials for you, and serves a webpage that lets you complete them. It does a remarkable job.<p>It still has a bit of the LLM prose problem, but it does help you fine tune the ‘voice’ it uses.
To get rid of the llm prose issue you can take a representative sample of its prose (say a question and its answer), rewrite the answer in the way you'd prefer, and add that to the system prompt; I did this to get my LLMs to compress down what they say, and now everything they say is very dense and to the point
anybody adds some prologue about what style of answers are prefered ? i know i often try to change the linguistic patterns because i too (unsurprisingly) am tired of llm prose.
So you want it to teach you <i>and</i> take notes for you?
> want to read anything generated by something like Opus 5 at this point<p>I've stopped using CC because of it. I find it insufferable.
"hey LLM, I'm trying to learn about ___. I already know ___. My favorite authors are ___. Suggest some reading material."
It annoys me that the default AI mode is so tedious and longwinded. I read a lot of nonfiction - the house style of AI is basically marketing copy.
><i>LLM prose is annoyingly dense, and the useful information gets lost in a bunch of noise.</i><p>This problem doesn't get talked about enough and is second only to the hallucination problem IMO.<p>AI produces so much noise to wade through in order to find signal, and the more expertise you have in a field the more that costs. That noise directly subtracts <i>signifcantly</i> from productivity gains.<p>And, I think the problem is directly related to the hallucination problem. It feels very much like an effort to kitchen sink the response in order to provide some value among possible hallucinations.<p>It also seems to be a byproduct of Gen AI operation. It just fundamentally doesn't understand what it's outputting, so doesn't know how to narrow down to the most salient bits.
> LLM prose is annoyingly dense<p>It's just long. It just doesn't shut up. It's overly verbose. And you can't tell it to be concise or you degrade its quality.<p>If I ask what an integral is, the correct answer is that it is the continuos analog of a sum, generally used to calculate areas and volumes.<p>It should really be a single sentence, and then let me ask more about the terms I don't understand, and here's the beauty, in the previous one there can be only 5 terms I cannot know.<p>An LLM will vomit an entire page or more of explanation which isn't bad per se, but is an answer to something different: "give me a short introductory explanation to integrals". And that's not what I asked.
I call that vomit shotgun answers, text from which you have to filter out all the extra info the LLM wasn’t asked for. Luckily you can control that behavior and make it behave closer to what you want. Just ask the LLM how to ask for it.
The new Google Translate. They've made it slightly better at translating paragraphs of text but in many cases it's lost the basic function for translation: dictionary.<p>Try it out, fairly sure that if you out in 100 random words for 30 of them it will just refuse to translate them (it will copy paste the original word into the target language) or it will do silly things like use the target 4th dictionary definition instead of the primary one).
Its aligned in getting you interested and frustrated about a topic enough to go to a primary source you would have never looked at
LLMs help me refine my search. If I want to dive deeper into any topic, I can yield a strong list of primary sources relatively quickly.
something to try that works really well is to put "explain this as if you're talking to a 5th grader" at the end of your request.... it just breaks down the text into more manageable sentences that can be understood by general audiences
You can instruct it to be terse and even take on a specific voice if the standard prose bothers you.
I think AI is surprisingly good at this. I use voice mode while working out to learn complex topics, follow up with reading, and then go back to ask the LLM more questions. They excel at simplifying complex ideas and have endless patience. One hack I found is telling the LLM to test my knowledge by asking me questions—that gives me a clear idea of what to read next. Overall, they’re a great tool to use alongside traditional learning methods like reading books and working through practice problems.
[dead]
[dead]
[dead]
This is on top of the issue of LLMs being a moron. like, I'm sure dumb people can learn stuff from them, but I'm sticking to books written by people who know what they're talking ahout and not vibed slop.
AI hater here. Too me this story is all to predictable. This is exactly how I thought using LLMs to learn would go. Or in simpler terms: <i>well duh</i>.<p>I'm actually going to make a prediction here as well. I think you will soon realize that using LLMs to clarify certain questions or ideas you have will turn out to have frustrations as well. And that you will soon direct those questions to either peers you know in real life or internet forums which are very likely to have a non-AI policy.
> First, I get exhausted reading LLM prose.<p>Often "be concise, to the point." is enough, but you can also paste it some stuff you like as an example text and ask to do style transfer.
You can change the prose that it outputs to anything you like. ask the llm how.
Specifically, you can set the tone and style to match what you like or used to after asking it to interview you, create an output, and then use that output as the project description or document to refer to
This feels like the weirdest complaint to me. Just tell it to shorten its response.<p>Literally saying "one sentence response" solves most of this problem.
Even better (for some topics) would be to play a Factorio-style game (or a Factorio mod).<p>Leaving aside the whole can-we-trust-LLMs aspect, the ChipTycoon page is not really a simulation, and the animation doesn't actually add anything. I like the author's intent, but there's a lot of work to do still before he makes this useful.<p>Surprised no one's dropped a link to Bret Victor's <a href="https://worrydream.com/LadderOfAbstraction/" rel="nofollow">https://worrydream.com/LadderOfAbstraction/</a> ("A Systematic Approach to Interactive Visualization") yet.
I once uploaded a 700 pages book and quizzed chatGPT strictly on its contents. It answered somewhere between 60-90% across 6 quizzes. This was 2 months ago. Those quizzes were fact checking statements, not even problem solving.<p>I'd be extremely cautious to ask it to have it explain any specialized concept even from a document.
> What you get is a beautiful animation that is 100% accurate and free of hallucinations.<p>I'm not sure I follow how this is actually guaranteed? The fact-checking process mentioned just seems to involve asking AI to review its own work.
All these LLM-as-review hype pieces don’t acknowledge that it’s turtles all the way down
Agreed. Given how many significant errors LLMs make in my topic of expertise, despite my taking multiple error checking steps, the idea of catching 100% of hallucinations because you told the LLM to check itself is hilarious. It’s just a wild lack of insight: “I’m using the LLM to teach me something I don’t know about, I definitely have the knowledge base to spot any errors that might remain!”
Yeah. People with technical and/or tech business bonafides claiming that AI granted them expertise are so often taken at face value when they really shouldn’t be. Who told them that they were proficient — a chatbot? Someone who knows even less about the topic, so any expertise seems impressive? I’ll bet it wasn’t someone that actually knew what they were talking about. Even some tech reporters are tripping over themselves to be amazed, but don’t bother checking if they should be.<p>People don’t even have to be lying to be wrong about this stuff. Someone can learn enough about a topic to be halfway up Mt. Stupid in no time flat, and in doing so, think they not only <i>truly understand</i> the topic at hand, but might be <i>particularly adept</i> because they were such quick studies. People that know less are impressed, because why wouldn’t they be? Anybody that knows more than them sounds like an expert. And people that know what they’re talking about cringe at the overconfidence, and probably try not to engage: who wants to have to prove that someone’s boundless confidence is <i>entirely baseless?</i> Most of the time, they think the actual expert is full of shit because they think they’re the expert. It’s incredible how many times I’ve had people in tech confidently, even smugly “explain” design concepts and strategies to me that they did not actually understand, knowing I was an experienced, degree-holding designer… and they didn’t even have a chatbot’s lips on their ass telling them how smart and insightful they were.
[dead]
I'm just looking at the rocker engine piece. The belt is running backwards. That's the first thing I'd expect it to get right or flag if it doesn't. Human in the loop is also the quality control. If that fails the rest might have similar issues.
Completely agree. While I didn't set things up to have AI review its output in a loop, my experience trying to build a specific acoustic testing rig with Opus 5 also aligns with the other "it's turtles all the way down" comment.<p>Opus 5 first built me a detailed plan, but a couple important details were either obviously wrong or felt unnecessary. I went back and forth asking for sources and more information probably like 4 times and <i>every</i> time it did the "in looking at things in more detail it appears my previous advice was incorrect" spiel. It just became exhausting at some point because it feels like it really lays bare how LLMs are just minimizing that loss function but don't actually "understand" anything. It was really useful as a search engine (it correlated some highly relevant source docs), but I just couldn't trust it to believe it was actually done at any step.
A second agent reviewing it adversarially resolves some context rot. Whatever they trained these LLMs on will just infinitely double down so I break it with 1 layer of checking and then a judge who looks at facts, since the checker is adversarial.<p>I know it sounds silly but 1 layer ends uo being way worse than 2.
I could certainly envision a scenario whereby review would increase reliability but not how it would every guarantee 100%, there is a pretty big logical gap there.
In my experience it depends on how much in detail you want to go. Chip manufacturing is a really opaque industry, so in this particular case LLMs might not even have the training data. However, using it for a high-level introduction into something is usually pretty safe from hallucinations.
even if you say use RAG or something to a source you can trust, there's no guarantee the agent will still use exactly what the source has.<p>i can't even get agents to remember core instructions like "use jq instead of writing a python script to parse some json"..
The "100% accurate and free of hallucinations" claim should probably be replaced with something much weaker
I don't do animations, but I have an answer. You research a topic well enough to be able to understand if the result is OK or not. Usually it means figuring out some sort of testing.<p>I'm researching causal inference right now, and my main goal was to make sure I understand how to test estimation on synthetic data.<p>Basically, it's the same way it works with people. If you delegate a task that you don't understand, and you can't have a credibility proof (i.e. doctors, lawyers), then you research a topic well enough to be able to (1) define the task and (2) verify the end result.
You can add "make no mistakes" to the end of the prompt and achieve the same result while burning less tokens.
Yep, that's impossible. The hard truth is that most people this lost to LLM psychosis cannot understand that fact. It's better to treat it like someone in a cult, arguing the facts isn't going to help if they refuse to accept them.
I thought after reading the title that the text was about learning something, yet the actual text seems to be about having a system do something for me.
I've had success using the socratic method. I give Claude some topic (say, how the intricacies of the bond market works, the content from which are screenshots of pages from a textbook), and then I go on a walk chatting with it in voice mode. Claude is the expert, I am the student. Claude asks me questions, leading me to an answer logically. I come back with questions, and we back and forth. LLMs arent like they were in '23-'25. I'm almost always skeptical its going to lie, and almost always wrong.<p>In particular:<p>- I limit it/encourage it to give me single sentence questions<p>- I sometimes will ask it to tell me a motivating, human-grounded story, when we're starting a new concept: claude responds "Maya is a bond portfolio manager, and her boss has asked her to quickly price in what happened if yields go down. She knows her bond's average duration, a measure in time, but she doesn't have a percentage, which is what her manager wants. How can she give him a percentage number with just a duration figure and the proposed new yield?"<p>- I'll often ask claude to let me work through it, to derive the thing myself, often resulting in a string of thoughts with "yes/no" trailers, to get the LLM to reply yes or no only, and avoid derailing my train of thought. If yes, my train of thought keeps going. If no, I've got something wrong.<p>- I'll sometimes stop and have it craft an artifact. I typically say "build me a Brilliant.org-style interactive demo of the topic", especially when we get into the realm of looking at the actual maths of a thing (for which prose and dialog is not optimal by itself AFAICT)<p>- I'll do this while I'm traveling, while I'm walking, while I'm doing chores.<p>It's so much fun.
What’s everyone’s opinion on learning new tech things in this day and age?
My opinion swings between positive and depressing vision of the future.<p>I still learn new stuff, but I’m afraid it won’t have any value in a year or so.<p>For example, I’m pretty good at optimizing low level stuff, but right now you can just ask LLMs to do so and they are pretty good at it. They will profile the code and suggest reasonable options like 90% of the time.
They're amazing at it, provided you keep asking the right questions.<p>Trust me when I say that in the hands of someone who doesn't have your experience, the LLMs would not be getting the results you get.<p>You might think what you're doing is trivial, it may be sessions that flow roughly, "Instrument this, okay this part is slow, profile this part, OK read the profile output and suggest a better approach".<p>But your experience will be steering it in the right direction, and you're probably unaware of just how much your experience is doing that guiding, as the LLM shoots off at 100mph, you feel like it's taking you with it, but you will be guiding it a lot more than you realise, and that's where learning and experience comes in, even if you're no longer operating at the lowest depth, your knowledge of that layer will be helping.<p>If nothing else, the experience to know when something is actually slow is a skill in itself. If a function takes 200ms, sometimes that's as quick as it can realistically go, and sometimes that's literally a million times slower than it could be, and there's actual skill and experience wrapped up in knowing what "slow" looks like.
> Trust me when I say that in the hands of someone who doesn't have your experience, the LLMs would not be getting the results you get.<p><a href="https://code.ffmpeg.org/FFmpeg/FFmpeg/issues/23049" rel="nofollow">https://code.ffmpeg.org/FFmpeg/FFmpeg/issues/23049</a><p>So there's this 11 year old issue in a forgotten ffmpeg plugin and I fixed it with deepseek by putting it into a self-testing loop. Probably would have taken me a few weeks to even understand the initial code to begin with. I haven't done C work in a long ass time and have zero knowledge of even what sub pixel sampling means.<p>With DS4 took me a few days and a couple of dollars. And by few days I mean I checked on it a few minutes every half hour or so a few times.<p>I don't understand the code it wrote but it's been in production for a while now and no issues so it's good. Ended up speeding up our video processing pipeline by 20-30%.
So while I do agree that it is cool you were able to do this, I‘ll say:<p>Sending in the patches but refusing to take responsibility for them is a surefire way to contribute to maintainer burnout. Please don’t do this. Either commit to fixing something and driving the PR to merge, or abstain from it entirely.<p>The bottleneck isn’t the speed of coding, and what you’re doing here is actively worsening the situation.
idk if it's really worsening, someone who has the same issue can apply the patch. I understand why they rejected it but also I'm not willing to learn everything that DS4 did there since I don't plan on working on ffmpeg filters and the knowledge is pretty much useless to me outside this patch. Too much time commitment for.. fixing a filter no one really cared about for 11 years.<p>But you can see how the parent's comment doesn't really hold, I was able to achieve this while not knowing anything other than what I need fixed and making the LLM test itself towards that goal.
So what should newcomers do who haven't yet gained enough expertise to ask LLMs the right questions?
“asking the right questions” is built on years of experience doing the things now being offloaded to AI<p>“asking the right questions” is also a moving target with each model release<p>People simply underestimate the value of doing the work and think that the end result is all that matters
Except the steering itself is also disappearing, the same prompts from just 6 months ago now need much less steering, AIs are learning to even ask back in certain cases to persuade people with no experience towards the most likely correct choice
Generally speaking, the pattern is that people are overestimating how much "work replacement" will happen, and underestimating how much "work shifting" will happen.<p>What is fascinating is how you can witness it at so many levels of organization. One example: Employer executive get enamored with moving from labor to capital. They believe that by using LLMs, they can replace a lot of workers. At my place of employment, we have people that are surprised they can't file a Jira ticket describing a product ask, and have it kick off an implementation. You can build the skill to attempt that, but invariably you'll get back questions like "what do you mean by <x>" and "what do you want to do in this case, a, b, or c?"; questions that a product person or an exec are not well suited to answer.<p>In the past, programmers did that kind of interpretation and judgment call. So then you're in a quandary; who should do that work? Work that previously, you never imagined was an inherent part of what the replaceable code monkeys do at your beck and call?<p>And then, how do you hire for that? How do you find the training for the people that are experienced enough with... something... to know what a cohesive error response is, or what kind of telemetry strategy is best for that particular product and organization, what collection of product asks are incredibly complicated for what they're asking and can deliver 95% of the benefits at 5% of the work if we just do this instead, and whether you want to aim more towards thick or thin clients?<p>Who are those people? Wait, those are programmers? Wait, there's this whole collection of inherently human skills that we devalued, by not appreciating they were always quietly doing that for us in the past?<p>That's just one example. There's a repeating pattern of discovering where the work truly is, work that was embedded in manual patterns we might not have to involve ourselves with anymore, but is yet still essential. So the nature of our jobs changes massively, but the overall level of employment does not.<p>At least, not in the medium to long term. There is a lot of painful churn we have to suffer through first.
I agree with you in the broad strokes, but replacement by LLMs isn't the only way the level of employment can be reduced. If LLMs can make it so that two programmers can do the work that used to require five, that can result in a very large reduction in employment, even while having (some) programmers is still essential.
Only if there is no further additional demand created by the now lower cost of doing the work. Take lighting as an example. As it has progressed from burning expensive candles to now leds, our demand for lighting has continued to increase.
On the bet that layoffs will result in programmers ending up at 40% of the staffing level they are now, I will take the over.
I'm also trying out a lot of different approaches, and generally I like the sparring I can get from LLMs but with the acceptance that they make mistakes and some things still need some fact checking. But the models are improving fast, so I'm positive about this approach just becoming better going forward<p>I'm working on a side-project called tech-professor.com which is a platform for learning. The content is built directly from the source code in your pull request and repositories you follow. So you can quiz yourself and your team based on the code you ship.
It's in beta and a lot of changes are still on the way, but if you want to check it out and give feedback, feel free to sign up for free.
I can only speak for myself, so I hope this resonates with you.<p>I wasn’t even really concerned with optimizing low level code before LLMs and that wasn’t why I was hired either.<p>However following that low level thread: We can look at the reasonable options and immediately know if they’re reasonable or nonsense. Why? We know the code. Now zoom a level out, where I think our expertise really lies.<p>Building a complex system isn’t easy. There are customers with requirements, there are budgets, SLAs etc. Sometimes one customer needs X and one needs Y. Our expertise is taking all of this in, and producing something that balances all the different variables. It’s knowing that we’ll expect <i>X</i> events a second so we’ll need <i>Y</i> to ensure we can tolerate failure.<p>Is it possible LLMs will be able to do all of that too? Maybe. But then why would our customers need the enterprises they pay for?
> I still learn new stuff, but I’m afraid it won’t have any value in a year or so.<p>I have stuff to do now, the value of the knowledge in a year or two isn't important if it solves the issues I have today.
I sometimes get vague ideas for solving maths/science problems. They never pan out but i can talk in detail on group theory and advanced maths and science topics due to investigating such vague ideas over the years. These days the LLM shoots the ideas down instantly and honestly correctly, i know enough to know "yeah that's right, oh well" and move on. Which actually takes away a huge avenue of learning. I'm pretty torn on the outcome of this honestly.<p>I'm not 'wasting time' but I'm also not really learning.
There's a big gap between being able to ask questions about something and <i>understanding</i> something.<p>The more things you understand, the higher the chance you'll spot a situation to use them in the future.<p>I think the best innovations come from times when someone is uniquely able to combine two of their previous experiences together. The more experiences you have in your back pocket the more combinations you have access to and the more likely you'll have a unique combination when the right problem comes along.
Purely personal but as I get older I am tired of learning new things and would just rather learn old stuff.<p>Career-wise, this is terrible. But for me technology was polluted by the ever-growing greed.<p>For example I’d much rather actually learn assembly, than learn the nitty-gritty details of how LLMs work.
There’s still an immense value in training the brain to learn and be able to approach new problems with the sort of procedural thinking that LLMs enable. We can explore topics that we are curious about and develop that sort of “muscle” to continue asking questions when we have them. I have no fear that when those bigger (and existential) problems arise we’ll be well equipped to keep asking questions and figuring out ways to solve them.
Not good at subjects you have no previously learnt knowledge.<p>They tell you have "hit the nail on the head" when you really haven't.<p>They tell you have had a "great insight" when you are really haven't.<p>They give you the illusion of learning and progress but essentially give you faulty preconceptions will trip you up further down the road.<p>You can ask the LLM to be more critical and less sycophantic but that only gets you so far:<p>They want you to continue using, being dependent on and feeding data into the LLM--your independence isn't a priority.
One possible value in learning new things is developing a habit of learning.<p>In particular it might be valuable to be in the habit of learning things that one is bad at <i>doing.</i><p>Or not.
I'm choosing to (mostly) switch off the news and continue learning things I find interesting anyway. Maybe the world will punish me for it at some point, but I guess I'll have to deal with that when it happens. The alternative is too depressing otherwise.
So you think building a warp drive is pointless because 99% of work, per your judgement, will be done by AI? Is your contribution meaningless and artifact useless? I wouldn't think so.
It depends strongly on the prompt. Like recently I was also doing some performance optimizations, and if I did not mention profiling none of the LLMs even profiled the code; they merely read the code and assumed, based on their own analysis of big-O time complexity. It is after I explicitly asked for profiling that the LLM started actually profiling.
> I still learn new stuff, but I’m afraid it won’t have any value in a year or so.<p>This is silly. This would be like arguing that encyclopedias made knowing things pointless. I learn new stuff for me.<p>Professionally, it's important to know enough to know if you're going in the correct direction. Practically, tokens are going to continue to cost money and knowledge can save you tokens.
I mean, part of the reason the LLM can do that is because you know enough to direct the LLM to do so and verify the results to some degree, right? It's good to learn new things because:<p>1. It satisfies you curiosity (and curiosity is always valuable)<p>2. You can better utilize the LLM to expedite something you now have knowledge about<p>3. You still improve as an engineer/programmer/prompter/whatever<p>I still think it's very important not to outsource everything to AI because there is a lot of value in learning and doing things yourself which is an important part of life.
I don’t agree with the implication that there has to be a practical reason to learn new things. I enjoy learning new technologies because it’s fun.
The way learning new stuff rewires your brain cannot really be predicted, but the effects are positive.
I decided to learn watchmaking instead
I have staff ranging from 10 years of IR experience to right out of college.<p>I can tell you that there is an enormous gap in ability between them despite them both using LLMs for daily IR work.<p>The reasons aren’t complicated. The senior responders have tacit knowledge of how breaches evolve and what to look for which gives them a much better framework for where to employ the LLM.<p>The juniors will normally start from “here are some logs, look for weird” which is fine but leads to tunnel vision and a lack of confidence in their reporting.<p>I don’t mandate that anyone do work with or without an LLM. I hire seniors based on experience and juniors based on interest. But my experience has so far been that our best up and comers focusing more on learning the technologies instead of leaving those details to the LLM are developing their intuition and understanding faster and in a more robust manner.
If people don't learn, and write, and converse, about new tech, the LLMs will not have raw material to learn their slop from. And I am quite worried that this is the direction we're going in, with the lake of insight being sipped dry and a future of shallow cliches as LLM responses.
> What you get is a beautiful animation that is 100% accurate and free of hallucinations<p>I can appreciate using all of the tools at your disposal to learn a new topic, and in no way want to discourage learning. I've used LLMs myself to question my own understandings and it can be helpful.<p>However, "... 100% accurate and free of hallucinations." isn't a statement someone who just learned the topic is capable of honestly stating.
The biggest thing I've learned from doing stuff like this is that there are no shortcuts. At some point or another, to truly learn something deeply, you've got to dig in to the boring details and do things the hard way. LLMs can help with this...but I find it's usually tempting to try and just offload the boring stuff to them, which doesn't work.
Having an initial higher level understanding across the domain is extremely useful to contextualize the deeper stuff. I think boring details is a very leaky characterization, but I'll continue with it.<p>In my experience it's infinitely easier and faster to learn deep, "boring" things when you understand how they relate to your shallow and wide understanding of all of the related components.<p>The LLM is merely a tool. And you can use it for domain discovery that enables efficient deep learning at an unprecedented rate or you can develop a cursory understanding of a topic and think yourself an expert.
I’ve found that if I’m not struggling I’m not learning. If stuff is coming fast and easy that’s a sign that what I’m doing is not stretching existing skills enough.<p>It’s true of most things. Running, dieting, weightlifting being uncomfortable is a sign of progress.
This is also why apps like Duolingo don't work for most users. They want to turn language learning into a fun, effortless game but effortless is fundamentally incompatible with learning.<p>Learning is uncomfortable. Reading a difficult (for you) text in a language you don't understand is exhausting and confusing. But that is where improvement happens.<p>Its even worse since Duolingo added a life system (not sure if they still use it), where you were only allowed to make 3 mistakes before having to recharge your energy. If you get everything right, you are not learning, you SHOULD be making mistakes constantly. That shows you're actually being challenged.
The LLMs are a way to get quick feedback and getting it promotes quicker learning (if the feedback is good). Learning is difficult, sometimes I get blocked on something and before llms that could prevent me from learning some material, nowadays I have another tool to help me unblock and learn faster.<p>I think that could be called a shortcut, not in learning per se, but in the process of getting to learn.
> The biggest thing I've learned from doing stuff like this is that there are no shortcuts. At some point or another, to truly learn something deeply, you've got to dig in to the boring details and do things the hard way.<p>This is the only path to mastery, or understanding if one prefers. There are no shortcuts to a person achieving deep understanding (a.k.a. "Aha!" moments).<p>Can a tool such as GenAI be beneficial to someone who already has done the work to understand? Absolutely. But it cannot infuse mastery into a person simply by its use.<p>Only the time and effort a person devotes can do that.
Quite - you still have to do the work yourself. I think LLMs are best placed to act as an eager tutor that doesn't mind discussing a topic ad nauseam until you're certain you understand it.
yes i've found that there are a few topics that i've really been able probably 10x my understanding of using LLMs, in particular in getting me over hoops that are hard to navigate when solo, BUT I have to be really careful for it to not just show me the answer all the time.
I’ve been using LLMs to create readable rewrites of RFCs and specs that interest me. It is not precise enough for implementation use, but it has increased my understanding of the underlying RFC.<p>Another useful approach has been asking Codex to implement complex things, like a Kademlia DHT or BitTorrent client in a literate style with the explicit purpose to increase understanding by reviewing the source code.<p>Examples: <a href="https://rickcarlino.com/notes/note-dump-and-ai-summaries/index.html" rel="nofollow">https://rickcarlino.com/notes/note-dump-and-ai-summaries/ind...</a><p><a href="https://github.com/RickCarlino/tiny-bt" rel="nofollow">https://github.com/RickCarlino/tiny-bt</a>
> In plan mode (using CC, or OpenCode) I ask a model to build the foundational knowledge for X topic.<p>Makes sense.<p>> I ask it to review the accuracy of the knowledge base it built in the previous step.<p>Ooookay that sounds good.<p>> I proceed asking it to build a simulation of that topic in a low-poly, Rollercoaster Tycoon-like animation.<p>wat.
Author likes this kind of animation. I have something similar like this, but without the animation step.<p>The main idea is you can do any style you want or like to learn.
It's such a surprising and delightful turn, I love it!
I only use LLMs for explaining things if the subject is one I’m deeply familiar with and can independently and easily verify the facts. Doing so with new knowledge areas is very risky for obvious reasons.<p>For example, “explain how the code in this file works,” I am familiar with the overall codebase, I know the purpose of the file, and I can read it or write tests to verify if I suspect what it’s telling me isn’t correct. Or, if it’s really important, I can overcome my introvertedness and ask the team member who wrote it…but that’s a last resort nowadays, which I am very thankful for. In 99% of cases since at least Claude 4.2 days, Claude and Codex have been very accurate. Gemini on the other hand messes up more frequently and sometimes does weird things like try to delete files it’s not familiar with, at least the 3.6 flash model I’ve been using lately does this. But, code explanations are still good for the most part.
The title is not representing what the post is about. “Use LLM to learn complex topics” here actually means that the author asks an agent to describe the problem area, and then implement a simple web-based simulation game, and by playing that game, the author actually learns about the topic and its constraints. They use chip making as an example.<p>That's actually a fun way to learn processes!
Its fun but is it really effective ? I mean I checked the LLM one and I came out more confused about a topic I already know about, I find the best way to to learn using LLMs is to just generate an example try to somewhat get a mental model of how it works and then ground my understanding with traditional documentation and resources, its an iteration of a technique I used to do in college where I would read the textbook questions first to understand what is important and then read the chapter
I assume different ways of learning work for different people. For me personally, it's taking a piece of paper and drawing the diagram of how things work together; of if it's some math, then, again, using the pen and paper to follow the text. I can very much accept that for some people playing the simulation is a good way to touch the new problem space. I can easily imagine that for some topics, let's say, traffic signal automation, a careful simulation game will probably give more information than reading papers or manuals.
Game-based learning, described by Comenius, works if someone else prepares “a game” for you. E.g. like a dungeon master. :)<p>Otherwise you probably get more confused as you have mentioned.<p>On the other side, Peter Diamandis describes a situation where a bunch of kids were given a internet-connected computer and they had no teacher. Instead of it there was a “grandma” that checked kids from time to time.<p>After that there was a knowledge test that revealed “no teacher” approach was more efficient.<p>But it was a group, not an individual activity…
Thanks! The original title was "How I use LLMs to learn...", but somehow HN removed the "How" part. I even removed the initial post thinking it was a typo on my end and tried to post again, but I stumbled upon the same behavior.
this would be a cool game
Really cool idea the sim game approach! I'm trying to find a good approach to learning in the age of agents, though more focused on the actual code I read and write in my day to day. I'm building tech-professor.com which is in beta, where my goal is to setup continuous learning for product teams and developers.
It's a hard problem to solve, but I believe that llm-based learning will become better as models improve!
The fact the author thinks every topic can be fit onto a rollercoaster tycoon-style analogy leads me to think they do not actually understand these topics very well.
From the article:<p>> I proceed asking it to build a simulation of that topic in a low-poly, Rollercoaster Tycoon-like animation<p>Sounds like the Rollercoaster Tycoon part is just referring to the aesthetics/graphics, and the author is just suggesting building a top-down isometric 2D animated simulation (which I agree is a bit limiting, there are definitely some things where you'd want to be able to fly around a 3D space in first person, move time back and forth, manipulate parts of it).
For me the bigger value comes from explaining complex stuff. I remember Andrej Karpathy once said (He was quoting someone else actually) "You can outsource your thinking but you cannot outsource your understanding".<p>I can keep asking LLMs to explain a complex topic until I get it. Ask to explain it 10 different ways, explain it using physical analogies, explain it using visualization. If I don't get it, just say that out loud so that they can keep explaining it to me in different ways. We can keep going that until I really get it. That is the value I get the most using LLMs to learn things, especially complex topics.
My main issue with using AI as a learning platform is that unlike documentation, books, Youtube videos, there is not really a process of having someone "review the learning material". For example, I can always read the review of some book or ciriculum, the comments under a video, or if it's some for of open source documentation you can check the PRs and verify to some extent it's claim. With AI I can't really say what it has halucinated, because I am learning a new thing, I don't have that benefit of previously reviewed material.
This is (exactly) why I very strongly tell people not to teach themselves with an LLM. Particularly from the ground up. If you do not understand the domain, you cannot learn from the model because you won't know what questions to ask and it certainly isn't going to answer all of them for you.
The LLM doesn't have to be the sole single only exclusive source you learn from. It's an addition to a mix. Nothing is a single definitive answer. Same way as many other things, like Anki flashcards or Duolingo or some YouTube channel, or some tutorial website or indeed a coursebook or an audio course or whatnot. Use multiple sources and use the strengths of each.
You can ask the LLM to connect the dots to the sources before displaying it to you so you can see the proof in line.<p>You can ask the LLM how to do this. Start with a topic you know well to get the mechanism working and trust it well.
Of course, and that is what I do, but it becomes and additional mental and time consuming effort. As an dumb example, if I am learning a new programming language and trying to grasp some concept, I'll check the docs, find the section and read it. I trust that the source in the docs has been already vetted by other devs and the authors. But if I ask the AI the same thing, I then need to verify it's claims usually by asking it to check if the info is true, and then possibly opening the source link (lucky for me Claude provides the links in the desktop app as footnotes). It's not a question about AI, it's about the trust I have of this tool, it builds over time, but as soon as the AI makes an assumption or a hallucination we are back down to square one.<p>I assume this will become less of an issue in the future as there is more trust between the AI tools and me.
"Complex topics" in this case means reading 22 AI-generated paragraphs that supposedly cover the entire chip manufacturing process. If the author seriously thinks this level of detail is complex then they have psychosis.
> What you get is a beautiful animation that is 100% accurate and free of hallucinations<p>How does he know?
Wrote about this awhile ago, and it hasn’t changed:<p>> Time and time again, when talking to people who rely on ChatGPT, Claude, Perplexity, and other general AI tools, I hear them say, “AI is incredible. It handles nearly everything I throw at them.”<p>> “What does it fumble with?” I’ll ask.<p>> “Well, it still gets things wrong when it comes to my line of work.”<p><a href="https://www.dbreunig.com/2025/04/08/on-ai-observational-comics.html" rel="nofollow">https://www.dbreunig.com/2025/04/08/on-ai-observational-comi...</a>
I think these same people believe everything they see on TV, unless the thing on TV is something they already knew about.
It's the kind of overstated unjustified claim an LLM would make.
I thought of the "does he know" meme when I saw this.
Gell-Mann Amnesia. Recognises the failings in their own field of discourse, assumes all true about anything else, same source.
There is something called tacit knowledge that cannot be easily learned through LLMs. LLMs are currently very good for research and theoretical knowledge. For example, learning how to make mechanical watches involves a lot of hands on, tacit knowledge. That skill would also be transferable to building other precision instruments. I don’t think we can currently learn these kinds of skills easily with the help of LLMs.<p>Even if you know everything about bicycles their mechanics, components, and how they work you still have to learn how to actually build, repair, or ride one through practice. Knowing, understanding, learning, and practicing are completely different things.<p>There are also niche areas of expertise that can take years to develop,not just to the point where you know the terminology and jargon, but where you understand the nuances of the field, can recognize the "unknown unknowns", and eventually have the ability to push the boundaries of existing knowledge. Maybe that is what we should really call learning: not simply acquiring information, but developing enough understanding and practical experience to contribute something new to the field.<p>Ironically, on the same front page of HN, there is a post about Andrew Wiles and this. I don’t think I would be able to comprehend Fermat’s Last Theorem, the Poincaré Conjecture, or Gödel’s Incompleteness Theorems, even with the availability of LLMs.
For learning, I find LLM's helpful as a knoledgeable "tutor" or "friend" during the reading of a complex paper or book. Before, when I got stuck, I spend lot's of time going around different books/pages/papers until I was able to find a simple enough explanation that allowed me to "catch up". Now, I can ask the LLM and then continue from there.<p>Learning from a book is still the best... Although I have been told that learning a complete subject from a book is now an inproductive use of my time... Perhaps they are right, but I still do it.
Yes, there are many misconceptions on "learning", but LLM can be useful.<p>The approach that works for me is using Justin's skycak methods he mentions in his books:<p><a href="https://www.justinmath.com/books/" rel="nofollow">https://www.justinmath.com/books/</a><p>Check the shorter "Advice on upskilling" or "The Math Academy way" for well researched approach.<p>So what works for me<p>- open a project in ChatGPT/Notebook LM
- dump all the relevant and highly cited materials (textbooks, papers)
- dump the advice on upskilling text or a short summary I've written for the LLM<p>- create "Learning Goals", that contain what I want to learn, and how to estimate is my level good enough<p>1) Ask it to create a learning path from the materials, following the approach. Give that to an adversarial LLM for cross check. (just for sanity check)<p>2) Ask it to create an "entry test" to check what I do know and what I don't<p>3) Iterate step by step on each module/submodule from the learning path that intermingles the approach of: small theory step + small practical task + small test. Log what's missing/wrong in my dept log. Give the dept log at the end of the session to the LLM to incorporate/create another test/task.<p>What I have found useful in this approach is that it will generate a lot of practical tests/tasks for me and it will explain a concept in many ways until I understand it. Also it finds some prerequisites I might miss, but based on my tests and debt log unexpected things I thought I understood surface.<p>So with the limits of LLM and while building a mental map of the relevant parts it's usually enough to spot the hallucinations, but if you apply structured approaches these are minimal. And it's super good, because the number of practice tests and explanations is endless.<p>The interfaces are a bit clunky, but current multimodal LLMs are ok with images or even hand writing.<p>I will recommend that structured approach.
"Learn complex topics". Yeah, not really. Get a cursory, superficial overview of complex topics? Sure. But that's about it.
I guess we all learn in different ways. I prefer reading, and can fairly fast find the articles that make sense to me.<p>Colleagues often suggest podcasts and videos - I very, very rarely listen to them or see them.<p>The bandwidth is too low. It's not efficient and ultimately I'm bored.<p>This is a nice project, it looks cute. I watched some of the pages
But I want more than that, more information, and faster - still a Wiki fan.<p>Also, step number 2 in the flow: have the LLM check itself... Naah, I don't believe that.<p>But you're not the only using gen ai like that. Take care.
Imo the podcast and the video are better served as background material for some other task. The low bandwidth becomes an advantage because it's often ok if you miss out on some parts due to lack of attention.<p>Indeed it's often a waste of time to just focus on talking people fully if you want to learn fast, reading and especially deliberate practice are better for that. But if you don't have the time, energy or focus, then listening to interviews in the background can be useful supplementally
I’ve written a skill that I basically feed what I’m looking to do, some ideas I had for accomplishing it and any other details like tech stack, etc.<p>The skill then riffs with me, judging my ideas and suggesting alternatives. We go back and forth until something useful comes out of it. This process isn’t unlike how I do normal development.<p>However, once agreed it breaks the work into “steps”. It then creates a tutorial for me, for those steps, explaining each line, why each change happens etc. I can then ask questions, muse about an alternative idea etc. Then I do the steps, and I’ve learned and gotten what I wanted to get done.<p>This has been how I’ve been learning Godot and making a game for the past month or so. I didn’t go in blind, I started with a course from GDQuest so I could feel confident guiding the tutorials. I will say though, having a tutor to bounce ideas off of has been really useful.<p>I still try to figure it out myself, consult the docs, discord etc. But if I’m stumped I’ll run my tutor skill and have some fun.
I’ve started doing a similar thing after reading a post on hn about manually applying the code so that you actually understand it.<p>I have done this for all my work this week and it works quite well.<p>For one it lets you actually query the LLM as to why, their plans give a high level not every single change and it allows you to correct it as you go and the plan will change.
The author says it's "100% accurate and free of hallucinations" but I am sceptical. Although I don't know much about chip production, when I ask LLMs about advanced topics like memory order LLMs tend to hallucinate more than entry-level questions. But the point is that I didn't found that LLM hallucinated before knowing it deeper. It's possible that LLM hallucinates but you don't find out because you are just learning it.
I've been using them by reading some docs/wiki/tutorial, then when I think I understand something trying to do a rough explanation to the LLM and ask if I'm right. I'm usually making some analogy to something I already understand a little. I'm usually partially right but missing some key bits at the first pass. I go back and forward asking for explanations of various bits or asking for resources around the area I'm not understanding. Often times just discovering the relevant name for the area of study opens lots of doors. I basically use it like I would talk to a knowledgeable and patient teacher.<p>As for how useful it is to understand thins, I believe it's still useful and hope it will continue to be.
One of the most exciting things about LLMs for me is to have someone with which I can discuss about technical/scientific/engineering things. Since usually I do not have a human at hand (or do not want to annoy people around me).
Especially conversations that involve formulae can get really interesting and insightful.<p>Of course, you have to be careful with the answers. Especially when the discussions get longer. But usually I see that it is time to stop or to start a new session when the formulae do not make so much sense anymore or when the LLM repeats itself.<p>But with enough caution, LLMs are really a not-so-bad intellectual sparring partner for discussing ideas and insights.
The little tool it outputted is nice, but click around the stages and the text is not high quality at all. The snippy titles, abbrievated explanations, I wish a few more iterations and thought was put into the actual main textual content. Especially for 'complex' stuff
The other day i was trying to learn why there is no internal structure to electrons and other quarks, but it failed. I still dont know.
Buildings are a fantastically complicated and interesting complex problem space. I found my architecture studio students using it to ask technical and code questions about the buildings they were tasked with designing. I observed that the inaccurate information it was returning was compounding...<p>To be clear, I say "inaccurate" rather than "wrong" in this case because even if the information it returns is factually correct to the question being asked, students don't have an understanding of the complexity of the interdependent tectonic, regulatory, and spatial / experiential factors of a building sophisticated enough to ask their questions of the specificity and nuance necessary to get a good output that addresses the entire problem.<p>Anyway - with the students still learning to ask questions the right way, and the conditionally-incorrect facts making their learning more complicated rather than less, I hit on a strategy for them to use LLM's that seemed to help much better.<p>I suggested that instead of ask the LLM for the factual answer, or even better for the facts and an explanation, that they ask it to direct them to the proper place in the source material to find the answer themselves. Then, to treat it like a lab partner. IE:<p>Hey Claude I'm looking for "x."<p>Claude: "look at foo, bar."<p>Thank you - chapter (foo) part (bar) table (goo) says "car." However I notice that footnote (hoo) says there's an exception if "dar." Which is what I have. Walk me through this exception...<p>It seemed to have good results as a guide to understanding the disparate bodies of knowledge that they will eventually have to keep together in their heads and work synthetically and non-linearly through, rather than just as an external source of blindly trusted authority.
I use it by telling it my background, giving it a rough timeline and asking it to create a learning timeline, save progress along the way, and git push / pull periodically so I can use the same thing on both Linux and Mac. I tell it for each phase in the learning timeline, present me information, then challenge me on it. If it's code, it challenges me with a coding challenge, where I use it in an IDE plugin. If I'm learning something that isn't strictly code, then I ask it to give me info, then challenge me with questions and grill til I get it right. I ask it to save what it think I struggled with, so that later we can drill it again and I can also review it in an .md file.<p>Does anyone else use Claude like this?<p>It's sped up my learning by 10x. I struggled with 'just reading a book.' Take kubernetes. I hemmed and hawed and spent years periodically reading some dry book or blog or official doc, falling asleep, and forgetting while I got busy. Now I'm aggressively working with it, almost like I'm addicted to a gamification, of getting through our learning timeline, and I'm excited to move forward as quickly as possible and pass its tests.<p>It's like a fake teacher, because I can also ask it to drill into a topic or re-explain itself if it made no sense.<p>The only thing that worries me is, sometimes I'll say something like, "Um, are you sure about that?", and it'll apologize and correct itself. I barely challenged it!
My high hopes were quickly dashed at the step that involved turning a complex topic into rollercoaster tycoon.
I use LLMs to learn deep technical concepts. I really like them because I can spend countless hours a day understanding things and building an investigation file with all my findings. I code examples and test the findings. It has helped me understand basically anything.<p>I'm using LLMs right now to build a terminal browser, a GUI browser, and a PyTorch/LibTorch replacement. It's really fun to be able to learn and make progress this way. It's like reading multiple interactive books, where every concept can be explained again and again until I understand it.
If you're using LLMs to learn or for research, and at some point you don't end up engaging with an actual resource (books, papers, lectures, web pages, etc) then you're playing yourself.
Sorta. If its response is grounded in actual material, and you're thorough, it's not so risky. As with all learning, trusting one source is a risk in itself. Hell, I didn't even trust my physics textbooks in college. Physics.
These animations are great. I have learnt so many things from LLM's, cross checking things is easy enough, but the hallucinations are really not much of a thing any more (in my experience). When you deep dive on things it does seem to get very wordy sometimes (this is claude anyway). Its taught me flutter and dart without opening a book (with the occasional reference page), set me straight on monads finally, refined some linear algebra, various bits of history, and philosophy, I'm learning spinors at the moment. Is some of it wrong - maybe, but it's not like my brain is 100% accurate any way, and when I need accuracy I look up references. It is fantastic getting a broad overview of a subject you don't know or a precis of a current subject, and its so much faster.
These comments make me wonder if people were unable or unwilling to use search engines effectively
Gamifying the presentation could make topics more accessible to others. For me the overhead wouldn't help with my own learning. Also I've been burned by just learning things mechanistically (e.g., coding, applying algebraic rules), so I'm leery of learning just by making flashcards or models of the topic.<p>I find LLM's do great for learning when I ask what are the principles, how the main applications work, what are the key drawbacks, where are the growth plates in the field, etc. - the kind of thing a good advisor points to. Sometimes I have to ask it explicitly to use topological order of topics and show relations, which often highlights the gradient changes in the learning curve. For pruning, it's surprisingly good applying philosophical heuristics - Occam's razor, or Derrida's differance (the difference that makes a difference), etc.<p>And finally, no learning is effective without problem sets, and for those LLM's at times get me over blocking issues.<p>The degenerate case is memorizing the glib phrases regurgitated back to me; they're helpful and functional enough to get me into real trouble!
I’ve been doing something similar (browser only interactive courses served from GitHub pages) to teach me topics from beginner to advanced<p>LLMs and systems intersection - <a href="https://kernelspace.naigap.com" rel="nofollow">https://kernelspace.naigap.com</a><p>Distributed systems - <a href="https://byzantine.play.naigap.com" rel="nofollow">https://byzantine.play.naigap.com</a>
This is a great share, gonna come back to it.<p>Also worth mentioning that Matt Pocock has a /teach skill that creates interactive, learning sites for learning a new skill.
+1, you can customize it to learn any topic concisely, learn by doing, add challenges, add visual explanations<p><a href="https://github.com/mattpocock/skills/tree/main/skills/productivity/teach" rel="nofollow">https://github.com/mattpocock/skills/tree/main/skills/produc...</a>
I am very interested in figuring out how people use LLMs for learning. I definitely have the knowledge, but it is severely autistic in a way.<p>OTOH, I am curious if there's a "practical value" to this exercise? If the LLM already contains the information and implementation knowledge to implement the networking stack inside an FPGA by itself, what value do I gain by learning about HDL, TCP, the bespoke Xillinx tooling, reading the documentation, reading papers on the implementation and going through every bit of details and theory.
I feel like there's a meta skill that is more worthwhile for "practical value".
This looks very interesting, something I was also trying to do with my learning.<p>One thing I wonder is, do you mentally 'fight back' monotonicity of your interactive tool? All seem to be in 3D space, with low-poly, like in a factory moving through the belt and giving you an information + textual description to read more<p>But sometimes you want to visualize the charts, or graph of simulations, or maybe even the parts of an item in the rocket.
The main bottleneck as an engineer is no longer writing or testing code. It is how long it takes to understand complex systems. This is a really nice approach that, if you have the tokens and the patience, feels like I great way to learn something and I think we'll see more and more stuff like this.<p>I had a similar realization a few months back and am working on a tool that generates "mermaid walkthroughs". It is 1000% less pretty but it is fast and is pretty good at explaining how services work or what a code review does or just as a way for your agent to explain some decision to you.<p><a href="https://github.com/scottrogowski/ariel" rel="nofollow">https://github.com/scottrogowski/ariel</a>
I wish there was a LLM tool to explore a topic recursively, as a tree or a mindmap. You would start with some high level concept (say "cryptography") then dig further and further to more specific topics.<p>I think that would be a way more natural way to explore than being stuck on the classic linear output of a LLM.
> In plan mode (using CC, or OpenCode) I ask a model to build the foundational knowledge for X topic. I ask it to review the accuracy of the knowledge base it built in the previous step.<p>> What you get is a beautiful animation that is 100% accurate and free of hallucinations.<p>How do you make that leap?
> I ask it to review the accuracy of the knowledge base it built in the previous step.<p>> [I ask it to build an interactive thing]<p>> I then push it to a new repo and enable GitHub Pages for it.<p>Congratulations. You are an echo chamber for LLMs. Use it to create, and verify, and post to then be scraped and trained on again.
i looked at the animations, they look cool, and i don't think i will enjoy learning things that way. as someone else said, there's a lot of content already produced on these topics. i also think the level at which these animations are playing, they are actually hiding the 'complexity' of these topics.
TBH I was expecting something different. When I use LLM for learning I ask it to make questions for me. It's genius in these tasks. I moderate it to not kill me with difficulty but otherwise it's friendly to help me learn and understand
I usually learn compelx topics using the image generator of an LLM, capabilities like GPT-Image2 or Nano-Banana.
I give it like a complex paper -> turn into visualzation or a poster, then ask quesitons and it helps me understand someitmes a very complex paper rather easily. The jump that nanobanana / gpt-image-2 had done is pretty wild.
I would prefer to view code this way - a flow of data between things... a project I'd really like to work on. Has anyone done anything similar?
There have been numerous approaches doing things akin to that. I remember my university working on such a project. Or at least a similar one, representing a code base as a street network with traffic showing how data flows through the system.<p>I too, would like to have such a tool for viewing larger projects where the flow can be cumbersome to reason about. One issue I guess would be finding the right level of abstraction in the representation.
That's it? It doesnt feel right. This feels good enough for a casual dinner table conversation and not much more.
But AI will be better than you at those topics as well, and when someone needs an expert in that topic take a guess who will they approach in such scenario.<p>I don't think we are even that far when the complexity AI can handle surpasses 99.999% of what humans can handle, where AI make e.g. physics discoveries beyond the grasp of most humans and it will have to "dumb it down" when talking with humans -even physicists- but not with other AIs
Something that I have realized recently is that it has become so easy to get an answer to almost any question with the help of chatbots that its almost unnecessary to spend any effort thinking about the problem or the solution. I feel like before when I had to spend time researching a problem to find an answer I learned so many things around the topic itself which helped me understand the problem itself better and gained a deeper understanding. Today it feels like you can have an answer to the most complex questions you might have, yet you gain a superficial understanding of the topic and might forget about it quickly.
For everyone who thinks you can’t learn with LLMs, Dr. Cat Hicks, psychological scientist and author of the recent book “The Psychology of Software Teams[1],” who worked at Google and founded the Developer Success Lab at Pluralsight, has written two skills called learning-opportunities[2] and learning-goal[3] that use validated learning science to help you learn while using LLMs.<p>Cat also has an awesome podcast with her wife, Ashley Juavinett, Phd, called <i>Change, Technically.</i>[4]<p>I encourage everyone to check out her work! She’s dedicated her life to helping software developers get the support they need inside organizations to be seen as humans, not just robots.<p>1: <a href="https://www.drcathicks.com#book" rel="nofollow">https://www.drcathicks.com#book</a>
2: <a href="https://github.com/DrCatHicks/learning-opportunities" rel="nofollow">https://github.com/DrCatHicks/learning-opportunities</a>
3: <a href="https://github.com/DrCatHicks/learning-goal" rel="nofollow">https://github.com/DrCatHicks/learning-goal</a>
4: <a href="https://www.changetechnically.fyi" rel="nofollow">https://www.changetechnically.fyi</a>
This looks like the most convoluted and token heavy way to consume a bulleted list.
It depends what you mean by “learn”. To have a superficial idea of the high level concepts of a step-by-step process, sure, a 3d visualization like the ones this author makes can work. But it stops there.
One concern though: "100% accurate and free of hallucinations" is doing a lot of work. A second LLM pass can catch some mistakes, but it can also confidently agree with the first one
Personally I'm excited about these sorts of experiments. We all learn in different ways, and these sorts of techniques allow us to create "on-demand" syllabuses and lessons that fit our learning style and learning level.<p>It's not perfect, but I'm optimistic this will be a useful way to teach/learn in the future.<p>And, to be clear, I think this will be best utilized within a group/community setting. I don't think it will replace teachers or classrooms.
I don’t think I really agree with the author’s approach here, but I will say LLMs have been a huge help to me as I’ve been reviewing linear algebra and diving into signal processing. Anything in a textbook that I don’t fully grasp or am confused about, I just take a snapshot or copy paste then ask a model to derive it or explain it in different terms.<p>It reduces friction a ton, but at the end of the day I’m not skipping anything.
I'm all for this and I'm keen to try it. I certainly don't want to take away from sharing another neat use case for learning.<p>But<p>> What you get is a beautiful animation that is 100% accurate and free of hallucinations<p>100% free of hallucinations when you're not an expert that can check it is impossible. LLM hallucinations are an unsolved problem.
The back-and-forth questioning seems especially useful for exposing gaps in your mental model rather than just producing a summary.
This guy is severely milking it now. If learning means building an inaccurate and incomplete understanding of the topic then go hog wild. Otherwise <a href="https://news.ycombinator.com/item?id=49209049">https://news.ycombinator.com/item?id=49209049</a> sums up my feelings about the author's attitude.
Really neat idea, I think it is one of the best ways to exploit the combined building and explaining capabilities of LLMs.
I am currently building an app/game to explain friends and family concepts around wealth management and wealth building. Games are a great way to hide complexity while still including it in the « guide » you are making.
having llm audit all my work/code, and generate review pages (as a teacher) of before/after with working examples is incredibly useful. Its something no course can do for me, even a teacher wouldn't have enough patience to go through each one of my mistakes.<p>having things defined/have correct solution to compare for review is useful, and keeps llm on track. Don't think i would trust llm if it were reviewing it all on its own
The selected topic (chip manufacturing) is being presented at a shallow level at best. Go read Wikipedia’s article [0] and see how deep and broad the topic is. It also skips quite a few steps, and utterly glosses over how insane of an accomplishment EUV is.<p>This is my biggest societal issue with LLMs: they allow you to think that you’ve “learned” a topic because you read a lot of technical terms. I don’t think it bodes well for the future.<p>0: <a href="https://en.wikipedia.org/wiki/Semiconductor_device_fabrication" rel="nofollow">https://en.wikipedia.org/wiki/Semiconductor_device_fabricati...</a>
Very cool, I like the visual learning nature of this and the auto play once starting. The game graphics are engaging which counts for a lot these days, I feel my attention span suffering after using agents for the past year.<p>I've been working on a similar process of pushing to github pages, but focused more on having "practice sessions" with coding blocks to test content. Using webassembly and mock servers to mock backend endpoints Here's one I built to build a full stack llm chat system in the browser.<p><a href="https://model-systems-labs.github.io/latent/llm-systems/lessons/conversation-state/" rel="nofollow">https://model-systems-labs.github.io/latent/llm-systems/less...</a>
I tend to ask the LLM for a single HTML page explanation, with a pedagogical approach. Something about dropping the word pedagogical leads to a more structured outcome, but I haven't quite figured it out why yet.
I ran this on ship tracks to see the global warming result. It built a toy climate model for cloud forcing: <a href="https://ship-tracks-tycoon.netlify.app" rel="nofollow">https://ship-tracks-tycoon.netlify.app</a><p>For background, in 2020 the International Maritime Organization changed fuel standards globally. The intent was to reduce pollution, which is great for human health. But, it turns out some of that pollution was supporting cloud formation and creating a cooling layer globally. And temperatures started to climb when the pollution was removed.<p>I haven't looked through how it's doing the calculations yet but this kind of visualization is full of possibilities if done right.<p>Thanks for making this guide!<p>Here's the code and publications/sources on Github for anyone to poke through: <a href="https://github.com/titojankowski/ship-tracks-tycoon" rel="nofollow">https://github.com/titojankowski/ship-tracks-tycoon</a><p>And since the details of ship tracks are a newer topic for me, I'm curious about Gell-Mann Amnesia. Next I'm going to apply this to a topic I understand well and will report back. Stay tuned! (will be tomorrow, bookmark or reply to this thread)
I am greatly disturbed by the idea that any of the demonstrations involve "complex topics". Whether it was the silicon workflow, LLMs, or EUV, I saw nothing complex. Are these supposed to be freshman undergrad or even high school level explainers? I suppose I didn't see any glaring errors on a quick glance, but definitely lots of details were glossed over.<p>Perhaps basic special relativity could be done this way, or simple derivatives, but definitely not general relativity or integrals, much less PDEs. I guess I was hoping for a 3B1B type output. Oh well.
My favorite way to learn infra topics at work right now is asking for a humorous analogy involving monkeys and bananas. I tend to remember the result, and it gives me reference points for new topics.
Open engine factory, stuff is flowing opposite direction of the conveyor belt it’s on. 100% accurate!
YouTube has so many truly wonderful videos on chip production. I admire your approach but it seems like a lot of people are in this ai maxxing phase where they reach for ai for everything despite their being ready, high quality things already available for free
I'm also not sure you can really learn chip production from widely available public information. It's a hugely complex industry where the details tend to shape larger strategies. For example, you can't really understand the relationship between Micron and TSMC without some awareness of the trade-offs of memory processes for peripheral transistors.
YouTube is just a big dump of information. Having a structured way to learning along with interacting helps you learn. Otherwise you're just binging information
Oh, I do similar, but using single page websites.<p>Last month, I read The Prince and had it make a text adventure campaign for me.<p>For a lot of other topics, I often just ask it to create a simple python example that I can run.
LLMs can help you understand a language, but they can't replace learning the vocabulary. Words and phrases still need to be learned the old-fashioned way: repetition
AKA - How I skim read a lot and learn nothing of value.
Looks like a horrible flow. I feel sadness for the guy.
haha, I did the same to study new topic and then realized how personalized education will turn out in the near future. The only thing left is keeping a curious mind and ask a lot of questions !!
> What you get is a beautiful animation that is 100% accurate and free of hallucinations.<p>How do you know if you're learning this for the first time? Very risky to learn from LLMs. I've done it, but you have to keep your wits about you. Lots of "oh of course you're right - what I just told you was completely wrong".
this is pretty cool! it feels very good for getting a brief summary/overview of something and getting a beginner's level grasp.
That seems like a terrible way to learn. It’s a neat animation but cmon, there’s like educational TV programs from the 80s that explain this so well, in Germany there’s “Sendung mit der Maus”, not sure if they have a segment on chip manufacturing. But in these clips you can at least see the real stuff instead of some half wrong animation, just let the LLM write a few paragraphs for you or better find an ACM article or book on the subject, probably still takes less time than coming up with that animation…<p>God does everything have to be productized and glorified as if you’ve invented a new way of learning. Read some books!
Building learning artefacts is under appreciated.<p>Inthink this was always the best way to learn. But it used to require immense work for a teacher.<p>My compiler course is a great example - program in plug in a stage of a compiler.<p>These exercises can be made on demand and incredibly easy now.
What I'm missing is an agent window near the text that I could immediately inquire about the details of the process.
This is cool project !
Too over engineered, few text paragraphs would suffice to understand the topic.
i've asked llms to write a presentation for me on a given topic. for whatever reason, that finds the hidden layer responsible for explaining things well.
Those animations are... series of steps, each with a description? How different is this from a plain text list? It's not that you can see forks or that the layout of the assembly line gives you more information.
If anything, a plain text list is easier to scroll backwards and forward?
Is there a way we could turn this into a reusable skill?
The biggest win for AI dev efficiency is cutting down what gets loaded into context. Semantically matching tasks to the top tools helps a lot.
This animation is worse than useless. I've taught a lot of students. This is not learning, it's stamp collecting.<p>You're just memorizing a nonsensical recipe. What are the constraints? Why do we do X rather than Y? How does a particular thing scale? etc.<p>All you're doing is fooling yourself into thinking that you've acquired some knowledge. When in reality you haven't even learned the basic mental model to reason about this stuff.<p>You've learned something when you have a mental model that makes correct predictions. Until then you've memorized it at best, and as with most memorized things it will decay exponentially and will be gone from your memory soon enough.
anyone using LLM to learn a new language? got any useful prompts for this?
not all knowledge can easily be translated into a pipeline alike game imho
"What you get is a beautiful animation that is 100% accurate and free of hallucinations."<p>Do you know it is free of hallucinations because you crossed checked it with the source material or because you told the LLM "don't hallucinate"
Another, possibly easier, way is to ask an LLM to give you a quiz on a topic, and then discuss your answers with it.<p>Surprisingly effective.
I had an internal company assessment I needed to pass before end of our fiscal year. The study material consisted of 10 ppt decks about 80 slides each (so around 800 total). I had an AI read all the decks and compose a study guide with quizzes along the way. It came up with a 100page word doc that I used in place of the decks to prepare. It worked very well for this including, like you said, quizzing me over various sections.<p>(Yes I confirmed it was ok to use AI with the material)
The self importance this author has is sickening. No wonder he's chronically talking to chatbots.
I love this idea!
Kids use agents for exam training, rather than cheating. Which is great as long as the LLM does not hallucinate
> I personally find the style used by LLMs to explain things difficult to follow. It's just too simplistic<p>I also struggle with LLMs explaining things, but for the opposite reason.<p>I consistently have problems to get short, precise but plain/simple answers.<p>Instead I'm overwhelmed with walls of texts, often filled with jargon that is a mixture of imprecise and unneeded.<p>The style at which I learn better is by asking about stuff interactively. I ask you what something is, you give me a 3-4 sentences top answer. Then I explore and dig into the topic from your answer on the things I want to know better.
I recently used Opus to create a learning plan in ClickUp for every Tailscale feature and it worked very well.
i had Bolt create an interactive app teaching me Oberon language but despite several attempts to fix issues, there were still glitches in unexpected places.
So the experience was... meh.<p>Then I went back to a book written by humans (Eric Nikitin's "Realm of Oberon").
> What you get is a beautiful animation that is 100% accurate and free of hallucinations.<p>I am pretty sure this person is<p>a. Ignorant of the fact, that AI is designed to give just answers, they do not care whether they’re true or not<p>b. Have never Cross-checked Information given by AI with reliable sources
I mean, yeah, fun project. But that whole game could be like 15 mins of prompting.
His other project, <a href="https://aivestor.tech/" rel="nofollow">https://aivestor.tech/</a>, seems like a huge grift.
Gell-Mann Amnesia: the blog post
once again. state and persistence are the issue. not generic llm inference.
[dead]
[dead]
[flagged]
[flagged]
[dead]
[flagged]
[flagged]