Good article and I wish this was much better known.<p>The issue is though that it's too focused on interactivity. In reality, 90%++ of slow sites are not slow because of interactivity really, they are slow because they ship enormous react/nextjs bundles and have extremely heavy hydration work to do.<p>_so many_ sites have bundles >10MB that need to be downloaded, parsed and hydrated.<p>I've even seen (many) sites which have multiple SPAs stacked inside of them.<p>If you're on a slow internet connection and/or CPU the page is basically unusable for many tens of seconds and no amount of yielding post bundle hydrate will really solve that.
NoScript is a remedy for this. When a site is broken I whitelist a few domains likely to be necessary. After a few attempts I bounce. If I see a dozen plus domains I don't even bother. This cuts down on the volume of garbage sites I waste time on and shields me from novel trackers not on any block list.<p>The web is much faster when useless JS is taken away.
99% of the time those sites could be plain HTML and CSS, but apparently new generations don't even know how to do that, out of programming bootcamps.
>99% of the time those sites could be plain HTML and CSS, but apparently new generations don't even know how to do that, out of programming bootcamps.<p>That is because the latest framework always fixes everything that wasn't broken before.
Bad take.<p>HTML is abysmally lacking for any interactive (which is what this article is about).<p>Decades later, even something as common as a combobox is unsupported.<p>EDIT: Downvotes but no argument.
The article acknowledges this in the very first paragraph:<p>> For most of us it’s things like reducing network requests, shrinking the bundle, or making good use of the cache.<p>These are likely going to be your first port of call for performance issues at your day job, but fixes like removing dependencies or making fewer network calls are pretty straightforward. I think the author chose to do a deep dive on the topic on freeing up the main thread because there's such a wide variety of approaches and many of them may not be obvious.
I'm not sure the author realises _what_ a massive impact bundle size has on the main thread though, especially hydration. The majority of apps I've optimised over the years have the (often vast) majority of main thread time spent on the bundle parse/hydration (plus obviously network).<p>Also, removing dependencies is not easy. I've seen many corporate that have a huge UI lib for example that everyone should use for brand consistency. But it's many MBs of JS, because it has to cover every possible use case.<p>This doesn't even get into 3rd party vendors who _also_ ship react et al and have other bundles.<p>I'm not saying the article is wrong, but if you want to free main thread time especially at the most critical point (when the user has initially loaded the page) you _probably_ will find that most of the opp is in bundle size and hydration improvements.
I challenge you to browse the web one week on this laptop part of the current top 10 Amazon best sellers on a gigabit fiber connection and tell me if you still think that this is the problem: <a href="https://www.amazon.com/HP-Everyday-Processor-Microsoft-Portable/dp/B0H94BMX1K/ref=zg_m_bs_g_565108_m_sccl_5/143-6149589-1760914?psc=1" rel="nofollow">https://www.amazon.com/HP-Everyday-Processor-Microsoft-Porta...</a>
Please don't brush off parent's "slow connection". Many people are stuck with that.<p>A prime example: cookie dialogs. On a slow connection, page loads, large parts are rendered, and you start reading. <i>After that</i>, some script starts to present a cookie dialog, and everything freezes. Page doesn't scroll anymore, buttons don't work, sometimes a previously-readable page is darkened or otherwise obscured so you can't keep reading while this goes on.<p>Then a whole bunch of stuff is downloading, which (again: "slow connection") takes forever. Like 20s+. Halfway through you see "accept / reject / settings", but none of those buttons respond (except the dark pattern where "accept" often works faster or smoother than either "reject" or "settings". Aaargh!). When things respond again, consider yourself lucky when page re-renders as before.<p>Which also runs afoul of 1 of my pet peeves with user interfaces: DO NOT PRESENT A UI ELEMENT UNTIL CODE TO PROCESS ITS USE, IS PRESENT IN MEMORY & READY. Really simple right? Yet I see examples ignoring this oooften.<p>A 'slow' CPU, low RAM/swapping etc just makes this worse. Web developers tend to have fast machines & connectivity so they may not even be aware of this. Or think it's a non-issue even though it affects many users - existing or potential.
It is a problem and plays a role, then the rest of the SPA interactions are as bad. Amplified by 100+ third party scripts.<p>Stop building SPA, go back to HTML. Re-assess every third party. For extra performance and scaling, implement cache. Relax and see web experience healing.
There's definitely trade-offs. I actually prefer a proper SPA to pure HTML when on a slow connection and interacting with a site a lot.<p>Especially when trying to buy something. I much prefer to have a longer initial load and then have everything just work instead of waiting as I navigate between pages, the multi stage checkout, confirmation etc.<p>But yeah, if I'm just trying read a single article on a blog, preloading everything is pointless. A hybrid site with the initial page being server side rendered + progressive enhancement afterwards is theoretically optimal in my opinion.
These people definitely have an overly rosy view of the past. The sites that are dog slow shit ux now still would be with server rendered html and jquery spaghetti, just like they were in the past.<p>Ever submit some giant form to get some random error and then lose the entire state of it? Used to be extremely common, even though it shouldn’t have been.
In London in many apartment blocks one can only get wired internet via an old copper cable with speeds like 80mbit/s download in theory but in practice it can be below 30 with ping in 50ms range and much slower upload. And 5g does not help either as the signal can be very weak.
Try it yourself on a gigabit internet. Put CPU throttling in devtools to 10x slowdown (assuming you have a fast computer) and see how fast it is even with super fast internet.
Why would a regular React site be so huge?<p>Maybe they had bundled fonts and images.<p>The bundle is just the lib plus your files minified.<p>You want to bundle vs hitting dozens of requests just to get files.<p>It’s not like React/webpack is a black box doing things I don’t know or want.<p>Performance: I challenge you to build a complex 3D game in vanilla threejs vs using r3f. useFrame alone is worth it
What a joke of challenge, there is still no browser 3D game that is a match to Infinity Blade, that Apple used to demo OpenGL ES 3.0 hardware in 2011.<p>Anyone serious about 3D gaming on the Web has to do streaming.
<a href="https://playcanv.as/p/MflWvdTW/" rel="nofollow">https://playcanv.as/p/MflWvdTW/</a><p>This isn't new at all, just one of the first things I found by googling "webgl demo."<p>WebGPU of course goes even further.<p>I think the real gap is just that people by-and-large aren't building real games on top of Safari. It's more lucrative to use the app store with its low-friction payment system.
ES 2.0
[flagged]
Since at least Windows 3.1 we all know that cooperative multitasking is a bad idea. But we see a lot of developers use it, even Rust developers who should know better.
I agree with most of the article, but would clarify the following:
> For the screen to look smooth, frames have to be drawn at the display’s refresh rate. On the most common 60Hz display, that means 60 frames per second, or about 16.6 milliseconds per frame.<p>It isn't absolutely necessary to match the display refresh rate. With a 144Hz monitor, 72FPS is going to look smooth for the vast majority of the people, and even 48FPS will look smooth for most people. I agree that higher FPS is better, but there are diminishing returns.
It's a good nitpick. A hypothetical 1000Hz display will still look smooth to the human eye at 60/120Hz. A 1Hz display will never look smooth.<p>But it's more about honoring the user's preference. I personally would rather 60Hz, then 120Hz heating up my room unnecessarily. If someone has a display set to 1000Hz for whatever reason, then you should try your best to honor that.
Here is a problem that I had thought about in my last frontend project: the project needed to parse a user-provided string to provide syntax highlighting. The implementation was to parse the string immediately after a user keystroke so the user always sees correct colors. But I had this nagging thought that if I had designed the grammar wrong some parses might take more than linear time and would hold the main thread during the parse. But I didn’t really want to first render a black string, parse on a service worker and then rerender with color. The effect must have seemed disorienting.<p>Anyways I stopped the project for unrelated reasons and this thought kept nagging me in the back of my mind. The time I work on the project I’ll be sure to try some techniques in the article.
Superb article.<p>There was very little new information for me as I have applied some of these techniques myself based on having developed an intuitive understanding on how a rendering "thread" works and blocks, but for a less experienced developer this article should be incredibly enlightening and provide a solid understanding of what's happening.<p>I employed use of yielding on a hobby project [0] I made about 15 years ago, particularly when it had to do lots of draw operations on a canvas. I also experimented with using worker threads to render pieces of it on a background thread, but at the time there was no way to copy the data efficiently between them and the main thread, one had to send the data as a base64 encoded PNG and the overhead of encoding, decoding and then copying it onto the canvas made it perform far worse than just doing it all on the main thread.<p>The website also does Gzip decoding of uploaded files in JavaScript and the library I found at the time did all the work synchronously so could lock up the UI thread easily for 10+ seconds. I tweaked it to be able to yield every 200ms or something, the process of which was very educational, particularly due to it convincing me to <i>never</i> omit the curly braces after an if statement, I spent a <i>very</i> long time trying to understand why it wasn't working until <i>eventually</i> I realized a statement I added wasn't in the if statement's block. It's not that I didn't understand how if statements worked, it's that in my mind the lack of curly braces was initially invisible to me.<p>[0]: <a href="https://mordritch.com/mc_rss/" rel="nofollow">https://mordritch.com/mc_rss/</a>
Top article, kudos! applied some of these techniques previously, and they do matter a lot. thing is, when you learn/teach JS there is usually limited time left to talk these topics, and they are essential more than it seems.<p>the whole point of cooperative multitasking is to yield now and then (back to the runner), so that it can process the drawing. Besides, at 60fps there's so much that can be computed once every N frames, and the eye does not see it, the animation flows.<p>It becomes even more interesting when webgpu is involved, but the CSS animator is indeed very fast.<p>note: some recent work of mine (newskool digital flyer sites) -> bsf.hmsu.org // nouveauxhivers.dub4powder.xyz
FYI: This isn't a browser-only thing. All platforms (Windows, Mac, ios, android) typically have a single-threaded UI.
Great piece, OP. We work in WASM and are considering web workers to help with rendering documents off the main thread in that context. I was surprised to read that ArrayBuffer is moved by reference only! Might be an option. Thanks for putting this together.
ArrayBuffer is copied by default unless you pass it as a special transferable object. But only the current owner of the buffer can use it.<p>If you need to read and write from both threads at once, you need to look at SharedArrayBuffer.
haven't done this for documents, but for canvas rendering transferControlToOffscreen() worked better than moving ArrayBuffers. It hands the canvas to a worker that draws directly, no pixles over postMessage at all.
This article concludes with the following statement:<p>> So much of development is trade-offs, and you have to choose according to the situation, which ultimately comes down to the developer’s experience and judgment.<p>It’s a great article, but I think it is a bit behind the ball in framing scheduling problems as a matter of “experience and judgment”. The problem of allocating work to a scarce resource is one of the oldest and most well-studied in all of computer science. It would make sense to go consult a textbook on the matter before trying to reinvent the wheel.
Well yes. But most of those studies assume/assert control over the environment. In this case you are running in the browser and you have to deal with the primitives it gives you. Both in compute management (threads/workers), communication (RPC, messages, shared memory, sockets), as scheduling (like having yield or not.<p>I’m not sure whether inventing a setup like green threads in JavaScript/workers would even be possible.<p>That is not to say that we should just forget about those learnings though.
This! Since it became easier for people to post their thoughts on a problem vs. research and learn from past work, we're now in the era where its harder to find the seminal and really-well-explained material for having to wade through years and years of people's rediscovery blogs.<p>(Don't get me wrong; I too think the article is great; just wish all the folks who went to JS bootcamp and are amazed by this would have cracked any CS or OS text book written since the late 60's and browsed a few chapters.)
Do you have any suggestions for books on the topic?
Excellent article, I went into it thinking the headline is obvious, but the examples are well crafted and it isn't just the obvious stuff.
I remember seeing some JS cryptography library a long time (maybe 10 years?) ago that provided an async hashing function for exactly this reason: to split up what would normally be a simple synchronous computation and yield more often to the main thread.<p>Can't recall the name, but I remember thinking that was very clever once I understood why it was doing that, and am glad to see the concept explained directly here.
The discussion of "FLIP (First, Last, Invert, Play)" would be improved by mentioning the View Transitions API, which is basically there to automate this technique.
In the first example: doesn't pushing the button while typing cause the textfield lose focus? What's the point of the typing in the example?
Brilliant, I had no idea about this stuff. Thanks for writing it up.<p>On the price ticket example, on my device (Samsung A15, mediocre phone from 2024) I get 11 fps with the slow example and 30 fps with the fast one. (15 if I scroll!)<p>Is that a case of the back pressure you mentioned?<p>All the other (fast) examples are 60 fps though :)
If you are currently trying to build a web-based clone of something approximating ChatGPT, pretty much everything in this article is absolutely mandatory.<p>The streaming response UI/UX is a total nightmare to make work smoothly. You have to come up with clever heuristics around where to chop up the stream of changes and how to batch the work relative to frame updates to make it not look like confetti during a streaming response.
I really don’t understand why the LLM web chat clients have all converged on this UI where one character appears at a time. It is kind of fun the first time (like you are watching some Harry Potter special effects where an enchanted book writes itself). But really they could send sentence or paragraph long chunks of text, it would be fine.<p>Seems like an artifact of the time when tokens-per-second were low enough that people needed to be informed that the machine was actually doing something.
> But really they could send sentence or paragraph long chunks of text, it would be fine.<p>The problem is that the content is multimodal, often recursively.<p>You can be inside markdown and then have a python code section. Simply detecting these boundaries is already challenging.
Nice examples, a bit repetetive perhaps.<p>One thing that I found quite interesting to see is how the behaviour of the "4.000 particles" demo changes between the 5ms rendering and the "everything now" rendering.
Reminds me of sprinkling DoEvents all over my VBA code to keep it "snappy" when I started to get into programming
Such an excellently written articles with really nice interactive visualizations!
The chat example here doesn't really seem to work for me—I get 32 FPS consistently no matter what the chat settings are. Maybe a Chrome thing? Or an M3 thing?
I learned these lessons from many separate places and have always wished to see them in one place. This was an incredibly great article that I very much enjoyed reading and will be sending to anyone who's in need of ideas about speed. Thanks a lot!
This was so incredibly helpful and well presented.
I wish await in JavaScript could conditionally yield. Instead I end up having to use arounds like if (shouldYield()) await do yield();
One obvious tool that this article doesn't mention is Chrome's performance monitor. Many techniques in the article only have to be applied once you can verify that they are running slow.
That's the kind of content I come to HN for, thanks!
I want to do a blanket response to people calling this AI slop: the post was written in korean and translated to english. Calling this slop is judgment slop.
> Press a button: the JS animation and typing freeze, but the CSS animation keeps spinning<p>How do you expect me to type if pressing a button moved text focus away from the text field?
great article - explains in detail why my sans js websites run so smoothly and so fast.
What does "Browser's Main Thread" even mean when there are over 30 processes running?
> So what if off-screen posts were left as empty shells that only take up their height, and got filled with real content as they approach the screen?<p>Yeah fuck everyone doing that, hello Reddit, Outlook for Web or Bluesky. It makes searching on such "feed" pages with the browser's search function an utter pain in the ass, made worse by the fact that the platforms' own search functions are outright braindead.
what's your solution to the performance hit that you get when you load up the dom with a zillion things? long, unvirtualized threads will bring every decent computer to its knees.<p>the sites could implement their own search to make it all work if they wanted to. they just dont. but blaming virtualization is not tit.
Using a lighter weight DOM can help. There's always a point where it starts to bog down, but many pages are just unnecessarily heavy because they're relying on so many nested widgets and whatnot.
> what's your solution to the performance hit that you get when you load up the dom with a zillion things?<p>Browsers can easily render and scroll through entire wads of content.<p>The problem is, when the "line" comprising an email in the email list of Outlook Web is in a maze of (literally, just looked it up) about 30 divs deep, performance inevitably goes down the drain.<p>Computers in the 00s could handle inboxes with thousands of emails just fine and scroll through them. Outlook struggles keeping more than 30 in active memory. That's <i>gotta</i> be a joke.<p>By the way: the solution is rendering tabular stuff in, well, <i>tables</i> instead of armies of divs that try to be tables. That case has been optimized to death because that is how websites and applications used to be built.
The solution is to improve the browser to remove the performance hit. Modern computers are extremely powerful so there is no good reason why they would not be able to handle a zillion things in the DOM.
The browser can easily handle millions of calculations and then render a million DOM elements so quickly that you won’t even notice it. The problem is when you try and do this hundreds of times very second.<p>The irony is that obsessing over smoothness and frames per second is what causes this in the first place.
A zillion things is more than a zillion bytes of RAM :p
Yeah, but if your website with, you know, text and stuff, doesn't do any stupid and unnecessary crap, it doesn't matter where the nonexistent unnecessary yet expensive code doesn't run.
and if you have no website at all, it takes zero seconds to load.<p>But for people who are developing websites that are more than just text, this is an excellently written article and great advice.<p>It's funny, for mobile app dev it feels like the community are a lot of focused on staying off the main thread, this is the first time I've come across one for webdev.
Well yeah but if you do actually need things like images, animations, high frequency updates, etc, this is actually a pretty good overview of how to approach it. Also learned that react uses posting to a MessageChannel to yield!
GP is right that just like with garbage where "reduce, reuse, recycle" is the mantra, the first question for optimizing something should be if you need to do the calculation at all.
This is true as well, yeah, but it came off as dismissive of everything too. Personally I prefer information dense interfaces with minimal chrome, but there really is a certain joy when you get to use a well designed and optimized fancy reactive, immersive interface
Since when do images need more than just an <img> tag and a bit of styling?
You'd be surprised how expensive it is to render text, although unless your page is very large you won't see it being slow on modern systems.
Amazing how you are being so down voted, most webpages do utter crap that no one would want the webpages to be doing other then advertisers. Really most things should be text and if we lived in a more cooperative world everything would be easy to parse and manipulate text with some video and images and perhaps various well defined interface types for different services that can be implemented in various ways as to the users liking.
Sure, but there are sites like HN and there are sites like <a href="https://earth.nullschool.net/" rel="nofollow">https://earth.nullschool.net/</a><p>What's your point? Are you saying all animations and rendering are unnecessary?
A handful of comments on an otherwise fairly reasonable article.<p>> <i>When we run into jank like this as developers, the usual reaction is to wonder “is my code slow?” and start picking apart algorithms or looking for wasted computation. In most cases, though, the speed of the code is not the problem. The code isn’t slow. It just happens to be the code that’s holding the main thread.</i><p>Eh, most of the time it <i>is</i> slow, because you chose to use React. React used naively scales <i>very</i> badly. You have to jump through lots of sometimes-fiery hoops to make React… not <i>much</i> slower than some of the alternatives. Memoisation (possibly now via React Compiler) and things like that.<p>> <i>[Diagram with rAF, Style, Layout and Paint attributed to the main thread]</i><p>Paint hasn’t been on the main thread in Firefox since 2017: <a href="https://mozillagfx.wordpress.com/2017/12/05/off-main-thread-painting/" rel="nofollow">https://mozillagfx.wordpress.com/2017/12/05/off-main-thread-...</a><p>Not sure about other browsers. Firefox has generally been the leader in these areas.<p>> <i>[steering cost demo]</i><p>The demo is deeply unsatisfying because the simulations are quite different in a very problematic way: in “all at once” mode, it loses most mouse movements, which radically affects the simulation which is attuned to movement events rather than simulating physics based on a constant tick rate. Without examining it closely, my guess is it’s using pointer events and the browser is coalescing the events because of the blockage and it’s only taking the final state rather than going through all of getCoalescedEvents(). In a simulation like that, if you can’t run it at full speed, you have to decide what to do, and you should do it deliberately, because it may be <i>disastrously</i> wrong. Should you fall over, simplify the simulation by dropping some of the calculations, reduce the tick rate, something else?<p>> <i>The demo below is a markdown editor with a long CHANGELOG open. Building the preview means parsing the entire document (about 2,000 lines) and rebuilding its DOM from scratch, which is far too expensive to run on every keystroke.</i><p>No it doesn’t. This is a clear example of your code being slow, because you’re doing the wrong thing. You want an incremental parser of some kind. Markdown is tolerably well-suited to this kind of thing because for most edits you can just render the current paragraph.<p>The suggestion is bad. “Debounce 300ms” behaviour is obviously worse for small documents.<p>> <i>DOM writes can be batched as well. Appending a hundred nodes in one operation instead of one at a time, or toggling a single class instead of changing style properties individually, turns many changes into one and helps performance. The old technique of assembling an HTML string and assigning it to innerHTML in one shot has the same essence. You gather the writes so the rendering pipeline’s fixed cost is paid once.</i><p>This is simplified far beyond accuracy. parent.append(<i>one_hundred_nodes) and one_hundred_nodes.forEach(node => parent.appendChild(node)) are unlikely to perform particularly differently. Changing style properties individually isn’t </i>that* much worse than toggling a single class (it amounts to rewriting the style attribute a bunch of times, and the CSS parser and serialiser aren’t particularly slow). Building an HTML string and assigning it to innerHTML is better than constructing children manually in some cases, worse in others. The <i>real</i> thing that matters is avoiding triggering layout unnecessarily by things like accessing clientWidth between changes.<p>> <i>Deferring</i><p>The lazy rendering trick used here is very problematic because you still need to know how tall each item is. Plenty has been written about hazards of infinite scrolling, that’s what’s being dealt with here. Now if you can have each item be a <i>fixed</i> height, then progressive rendering has far fewer side-effects. I would also say that switching from Notifications back to Feed and having it take an extra few hundred milliseconds is really not <i>that</i> bad. And that I’m not convinced the approach taken was right anyway, you could often just leave the feed rendered and avoid affecting the gross layout.<p>—⁂—<p>On the presentation of the site itself: this makes <i>no</i> sense:<p><pre><code> .post-content ul {
word-break: break-all;
}</code></pre>
[flagged]
So this is AI slop written? Why would anyone believe I'd want to read AI spam?<p>Also, the issue I see is who controls browsers as much more profound. We need to find a solution here, as the browser is too important to allow private companies to keep mankind hostage.<p>Edit: Wow, and the praise-accounts. Is that new on hackernews?
Honestly... i'm usually on the AI;DR bandwagon but this was actually good :/
I started reading and it immediately sounded like AI, sent it to pangram and it agreed. The amount of posts praising it like it's fuckin oxygen or something ... dead fuckin internet
What signs of slop are people seeing here? Or is it just a knee-jerk reaction to encountering lots of text?<p>I’ve worked in the field for a long time and see a carefully written, correct, calm article. No obvious AÍ tells in wording or sentence construction. It is a bit long - might have been inspired by ciechanow.ski
"and there’s a reason for that"
"The code isn’t slow. It just happens to be the code that’s holding the main thread."
"dealing with the main thread becomes the important part"
"What to remember for now is that holding the main thread for a long time is the same thing as freezing the screen."
"One thing not to misread here is"<p>I realize the author may not write native English, but this is not translation slop, it's AI writing slop.
I think you're overindexing here. There are no obvious traces of AI in those full paragraphs (and I read thousands of lines of AI generated text daily). These are not the usual tells, just decent writing.<p>It reads pretty much like every well-written technical article used to, ten years ago; and scores a 0% likelihood of being AI generated in Quillbot.
Somewhere along the line "machine translation" became conflated with "machine translation + LLM editing"
[flagged]
[flagged]
[flagged]
[flagged]
[flagged]
[flagged]
The javascript web is. Restore the interop with noscript/basic HTML and it will lean towards sanity, something lost a few years ago.
AI;DR – too bad as the content seems to be worthwhile, but then why not take the trouble to write it up yourself. Have it proofread/edited/spruced up all you want afterward, but don't have it do all (or most of) the writing.
Actor Model, dedicated or shared application worker. Full support for multi-window apps. Resolved since 2019. 26000 commits in, and counting. You are welcome!<p><a href="https://github.com/neomjs/neo/blob/dev/learn/benefits/body/OffTheMainThread.md" rel="nofollow">https://github.com/neomjs/neo/blob/dev/learn/benefits/body/O...</a>
It would be better to say that the Browser's Main Thread has been made expensive to run, because browsers have had a bunch of crap piled on them in terms of functionality that is expensive to run.
This mistake gets repeated over and over again, in every single GUI framework of any kind. I don't understand why does it have to be that way.<p>Just use multi-threading. Run each library in a separate thread. Use actors approach to pass data between libraries, application and finally to submit data to update GUI.<p>Using single thread for everything and expecting that developer will create separate threads for heavy work is obvious approach, but it never worked. Developer doesn't care. And user gets inferior experience.