Unsloth Studio

(unsloth.ai)

101 points by brainless7 hours ago

7 comments

  • trvz1 hour ago
    Installing with pip on macOS is just not an acceptable option. It&#x27;ll mess up your system just like npm or gem.<p>This needs to go on homebrew or be a zip file with an app for manual download.
    • DIVx01 hour ago
      Agree with you, a slightly more maintainable way to use it now is with &quot;uv&quot; or mise. i&#x27;ve used `uv tool install unsloth` for this one.
      • danielhanchen49 minutes ago
        Yep - uv is a better fit - and you get parallel downloads as well
    • danielhanchen51 minutes ago
      Hey we&#x27;re still working on making installation much better - appreciate the feedback!<p>We come from Python land mainly so packaging and distribution is all very new to us - homebrew will definitely be next!
    • beernet1 hour ago
      Agreed, feels like a vibe-coded frontend based on already given backend features.<p>Also, never saw any Unsloth related software in production to this day. Feels strongly like a non-essential tool for hobby LLM wizards.
      • danielhanchen46 minutes ago
        You would be surprised - we&#x27;re the 4th largest independent distributor of LLMs in the world - and nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - we for example collab directly with large labs to release models with bug fixes.
      • airspresso18 minutes ago
        Unsloth is providing the best and most reliable libraries for finetuning LLMs. We&#x27;ve used it for production use-cases where I work, definitely solid.
    • bityard59 minutes ago
      I recommend installing uv first, then you can install any Python code you want inside a virtual environment to keep it isolated from the rest of the system.
      • danielhanchen50 minutes ago
        Yep uv pip install unsloth works as well - we probably should have just made that the default - in fact Unsloth makes its own venv using UV if you have it dynamically
    • Computer01 hour ago
      On my linux systems I use venv to not affect system packages, is that not an option for this situation?
    • gessha55 minutes ago
      I know the whole package system across most languages is a dumpster fire but for Python, uv solves a lot of problems.<p>uv init<p>uv add unsloth<p>uv run main.py % or whatever
      • danielhanchen40 minutes ago
        Yep UV is fantastic - should have just that default!
  • car35 minutes ago
    Tried to build from source on MacOS, but got this error:<p><pre><code> (base) unsloth git:(main) unsloth studio setup ╔══════════════════════════════════════╗ ║ Unsloth Studio Setup Script ║ ╚══════════════════════════════════════╝ Node v25.8.1 and npm 11.11.0 already meet requirements. Skipping nvm install. Node v25.8.1 | npm 11.11.0 npm run build failed (exit code 2): &gt; unsloth-theme@0.0.0 build &gt; tsc -b &amp;&amp; vite build src&#x2F;features&#x2F;chat&#x2F;shared-composer.tsx(366,17): error TS6133: &#x27;status&#x27; is declared but its value is never read.</code></pre>
    • danielhanchen19 minutes ago
      Hey will check ASAP and fix - sorry about that
  • zokier56 minutes ago
    What is unsloths business&#x2F;income? They seem to be publishing lot of stuff for free, with no clear product to back them?
  • car38 minutes ago
    Can Unsloth Studio use already downloaded models?
  • meowokIknewit2 hours ago
    The GUI for the fine tuning looks interesting. Hopefully this leads to a lot of new custom models
    • danielhanchen45 minutes ago
      Thank you! We&#x27;re still iterating on it so any suggestions are welcome!
  • jawerty3 hours ago
    Excited to use this been using unsloth models for the past couple years
    • danielhanchen45 minutes ago
      Thank you for your continued support - we have much more planned for it!
  • saberience1 hour ago
    Who&#x27;s the intended user for this?<p>Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?<p>Is it a competitor to LMStudio?
    • danielhanchen29 minutes ago
      You would be surprised! Nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - the UI was primarily a culmination of pain points folks had when doing either training or inference!<p>We&#x27;re complimentary to LM Studio - they have a great tool as well!
    • huydotnet41 minutes ago
      you just answered your own question, &quot;AI hobbyists who has 4090 at home&quot;. And they are pretty much targeted user of Unsloth since the start.
      • danielhanchen28 minutes ago
        Actually the opposite haha- more than 50% of our audience comes from large organizations eg Meta, NASA, the UN, Walmart, Spotify, AWS, Google, and the list goes on!
    • lastdong1 hour ago
      From the homepage looks like it: “Training: Works on NVIDIA GPUs: RTX 30, 40, 50, Blackwell, DGX Spark&#x2F;Station etc.”
    • mlnj1 hour ago
      I am unaware lm studio is being used for fine tuning. I believe it only does inference.<p>Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I&#x27;m just lazy.<p>Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I&#x27;ll have to wait for AMD ROCm support.
      • danielhanchen17 minutes ago
        Thanks! We do have normal AMD support for Unsloth but yes the UI doesn&#x27;t support it just yet! Will keep you posted!