2 min readfrom Machine Learning

We built a tool that installs frameworks like ComfyUI, Ollama, OpenWebUI etc on any cloud GPU in one command and saves your whole setup between sessions [R]

Our take

Introducing swm, the tool that simplifies GPU management by effortlessly installing frameworks like ComfyUI, Ollama, and OpenWebUI with a single command. Tired of wasting valuable time on setup? swm streamlines your workflow by syncing all your custom nodes, models, and configurations to S3-compatible storage. With features like automatic lifecycle management and background auto-sync, it ensures that your workspace is always ready when you are. Discover how swm can enhance your productivity and keep your GPU costs in check.

In the ever-evolving landscape of AI and cloud computing, efficiency is paramount. The introduction of swm, a tool designed to streamline the setup of frameworks like ComfyUI, Ollama, and OpenWebUI on cloud GPU instances, represents a significant leap forward in addressing long-standing hurdles faced by users. Many have experienced the frustration of spending valuable time reinstalling custom nodes, models, and configurations every time they rent a GPU. This common pain point echoes the challenges highlighted in articles such as How to locate the Origin of an Unreferenced Value in a Complex Excel Workbook? and Excel workbook that reads two pasted reports and outputs a categorised breakdown, how would you build it?, where users grapple with the complexities of their tools in pursuit of productivity.

The developers of swm recognized that the traditional methods of managing GPU instances were not only inefficient but also detrimental to the user experience. By leveraging an innovative approach that includes workspace synchronization and lifecycle management, swm effectively eliminates the need for repetitive installations, enabling users to focus on what truly matters: their projects. The tool's ability to save and restore the entire setup, including custom nodes and configurations, is a game changer, particularly for heavy users of ComfyUI and similar platforms. This aligns with the trend of making technology more accessible and user-friendly, resonating with our readers who may have become accustomed to the cumbersome processes of legacy systems.

Furthermore, the inclusion of features like the background auto-sync daemon and lifecycle guard demonstrates a thoughtful understanding of user behavior and needs. Many users, especially those working late into the night, have likely faced unexpected costs due to idle sessions. The lifecycle guard feature not only mitigates these costs but also reinforces the importance of responsible resource management in cloud computing. This critical shift towards user-centric design is vital as the AI landscape continues to expand rapidly, emphasizing the need for tools that empower users rather than hinder them.

As we look to the future, the implications of swm extend beyond just convenience. The tool fosters an environment of exploration and experimentation, encouraging users to delve deeper into AI frameworks without the fear of losing their setups. This could potentially lead to greater innovation and collaboration within the community, as users become more willing to share their custom solutions and configurations. Moreover, the open-source nature of swm encourages contributions from the wider community, ensuring that the tool stays relevant and continuously evolves alongside emerging technologies.

In conclusion, the development of swm is a noteworthy advancement in the field of cloud GPU management. It not only addresses immediate user frustrations but also sets a precedent for future innovations in the space. As AI and cloud technologies continue to intertwine, we must ask ourselves: How can we further empower users to harness the full potential of these tools without the burden of complexity? The answer may lie in continued collaboration and innovation, driving us toward a future where technology truly serves its users.

We kept running into the same problem every time we rented a GPU to run Ollama + OpenWebUI or ComfyUI, we'd spend the first 45 minutes reinstalling everything. Custom nodes, models, configs, all of it. Docker images went stale fast, different providers had different base images, and nothing was truly portable. We got sick of it and built swm.

Here's what it does for ComfyUI users specifically:

swm gpus -g a100 --max-price 2.00 --sort price shows you the cheapest available GPU across RunPod, Vast ai, Lambda, and 7 other providers in one view

swm pod create — spins up an instance on whatever provider you pick

swm setup install comfyui — installs ComfyUI on the pod

From there the main thing is the workspace sync. Your entire setup custom nodes, models, outputs, configs lives in S3-compatible object storage (I use B2). When you're done you run swm pod down and it pushes everything, kills the instance, and next time you spin up on any provider you just pull and everything is exactly where you left it. No more reinstalling 15 custom nodes and redownloading checkpoints every session.

We also built a lifecycle guard because we kept falling asleep mid-session and waking up to dumb bills. It watches GPU utilization and if nothing's happening for 30 minutes (configurable), it saves your workspace and terminates automatically. Has saved us more money than we want to admit lol.

A few other things:

  • Background auto-sync daemon pushes changes every 60 seconds so you don't have to remember to save
  • Tar mode for huge workspaces with tons of small files packs everything into one S3 object instead of 600k individual uploads
  • Also supports vLLM, Ollama, Open WebUI, SwarmUI, and Axolotl if you do more than SD
  • Works with Cursor, Claude Code, Codex, Windsurf if you want your AI agent to manage GPU instances for you

Free, open source, Apache 2.0.

pipx install swm-gpu

Site: https://swmgpu.com GitHub: https://github.com/swm-gpu/swm

Would love feedback from anyone who rents GPUs. What's the most annoying part of your current workflow? We are also looking for contributors to the open source repo and suggestions on new frameworks/extensions to be included. Please share your thoughts

submitted by /u/Tkpf18
[link] [comments]

Read on the original site

Open the publisher's page for the full experience

View original article

Tagged with

#natural language processing for spreadsheets#generative AI for data analysis#Excel alternatives for data analysis#rows.com#real-time data collaboration#financial modeling with spreadsheets#real-time collaboration#no-code spreadsheet solutions#workflow automation#cloud-based spreadsheet applications#cloud-native spreadsheets#GPU#ComfyUI#Ollama#OpenWebUI#docker images#workspace sync#custom nodes#models#configs