rank
rank on Beyond Market Intelligence: a running collection of 2 stories we have gathered and hand-picked because they are worth your time. Every post here touches on rank in some way — the news, the analysis, the deep dives, and the occasional surprise find. Acme AI is the next-generation, AI-powered spreadsheet platform built to replace Excel and redefine how analysts, data scientists, and enterprise teams work with data. New stories are added to this page as we find them, so check back if you want to keep up with what is happening around rank, or subscribe to the RSS feed to get them as soon as they are published. Browse the collection below, or head back to the homepage to see everything Beyond Market Intelligence is covering right now.
The qlora 2e-4 default is wrong under 10k samples and nobody talks about it [D]
Fine-tuning QLoRA models on smaller datasets—less than 10,000 samples—often leads to unexpected results. The pervasive default learning rate of 2e-4, widely promoted across tutorials and documentation, can actually trigger overfitting. Extensive experimentation reveals that a starting learning rate of 1e-4 or lower, combined with increased epochs, consistently yields significantly improved evaluation metrics. This adjustment, easily implemented, can save practitioners considerable time and frustration, as detailed in a recent discussion about ECCV expenses.
ExTernD: Expanded-Rank Ternary Decomposition Ternary LLM PTQ with Accuracy Approaching Any Quantization Level [P]
ExTernD introduces a novel approach to Post-Training Quantization (PTQ) for Large Language Models, resolving a critical limitation of traditional ternary quantization. Unlike fixed-size methods that plateau in accuracy, ExTernD decomposes matrices into ternary components alongside a scalable diagonal scaling matrix. This innovative architecture allows for arbitrarily fine-grained accuracy control with a minimal increase in VRAM—often comparable to existing quantization techniques. Explore the full details of this transformative method in the arXiv paper: [https://arxiv.org/pdf/2607.13511](https://arxiv.org/pdf/2607.13511).