Retraining vs Fine-tuning or Transfer Learning? [D]
Our take
Hi!
I am currently working on a project that is basically an e-commerce clickstream data. We take in data, find the intent of the user(XGboost) and price sensitivity(Xgboost), segregate the user in different segments based on their purchasing intent or their research or price behaviour(Xgboost), recommend the benefit like discount or free shipping(Linucp or Thompson sampling), etc.
My question is this - when the data comes in daily to train our models, is it better to retrain the models from scratch or train our models on initial data and keep on fine-tuning everyday when the new data comes in for that day?
Retraining won't be on the whole data. I will take 100% samples from last 30 days, 50% from last 30 to 90, 10% from 90 to 180 days so to avoid the accumulation of training data and keeping the latest trends.
Also, is there any resource where I can learn this better?
Thank you for all the help.
[link] [comments]
Read on the original site
Open the publisher's page for the full experience
Related Articles
- Retraining strategy with evolving classes + imbalanced labels?Hi all — I’m looking for advice on the best retraining strategy for a multi-class classifier in a setting where the label space can evolve. Right now I have about 6 labels, but I don’t know how many will show up over time, and some labels appear inconsistently or disappear for long stretches. My initial labeled dataset is ~6,000 rows and it’s extremely imbalanced: one class dominates and the smallest class has only a single example. New data keeps coming in, and my boss wants us to retrain using the model’s inferences plus the human corrections made afterward by someone with domain knowledge. I have concerns about retraining on inferences, but that's a different story. Given this setup, should retraining typically use all accumulated labeled data, a sliding window of recent data, or something like a recent window plus a replay buffer for rare but important classes? Would incremental/online learning (e.g., partial_fit style updates or stream-learning libraries) help here, or is periodic full retraining generally safer with this kind of label churn and imbalance? I’d really appreciate any recommendations on a robust policy that won’t collapse into the dominant class, plus how you’d evaluate it (e.g., fixed “golden” test set vs rolling test, per-class metrics) when new labels can appear. submitted by /u/fleeced-artichoke [link] [comments]
- Best technique for training models on a sample of data?Due to memory limits on my work computer I'm unable to train machine learning models on our entire analysis dataset. Given my data is highly imbalanced I'm under-sampling from the majority class of the binary outcome. What is the proper method to train ML models on sampled data with cross-validation and holdout data? After training on my under-sampled data should I do a final test on a portion of "unsampled data" to choose the best ML model? submitted by /u/RobertWF_47 [link] [comments]
- [R] Fine-tuning services reportIf you have some data and want to train or run a small custom model but don't have powerful enough hardware for training, fine-tuning services can be a good solution. Once training (requiring more resources than inference) is done, the custom model can then run locally. For larger models, there is also (for some providers) the option to run inference with the custom model using their services. To get a better overview of the currently existing landscape, I did some benchmarking and experiments on cost, speed and user experience. The space is moving quickly, with new providers arriving even while I was testing, so what’s “best” really depends on your use case. For function-calling specifically, Nebius had some useful capabilities that made iteration more efficient. Full write-up with details, methodology, and comparisons here: https://vintagedata.org/blog/posts/fine-tuning-as-service submitted by /u/ynckdrt [link] [comments]