Beyond Market Intelligence/feature selection

feature selection

6 stories filed under feature selection on Beyond Market Intelligence. The newest of them: “Why Feature Selection Deserved the Real Credit for Our Hackathon Win”, “Vote-Based Federated Selection Lets Institutions Choose Features Without Sharing Data”, and “Explore how distance shapes radar classification and what it means for your models”. For a year, we credited supervised binning for our insurance hackathon win. Hospitals, banks, and edge devices can now decide which features matter most without ever sharing raw data. Acme AI is the next-generation, AI-powered spreadsheet platform built to replace Excel and redefine how analysts, data scientists, and enterprise teams work… The list below is every feature selection story on Beyond Market Intelligence, newest first.

Towards Data Science

Why Feature Selection Deserved the Real Credit for Our Hackathon Win

For a year, we credited supervised binning for our insurance hackathon win. But after running four seeds per arm with one shared feature set, the real hero emerged. Feature selection deserved the trophy. It's a humbling reminder that the quiet work often drives the biggest results. If you're curious about why traditional metrics miss meaningful connections, our piece "Discover the hidden connections traditional spreadsheet metrics miss" explores that same theme.

Towards Data Science

Vote-Based Federated Selection Lets Institutions Choose Features Without Sharing Data

Hospitals, banks, and edge devices can now decide which features matter most without ever sharing raw data. Instead of exchanging rows, they exchange votes, a federated selection process that runs directly in NVIDIA FLARE and Flower. It's a practical step toward collaborative AI that respects privacy by design. Institutions keep control while still aligning on what counts. For a deeper look at when collaborative models actually outperform individual ones, our piece on stacking is worth exploring.

Machine Learning

Explore how distance shapes radar classification and what it means for your models

A model that scores higher every time range is added should raise an eyebrow, even when validation looks clean. The concern here is legitimate: radar returns fewer points from distant objects, so the model may be latching onto distance as a proxy for size or class. Stress testing means breaking the data so range distributions differ between training and validation sets. That reveals whether the model generalizes or memorizes the environment. Dropping the feature entirely is also worth exploring if the performance gap remains acceptable.

Simplify Complex Real Estate Data with Linear Discriminant Analysis
Towards Data Science

Simplify Complex Real Estate Data with Linear Discriminant Analysis

A real-estate dataset rarely gives you the luxury of clean, low-dimensional features. When classification tasks start drowning in noise, Linear Discriminant Analysis steps in to cut through the clutter. Applying LDA for dimensionality reduction sharpens class separation rather than just shrinking data. It's a practical reminder that reducing dimensions is about preserving what matters most for prediction. For those ready to push further into advanced modeling, our guide on distributed training offers a natural next step.

Machine Learning

Automated feature engineering evolves with genetic algorithms and open-source simplicity.

Feature engineering remains the quiet battleground where tabular ML models are won or lost. py-evoFE (v0.3.0) takes a different path: genetic algorithms that evolve compact, high-impact feature recipes instead of brute-forcing thousands of noisy combinations. Its hierarchical chaining, Polars-powered vectorization, and multi-fidelity screening are thoughtful engineering. For anyone tired of manual transformations or explosive feature spaces, this library invites exploration. It is practical, open-source, and built for the workflows teams actually use. That is worth a closer look.

Machine Learning

Discover how information theory reveals hidden data structure beyond linear limits.

Standard principal component analysis doesn't just lose accuracy on tangled, non-linear data, it fabricates thousands of phantom dimensions. This work confronts that collapse directly, offering a non-parametric diagnostic that reads pure probability mass instead of spatial distance. The stress test is telling: where PCA inflated 20 true roots into 5,700 false ones, the Entropic Scree lands exactly on 20. That is not a tweak; it is a reframing of how we map intrinsic structure.