After 5 years in data science, I’m starting to realize most “insights” we deliver are completely ignored. Is this normal?
Our take
In the realm of data science, the struggle to translate complex analyses into actionable business insights is a familiar narrative. A recent discussion by an industry professional highlights a disheartening trend: despite meticulous data preparation and analysis, many insights go unutilized or are selectively acknowledged to reinforce pre-existing beliefs. This phenomenon raises critical questions about the efficacy of data-driven decision-making in contemporary organizations. As the author reflects on their five-year journey through data science, they articulate a growing frustration, one that resonates deeply within the community. For those navigating similar waters, it's essential to consider not only the mechanics of data analysis but also the cultural and organizational frameworks that can either support or hinder effective data utilization. Insights can easily be lost in the noise of gut feelings and established biases, underscoring the need for a shift in how stakeholders engage with data.
The reality is that many organizations still struggle with the transition from intuition-based decision-making to a genuinely data-informed approach. This disconnect can have profound implications for productivity and innovation. When leadership solicits "data-driven decisions" yet operates from a predetermined stance, it diminishes the role of data as a strategic asset. Instead, it transforms the data science function into a mere checkbox activity rather than a vital contributor to organizational strategy. In environments where data should illuminate the path forward, it instead often gathers dust—an unfortunate fate for the countless hours spent cleaning, analyzing, and visualizing data. The challenge lies not just in generating insights but in fostering a culture that values evidence-based decision-making at all levels, as discussed in the Looking for real world comparisons between WALL OSS pi0.6 and OpenVLA[D article.
Furthermore, the tension between data insights and instinctual decision-making may stem from a lack of understanding or appreciation for data's potential among stakeholders. Many professionals in data science have experienced this unnerving reality, where their hard work is met with indifference or skepticism. Addressing this requires more than just better tools or methodologies; it demands a concerted effort to educate decision-makers on the value of data. The rise of AI-driven tools, as highlighted in articles like With Android CLI, Google is Making the Android Toolchain Agent-Friendly, showcases how integrating advanced technology can facilitate a more intuitive understanding of data, making insights more accessible and actionable.
As we look towards the future of data science, it is clear that the field stands at a crossroads. The call for a more integrated approach to data utilization is loud and clear: stakeholders must be engaged and informed, not just presented with findings. This cultural shift will require collaboration between data scientists and decision-makers, ensuring that insights are not only communicated but also understood and acted upon. The exploration of new technologies, frameworks, and educational initiatives can empower organizations to break free from outdated patterns. As we continue to examine the role of data in driving meaningful decisions, one question remains: how can we cultivate a data-centric culture that values insights as integral to strategic direction rather than optional extras? This challenge is one worth watching as the landscape of data science evolves.
I’ve been in data science roles (both analytics and ML) for about 5 years now across a couple of companies. Lately I’ve been feeling a bit burned out because I keep seeing the same pattern:
We spend weeks cleaning data, building dashboards, running statistical analysis, or training models… and then the stakeholders either:
- Say “thanks” and never use it
- Cherry-pick the numbers that support their existing opinion
- Or just completely ignore the findings and go with gut feel anyway
The worst part is when leadership asks for a “data-driven decision” but they’ve already decided what they want to do.
Am I alone in this? Or is this just the reality of data science in most companies?
For those of you who’ve been in the field longer how do you deal with this? Have you found companies where data actually influences decisions at a meaningful level?
Would love to hear honest experiences.
[link] [comments]
Read on the original site
Open the publisher's page for the full experience
Related Articles
- Is working as a data scientist (ML focus) but not getting to interact with the business a common tradeoff, or is my company just weird?Prefacing this with the fact that I've been in this field for 3 years, across 2 different DS roles at my company. My company is huge and I know that often results in specialized roles, however getting a balance of business and technical exposure is much more difficult than I think it should be. My first role was heavily consulting-focused for DS work and very little building for production. I moved to a team with a more technical focus to make sure I didn't lose that skill set and it's very difficult to get work with an actual business stakeholder, and I'm now worried I'm going to get worse at that. I've tried to find ways to work that into the role and to go talk to people to help find projects but the manager does not seem to support that for the team, only for themselves and one of the leads. I really don't feel like this should have to be an either-or dichotomy, especially since so many areas can benefit from data science work but they don't always know where or what they can ask for. Technical skills are important but they mean nothing if you can't work with the business. Is this more common for the stats/ML side of DS work or do I just need to start job searching? submitted by /u/TaterTot0809 [link] [comments]
- Is the ds/ml slowly being morphed into an AI engineer? [D]Agents are amazing. Harnesses are cool. But the fundamental role of a data scientist is not to use a generalist model in an existing workflow; it's a completely different field. AI engineering is the body of the vehicle, whereas the actual brain/engine behind it is the data scientist's playground. I feel like I am not alone in this realisation that my role somehow got silently morphed into that of an AI engineer, with the engine's development becoming a complete afterthought. Based on industry requirements and ongoing research, most of the work has quietly shifted from building the engine to refining the body around it. Economically, this makes sense, as working with LLMs or other Deep Learning models is a capital-intensive task that not everyone can afford, but the fact that very little of a role's identity is preserved is concerning. Most of the time, when I speak to data scientists, the core reply I get is that they are fine-tuning models to preserve their "muscles". But fine-tuning is a very small part of a data scientist's role; heck, after a point, it's not even the most important part. Fine-tuning is a tool. Understanding, I believe, should be the fundamental block of the role. Realising that there are things other than "transformers" and finding where they fit into the picture. And don't even get me started on the lack of understanding of how important the data is for their systems. A data scientist's primary role is not the model itself. It's about developing the model, the data quality at hand, the appropriate problem framing, efficiency concerns, architectural literacy, evaluation design, and error analysis. Amid the AI hype, many have overlooked that much of their role is static and not considered important. AI engineering is an amazing field. The folks who love doing amazing things with the models always inspire me. But somehow, the same attention and respect are no longer paid to the foundational, scientific side of data and modeling in the current industry. I realise it's not always black and white, but it's kind of interesting how the grey is slowly becoming darker by the day. Do you feel the same way? Or is it just my own internal crisis bells ringing unnecessarily? For those of you who have recognized this shift, how are you handling your careers? Are you leaning into the engineering/systems side and abandoning traditional model development? Or have you found niche roles/companies that still value the fundamental data scientist role (data quality, architectural literacy, statistical rigor)? I'd love to hear how you are adapting submitted by /u/The-Silvervein [link] [comments]
- What has been people's experience with "full-stack" data roles?I started my career being a jack of all trades - hired as a data analyst but I had to extract, clean, and then analyze data and even sometimes train models for simple predictions and categorization. That actually led me to become a data engineer but I've spent most of my career working closely with data scientists and trying my best to make their jobs easier by taking away all the preprocessing tasks away from them so they can focus on training, inference MLops, etc. While I claim to have helped them, to be honest DE teams often become a bottleneck and an obstacle. Everything from not being able to provide the data needed to train on time, or how we processed the data was wrong and led to bad performance, or they went live with a model blindly because we couldn't get them the observation data on time for them to analyze accuracy. I'm wondering how much of the data engineering tasks can be automated/vibed away by data scientists. My guess is that in larger companies this won't be the case but I think startups and SMBs want to move fast so they'd rather have data scientists own the whole pipeline. What has been other's experience with this and where is it heading? submitted by /u/uncertainschrodinger [link] [comments]
- Does automating the boring stuff in DS actually make you worse at your job long-termBeen thinking about this a lot lately after reading a few posts here about people noticing their skills slipping after leaning too hard on AI tools. There's a real tension between using automation to move faster and actually staying sharp enough to catch when something goes wrong. Like, automated data cleaning and dashboarding is genuinely useful, but if you're never doing, that work yourself anymore, you lose the instinct for spotting weird distributions or dodgy groupbys. There was a piece from MIT SMR recently that made a decent point that augmentation tends to win over straight replacement in the, long run, partly because the humans who stay engaged are the ones who can actually intervene when the model quietly does something dumb. And with agentic AI workflows becoming more of a baseline expectation in 2026, that intervention skill matters even, more since these pipelines are longer, more autonomous, and way harder to audit when something quietly goes sideways. The part that gets me is the deskilling risk nobody really talks about honestly. It's easy to frame everything as augmentation when really the junior work just disappears and, the oversight expectation quietly shifts to people who are also spending less time in the weeds. The ethical question isn't just about job numbers, it's about whether the people left are, actually equipped to catch failures in automated pipelines or whether we're just hoping they are. Curious if others have noticed their own instincts getting duller after relying on AI tools for, a while, or whether you've found ways to keep that hands-on feel even in mostly automated workflows. submitted by /u/taisferour [link] [comments]