2 min readfrom Machine Learning

Machine learning industry job requirements used to be myopic, but now it feels impossible. Anyone else seeing this? [D]

Our take

The machine learning job market is experiencing a perplexing shift. Once focused, requirements now demand an almost superhuman breadth of expertise. Companies, particularly in industrial automation, are seeking candidates with deep knowledge spanning LLMs, robotics, GPU programming, and more—a convergence of highly specialized fields rarely found in a single individual. This trend, while indicative of ambitious goals, raises the question: who *can* realistically fulfill such demanding profiles? Explore related insights in our "[D] Monthly Who's Hiring and Who wants to be Hired?" thread.

The recent Reddit post from /u/NeighborhoodFatCat, questioning the increasingly outlandish job requirements in the machine learning space, resonates with a growing unease in the industry. It’s a sentiment many of us share: the demand for singular individuals possessing encyclopedic knowledge across disparate fields—from large language models and robot dynamics to CUDA GPU programming—is not just unrealistic, it's potentially counterproductive. The author’s analogy to Terence Tao’s observation about the divergent specializations within mathematics is particularly apt. Demanding mastery of such deeply specialized areas within a single candidate feels less like identifying talent and more like searching for a mythical hybrid skillset. This trend echoes concerns raised in our own "[D] Monthly Who's Hiring and Who wants to be Hired?" post, where the sheer volume of requirements, often beyond reasonable expectations, is a recurring theme. The focus seems to have shifted from seeking skilled problem-solvers to chasing an idealized, and frankly unattainable, profile.

The implications extend beyond individual job seekers. This hyper-specialization fosters a siloed approach to AI development, potentially hindering innovation. True breakthroughs often occur at the intersection of disciplines, but demanding deep expertise in *everything* discourages cross-pollination and the formation of diverse teams. It also risks stifling the development of foundational skills. Why invest in learning the fundamentals of, say, reinforcement learning when the job posting explicitly demands pre-existing, "deep" expertise alongside a laundry list of other advanced techniques? This creates a vicious cycle where companies prioritize experience over potential, limiting the talent pool and potentially hindering long-term growth. The desire to build advanced AI agents, as explored in "The fastest way to make an AI agent dangerous #AIagents #AI #agents #automation #futureofwork," highlights the urgency of addressing this talent bottleneck and fostering a more sustainable approach to building these complex systems. It’s clear that simply throwing more requirements at candidates is not a viable strategy.

The shift towards these inflated expectations isn't entirely surprising given the current hype surrounding AI, particularly in areas like robotics and industrial automation. Companies are eager to capitalize on the buzz, leading to unrealistic demands in their hiring practices. However, this approach carries significant risks. Beyond the difficulty of finding qualified candidates, it can also lead to inflated salaries and a culture of burnout within teams. Moreover, it may incentivize individuals to game the system, tailoring their resumes to match the most extensive lists of requirements rather than showcasing genuine expertise and a passion for problem-solving. Our “[D] Self-Promotion Thread” underscores the importance of showcasing practical experience and demonstrable skills—something often lost in the noise of overly complex job descriptions. The focus on “non-academic” experience, as noted in the original post, further contributes to this perception of unattainable ideals.

Ultimately, the industry needs to recalibrate its approach to talent acquisition. Companies should prioritize identifying individuals with strong fundamentals, a willingness to learn, and the ability to collaborate effectively. Focusing on core competencies and emphasizing the potential for growth over a rigid checklist of skills will attract a wider range of talented individuals and foster a more innovative and sustainable AI ecosystem. The question now is whether companies will recognize the inherent limitations of this current “unicorn hunter” approach and embrace a more pragmatic and human-centered approach to building their AI teams. What will it take for the industry to realize that diverse, adaptable teams, rather than mythical all-knowing experts, are the true key to unlocking the full potential of AI?

Today I was just casually browsing some jobs with tags [machine learning] on one of those large popular job-sites. What I am seeing really had me astonished. I want to check with Reddit whether I am hallucinating.

A non-FAANG/non-Deepmind/.../non-Anthropic industrial automation company is hiring people to work on ML for robots (the latest hot topic). Fine. But then I saw their laundry list of job requirements ("you must meet these"), which include:

  • Deep expertise in LLM, VLA, VLM, action transformers
  • Deep expertise in robot dynamic and kinematic modelling (forward, inverse kinematics, trajectory generation, planning), sensor fusion, model predictive control, reinforcement learning
  • Deep expertise in CUDA GPU programming, FPGA hardware acceleration
  • Familiarity with latest software engineering best practices in Python3 and C++23
  • Familiarity in one or more of popular ML framework
  • Have top publications in one or more typical ML and robotics conferences

This is before they go off listing familiarity with a set of standard softwares/simulators, one of which is called RLib, something I've never heard of. Oh and of course they had these 3+, 5+ "non-academic" experience requirements. I forgot which is which.

I was just sitting there confused. Then I checked several more jobs, and it was more of the same (except for some banks).

I remember there was a talk by Terence Tao where he divided mathematician into two camps, the analysts and algebraists. He said even among top mathematicians, it is exceedingly rare to find someone who possess deep expertise in both, as each tends to require a different mode of thinking and each is infinitely deep in terms of specialization, theory and insights.

And here we have a bunch of ML companies treating these infinitely deep academic fields ranging from robot dynamic and kinematic modelling to large language models like some bizarre MMORPG video-game scenario where you need to be a warrior archer warlock who is also a shaman priest mage.

Who are they even hiring, lol?

submitted by /u/NeighborhoodFatCat
[link] [comments]

Read on the original site

Open the publisher's page for the full experience

View original article