Getty Images; Alyssa Powell/BIBosses everywhere are scrambling to figure out if and how to grade their employees' AI use.At Gusto, a platform for human resources, managers slot workers into one of five AI archetypes during quarterly reviews. They may begin as "observers," those who aren't yet using AI on their own. "Integrators" have made AI part of their regular work day and see "better outcomes consistently" as a result. The most advanced are "amplifiers," who find new ways to use AI and share what they've learned with coworkers.The intent is less to rule by the carrot or the stick, and more to standardize how the company implements an emerging technology, says Scott Helmes, Gusto's chief people officer. "We want to be able to have a coaching conversation," he tells me. The next step is to look more directly at the impact workers make with AI. "The introduction of this, I think, has really helped us have a consistent way to talk about AI fluency across the organization."The employee AI grading rubric started with tokenmaxxing, but the backlash quickly arrived. Companies like Amazon and Uber tried leaderboards for tracking AI use, but have since pivoted away from maxing out AI. Duolingo walked back plans to evaluate AI use in employee performance reviews. Meta faces a lawsuit from laid-off workers alleging that the company used AI to rank workers' productivity, including how often they used AI tools, and then singled out lower performers for cuts without considering medical and parental leaves as reasons for lower usage. The company has denied the allegations.Workplaces can't take macro leaps of AI adoption until they sort out what's happening on the micro level and individual workers' desks as they corral agents and chatbots. Attempts to suss out those who shun AI from the superusers has increasingly become part of performance reviews, but with many companies still looking to unearth AI's potential, that can leave workers clambering to meet expectations that managers haven't fully formed. "There's a lot of drive to push that responsibility onto frontline workers in a way that's not particularly fair," says Richard Landers, a professor of industrial-organizational psychology at the University of Minnesota. Some companies have made the false equivalence of rewarding AI use even if it doesn't achieve the goal of better work, he says. "You can't really reward AI performance because we don't really know what that even is yet, and it also looks very different for different jobs."AI might be a box to check in your next performance review. But when success with the technology remains rare and subjective, it's an elusive category to ace.Companies have largely dropped subscriptions and logins to AI systems onto workers and urged them to figure out how to best use them. The lack of training and brute force adoption has led to a deluge of workslop, security risks, and a confusing sprawl of sprawl workflows. Yet, managers increasingly want to evaluate how people use AI. General Assembly, the tech skills training provider, found in a recent survey of 500 business leaders in the US and UK that nearly half had incorporated AI into employee reviews, looking particularly at reports of AI tool usage, improvements to performance attributable to AI, and anecdotes about improved efficiency.Much of that is subjective, and unlike past innovations where companies bought software for specific use cases and trained workers on it, there's an expectation at some companies that the workers lead.Without strict quantitative benchmarks like tokens spent, lines of code generated, prompts written, and agents deployed, many evaluate workers' AI use by tracking that they're doing more of what they did before. Stefan Camilleri, vice president of engineering at the software company Typeform, says he asks his engineers: "Now that I've given you a new tool, how much faster are you doing it?" But speed alone doesn't cut it. "I'm expecting more ambitious output from fewer people." Shensi Ding, the cofounder and CEO of the AI software company Merge, says she reviews employees based on the quality of their AI use. For example, someone in accounting automated payment tracking and increased the team's productivity, which Ding saw as highly effective. The highest praise comes for those who have figured out a good use case and passed it along to their colleagues. "If you're teaching other people, then that's a level above what we would expect, and it's such a big impact and compounds over time in the business that people are really rewarded for that," Ding says.For startups, there's pressure to do more with fewer people equipped with AI, but large companies are also now closely evaluating workers' AI use. Meta announced to employees late last year that it would add "AI driven impact" as a core part of their performance review process. Accenture reportedly began monitoring AI logins when considering workers for top-level promotions earlier this year. My
Don't miss out on breaking stories and in-depth articles.