Artificial intelligence is changing jobs faster than many organizations can redefine what good performance looks like. New research from talent-management company Talogy finds that 78% of surveyed HR and talent leaders face challenges assessing AI skills, while only 38% feel very prepared to adapt traditional job descriptions and career paths for an AI-enabled workplace. The findings point to a growing HR technology problem: organizations increasingly need to measure how people work with AI, not simply whether they know how to operate an AI tool.

AI Is Changing Jobs Faster Than HR Can Measure the Skills Behind Them

The enterprise AI conversation has largely focused on technology: which models to deploy, which copilots to buy and which workflows to automate.

For human resources teams, a more fundamental question is emerging: How should companies measure the capabilities employees need when AI becomes part of the job?

New research from Talogy suggests many organizations have not yet answered it.

The study surveyed 207 senior HR leaders, talent acquisition managers and learning and development professionals across the United States and United Kingdom, covering sectors including manufacturing, retail, financial services and fintech, healthcare, technology, and government.

The findings reveal a disconnect between AI adoption and the ability of HR organizations to assess AI-related capability.

Some 78% of respondents said they face challenges assessing AI skills. Only 38% said they feel “very prepared” to adapt traditional job descriptions and career paths for an AI-enabled workplace.

That gap matters because AI is increasingly becoming part of existing jobs rather than simply creating a separate category of “AI jobs.”

A financial analyst may use generative AI to interpret data. A recruiter may use AI to screen candidates or draft communications. A manufacturing manager may rely on predictive analytics. A customer-service employee may work alongside an AI assistant.

In each case, technical tool knowledge is only one part of the capability equation.

AI Fluency Is Becoming a Broader Workforce Skill

Talogy’s research suggests HR leaders increasingly view AI fluency as a combination of technical and human capabilities.

Among respondents, AI tool proficiency ranked highest at 48%, followed by data literacy at 43%, adaptability at 42%, problem-solving at 40%, and judgment and critical thinking at 36%.

That ranking is significant because most of the capabilities are transferable skills rather than specific software competencies.

An employee can learn how to operate a particular AI assistant relatively quickly. Understanding whether its output is reliable, recognizing missing information, asking useful questions and deciding when human intervention is necessary are harder capabilities to teach—and harder to measure.

The distinction is particularly important as enterprises move from experimentation toward more autonomous AI systems.

A worker interacting with a generative AI chatbot requires one level of oversight. An employee supervising an AI agent that can execute tasks, access enterprise systems or make recommendations affecting customers may require considerably stronger judgment and governance skills.

For HR departments, that means an AI-skills framework cannot simply become a list of software certifications.

Traditional Talent Frameworks Have a Context Problem

Talent assessment is already widespread.

Talogy’s study found that 87% of organizations use talent assessment frameworks for most or all roles.

But respondents also identified shortcomings. The most common complaint was that frameworks are too generic and fail to provide role-specific insights. Respondents also cited limited or missing consideration of transferable skills.

That weakness becomes more consequential when AI changes the composition of individual jobs.

A generic assessment might measure communication, leadership or analytical ability. But the real question for an AI-enabled role may be how those capabilities interact.

Consider a marketing manager using AI to generate campaign strategies. Tool proficiency matters, but so does the ability to evaluate generated ideas, understand customer data, recognize unsupported claims and make strategic decisions.

The capability is therefore multidimensional.

HR technology needs to capture not only what skills someone possesses, but how those skills work together in a specific job context.

The Rise of Skills-Based Talent Management

This is accelerating a broader shift toward skills-based workforce management.

Platforms from Workday, SAP, Oracle, Microsoft and LinkedIn are increasingly connecting skills data with recruiting, learning, workforce planning and internal mobility.

The objective is to move beyond static job descriptions.

Instead of defining a position primarily through credentials and responsibilities, skills-based talent management attempts to identify the capabilities required to perform the work—and determine which employees already possess them, which can be developed and which may need to be recruited.

AI adds another layer to that model.

Job descriptions that remain unchanged for years may become poor representations of actual work. Career paths can also change as automation takes over routine activities and employees spend more time on analysis, judgment, collaboration and oversight.

That creates pressure on HR teams to continually update their skills architecture.

Assessment Technology Must Become More Role-Specific

Talogy’s research points toward demand for assessment systems that can evaluate AI readiness while adapting to individual roles.

Respondents identified three priorities as non-negotiable: scientifically validated methodologies, evidence of business impact and integration with existing HR technology stacks.

That combination reflects the procurement reality facing enterprise HR departments.

HR leaders are increasingly wary of standalone AI tools that create another data silo. A talent assessment system needs to connect with applicant tracking, human capital management, learning and development, performance management and workforce planning platforms.

The science also matters.

If an assessment is used to make hiring, promotion or development decisions, organizations need evidence that it measures the capabilities it claims to measure and that the results have practical relevance.

That becomes especially important for AI fluency, where the definition itself is still evolving.

AI Could Make Skills Measurement More Dynamic

AI may ultimately help solve some of the assessment problem it is creating.

Instead of evaluating employees through static questionnaires alone, future systems could combine simulations, work samples, behavioral assessments and contextual scenarios to observe how people make decisions alongside AI.

A candidate might be presented with an AI-generated recommendation containing subtle errors and asked to evaluate it. A manager could be assessed on how effectively they use AI while maintaining accountability for the final decision.

Those scenarios measure something traditional software-proficiency tests cannot: human judgment in an AI-enabled workflow.

The challenge is ensuring such systems remain valid, explainable and appropriately governed.

For HR leaders, the objective should not be to quantify every interaction with AI. It is to identify the capabilities that materially affect performance and determine how those capabilities can be developed.

The Enterprise Workforce Is Moving Toward Human-AI Collaboration

The implications extend beyond talent acquisition.

Learning and development teams will need to teach employees how to work effectively with AI. Managers will need new approaches to performance evaluation. Workforce planners will need to understand which jobs are being augmented, redesigned or automated.

HR technology vendors, meanwhile, will need to incorporate AI skills into existing talent architectures without turning every job into an “AI role.”

The findings from Talogy point to an emerging reality: AI adoption is becoming a workforce-design challenge as much as a technology challenge.

Companies that can identify the human capabilities that complement AI will have a better chance of translating technology investment into productivity and business value.

For HR leaders, the priority is moving beyond the question of whether employees can use AI.

The more important question is whether they can use it responsibly, critically and effectively within the context of their role.

Market Landscape

The HR technology market is moving toward skills-based talent management and continuous workforce intelligence.

Several trends are converging:

• Skills intelligence: Organizations are mapping capabilities rather than relying exclusively on job titles and credentials.
• AI fluency: Companies increasingly need to assess employees’ ability to work safely and productively with AI.
• Role-specific assessments: Generic competency frameworks are giving way to more contextual evaluations.
• Internal mobility: Skills data can help organizations identify employees who can transition into emerging roles.
• Integrated HR stacks: Assessment, learning, recruiting, performance and workforce-planning systems increasingly need to share skills data.

Major HR technology ecosystems including Workday, SAP SuccessFactors, Oracle, Microsoft and LinkedIn are positioned around this broader skills-based transformation.

For enterprise buyers, the competitive question is shifting from “Does this platform assess skills?” to “Can it identify the capabilities that matter for this specific role, demonstrate validity and connect those insights to workforce decisions?”

That is particularly important as AI changes job responsibilities faster than conventional workforce-planning cycles.

Top Insights

• AI adoption is moving faster than skills assessment, with 78% of surveyed HR leaders reporting challenges measuring AI capabilities across increasingly AI-enabled roles.
• AI fluency requires more than tool proficiency, as data literacy, adaptability, problem-solving and critical thinking increasingly determine effective human-AI collaboration.
• Traditional competency frameworks face growing pressure, with organizations seeking role-specific assessments that capture transferable skills and contextual performance.
• Skills-based talent management is becoming strategic HR infrastructure, connecting assessment, recruiting, learning, career development and workforce planning around measurable capabilities.
• AI-ready assessment platforms must integrate with HR technology stacks, while providing scientifically validated methods and evidence that assessments improve business outcomes.

Join thousands of HR leaders who rely on HRTechEdge for the latest in workforce technology, AI-driven HR solutions, and strategic insights