Sign in
Edition of 20:00 CETSaturday, July 25, 2026
325 outlets · 17 languages63 briefings today
Economy & MarketsThursday, July 23, 2026

Inference Overtakes Training as AI’s Infrastructure Race Shifts to Cost Per Token

Data centre workloads have flipped, with inference now dominating, as companies and governments confront the organisational and skills gaps of mass adoption.

The centre of gravity in artificial intelligence infrastructure has moved decisively from building models to running them. At an event in San Francisco, AMD presented data showing that inference—the moment a user interacts with a trained model—now accounts for roughly 60 percent of AI data centre demand, up from 40 percent in 2024, while training has fallen to 40 percent. The company’s new Helios platform, which integrates processors, accelerators and networking, is designed for this reality, and AMD claims it can deliver up to 30 percent more tokens per dollar than Nvidia’s forthcoming Vera Rubin NVL72 in certain configurations. Firms including OpenAI, Meta, Anthropic, Microsoft and Oracle are adopting or evaluating the architecture.

The shift is being accelerated by the rise of agentic AI—systems that consult external tools, access databases and coordinate multiple applications before delivering a result. Each such query multiplies the processing load, making cost efficiency the decisive competitive metric. AMD’s roadmap extends to 2028 with successive GPU generations, while the broader market is expanding rapidly: in Italy, the AI market grew 58 percent in 2024 to €1.2 billion, though Istat data show that high costs, unclear regulation and a lack of skills remain the top barriers, especially for small and medium-sized enterprises. In Indonesia, Google projects that full adoption of generative AI in the creative economy could unlock Rp66 trillion annually, with workers saving an average of 390 hours per year.

Organisations are struggling to align leadership with the pace of adoption. A Microsoft survey of 20,000 users across 10 countries found that only 26 percent believe their leadership is clearly aligned on AI use, while 65 percent fear being left behind. McKinsey data indicate that 71 percent of organisations now use generative AI regularly, yet just 21 percent have significantly redesigned workflows—the factor most strongly correlated with financial returns. The Adecco Group’s chief executive, citing OECD employment figures at record highs, argues that AI is reshaping tasks rather than destroying jobs, though entry-level roles are changing and upskilling is urgent. The World Economic Forum projects a net gain of 78 million jobs globally by 2030, but estimates that 40 percent of core skills will need to change.

Adoption patterns reveal sharp divides. In Brazil, AI is present in 59 percent of federal and state public bodies, reaching 94 percent in the judiciary but only 55 percent in the executive, while among municipalities the rate drops to 22 percent in towns with fewer than 10,000 inhabitants. Italian SMEs use AI at a rate of 15.7 percent, against 53.1 percent for large firms—a gap that has widened by 17 percentage points in two years. In Colombia, an Accenture study found that 74 percent of consumers would trust an AI agent more than a friend to make a purchase on their behalf, forcing brands to optimise for both emotional connection and algorithmic evaluation. Indonesia’s deputy minister for creative economy points to new roles such as prompt engineer, while YouTube’s creative ecosystem contributed over Rp8.4 trillion to Indonesian GDP in 2025.

The next milestone is whether the infrastructure build-out and the promised efficiency gains can be distributed beyond the largest players. AMD’s next GPU generation is scheduled for 2028, and governments from Rome to Jakarta are designing incentive schemes and training programmes. The immediate watchpoint is the capacity of agentic AI to scale without widening the digital divide between large firms and SMEs, and between high- and low-income municipalities.

Divergence — who tells it how
28%Medium
3 blocs · positions from −0.60 to 0.00
CriticalFavorable
INDLATEUR
Divergence between press blocs
Indian & South Asian press−0.60critical
Latin American press0.00neutral
Continental European press0.00neutral
Indian & South Asian press−0.60
Voice

Workers and experts warn: AI threatens jobs, rules are needed now.

Mechanismallarme preventivo

Emphasizes the speed of change and lack of preparedness, using expert testimony to create urgency and a sense of inevitability.

Omission

Does not mention productivity gains or new job creation, which appear in other blocs' materials.

AlarmSkepticism
Latin American press0.00
Voice

Leaders and organizations are lagging: AI advances faster than the capacity to manage it.

Mechanismdivario statistico

Uses statistical data to highlight an objective gap, creating a sense of urgency without alarmism.

Omission

Does not address the impact on workers or job displacement, unlike the Indian bloc.

PragmatismDetachment
Continental European press0.00
Voice

Italian SMEs are struggling, but AI can be an ally if managed well.

Mechanismbilanciamento storico

Contrasts growth data with concrete barriers, and uses a historical argument to normalize change and reduce fear.

Omission

Does not mention mass layoff risks or the need for urgent policy, unlike the Indian bloc.

PragmatismSkepticismSplit voices

Broaden your view

Read more
Breaking
D4vd Hearing Reveals Abortion Texts and Chainsaw Evidence as Murder Case Builds·A Recorded Plea, a Brutal Murder: True Crime's New Global Grip on Netflix·Rival Blocs Register Contested Lists for Peru’s Restored Congress Leadership·Murder of Pregnant Woman in Colombia Prompts Regional Alarm over Violence Against Women·Zelensky: Russia Seeks 30,000 North Korean Troops and Prepares New Mobilisation·Kyiv Detains Organiser After Deadly Russian Strike on Weapons Expo·Iran’s Revolutionary Guard Says It Destroyed 11 US Aircraft, Citing Over 200 American Casualties·Messi Reappears at Family Club in Rosario After World Cup Defeat·D4vd Hearing Reveals Abortion Texts and Chainsaw Evidence as Murder Case Builds·A Recorded Plea, a Brutal Murder: True Crime's New Global Grip on Netflix·Rival Blocs Register Contested Lists for Peru’s Restored Congress Leadership·Murder of Pregnant Woman in Colombia Prompts Regional Alarm over Violence Against Women·Zelensky: Russia Seeks 30,000 North Korean Troops and Prepares New Mobilisation·Kyiv Detains Organiser After Deadly Russian Strike on Weapons Expo·Iran’s Revolutionary Guard Says It Destroyed 11 US Aircraft, Citing Over 200 American Casualties·Messi Reappears at Family Club in Rosario After World Cup Defeat·
Upd. 06:54 PM6 languages · 10 outlets
PreviousEconomy & MarketsNext
10 outlets|6 languages|3 min read
Thursday, July 23, 2026

Inference Overtakes Training as AI’s Infrastructure Race Shifts to Cost Per Token

Data centre workloads have flipped, with inference now dominating, as companies and governments confront the organisational and skills gaps of mass adoption.

The centre of gravity in artificial intelligence infrastructure has moved decisively from building models to running them. At an event in San Francisco, AMD presented data showing that inference—the moment a user interacts with a trained model—now accounts for roughly 60 percent of AI data centre demand, up from 40 percent in 2024, while training has fallen to 40 percent. The company’s new Helios platform, which integrates processors, accelerators and networking, is designed for this reality, and AMD claims it can deliver up to 30 percent more tokens per dollar than Nvidia’s forthcoming Vera Rubin NVL72 in certain configurations. Firms including OpenAI, Meta, Anthropic, Microsoft and Oracle are adopting or evaluating the architecture.

The shift is being accelerated by the rise of agentic AI—systems that consult external tools, access databases and coordinate multiple applications before delivering a result. Each such query multiplies the processing load, making cost efficiency the decisive competitive metric. AMD’s roadmap extends to 2028 with successive GPU generations, while the broader market is expanding rapidly: in Italy, the AI market grew 58 percent in 2024 to €1.2 billion, though Istat data show that high costs, unclear regulation and a lack of skills remain the top barriers, especially for small and medium-sized enterprises. In Indonesia, Google projects that full adoption of generative AI in the creative economy could unlock Rp66 trillion annually, with workers saving an average of 390 hours per year.

Organisations are struggling to align leadership with the pace of adoption. A Microsoft survey of 20,000 users across 10 countries found that only 26 percent believe their leadership is clearly aligned on AI use, while 65 percent fear being left behind. McKinsey data indicate that 71 percent of organisations now use generative AI regularly, yet just 21 percent have significantly redesigned workflows—the factor most strongly correlated with financial returns. The Adecco Group’s chief executive, citing OECD employment figures at record highs, argues that AI is reshaping tasks rather than destroying jobs, though entry-level roles are changing and upskilling is urgent. The World Economic Forum projects a net gain of 78 million jobs globally by 2030, but estimates that 40 percent of core skills will need to change.

Adoption patterns reveal sharp divides. In Brazil, AI is present in 59 percent of federal and state public bodies, reaching 94 percent in the judiciary but only 55 percent in the executive, while among municipalities the rate drops to 22 percent in towns with fewer than 10,000 inhabitants. Italian SMEs use AI at a rate of 15.7 percent, against 53.1 percent for large firms—a gap that has widened by 17 percentage points in two years. In Colombia, an Accenture study found that 74 percent of consumers would trust an AI agent more than a friend to make a purchase on their behalf, forcing brands to optimise for both emotional connection and algorithmic evaluation. Indonesia’s deputy minister for creative economy points to new roles such as prompt engineer, while YouTube’s creative ecosystem contributed over Rp8.4 trillion to Indonesian GDP in 2025.

The next milestone is whether the infrastructure build-out and the promised efficiency gains can be distributed beyond the largest players. AMD’s next GPU generation is scheduled for 2028, and governments from Rome to Jakarta are designing incentive schemes and training programmes. The immediate watchpoint is the capacity of agentic AI to scale without widening the digital divide between large firms and SMEs, and between high- and low-income municipalities.

Divergence — who tells it how
28%Medium
3 blocs · positions from −0.60 to 0.00
CriticalFavorable
INDLATEUR
Divergence between press blocs
Indian & South Asian press−0.60critical
Latin American press0.00neutral
Continental European press0.00neutral
Indian & South Asian press−0.60
Voice

Workers and experts warn: AI threatens jobs, rules are needed now.

Mechanismallarme preventivo

Emphasizes the speed of change and lack of preparedness, using expert testimony to create urgency and a sense of inevitability.

Omission

Does not mention productivity gains or new job creation, which appear in other blocs' materials.

AlarmSkepticism
Latin American press0.00
Voice

Leaders and organizations are lagging: AI advances faster than the capacity to manage it.

Mechanismdivario statistico

Uses statistical data to highlight an objective gap, creating a sense of urgency without alarmism.

Omission

Does not address the impact on workers or job displacement, unlike the Indian bloc.

PragmatismDetachment
Continental European press0.00
Voice

Italian SMEs are struggling, but AI can be an ally if managed well.

Mechanismbilanciamento storico

Contrasts growth data with concrete barriers, and uses a historical argument to normalize change and reduce fear.

Omission

Does not mention mass layoff risks or the need for urgent policy, unlike the Indian bloc.

PragmatismSkepticismSplit voices

This story appeared in

10 outlets · 6 languages

Broaden your view

From Geopolitics & Politics

Trump jokes on third term and revives press attacks at rescheduled correspondents’ dinner

7 languages · 26 outlets

From Technology

Musk Admits Political Overreach in Efficiency Drive, Insists Cuts Caused 'Zero' Deaths

3 languages · 5 outlets

From Science & Health

Gene Therapies Advance Amid Global Scramble for Access

4 languages · 6 outlets

Read more