M
MercyNews
Home
Back
Real LLM Usage Data: 7-Month Study Reveals Work Habits
Technology

Real LLM Usage Data: 7-Month Study Reveals Work Habits

A comprehensive 7-month study tracking 527 employees reveals the true cost and usage patterns of LLMs at work, challenging subscription models.

Habr11h ago
5 min read
📋

Quick Summary

  • 1A 7-month study tracked 527 employees using LLMs, revealing actual usage patterns rather than analyst predictions.
  • 2Only 416 of 527 employees actively used the tools, with an average of 42 queries per user per month.
  • 3The pay-per-token model proved 8.
  • 4Image generation accounted for 64% of the budget, while text-only usage was remarkably low at 62 rubles per user monthly.

Contents

The Study DesignUsage Patterns & CostsThe Prompt ChallengePractical ImplicationsKey Takeaways

Quick Summary#

A groundbreaking 7-month study has provided the first concrete data on how employees actually use Large Language Models (LLMs) in the workplace. Unlike analyst predictions or vendor presentations, this research is based on direct transaction counts from real user logs.

The study tracked 527 employees from June through December 2025, offering unprecedented insight into practical AI adoption. The findings challenge common assumptions about workplace AI usage and reveal significant cost implications for companies choosing between subscription and pay-per-token models.

The Study Design#

The company decided to lead by example, providing all employees with a clear service to test various market models. The goal was to observe practical productivity gains rather than theoretical benefits. A critical decision was choosing pay-per-token pricing over fixed subscriptions, which proved crucial for accurate measurement.

Researchers tracked 122,346 queries over the seven-month period. The data revealed that 416 users out of 527 actively engaged with the tools at least once. This represents a 79% adoption rate among employees given access to the technology.

"If what, large models show users, but carefully hide the number of requests and traffic. Because it is extremely low there."

The study utilized an aggregator of neural networks that included image generation capabilities. This comprehensive approach allowed for tracking diverse use cases across different AI models, including Gemini 3 Pro Preview, the latest GPT models, and Anthropic's offerings.

"Large models show users, but carefully hide the number of requests and traffic. Because it is extremely low there."
— Study Researcher

Usage Patterns & Costs#

The financial data reveals striking contrasts between pay-per-token and subscription models. Total expenses reached $6,851 (approximately 535,000 rubles) over seven months. This breaks down to 184 rubles per active user monthly—a figure that would be dramatically higher with subscriptions.

If the company had chosen standard $20 monthly subscriptions, costs would have been 8.5 times higher for the same usage level. This highlights the economic inefficiency of flat-rate pricing for variable AI usage patterns.

Key cost breakdown:

  • 64% of budget allocated to image generation
  • Text-only usage cost just 62 rubles per user monthly
  • Annual cost per active user: $184
  • 79% of employees actively used the tools

The data shows that image generation consumed the majority of resources, suggesting visual content creation is a primary workplace AI application. Text-based queries, while valuable, represented a smaller portion of overall usage.

The Prompt Challenge#

A critical factor limiting AI adoption is the prompt formulation barrier. Research by Jakob Nielsen indicates that only 20% of the population can effectively structure prompts for optimal results. This skills gap explains why many employees try AI tools briefly and then abandon them.

The study observed that users who understood how to apply the models to their specific work needs became consistent, returning users. This pattern suggests that training and education are as important as tool access for successful AI integration.

"They try a couple of times and leave."

The 42-query average per user per month indicates moderate engagement rather than heavy reliance. This usage pattern supports the argument for flexible pricing models over fixed subscriptions, as most employees don't require daily AI assistance.

Practical Implications#

The study provides actionable insights for organizations considering AI implementation. First, actual usage differs significantly from vendor projections. Companies should base their budgeting on real transaction data rather than theoretical maximums.

Second, the image generation dominance (64% of budget) suggests that visual AI tools may be more valuable for workplace productivity than text-based models alone. Organizations should consider this when selecting AI platforms.

Third, the cost efficiency of pay-per-token models becomes apparent at scale. For 527 employees, the difference between subscription and usage-based pricing represents substantial savings without sacrificing access to state-of-the-art models.

Finally, the 79% active usage rate demonstrates that when employees are given clear, accessible AI services, adoption follows naturally. The key is providing the right tools with appropriate pricing models that match actual usage patterns.

Key Takeaways#

This 7-month study provides the first concrete evidence of how LLMs are actually used in workplace settings. The data challenges several common assumptions about AI adoption and cost-effectiveness.

Organizations should consider pay-per-token models over subscriptions, as they align costs with actual usage. The 8.5x cost difference represents significant savings for companies with moderate AI requirements.

Training remains crucial for adoption. Only 20% of users can effectively prompt AI systems, suggesting that educational programs should accompany tool deployment.

Finally, the visual AI emphasis (64% of budget on images) indicates that workplace AI value extends beyond text processing. Companies should evaluate their specific needs before committing to any single AI solution.

"They try a couple of times and leave."
— Study Researcher

Frequently Asked Questions

The study revealed that actual workplace AI usage is much lower than often assumed, with employees averaging just 42 queries per month. It also demonstrated that pay-per-token pricing is 8.5 times more cost-effective than standard subscriptions for moderate usage levels.

Image generation accounted for 64% of total spending, suggesting that visual content creation is a primary workplace application for AI tools. This indicates that organizations should consider visual AI capabilities when evaluating productivity solutions.

Research shows only 20% of people can effectively structure AI prompts, creating a skills barrier. Many employees try AI tools briefly and abandon them, highlighting the need for proper training alongside tool access.

Pay-per-token models proved most economical, costing just $184 per active user annually compared to $2,040 for subscriptions. This approach aligns costs with actual usage patterns and avoids paying for unused capacity.

#chatgpt#gemini#claude#искусственный интеллект#нейросети#внедрение#менеджмент

Continue scrolling for more

AI Transforms Mathematical Research and Proofs
Technology

AI Transforms Mathematical Research and Proofs

Artificial intelligence is shifting from a promise to a reality in mathematics. Machine learning models are now generating original theorems, forcing a reevaluation of research and teaching methods.

Just now
4 min
285
Read Article
Roborock Qrevo Curv 2 Flow is $150 off for 9to5Mac readers
Technology

Roborock Qrevo Curv 2 Flow is $150 off for 9to5Mac readers

Anyone who has ever owned a conventional robocleaner with mopping function will know that it takes multiple passes to get a completely clean home. That’s due to a number of factors, including the fact that the mop itself gets dirty during a full-home cycle. The Roborock Qrevo Curv 2 Flow is different, however. It has five features designed to ensure a complete clean in a single pass, starting with a real-time self-cleaning mop … more…

45m
3 min
0
Read Article
AI Investments Yet to Pay Off, CEOs Report
Technology

AI Investments Yet to Pay Off, CEOs Report

Most CEOs are still waiting for AI to deliver clear financial benefits, according to a major new survey. While a small group is seeing returns, many others struggle to move beyond pilot programs.

48m
5 min
6
Read Article
Oracles Bridge Real World Assets to Crypto
Technology

Oracles Bridge Real World Assets to Crypto

Financial data oracles are transforming into critical infrastructure for tokenized real-world assets, with major platforms reporting billions in value.

50m
5 min
6
Read Article
Bitcoin Price Crashes to Zero on Paradex Exchange
Cryptocurrency

Bitcoin Price Crashes to Zero on Paradex Exchange

A technical glitch on the Paradex exchange caused Bitcoin's price to plunge to $0, triggering a massive liquidation cascade and requiring a blockchain rollback.

59m
5 min
6
Read Article
Elon Musk's AI Retirement Plan: Why 94% of Readers Say No
Technology

Elon Musk's AI Retirement Plan: Why 94% of Readers Say No

Elon Musk claims AI will make retirement savings irrelevant. But 94% of readers disagree. Experts warn this is a dangerous message.

1h
5 min
6
Read Article
Tesla Revives Dojo Supercomputer Project
Technology

Tesla Revives Dojo Supercomputer Project

After a year-long hiatus, Tesla is returning to its ambitious Dojo supercomputer project. The renewed focus aims to accelerate Full Self-Driving capabilities through advanced data processing.

1h
5 min
6
Read Article
Marathon-Inspired DualSense Controller Arrives
Technology

Marathon-Inspired DualSense Controller Arrives

The latest limited edition DualSense controller draws inspiration from the Marathon franchise, offering a clean, minimalist design that distinguishes itself from previous releases.

1h
5 min
12
Read Article
Russia's 2025 Budget Deficit Hits 2.6% of GDP
Economics

Russia's 2025 Budget Deficit Hits 2.6% of GDP

The 2025 federal budget closed with a deficit of 2.6% of GDP, matching autumn expectations but exceeding initial plans by a factor of five. Despite falling revenues, the Ministry of Finance managed to curb spending and avoided tapping the National Wealth Fund.

1h
5 min
6
Read Article
Kia EV4 Launches in Australia: Cheaper Than Tesla Model 3
Automotive

Kia EV4 Launches in Australia: Cheaper Than Tesla Model 3

Kia has officially launched the EV4 in the Australian market, entering the competitive electric vehicle space with a strategic pricing move that undercuts the Tesla Model 3.

1h
3 min
14
Read Article
🎉

You're all caught up!

Check back later for more stories

Back to Home