M
MercyNews
Home
Back
Quadric Shifts AI from Cloud to On-Device
Technology

Quadric Shifts AI from Cloud to On-Device

TechCrunch3h ago
3 min read
📋

Key Facts

  • ✓ Quadric's technology enables the deployment of AI models directly onto devices rather than relying on remote cloud servers.
  • ✓ The company's programmable chips are specifically engineered to handle fast-changing AI models with local processing power.
  • ✓ This on-device approach offers significant advantages in terms of data privacy, reduced latency, and operational efficiency.
  • ✓ Quadric's solution is being adopted by both commercial companies and government entities seeking more control over their AI infrastructure.
  • ✓ The shift to on-device inference represents a broader industry trend moving away from centralized cloud computing for certain AI tasks.

In This Article

  1. The On-Device AI Revolution
  2. What is On-Device Inference?
  3. Why the Shift Matters
  4. The Technology Behind the Shift
  5. A New Era for AI Deployment
  6. Looking Ahead

The On-Device AI Revolution#

The artificial intelligence landscape is undergoing a fundamental transformation. For years, the dominant model has been cloud-based processing, where massive data centers handle the computational heavy lifting for AI applications. However, a new paradigm is emerging, and Quadric is at the forefront of this shift.

The company is pioneering the move toward on-device inference, a technology that allows AI models to run directly on local hardware. This approach promises to make AI faster, more private, and more efficient by eliminating the constant need to communicate with distant servers.

Quadric's mission is to empower organizations—from large corporations to government agencies—by providing the tools to build and deploy their own programmable AI chips. These chips are designed to handle the complex, rapidly evolving models that define modern AI, all within the device itself.

What is On-Device Inference?#

On-device inference represents a significant departure from traditional cloud AI. Instead of sending data to a remote server for processing, the AI model runs directly on the chipset within the device itself. This local execution is crucial for applications requiring immediate responses and minimal latency.

Quadric's technology is specifically engineered to manage this task effectively. Their chips are not just powerful processors; they are programmable, offering flexibility that fixed-function hardware cannot match. This programmability is essential for adapting to the fast-changing models that characterize the AI field, where algorithms are constantly being updated and refined.

The benefits of this approach are multifaceted. Key advantages include:

  • Enhanced data privacy by keeping sensitive information local
  • Reduced latency for real-time applications
  • Lower operational costs by minimizing cloud dependency
  • Increased reliability in environments with poor connectivity

Why the Shift Matters#

The transition from cloud to on-device AI is not merely a technical adjustment; it is a strategic response to the evolving demands of the digital world. As AI models become more sophisticated and widespread, the limitations of cloud-only processing become increasingly apparent. Latency and bandwidth constraints can hinder performance, while concerns over data sovereignty and security are paramount for many organizations.

Quadric's focus on programmable on-device chips addresses these challenges directly. By enabling local processing, they provide a solution that is both secure and efficient. This is particularly vital for sectors like government and enterprise, where control over data and infrastructure is non-negotiable.

Quadric aims to help companies and governments build programmable on-device AI chips that can run fast-changing models locally.

This capability allows for a new class of AI applications that were previously impractical due to the limitations of cloud computing. From autonomous systems to smart infrastructure, the ability to process complex AI tasks on-site opens up a world of possibilities.

The Technology Behind the Shift#

At the heart of Quadric's offering is a unique blend of hardware and software innovation. The company provides a comprehensive platform that allows clients to design, program, and deploy their own custom AI chips. This end-to-end solution is critical for organizations looking to tailor their AI infrastructure to specific needs.

The programmability of the chips is a key differentiator. Unlike application-specific integrated circuits (ASICs) that are hardwired for a single task, Quadric's architecture can be adapted to support new and evolving AI models. This future-proofing is essential in a field where today's state-of-the-art model can be obsolete tomorrow.

By offering a flexible, scalable platform, Quadric lowers the barrier to entry for advanced AI deployment. Organizations no longer need to rely solely on the monolithic infrastructure of major cloud providers. Instead, they can build and control their own AI hardware, optimizing for performance, cost, and security according to their unique requirements.

A New Era for AI Deployment#

The implications of this technological shift extend far beyond individual companies. The move toward on-device AI represents a broader decentralization of computational power. As more intelligence moves to the edge—from smartphones and cameras to industrial sensors and vehicles—the entire ecosystem of AI development and deployment is being redefined.

Quadric is positioned as a key enabler of this new era. By providing the tools for programmable on-device inference, they are helping to democratize access to powerful AI capabilities. This empowerment allows for innovation at a pace and scale that cloud-dependent models cannot always match.

The future of AI will likely be a hybrid one, blending the strengths of cloud computing for training and large-scale analysis with the agility and privacy of on-device inference for real-world application. Quadric's work is paving the way for this balanced, efficient, and secure future.

Looking Ahead#

The journey from cloud-centric to on-device AI is well underway, and Quadric is leading the charge. Their focus on programmable chips for local inference is a direct response to the industry's most pressing challenges: speed, privacy, and flexibility.

As AI continues to permeate every aspect of technology and society, the demand for efficient, secure processing will only grow. Quadric's approach offers a compelling solution, enabling organizations to harness the full power of AI without being tethered to the cloud.

The shift is more than a trend; it is a fundamental rethinking of how we build and interact with intelligent systems. With companies like Quadric at the helm, the future of AI is not just intelligent—it's local, responsive, and securely in the hands of its users.

#Startups#AI#Exclusive#AI chip#Quadric

Continue scrolling for more

AI Transforms Mathematical Research and Proofs
Technology

AI Transforms Mathematical Research and Proofs

Artificial intelligence is shifting from a promise to a reality in mathematics. Machine learning models are now generating original theorems, forcing a reevaluation of research and teaching methods.

Just now
4 min
346
Read Article
Reid Hoffman: Why AI Pilots Fail Companies
Technology

Reid Hoffman: Why AI Pilots Fail Companies

LinkedIn cofounder Reid Hoffman warns that most companies are approaching AI adoption incorrectly. Instead of pilot projects, he argues the real wins come from automating the 'unglamorous layer' of daily work.

1h
7 min
0
Read Article
Banijay's A Fábrica Brasil Unveils Ambitious Slate at Content Americas
Entertainment

Banijay's A Fábrica Brasil Unveils Ambitious Slate at Content Americas

A Fábrica Brasil, part of Banijay Americas, drilled down at Content Americas on Wednesday on a nine-title slate which delivers what looks like the sine qua non these days of success in Brazil: Ongoing production relations with Netflix and Brazilian media giant Globo and Globoplay, its energetic VOD service, and projects with Brazil’s young king.

1h
5 min
0
Read Article
Mario Kart World's Best Mode Just Got Even Better
Entertainment

Mario Kart World's Best Mode Just Got Even Better

The popular Knockout Tour mode in Mario Kart World is receiving a major update that introduces team-based competition, fundamentally changing the strategic landscape of the game's premier racing experience.

2h
5 min
0
Read Article
Tocantins Farmers Build Roads to Secure Record Soy Harvest
Economics

Tocantins Farmers Build Roads to Secure Record Soy Harvest

With a record soy harvest approaching, Tocantins farmers are taking road construction into their own hands, paving critical corridors to ensure their crops reach global markets.

2h
5 min
0
Read Article
AMD Ryzen 9 9950X Drops to Lowest Price on Amazon
Technology

AMD Ryzen 9 9950X Drops to Lowest Price on Amazon

A sudden discount on Amazon brings AMD's high-performance Ryzen 9 9950X processor to its lowest price, offering significant savings for PC builders and enthusiasts.

2h
5 min
0
Read Article
Spirit Airlines in Talks with Castlelake for Takeover
Economics

Spirit Airlines in Talks with Castlelake for Takeover

Spirit Airlines is in talks with investment firm Castlelake for a potential takeover of the discount airline, which is in bankruptcy.

2h
5 min
0
Read Article
Why Wall Street's most data-obsessed investors are taking it slowly with generative AI
Economics

Why Wall Street's most data-obsessed investors are taking it slowly with generative AI

Quant asset managers haven't adopted AI en masse yet. Michael M. Santiago/Getty Images A new Bloomberg survey of quant investors found that 54% of respondents do not use generative AI for investing. AI usage in quant investing will be linked to data formatting and availability going forward, Bloomberg believes. This aligns with the thinking from many quant executives, who have said that AI is not yet able to beat the market. Generative AI hasn't yet won over the quants. A majority of people running systematic trading strategies at top-tier asset managers have "not yet begun their generative AI journey," according to a new Bloomberg survey. The data giant interviewed 151 quants between April and November last year to determine how they've integrated generative AI tools into their investment research process. While this section of the investing world has used machine-learning techniques for years, generative AI has not yet broken through. Most of the respondents, 54%, do not incorporate it into their workflows, the survey found. This matches the vibe Business Insider reported on in October, where quants at a London-based conference were skeptical of the technology's ability to beat the market and add value to their investing processes. A UBS executive, for instance, said that AI is not going to help win the "alpha war." Bloomberg's rationale for the slow adoption is focused on data formatting and structure. Angana Jacob, the firm's global head of research data, said quants require their data to be cleaned and structured a specific way because of the complex systems their strategies run and the amount of capital at stake if there is an error. "They're working in a very controlled research environment, models need to be explainable, models need to be repeatable," said Jacob, in an interview with Business Insider. The work required to get the datasets to a point where they can be used is "unglamorous," but "foundational," Jacob said. Her team is creating data products for quants that might increase AI adoption among them, because, she said, the enthusiasm is high for what AI can do once the data catches up. The lack of widespread use in the investing process is more a sign of the diligence of these players. "It's a good thing, it shows their caution," she said. Bloomberg is not the only data player that has identified this issue. Former Point72 data executive Kirk McKeown's startup, Carbon Arc, is also focused on structuring datasets for easier ingestion into artificial intelligence models. Read the original article on Business Insider

2h
3 min
0
Read Article
Motorola Phones: The Best Budget Androids of 2026
Technology

Motorola Phones: The Best Budget Androids of 2026

Motorola phones may seem old-school, but their reasonable prices, colorful designs, and simple software make them good, wallet-friendly Android smartphones.

2h
5 min
0
Read Article
Hollywood Announces 2026 Oscar Nominees
Entertainment

Hollywood Announces 2026 Oscar Nominees

Hollywood woke up early on Thursday for one of its biggest days: the announcement of nominees for the 2026 Academy Awards. The nominations were revealed at 5:30 AM local time.

2h
3 min
7
Read Article
🎉

You're all caught up!

Check back later for more stories

Back to Home