, ,

Tiny, speedy AI models shake up business as we know it

In life, timing is critical.

That’s especially true in business, where every organization must forecast sales, demand, revenue, and capacity requirements. Accurate and reliable time-dependent forecasts could help every organization save—and earn—billions of dollars.

Time series forecasting is the bread and butter of what drives an enterprise. It involves predicting future values based on past observations collected in constant time intervals, whether daily, monthly, quarterly, or yearly.

Artificial intelligence is expected to accelerate and tighten business planning with new, faster, and smaller, foundation models designed for multivariable time series forecasting. These models do not need to be the equivalent of an AI sledgehammer to drive results. Small time series-based or other small foundation models trained on high-quality, curated data are more energy-efficient and can achieve the same results or better.

How can time series AI models predict the future?

Time series models can be built from scratch or adapted from existing pre-trained models and are best used for predicting outcomes in time-series data. Traditionally, AI’s large language models compute relationships among words to identify patterns in the data that can be projected forward to make better decisions.

Time series foundation models look for patterns in historical observations to “understand” a temporal process. These abstract representations are what allow the models to solve predictive tasks. The longer the time series, the better the forecast.

However, these kinds of measurements pose complications in ways that words, code and pixels do not. First, time series data is often continuous: Think of video streaming from a self-driving car, temperature readings from a reactor or heart rate data from a smartwatch. There’s a lot of data to process, and its sequential order and directionality must be strictly preserved.

Time series data vary widely, from stock prices and satellite images to brain waves and light curves from distant stars. Compressing disparate observations into an abstract representation is an enormous challenge.

In addition, different sets of time series data are often highly correlated. In the real world, complex events arise from multiple factors. For example, air temperature, pressure, and humidity strongly interact to drive the weather. To predict a hurricane, you must know how these variables influenced each other in the past to understand how the future could play out. Computations and cross-channel correlations could quickly become overwhelming as the number of variables increases, especially if it’s a long historical record.

The farther back you go, the more complex these calculations get, especially if your target variable is influenced by other factors. Home heater sales, for example, may be tied to quirky weather or the economy. The more interacting variables in any time series data set, the harder it can be to isolate the signal that foreshadows the future.

Breaking barriers in time series forecasting

AI foundation models designed for time series forecasting can be difficult to build. The sheer scale and complexity of multi-channel data sources coupled with external variables pose significant architectural challenges for the ensuing model and non-trivial computational demands, making it difficult to train and update models with reasonable accuracy and desired forecasting window in a timely manner. Today, many foundational models can’t pick up on the trends that the rapidly evolving data patterns reveal – a process known as “temporal adaptation”. Time series foundation models such as MOIRAI, TimesFM, and Chronos are built on hundreds of millions of parameters demanding significant computational resources and runtime.

The next wave of innovation

Researchers and practitioners are working on new ways to overcome these obstacles and unlock the full potential of using AI in time series forecasting. Can smaller models pre-trained purely on limited public diverse time series datasets deliver better forecasting accuracy? It turns out that the answer is yes!

Experimentation with the development of “tiny” foundation models significantly less than 1B parameters is now well underway. Smaller models for time series forecasting (1M to 3M parameters) can offer significant computational efficiency while still achieving state-of-the-art results in zero/few-shot forecasting, which is when models generate forecasts from unseen datasets. They also can support cross-channel and external variables — critical features that existing popular methods lack.

These fast and tiny general pre-trained AI models can be put to work quickly on use cases such as predicting electricity consumption demand. They are also flexible enough to be extended to other time series tasks beyond forecasting. In anomaly detection, for instance, these tiny models can be trained on datasets that include anomalous and regular patterns, allowing them to learn the characteristics of anomalies and detect deviations from normal behavior.

Increasingly, we’re seeing that these small models, combined with enterprise data, can make a big impact, offering task-specific performance that rival large models at a fraction of the cost. They are poised to become the ‘workhorses’ of enterprise AI.

In the next few years AI is expected to help progress a radical transformation in the business landscape. While most of the world’s public data feeds current models, a vast majority of enterprise data remains untapped. Small, fast foundation models — which have flexibility, low development costs and wide-ranging applications — are poised to play a significant role in this shift.

We feature the best AI tools currently available.

This article was produced as part of TechRadarPro’s Expert Insights channel where we feature the best and brightest minds in the technology industry today. The views expressed here are those of the author and are not necessarily those of TechRadarPro or Future plc. If you are interested in contributing find out more here: https://www.techradar.com/news/submit-your-story-to-techradar-pro

https://www.techradar.com/pro/tiny-speedy-ai-models-shake-up-business-as-we-know-it


Leave a Reply

Your email address will not be published. Required fields are marked *

January 2025
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
2728293031  

About Us

Welcome to encircle News! We are a cutting-edge technology news company that is dedicated to bringing you the latest and greatest in everything tech. From automobiles to drones, software to hardware, we’ve got you covered.

At encircle News, we believe that technology is more than just a tool, it’s a way of life. And we’re here to help you stay on top of all the latest trends and developments in this ever-evolving field. We know that technology is constantly changing, and that can be overwhelming, but we’re here to make it easy for you to keep up.

We’re a team of tech enthusiasts who are passionate about everything tech and love to share our knowledge with others. We believe that technology should be accessible to everyone, and we’re here to make sure it is. Our mission is to provide you with fun, engaging, and informative content that helps you to understand and embrace the latest technologies.

From the newest cars on the road to the latest drones taking to the skies, we’ve got you covered. We also dive deep into the world of software and hardware, bringing you the latest updates on everything from operating systems to processors.

So whether you’re a tech enthusiast, a business professional, or just someone who wants to stay up-to-date on the latest advancements in technology, encircle News is the place for you. Join us on this exciting journey and be a part of shaping the future.

Podcasts

TWiT 1013: Calamari in Crisis – Touching the Sun, Fake Spotify Artists, Banished Words This Week in Tech (Audio)

Touching the Sun, Fake Spotify Artists, Banished Words AI Needs So Much Power, It's Making Yours Worse How many billions Big Tech spent on AI data centers in 2024 NASA Spacecraft 'Touches Sun' In Defining Moment For Humankind Elon Musk Calls Out NASA's Moon Ambitions: 'We're Going Straight to Mars' Elon Musk and the right's war on Wikipedia Trump Asks Supreme Court to Pause Law Threatening TikTok Ban US Treasury says Chinese hackers stole documents in 'major incident' Judge blocks parts of California bid to protect kids from social media Finland probes Russian shadow fleet oil tanker after cable-cutting incident US appeals court blocks Biden administration effort to restore net-neutrality rules The Ghosts in the Machine (fake spotify artists) Massive VW Data Leak Exposed 800,000 EV Owners' Movements, From Homes To Brothels Banished Words | Lake Superior State University 2025 Public Domain Day 2025 Happy Birthday, Bitcoin! The top cryptocurrency is old enough to drive End of the lines? QR-style codes could replace barcodes 'within two years' Host: Leo Laporte Guests: Richard Campbell, Anthony Ha, and Stacey Higginbotham Download or subscribe to This Week in Tech at https://twit.tv/shows/this-week-in-tech Get episodes ad-free with Club TWiT at https://twit.tv/clubtwit Sponsors: ZipRecruiter.com/Twit joindeleteme.com/twit promo code TWIT canary.tools/twit – use code: TWIT zscaler.com/security
  1. TWiT 1013: Calamari in Crisis – Touching the Sun, Fake Spotify Artists, Banished Words
  2. TWiT 1012: Our Best Of 2024 – The Best Moments From TWiT's 2024
  3. TWiT 1011: The Year in Review – A Look at the Top Stories of 2024
  4. TWiT 1010: The Densest State in the US – TikTok Ban, Drones Over Jersey, GM Quits Robotaxis
  5. TWiT 1009: Andy Giveth & Bill Taketh Away – Trump's Tech Titans, Crypto Boom, TikTok's US Ban, Intel CEO Exits