Enterprise

OpenStack improves support for AI workloads

Comment

Portrait of a Caracal (Felis Caracal) laying down
Image Credits: Heinrich van den Berg / Getty Images

OpenStack allows enterprises to manage their own AWS-like private clouds on-premises. Even after 29 releases, it’s still among the most active open source projects in the world and this week, the OpenInfra Foundation that shepherds the project announced the launch of version 29 of OpenStack. Dubbed “Caracal,” this new release emphasizes new features for hosting AI and high-performance computing (HPC) workloads.

The typical OpenStack user is a large enterprise company. That may be a retailer like Walmart or a large telco like NTT. What virtually all enterprises have in common right now is that they’re thinking about how to put their AI models into production, all while keeping their data safe. For many, that means keeping total control of the entire stack.

OpenInfra Foundation CEOO Mark Collier
OpenInfra Foundation COO Mark Collier. Image Credits: Frederic Lardinois/TechCrunch
Image Credits: Frederic Lardinois/TechCrunch

As Nvidia CEO Jensen Huang recently noted, we’re at the cusp of a multitrillion-dollar investment wave that will go into data center infrastructure. A large chunk of that is investments by the large hyperscalers, but a lot of it will also go into private deployments — and those data centers need a software layer to manage them.

That puts OpenStack into an interesting position right now as one of the only comprehensive alternatives to VMware’s offerings, which is facing its own issues as many VMware users aren’t all that happy about its sale to Broadcom. More than ever, VMware users are looking for alternatives. “With the Broadcom acquisition of VMware and some of the licensing changes they’ve made, we’ve had a lot of companies coming to us and taking another look at OpenStack,” OpenInfra Foundation executive director Jonathan Bryce explained.

Image Credits: Frederic Lardinois/TechCrunch
Image Credits: Frederic Lardinois/TechCrunch

A lot of OpenStack’s growth in recent years was driven by its adoption in the Asia-Pacific region. Indeed, as the OpenInfra Foundation announced this week, its newest Platinum Member is Okestro, a South Korean cloud provider with a heavy focus on AI. But Europe, with its strong data sovereignty laws, has also been a growth market and the U.K.’s Dawn AI supercomputer runs OpenStack, for example.

“All the things are lining up for a big upswing and open source adoption for infrastructure,” OpenInfra Foundation COO Mark Collier told TechCrunch. “That means OpenStack primarily, but also Kata Containers and some of our other projects. So it’s pretty exciting to see another wave of infrastructure upgrades give our community some important work to complete for many years to come.”

In practical terms, some of the new features added to this release include the ability to support vGPU live migrations in Nova, OpenStack’s core compute service. This means users now have the ability to move GPU workloads from one physical server to another with minimal impact on the workloads, something enterprises have been asking for because they want to be able to manage their costly GPU hardware as efficiently as possible. Live migration for CPUs has long been a standard feature of Nova, but this is the first time it’s available for GPUs as well.

The latest release also brings a number of security enhancements, including rule-based access control for more core OpenStack services like the Ironic bare-metal-as-a-service project. That’s in addition to networking updates to better support HPC workloads and a slew of other updates. You can find the full release notes here.

A general view of atmosphere at the 7-Eleven 88th birthday celebration at 7-Eleven on July 10, 2015 in Burbank, California. Image Credits: Photo by Chris Weeks/Getty Images for 7-Eleven
Image Credits: Chris Weeks/Getty Images for 7-Eleven / Getty Images

This update is also the first since OpenStack moved to its “Skip Level Upgrade Release Process” (SLURP) a year ago. The OpenStack project cuts a new release every six months, but that’s too fast for most enterprises — and in the early days of the project, most users would describe the upgrade process as “painful” (or worse).

Today, upgrades are much easier and the project is also far more stable. The SLURP cadence introduces something akin to a long-term release version, where, on an annual basis, every second release is a SLURP release that’s easy to upgrade to, even as the teams still produce major updates on the original six-month cycle for those who want a faster cadence.

Throughout the years, OpenStack has gone through its up-and-down cycles in terms of perception. But it’s now a mature system and backed by a sustainable ecosystem — something that wasn’t necessarily the case at the height of its first hype cycle 10 years ago. In recent years, it found a lot of success in the telco world, which allowed it to go through this maturation phase and today, it may just find itself in the right place and time to capitalize on the AI boom, too.

More TechCrunch

Ola Electric, India’s largest electric two-wheeler maker, saw its shares rise as much as 20% on its public debut on Friday, making it the biggest listing among Indian firms in…

Ola Electric surges in India’s biggest listing in two years

Rocket Lab surpassed $100 million in quarterly revenue for the first time, a 71% increase from the same quarter of last year. This is just one of several shiny accomplishments…

Rocket Lab’s sunny outlook bodes well for future constellation plans 

In 1996, two companies, Patersons HR and Payroll Solutions, formed a venture called CloudPay to provide payroll and payments services to enterprise clients. CloudPay grew quietly over the next several…

CloudPay, a payroll services provider, lands $120M in new funding

The vulnerabilities allowed one security researcher to peek inside the leak sites without having to log in.

Security bugs in ransomware leak sites helped save six companies from paying hefty ransoms

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the…

A comprehensive list of 2024 tech layoffs

A new “beta rabbit” mode adds some conversational AI chops to the Rabbit r1, particularly in more complex or multi-step instructions.

Rabbit’s r1 refines chats and timers, but its app-using ‘action model’ is still MIA

Los Angeles is notorious for its back-to-back traffic. Three events that promise to bring in millions of spectators from around the world — the 2026 World Cup, the Super Bowl…

Archer to set up air taxi network in LA by 2026 ahead of World Cup

Featured Article

Amazon is fumbling in India

Amazon’s decision to overlook quick-commerce in India is now looking like a significant misstep.

Amazon is fumbling in India

OpenAI’s GPT-4o, the generative AI model that powers the recently launched alpha of Advanced Voice Mode in ChatGPT, is the company’s first trained on voice as well as text and…

OpenAI finds that GPT-4o does some truly bizarre stuff sometimes

On Thursday, Box filled in a missing piece on its AI platform when it bought automated metadata extracting startup, Alphamoon.

Box adds crucial piece to its AI platform with Alphamoon acquisition

OpenAI has announced a new appointment to its board of directors: Zico Kolter. Kolter, a professor and director of the machine learning department at Carnegie Mellon, predominantly focuses his research…

OpenAI adds a Carnegie Mellon professor to its board of directors

Count Spotify and Epic Games among the Apple critics who are not happy with the iPhone maker’s newly revised compliance plan for the European Union’s Digital Markets Act (DMA). Shortly…

Spotify and Epic Games call Apple’s revised DMA compliance plan ‘confusing,’ ‘illegal’ and ‘unacceptable’

Thursday seeks to shake up conventional online dating in a crowded market. The app, which recently expanded to San Francisco, fosters intentional dating by restricting user access to Thursdays. At…

Thursday, the dating app that you can use only on Thursdays, expands to San Francisco

AI companies are gobbling up investor money and securing sky-high valuations early in their life cycle. This dynamic has many calling the AI industry a bubble. Nick Frosst, a co-founder…

Cohere co-founder Nick Frosst thinks everyone needs to be more realistic about what AI can and cannot do

Instagram is rolling out the ability for users to add up to 20 photos or videos to their feed carousels, as the platform embraces the trend of “photo dumps.” Back…

Instagram is embracing the ‘photo dump’

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Anyone paying…

Lyft ‘opens a can of whoop ass’ on surge pricing, Tesla’s Dojo explained and Saudi Arabia pumps $1.5B into Lucid

Flint Capital just closed its third fund at $160 million. Its has a unique strategy for finding its limited partner investors. 

Flint Capital raises a $160M through an unusual fund-raising strategy

Earlier this week it emerged that the DPC had instigated court proceedings seeking an injunction against X over the data processing without consent.

Elon Musk’s X agrees to pause EU data processing for training Grok

During testing, Google DeepMind’s table tennis bot was able to beat all of the beginner-level players it faced.

Google DeepMind develops a ‘solidly amateur’ table tennis robot

The X account announced that its Premium+ subscription would now be “fully” ad-free, leading some to question how this change would affect creator earnings.

As X sues advertisers over boycott, the app ditches all ads from its top subscription tier

Apple has further revised its compliance plan for the European Union’s Digital Markets Act (DMA) rulebook, which, since March, has forced it to give iOS developers more freedom over how…

Apple revises DMA compliance for App Store link-outs, applying fewer restrictions and a new fee structure

The rise of neobanks has been fascinating to witness, as a number of companies in recent years have grown from merely challenging traditional banks to being massive players in and…

Chime and Dave execs are coming to TechCrunch Disrupt 2024

If you visited the Wikipedia website on mobile this week, you might have seen a pop-up indicating that dark mode is ready for prime time.

How to enable Wikipedia’s dark mode

The home security company says attackers accessed databases containing customer home addresses, email addresses, and phone numbers.

Home security giant ADT says it was hacked

The Looking Glass Pro has a 6-inch display and a foldable base. It shows spatial images like those created with the Apple Vision Pro and iPhone 15 Pro.

Looking Glass’ new lineup includes a $300 phone-sized holographic display

TikTok’s latest offering is capitalizing on the app’s ability to serve as a discovery engine for other media — something its users already take advantage of by sharing short clips…

TikTok partners with Warner Bros. to become a discovery engine for TV and movies

Cocoon is a new startup built on the belief that greener steel production and the creation of concrete slag doesn’t have to be an either/or proposition.

Cocoon is transforming steel production runoff into a greener cement alternative

SoundHound, an AI company that makes voice interface tech used by car companies, restaurants and tech firms, is doubling down on enterprise services by playing consolidator in a crowded market.…

SoundHound acquires Amelia AI for $80M after it raised $189M+

Seeking mental health support is a complex process, but some founders believe that using AI to formalize techniques like cognitive behavioral therapy (CBT) can help folks who might not have…

Feeling Great’s new therapy app translates its psychiatrist co-founder’s experience into AI

The U.K.’s antitrust regulator has confirmed that it’s carrying out a formal antitrust investigation into Amazon’s ties with Anthropic, after Amazon recently completed a $4 billion investment into the AI startup.…

UK launches formal probe into Amazon’s ties with AI startup Anthropic