AI Readiness: Infrastructure’s Strategic Impact | The Six Five Summit

Welcome to the cloud infrastructure track of six five Media Summit. I love these things. I love having conversations with industry experts.

The theme of this year's summit or virtual event is AI unleashed and what better guests they have on than Varun trauma of, uh, Dell Technologies work. Uh, Dell Technologies. Varun, welcome to the program.

Thanks so much, Keith. Nice to be talking to you again. You know what, we've talked across multiple platforms, across multiple events, and I gotta tell you, you Dell Technologies world, Michael called it at the start a AI conference.

And I think if before the conference, if folks had not known what Dell had been do doing in the industry around AI would've challenged him in that statement that Dell is a hardware company, and that there's not much to do with ai. I've, I've gone back and forth folks online with this, but what I witnessed in during the Dell Technologies world is what I've witnessed throughout the larger industry. Customers are having the most difficult time understanding the different components of the AI AI journey, the AI factor three.

What aren't you seeing, uh, within customers? Uh, it's a great, it's a great point, Keith. I think first of all, yes, Michael did, did start call, start by calling the event Dell Tech World AI edition.

And certainly, you know, as you probably saw at the event, AI was a, was a big, big theme, probably the theme of the event. Um, look, it's really driven by what we're seeing with customers. And, and you touched upon a few of these things, right?

Obviously, most customers that we talk to see the opportunity with ai, actually all customers we talk to see the opportunity with AI and, uh, where they need help. Actually, it's different for different customers and, and every, it's a continuum of our journey. And different customers are at different points of the journey.

But, but at a very high level, most people can, can see, hey, there's a lot of different use cases. They're looking for help on where do we get started first, what, what use cases will give us the best bang for the buck? Is it largely productivity or are there other, uh, gains as well?

Right? Productivity is usually where people focus. So that's another question that comes up.

There's, there's certain, certain customers that have kicked the tires, they have POCs that they've tried, uh, and now they're looking to scale under production. And what they're now starting to see is a lot of interest in the, in the POC, a lot of good success. But there's a difference between the level of accuracy you're expecting or okay, within A POC versus when you're taking a production.

How do you limit bias? How do you make sure your answers are trustworthy? What's the exposure the company has from a legal and compliance perspective when they take these Gen AI models and move them into production to power their customer experiences, their end user experiences, their, their partner and supply chain experiences?

So that's another question we get. And then there's also, uh, the age old question of, Hey, I've got stuff all over the place. My data's growing in the public cloud.

My data's growing in my data centers. My data is, uh, growing, especially out of the edge. It's increasing exponentially.

How do I bring all of this together? What is the right data preparation strategy? What's good data?

What's bad data? Do I train my models from scratch? Do I tune them?

What's, what's going on with retrieval, augmented generation? And then once you have all of these questions answered, how do I, how do I look at the stack when it comes time to implement implementing it? How do I think about the infrastructure layer?

Uh, what, what, what software parts do I use? What, you know, do I go open source? Do I look at specific vendor solutions?

Do I design open from the ground up, or do I go with a vertically integrated stack? How do I think about professional services? How do I align my team members?

There's just so much to work out. So while the promise and the potential is very easy for people to see, and they are seeing it, what we're asked, what we're being asked most often at Dell Technologies by, by customers, is we see the promised land, help us get there, help us go through this forest and navigate all these different obstacles. Uh, and then every customer has their own set of obstacles.

They're working. You know, I like to say that AI demos are easy. AI projects are really hard.

I mean, uh, I don't think I've seen this in the industry my, for my entire career. We've, you know, talked about technology across several roles that you've had in Dell Technologies. Yes.

One of those roles was telling Dell's hybrid cloud story. And I, I don't think there's a technology that's more geared towards hybrid cloud or multi-cloud than ai. Can you talk to me about what you're seeing in the industry?

I, I know what I'm seeing is that customers are saying this is not an either or conversation. This is a, and conversation. So what are you seeing and how is Dell helping customers along that journey?

Absolutely. So what, what's happening there, Keith, is that I think it really starts with the data, right? You've gotta, you've gotta follow the data and the, what what's happening with customers, as I was saying, is that the data is all over the place, right?

And what customers have a choice to do once they've got their data strategy figured out, which is not trivial, but let's say they understand which data sources they want to use for powering their, or, or augmenting their, their models and their gen AI applications, um, let's, let's say they figured that out. What they've gotta then figure out is, Hey, do I, I bring my AI to the data, or do I bring my data to the ai? And now what I mean by that is how do you think about the placement of, of data versus where your, uh, compute intensive, uh, you know, uh, infrastructure is located to be able to run, uh, the data processing capabilities that you need to make your AI more effective, more impactful, more, um, more accurate and more, um, specific to your business and your insights?

And, and, and our perspective on this is it's not, it's not really cost effective to actually move your data to one central location and have, uh, have that be where you process all your data. That's just not feasible, given it how distributed everybody's data is, not just across the three locations that I mentioned, but even within, uh, multi-cloud or public cloud, for example. There's just, there's just so many different locations, right?

People are, as we've talked about in the past, uh, there's so many different public clouds that, that, you know, a single enterprise could be using more different applications and different data stores. Edge locations are more distributed than ever, and many US stores have data settlers or CSPs they work with. So our belief is actually you've gotta bring AI to your data versus the other way around.

And I think that's where what you mentioned around hybrid is, is, is gonna come to fruition, I think, is that you really need a technology approach that allows you to be able to use the data where it is without having to do unnatural things to move it, or costly things to move it and be able to get your best AI insights on that data in the location at the fastest, with the fastest time, uh, lowest latency and most possible accuracy. So, barone, I'm, I'm gonna save you some hero NS from a or, or some, you know, some, some brags, some humble brags. Dell EMC, world largest storage company.

Dell fights for number one and two in the OEM server space data center server space. Dale is, you know, the preferred partner of Nvidia to sell gpu. That's all great.

And that's, but at the end of the day, how is Dell differentiating between you and your competitors? I'm hearing some of the same messaging coming out of some of the world's largest competitors to Dale. So, uh, great, great question.

Let, let me, let me answer that in two parts. I think the first is let's level set on what is our strategy, right? I talked about data, bringing AI to your data, et cetera, et cetera.

How do we actually make that real, right? The number one thing that people are asking us for is, um, it, it is a little, uh, try sometimes to call these things as easy, easy buttons because there is no easy button, but, but in it, but what customers are asking us is, how do I make, as I was saying, the promise real, and the way to do it is you've gotta simplify the complexity. You've gotta help customers work through some of the choices they've gotta make, uh, on the various quirks in the road.

And to do that, we actually talked about this a lot at Dell Tech world, is this notion of a Dell AI factory and an, and an AI factory for us is something that brings together all the various components that a customer and organization needs to make AI real, right? And, and at the foundation of the Delia factory is AI infrastructure. So think about, you know, your servers, network networking gear, uh, storage, data protection, uh, PCs, all of these in, in our opinion are, are like the foundation of what makes an AI application or AI workload work, but the, the infrastructure by itself is not enough, right?

So we've got, we think about, uh, the ecosystem and the work that you've been doing, and we've been doing, and you just mentioned it, we've, we've put in a lot of work over the last year working with the AI ecosystem across the board, forging strong partnerships to make sure that, um, you know, our, our infrastructure works really well with the software layer, the models, the ISV applications that customers are gonna want to run on it. Yeah. De world.

We featured heavily our collaboration with nvidia. In fact, we've got a very specific flavor of our de ai factory called De Factory with Nvidia that combines, you know, NVIDIA networking, Nvidia GPUs, our infrastructure with Nvidia AI enterprise software, uh, and our professional services. So NVIDIA's a a huge partner for us.

We've got, um, we, we've obviously working with, uh, A MD and Intel to bring their GPUs to market as well. Uh, and then we we're not stopping there, right? EBIT, the, in the model and ISV ecosystem in place as well.

We're doing a lot of work. We had GIE face come on stage, announce the Dell Enterprise hub with hugging phase, where customers can actually get their, uh, specific vetted models, the most popular open source models, uh, specifically vetted for Dell infrastructure. Uh, they can choose what Dell infrastructure they have, and then it'll tell them what, um, what open source models they can use for that Dell infrastructure.

And then we make it easy for people to deploy things. We're working with meta on LAMA three, et cetera, et cetera. There's just so much happening in, in the multi-cloud space with Red Hat, with Azure, et cetera.

So ecosystem is the second part. Infrastructure ecosystem. And then it's all about professional services.

Professional services plays a massive, massive role in this, whether it's professional services deployed by, delivered by Dell, or by our partner ecosystem that we are finding is so important to help customers ask the right questions, align their strategy, think about business use cases before they go down the path of, well, let me go, you know, order a bunch of gear, or do POCs think through their AI strategy end to end before they actually go down this path. So this combination of infrastructure, ecosystem integrations and services is really what we think of as a de AI factory. This is a really, really important part of what we're delivering.

This is how we, we make things simple for our customers. Now, let me answer your question directly. What's different about what we're doing with AI Factory?

And to me, Keith, it comes down to five things. First of all, we believe we have the broadest AI portfolio, uh, in the industry. Nobody else has, uh, you know, desktops, data center solutions with server storage, networking, compute, data protection to, uh, multi-cloud solutions where, you know, you can think of a consistent data platform with our storage software running not only in customer's data centers, but also in different public clouds, providing that consistent data, uh, data platform to be able to run AI on and use the same workflows, get the same performance, et cetera, et cetera.

Broadest AI portfolio. Second one, uh, at the end of the day, a huge component of AI is scale and performance. And what, what can your solutions, what can the vendor solutions do to really help customers be able to get the best performance for their AI workloads?

5 times the, uh, the energy efficiency of previous platforms, uh, most dense racks, uh, you know, 72 GPUs and video GPUs in a single rack, uh, incredible throughput from our, our storage platform, our scale, et cetera. So, leading AI performance as a second differentiator, uh, going back to third one, going back to what I just talked about, reducing the complexity. Ultimately, it's not about speeds and feast.

Uh, it's, it's not just about speeds and FETs. It's actually about how fast can we get customers to see value from ai. So the third differentiator for us has really accelerated time to value.

So not only do we have all these incredible piece parts like compute, storage, networking, we've done a lot of work actually pull these togethers in into cohesive solutions, full stack turnkey solutions, uh, alongside our professional services. Uh, and we've actually done software automation. Now we, we, we showed some of that at Dell Tech world that actually pulls together, uh, you know, use cases like, um, you know, uh, uh, gen ai, digital assistance and helps or, or, uh, retrieval augmented generation platforms and helps deliver those to customers 85% faster than if they were to do it themselves, right?

So, so software driven automation and integration with the ecosystem at a deep level. Um, so accelerated time to value is a huge part of it. Fourth is cost, right?

You and I have never had a single conversation in all these years where we have not talked about cost and how important that is as a factor for our IT stakeholders. And we really, we have best in class TCO customers are making choices about where they want to deploy, uh, these workloads. And, and I agree with you that this is gonna be a large hybrid deployment always.

But we do believe that when it comes to long-term inferencing and, and inferencing over, over the long term, our research indicates there's actually 75% more cost effective to do inferencing on-prem with Dell than doing it just in the public cloud. And then finally, fifth differentiator is all about trust and minimizing risk, right? So we work closely with partners like, um, HuggingFace with Nvidia to make sure that we have built in data security, data privacy, and we've got, uh, software tools that we are integrating with, whether they are PO or software moves that are our, our partners like Nvidia and HuggingFace have to make sure we maximize the accuracy of the models that customers are using, as well as the appropriateness, the reducing bias, um, reducing, um, you know, making sure I IP is protected, et cetera, et cetera.

So all of these things together are, I, I, I think are really what, what differentiates us. There's really this five things I talked about, the broader CI portfolio, the ability to deliver the leading AI performance, density, throughput, whatever you call it, accelerated time to value, right? 85% faster than doing it by yourselves.

Um, SSIM class TCO. So 75% cheaper to do inferencing than doing it just in the public cloud. The fifth one is maximizing trust and minimizing risk for your business as you move forward with, um, taking gen AI to your customers, into your users.

And I know that was a bit of a long answer, but hopefully, uh, I was able to address what you were, what you were asking. No, that, that is very helpful. And for watchers, these five areas you wanna put Dell to the test, I had a great conversation with Chad Rudall, the person in charge of making this happen within Dell and Dell adopting these tech, this approach and these technologies.

I encourage you to have a conversation with DE's team and ask him about their AI journey for my guest, barroom Chaba, senior Vice President Infrastructure Solutions Group in tele telecom marketing at Dell Technologies. Thank you for joining us on six five Summit. Thanks Bar.

Thank you for, thank you for having me, Keith.