Eduardo Silva, Calyptia | KubeCon + CloudNativeCon Europe 2023

This is texturung TV. Hey, everyone. Welcome.

We're live here in Amsterdam at kubecon EU 2023. I'm Alan Shimmel. I'm the CEO of tech strong group and look you may know us as text strong and Textron TV.

com or Security Boulevard. Maybe you followed us over the years with our Cloud native. Themed site which was container Journal.

I'm really happy to announce that as of today container Journal is now Cloud native now and so you could still get to it a container Journal but the name of the site is now cloud-native now and we think that better fits what the mission of of cloud native now is which is this right? You guys can't see it because your face the background but Eduardo and I are looking out on a sea of people of opened up here is the Expo for just opened. And this I know I know it's sold out this year Connie use I think it's about 7,000 or well so they announced they announced 10,000 people 10,000.

Yeah. Oh crazy 9,000 people here. Yeah, and we started yesterday with observability day at collocated event.

And yeah also really plus other events. They had a lot around 2,000 people bad guys. So yes amazing experience.

Yeah. It's person is back. Well, let me introduce you.

I've already started. Okay popping up for information Eduardo Silva Eduardo is with Calista. Yeah.

My name is Eduardo Silva and the CEO caliphya one of the owners of the company. Actually. Most of the people in this conference knows me because someday creator of fluent dates and maintainer of the project for a long time.

And after that sometime after the you know, we started the pro league the Enterprise is stuck in start and knocking the doors and they want to wait give us more right? Yeah more for the Enterprise. So we started caliphia we make a founder and we're a good time.

And here we are. actually, excellent, so Eduardo let's say some of the people out here. They're not familiar with the project.

How would you describe let's start with the name slowly because with all the noise, it's hard. Yeah, and what what's the project about? Yeah in the open source side exists is pretty cool fluent D that was started around 2011.

Right and after a few years, I joined the company that were fluid was created. What was called Treacher data? I created a new project which called fluent bit which was kind of the Next Generation for fluentd for the future.

And well a both projects at that time at Treasure data, we decided that the projects got a lot of traction they were open source, and we did excited to donate them to the cncf context kubernetes was kind of new Joker was new we just permit it was around so fluently was kind of the first projects that joining the foundation. And yeah, I'm looking forward from it was started in 2015 after a couple of years, you know, everybody starting adopting kubernetes microservices and one of the biggest problems that people wanted to solve is like you got a lot of applications all of them generate ton of login information all of them in different formats from different sources, but your problem is that you went to analyze your data. Yeah so hold if you have everything distributed, how do you analyze and the first approach was a let's try to centralizing formation in a database so we can query the database and run analytics right?

Maybe in the Enterprise that is called mostly a scene. So you have something that centralized information you can run analytics and one of the problems was like nobody had a specific tool to collect data from different sources different formats and be able to unify them in a database so fluently was one of the first Solutions available in the market for that and maybe an open source, I'm fluent bit was just like A new architecture based on fluency based on the experience but times performance and time slide weight. I love it.

Let's talk about this fluent D. It was early. It was one of their early projects as a graduated at this point or is it still incubated?

Sandbox? What what's the status? Hey at that time fluindy join us and incubator project and it was graduated around 2018-19.

Yeah, that's what I remember and again, I think most of our audience a cloud native now knows yeah a fluid day, but give them a sense of the scale of the amount of users the amount of downloads the amount of contributors. What what numbers do you think really kind of drive home? How well I spread this is actually that's a really good question because we have a big problem.

3 billion downloads in total just flow in bed. And I say that it's a problem because imagine that more users more fans more requests more bugs, right? Okay, six point three billion with a business of to download my God.

It's full in bed fluently. Yeah. We just lose the count.

Okay, we don't even carefully. We know that that's crazy. Yeah.

so so we're here with 10,000 of our friends at Cloud native con. Kubecon. What's what's new with fluent D fluid bed and calypsy I said here for the show.

Yeah. So from the fluent bit side, we just released influent bit to that one. One of the biggest effort and has been asking by community and companies is have a very integration with other ecosystems.

So fun beat is not just a solution for looks also that's Matrix and traces but the way that it does it that it connects to Prometheus. It connects to open Telemetry it connect the ecosystems around more than just be and dropping replacement solution. It connects all of your tools that everybody is using in the Enterprise so you can extract the best of the value, you know of each tool in the each part of the world and what floam beach has been to that once been announced today officially and from the Calista side the comparing company of fluent bit today where we hire Engineers to work in open source, we put our money.

Is our maltes for our money. We're about this a calyptia. We have a product for the Enterprise that is called calipta core, you know, everybody talks about officerability battles like a You know why turn but everybody talks about observability platform when you store the data and you analyze the data and how you correlate the data but few people talks about the problem that happens before that, which is called Telemetry pipelines, right?

How do you make sure that you can move your data process the data and then send this data to a central database that concept inside of cervability is called Telemetry pipelines, right? I'm fluent bit. It's a Telemetry pipeline solution.

That is like a new name for that. Right same for fluent D. So one of the problems in the market is like every company we work with banks financial institutions all of them use very expensive Sims or bend those for example, like Splunk and the thing the problem that they have is this tools that really really good.

But the thing is that they send the whole data to this platforms and they ended up paying money. Right for all the data that they ingest and the question is do you query all the data that you're ingesting most of the time you're just wearing 20% but you are paying for a hundred percent. You know, so a company's get this struggle in companies say okay.

If every year we are generating 20 to 30% more data. It means that my bills next year will be 20 to 30% more. Okay, is that worth it?

Well, it depends most of the companies that we work with they say, you know this too expensive. It's too expensive because we are not extracting the right value. So calyptia as a solution.

We provide a product called calipta core that is like Enterprise platform for Telemetry pipelines where the user can do Telemetry pipelines with the drag and drop they can put the business intelligence into the pipeline what you can say, please a for every data that's coming that is not relevant. It's a developer message don't send it to the scene because you don't want to pay for that. Right?

And also we are launching another future. We Collective core in in this call in this conference. That is called Fleet Management Fleet Management.

Yeah, why are things that we have thousands and thousands of fluid users and most of them say, okay. My problem is that I can manage this stuff. But the moment that I have 50,000 notes a hundred thousand notes like big corporations.

It gets probably problematic. Yeah, because no all of them runs the same configuration. Yeah, most of the time they're just specific teams or stakeholders that they need special The Limited pipelines configurations or business lodge individual business Logics.

So callith code we're launching now with a Fleet Management capabilities. So more than just create one pipeline to receive and process the data and reduce cost not so we can attach the agents and do remote Telemetry Pipelines. I love it.

That's great. What if how's it been received? I know observability day was Monday you guys are in part of that.

You've had a chance to kind of socialize this with with the audience here. What are we hearing? Yeah, we I think that everybody's resonating with the message and with the product because most of people is facing the same problem and you have the same problem in your inbox in your email.

How many emails are you getting right? You don't want to know? Yeah, so, you know and everybody's moving to microservices to distributed system.

But also this is really important most of companies. Yeah, they're moving to kubernetes, but they have I don't know thousands of VMS. System with windows with Linux but they also have the same problem.

How do I move my data? How do I preprocess the data for my windows boxes before send this out to my SIM? so collect your core and we call it you want to simplify all these observability pieces that nobody take care of everybody focus on the end of the data, but nobody focus on the Telemetry pipelines where we think that there is the The real power actually that this is what people call it a moving to the left right Chief let where the date has been generated try to do analytics on that side.

So I think that we are an early stage from this movement but a happy to have caliphya a great team global team of 30 people working on this problem and really excited with all our customers. Absolutely Eduardo, you know, we didn't even mention website for people want to get low D or flow bad words. Where would what's the best site to they go right to collectio or is there a separate site?

Yeah, if you want just want to have the purely open source Edition go to GitHub or fluent bit that I know and you will get the sources documentation. But for example, if you're a financial institution that cannot use the fluid bit Upstream version because we updated every two weeks and you want something for 18 months. We just creative fixes you might go to khalifia and get the caliphia LPS Edition for fluid.

I love it. What else are you looking forward to the rest of this week here? Oh, yeah, I think that you come for me.

This person is very special. This is where the project born and every future was built based on feedback from users. So for us as calyptia is is coming here to engage with our community of user community of customers.

Right, but also get all this interactions with feedback about a what are the problems that you are facing today. We just solve the problem from last year. Okay now tell me about the new problems.

And that's the nature of tech, right? There's always the next problem. There's always the new problem.

Yeah, as soon as we solve one. Sometimes you don't see what's behind that till you solve it and then the next one presents itself, right? It's sort of like in the book The Goal which the Phoenix project is based on.

Yeah right as soon as you get rid of one bottle neck. See the next one down Downstream and it's very much. That's that's just the way of things isn't it?

Yeah, and for example some people where it was asking about AI everybody before was what's your AI? Yeah, it was like then we have blockchain with fluent bit Yeah. Okay now they say but yeah, I know makes sense because in the way that we're seeing for example how we can take advantage of AI it's like in the product in calipta core.

Actually. We just launched this appeal see You can have a way to add processing rules processing rules. You can specify how the videos are going to be modified.

You can click on buttons or you can write a script in the in the network user interface. Now. We have a box that you write in human text.

What do you want to do with the data? And our AI system generates the script for you. crazy look So I I am not from the school that says we got to stop AI development.

Yeah, I don't think anything's gonna stop it. Anyway, I I think the kind of thing you just outlined is a perfect example of what we of where AI can rather easily right without imagining some sentience or skylord. Skynet drink can really come in and help people right now.

Yeah, right with this type of thing. So you just launched your POC. When do you think it might be a you know released product if you will GA?

Okay. So right now I'm just given we're releasing a little core to that all and this future will kind of experimenting it will be out next week next week. Yeah, because we have some guys or that's what it's about.

That is a product. Yeah. That's the plug.

It's private you. Yeah, I don't get in. He's getting a ton of value.

You know, what is the thing the thing with all this this world of kubernetes and infrastructure? That everybody is working very low level. Yeah, right, but what we need to do is to level up people right?

Well, you don't need to think about the agent. You don't need to think about the connection. So I I've seen this before in security as well.

People won't do that level up as you call it until there's it's all about like, you know, the crossing the chasm. Right, you have early adopters means early mainstream late mainstream laggards, right? But the mainstream which is 70% of the market.

Yeah, they won't adopt until they see years of there's adopting For most of the mainstream they don't want to be the first ones right? They don't want to be the guinea pig. They don't want to be the experiment let the early adopters do that when they see it working at competitors at peers then they do it and I think that's where we are now.

in in the whole Cloud native system We've got enough early adopters. We had it's time now where the mainstream is saying. Yeah, no, we got to do this and and what's my best way of doing it?

And and so that confidence builds so they get out of the weeds, right and they start coming here now because they they take that they have confidence in this. Yeah, everybody's doing it. They're willing to go beyond.

And I think I think 10,000 people here is proof of that to tell you the truth. Yeah, right. And that's an interesting perspective, you know, you know what in the open source we saw that.

Fluid always got traction, but the moment that AWS said we're going to use it for an infrastructure AWS Microsoft Google Cloud. I live Baba. That's that's the stamp that word it reaches that critical mass and goes Main Street.

Yeah. Anyway eduard and we're about at a time. Yeah, I want to thank later.

Thank you kind of talk with us come talk with us. Yeah, anytime. You're always reach out.

We do these by Zoom. Every day awesome. All right.

Well, thank you so much Eduardo here from caliphia fluid D. We're live. We're live with 10,000 people here in Amsterdam.

We're gonna be right back stay tuned.