AI Platform Team with Patrick Debois at AIE 2024
Similarly to introducing Agile and DevOps, companies have pilot projects to release their first genAI features. They would bring in people that have an affinity for both AI and applications together to form the first change agent in a company. Once you have a few teams, you notice that there is shared AI infrastructure, you need enablement and governance across. This pattern has been used to introduce Cloud, Security and Developer Experience. In this talk we highlight:
– the shared components of the AI stack: proxies, caching, testing, feedback collection, guardrails, ect
– the steps (and struggles) to enable this across the whole engineering (hackatons, training, abstractions)
– how it fits in the existing SDLC workflow and processes (testing , versioning, observability , security)
