DevOps Exchange February - Amazon, Grafana Labs, Zuhlke Engineering

We're back on Thursday 27th February for our next DevOps Exchange London event, hosted by our good friends at Zuhlke Engineering.

**For this event, all RSVPs must be made via Eventbrite here.

In our usual style, we’re excited to welcome four expert speakers to the stage as they guide us through the latest advancements and emerging trends in the ever-evolving world of DevOps.

Srivalsan Mannoor from Amazon will kick-start the evening with a talk around the growing trend of multi-cloud strategies and how organisations are leveraging Kubernetes to host Large Language Models (LLMs) applications efficiently.

Tulayb Mahmood from Grafana Labs will then dive into their journey through the evolving observability landscape, highlighting how they seamlessly integrated diverse tools and capabilities to establish themselves as a leader in the field.

Finally, we will be joined by Immo Huneke and Istiaque Shaikat from our hosts at Zuhlke Engineering as they unveil ZAG, their plug-and-play, agent based AI chatbot, adaptable to customer data and use cases. They will also highlight how their DevOps expertise transformed ZAG from an Azure only solution into a seamless multi-cloud deployment.

Our usual format will be followed, with the 3 x 20 minute talks starting at 7pm. Refreshments and drinks will be available on the night, courtesy of Zuhlke Engineering!

Agenda:

6:30pm - Doors open

7:00pm - Srivalsan Mannoor, Cloud Architect @ Amazon
"Deploying LLMs in Kubernetes cluster the DevOps way"

Organisations are leaning more towards the multi-cloud strategy as it allows them to stay agile, avoid vendor lock-in, run their workloads more optimally, reclaim some control of their infrastructure, and meet strict compliance requirements. Due to this trend, there is an appetite to host LLM applications in Kubernetes cluster to make the best use of the resources.

This talk will discuss how to deploy LLM's in Kubernetes using open source stack such as RayServe and vLLM and also provide insights about observability and monitoring while hosting and deploying LLM's.

Bio: Cloud Architect with Amazon Web Services whose interests include Containers, Kubernetes, Data Engineering. A public speaker by passion, Srivalsan has given tech talks in multiple AWS Events, CNCF meetups & AWS User Group meetups in London and Liverpool.

7:20pm - Tulayb Mahmood, Staff Solutions Engineer @ Grafana Labs
"From Zero to Observable"

With the observability space moving at lightning speed, toolsets and best practices constantly evolve and it can be tough to keep up. In this talk, we'll go through Grafana Labs' own journey and how it weaved together different tools and capabilities to become a force in observability.

Bio: Tulayb works as a Staff Solutions Engineer at Grafana Labs, where he leads technical engagements with Grafana users - from architecting solutions built on the Grafana Stack to frequently presenting at meetups, conferences and webinars. He has a background in observability & cloud infrastructure.

7:40pm - Immo Huneke & Istiaque Shaikat @ Zuhlke Engineering
“Is it LLMOps? Delivering an AI solution on multiple Cloud platforms”

Zühlke helps rewire organisations for the future, embedding technology at their core so that they can run smarter today and embrace tomorrow. Generative AI is on every executive’s agenda today as a key technology that must be leveraged to reduce costs and increase output. We close the gap between aspiration and implementation by providing highly skilled and motivated teams, using tools and accelerators honed over successful deliveries.

In this talk and demo, we showcase one of these accelerators - ZAG, a plug-and-play agent-based selectable-model AI chatbot that is adaptable to our customers’ data and use cases. Along with the technology demonstrator, we throw a light on how our DevOps expertise enabled us rapidly to turn the initial Azure-only implementation into a multi-cloud deployment.

Bio: Immo, a software developer since 1980, is passionate about advancing the field while ensuring an enjoyable process. Chair of the BCS SPA specialist group, he has been involved since the late 1980s. Currently a DevOps Engineer at Zühlke Engineering Ltd, he brings expertise across multiple industries and technologies.

Bio: I'm a Machine Learning Engineer driven by AI, problem-solving, and adventure. Originally from Dhaka, Bangladesh, I studied Computer Science at BRAC University, where my published thesis on EEG-based emotion recognition ignited my passion for AI.

We hope to see many of you on the night!

Thanks,

The DOXLON team