Presentations
Learn how cloud-native technologies like Kubernetes are revolutionizing database software, enabling scalability, resilience, and agility. Join Divine a Data on Kubernetes Ambassador to explore real-world examples and best practices for building the next generation of database solutions.
We went from running databases in a typical LAMP stack, to building databases to run in cloud like environments, to actually just running database in the hosted cloud (or a self-run hosted platform like Kubernetes). The principles of running your data stores, however, have not changed, and still require: monitoring, instrumentation, management, compliance, high availability, optimised performance, security, capacity planning, and keeping up with the SLAs.
You probably have an iPhone or Android phone that you used for pictures. Well what do all those pictures say about you or the world you live in? In this session I will show you how to use computer vision data curation to understand: are there themes in your pictures, which pictures are out of focus, which has your pet versus a QR code?
This talk will include working demos, each with Github repositories that you can use later. Come to learn some of the latest AI Computer Vision techniques by using photos you can relate to.
ClickHouse recently undertook a major refactoring of our operator to change how we orchestrate customer-provisioned databases through Kubernetes StatefulSets.
The challenge? Migrating thousands of services to the new orchestration system without any downtime. This talk explores how we accomplished this migration, diving into the complex challenges we faced and solved. We'll cover our custom migration controller, durable execution workflows, and database synchronization hurdles that emerged while keeping ClickHouse Cloud's fleet running smoothly.
Right now, there is a tremendous demand for AI ML solutions. The tasks of training and deploying open source AI models and then scaling inference have become crucial to business needs. Even though the underlying libraries are maturing rapidly, MLOps solutions have a long way to go. In this presentation, Crexi (Commercial Real Estate Exchange, Inc.) reveals how it achieved its business objectives with a powerful and flexible pipeline and model deployment solution, using open source tools to deploy open source models in AWS.
In this workshop, Leigh, Tanja, and Nick will show a GitOps workflow for both your team's laptops and Kubernetes clusters.
We'll cover the basics of Nix and Flox, a collaborative interface for using Nix as a team.
Attendees will work together in the hands-on portion to:
- bootstrap a frontend and backend project with Javascript, Go, and Postgres
- declare cross-platform tools and dependencies for build and development
- containerize their build in a Nix-native way
- use GitOps via Flux to promote their service to Kubernetes clusters with zero-downtime deploys
Digital citizen participation is widely regarded as a significant promise for democracy, yet its success is far from guaranteed. In this presentation, we will explore the key factors that contribute to successful and impactful participation. Drawing on examples and lessons learned from our extensive Consul community, which includes over 250 municipalities and governments, we aim to highlight practical insights and success strategies that not only build long-term trust in democracy but also yield innovative results.
On its face, bpftrace is a simple DSL/tracing-tool for writing BPF programs. It abstracts away a lot of the complicated user and kernel space code neccessary to write observability and debugging programs. However, adding new language features/syntax isn't easy. There are a lot of considerations to be made in regards to bpftrace's primary usecases and the classic problem of how much complexity/details to hide from the user.
We migrated our Slurm based AI research infrastructure to Kubernetes, focusing on a seamless user experience. This required innovative solutions for managing complex systems, including provisioning, authentication, access control, and host management.
We leveraged Kubernetes features to build a scalable and flexible infrastructure, and developed new approaches to configuration management. Join us to learn about our journey and the lessons we learned along the way.
We are used to calling Metrics, Logs, Events, Traces as the 4 pillars of Observability. True Observability is not attainable without being able to jump from one pillar to another. Exemplars promote the same from Metrics to Traces. Over the years, we have found extreme value in being able to use Exemplars for other things such as making tail sampling decisions, enriching alerts with sample traces and finally serving longer term Exemplars out of our tracestore built on top of ClickHouse. In this talk, we discuss how metrics and traces go hand in hand through the concept of Exemplars.