Zero-downtime Kubernetes migration of 14K Apache Pinot database fleet at LinkedIn
LinkedIn recently migrated its production Apache Pinot fleet from on-premises bare-metal hardware to Kubernetes with zero downtime. This tech talk will explore the technical journey, focusing on design choices, the challenges and trade-offs faced, and a balance of building custom tools versus leveraging existing solutions.
Key highlights include availability zone-aware data shard placement, automated OLAP table migrations with Airflow and Temporal, performance testing, pre- and post-migration validations, and disruption management. Lessons learned and valuable strategies for ensuring uninterrupted service-level objectives (SLOs) will also be shared.
`git push` to etcd: An Anatomy of Flux
What actually happens between a `git commit` and running Pods? In this session, Leigh will trace the instructions that make up a GitOps reconciliation.
We will peel back the layers of Flux's architecture, exploring:
- Native Go SDKs (no fork/exec) and `controller-runtime` queues
- API Machinery internals like Server-Side Apply, Resource Versions, and etcd
- Performance tuning using the Flux Operator dashboard
This session will be a fun, deep adventure. Come read some code with us!
“Millions-to-One, Words-to-Terms” – Generative AI Tools in Action for Rare Disease Diagnosis and Patient Data Harmonization
Precision medicine is constrained by two major data interpretation bottlenecks: the “Millions-to-one” challenge of filtering millions of genomic variants from next-generation sequencing to identify a single causative variant for molecular diagnosis reporting, and the “Words-to-terms” challenge of transforming unstructured clinical jargon into standardized, interoperable ontology terms. We present two novel Generative AI (GenAI) frameworks addressing these challenges. Both systems integrate contextual information with knowledge from curated medical databases and real-time web data. Evaluation using both open-source Kimi 2 and closed-source Gemini-2.5-pro yielded similarly accurate results.




