On June 21, we hosted the 33rd edition of Mydbops MyWebinar, titled "Demystifying Real-Time Analytics with TiDB." The session was led by Kabilesh PR, Founding Partner of Mydbops. Kabilesh shared his extensive knowledge on real-time analytics and TiDB's capabilities in handling such workloads.

Webinar Highlights

Introduction to TiDB

TiDB is an open-source, distributed HTAP (Hybrid Transactional/Analytical Processing) database that is compatible with MySQL protocol. It offers horizontal scalability and high availability, making it ideal for mission-critical applications.

TiDB Architecture

TiDB separates compute from storage to simplify scaling. The Placement Driver acts as the orchestrator, managing tasks such as TSO, scheduling, shard maintenance, and metadata. TiKV, the transactional storage component, ensures high availability and strong consistency, scaling to hundreds of nodes with petabyte-level data.

Understanding Real-Time Analytics

Real-time analytics involves processing data as it is created, providing immediate insights for decision-making. Use cases include real-time fraud detection, market analysis, personalized recommendations, and demand forecasting. Challenges in this domain include data volume, velocity, integration, data quality, and cost.

TiFlash - The Real-Time Analytical Engine

TiFlash is an integrated columnar storage engine designed for analytical workloads. It uses the Clickhouse co-processor for MPP (Massively Parallel Processing) queries, seamlessly integrating with TiKV.

Data Sync and Enabling TiFlash

Data synchronization with TiFlash is done using the extended Raft-Learner Algorithm. Adding a TiFlash node online does not impact the OLTP workload. Replication to TiFlash can be configured at the table or schema level and monitored through specific SQL queries.

Scaling and Queries with TiFlash

Scaling TiFlash nodes can be done online without affecting OLTP workloads. The TiDB optimizer smartly determines the use of TiFlash replicas based on cost, and manual hints can be used to force TiFlash usage in queries. TiFlash also supports MPP and FastScan modes for different performance needs.

Thank You

We extend our gratitude to all attendees for making this webinar a success. Special thanks to Kabilesh PR for his insightful presentation. For those who missed it or want to revisit the content, we have provided the webinar recording and presentation slides below.

Resources

Webinar Recording: Watch the full session.

• Presentation Slides: Download the slides from the webinar.
• Mydbops Blogs on TiDB: Read our latest articles on TiDB database management and optimization.

Stay tuned for more webinars and meetups from Mydbops, where we continue to explore the latest in database technologies and solutions.Enhance your TiDB deployment with expert consulting services from Mydbops. Contact us today for performance tuning, optimization, and managed services tailored to your needs.

{{cta}}