Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:
- AI/data science
- data in general
- data architecture
- streaming
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me for the week just ending.
Misc.
- Rapid Event Notification System at Netflix. This post from the Neflix tech blog looks at the Rapid Event Notification System (RENO), which Netflix developed to support use cases that require server-initiated communication with devices in a scalable and extensible manner. The post gives an overview of the system and shares “lessons learned”.
Data Architecture
-
How Gemini Built a Cryptocurrency Analytics Platform Using Lakehouse for Financial Services. This post is about crypto market leader Gemini and how they partnered with Databricks to build an order book analytics platform using the Lakehouse architecture. Very interesting post! I have some “cool” takeaways from the post!
-
Apache Druid vs Apache Pinot - Which One Should You Choose?. Apache Druid and Apache Pinot are two open-source OLAP datastore popular for real-time analytics. This post discusses the similarities and differences between the two, along with the use cases to help you understand which scenario favors Druid more and vice versa.
Azure Data Explorer
- Deleting individual records in a table. This post does what “it says on the tin”: it looks at how to delete individual records from a table in an Azure Data Explorer cluster. Very interesting!
Streaming
- Bringing Your Own Monitoring (BYOM) with Confluent Cloud. Confluent Cloud provides a Metrics API to see performance data for a cluster. This means you can configure an application performance monitoring (APM) product with a Confluent Cloud cluster to monitor the telemetry flowing through the cluster. This blog post uses the Metrics API, Docker, Prometheus, Grafana, Splunk, and Datadog to create a complete monitoring solution for a Confluent Cloud deployment.
WIND (What Is Niels Doing )
Prepping, prepping, prepping:
Figure 1: Sessions at SQLBits 2022
SQLBits 2022 is very close now, and I am nowhere near ready to present the sessions you see in Figure 1, <sigh>! However, somehow all will be OK! Details of the sessions:
- A Day of Azure Data Explorer. Full day training class.
- ksqlDB - The Real-Time Streaming Database. Conference session.
- Analyze Billions of Rows of Data in Real-Time Using Azure Data Explorer. Conference session.
There are still seats available for my training class as well as the conference. You register here!
See you in London in two weeks time!
~ Finally
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.
comments powered by Disqus