Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:
- AI/data science
- data in general
- data architecture
- streaming
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me for the week just ending.
Misc.
- Fixing Performance Regressions Before they Happen. This Netflix blog post looks at one of the strategies they use to quickly and easily detect performance anomalies before they are released — and often before they are even committed to the codebase.
Distributed Computing
- When to Use Two Phase Commit in Distributed Transaction. Ah, one of my favorite topics - distributed transactions and 2 phase commit! This post looks at helping you understand the pros and cons of the 2PC algorithm and build capability to thoroughly assess the trade-off between different algorithms for your future system designs.
- Decoupled Transactions: Low Tail Latency Online Transactions Atop Jittery Servers (CIDR 2022). In last weeks roundup, I mentioned the CIDR conference and how the talks were available on YouTube. The post linked to by Murat looks at a White Paper submitted to the conference by Pat Helland. If you are not interested in reading the post (or the paper), Pat’s talk based on the white paper is now up on YouTube: Decoupled Transactions: Low Tail Latency Online Transactions Atop Jittery Servers. The video is very, very “watch worthy”!
Azure Data Explorer
- ADX dashboards January 2022 updates. As the title implies, this post looks at new functionality introduced for dashboards in Azure Data Explorer. Hmm, the ability to export dashboards, very cool!
Data Architecture
- All Eyes on Snowflake and Databricks in 2022. It’s hard to overstate Snowflake and Databricks’ impact on the data industry for customers, partners, and competitors. This blog post looks at both Databricks and Snowflake and tries to determine what 2022 has in store.
- Modern Data Stack: Which Place for Spark ?. This very interesting post looks at why you rarely see any mentions of Apache Spark in articles about the Modern Data Stack.
- Building Reference Architectures for User-Facing Analytics. User-facing analytics can be challenging to implement and, more specifically, user-facing analytics at scale. The post, written by Dunith Dhanushka, discusses several blueprints for building scalable analytics infrastructure to deliver user-facing analytics. This is a MUST read post if you are interested in real-time user-facing analytics.
Streaming
- What’s New in Apache Kafka 3.1.0. This post highlights some of the more prominent features in the newly released 3.1.0 version of Apache Kafka.
WIND (What Is Niels Doing)
In the coming days and weeks, I will be prepping for quite a few conference talks:
Figure 1: Stream Processing with Apache Kafka and .NET
- Stream Processing with Apache Kafka and .NET. This is a Meetup user group talk, where I discuss Kafka, .NET and stream-processing.
Figure 2: SQLBITS 2022 - A Day of Azure Data Explorer
- A Day of Azure Data Explorer. This is a one-day training class about Azure Data Explorer at SQLBits 2022. I am presenting live (woohoo), but you can also attend virtually.
Figure 3: ksqlDB - The Real-Time Streaming Database
- ksqlDB - The Real-Time Streaming Database. An SQLBits 2022 conference talk, where I - in this demo filled session - look at using ksqlDB to gain real-time insights into streaming data. We look at push/pull queries, User Defined Functions, tables, streams, and other cool stuff.
Figure 4: Analyze Billions of Rows of Data in Real-Time Using Azure Data Explorer
- Analyze Billions of Rows of Data in Real-Time Using Azure Data Explorer. This is my second conference talk at SQLBits 2022 (not counting the training day). In this session (full of demos), we get an overview of Azure Data Explorer. We look at how to ingest data and query in real-time against billions of rows with sub-second latency.
For the SQLBits related “stuff” (training day and conference), you register here.
I hope to see you either at the .NET to the Core session or at SQLBits!
~ Finally
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.
comments powered by Disqus