Throughout the week, I read a lot of blog-posts, articles, and so forth, that has to do with things that interest me:
- data science
- data in general
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me, for the week just ending.
Big Data
- Diving Into Delta Lake: DML Internals (Update, Delete, Merge). Later releases of Delta Lake supports DML, (data manipulation language), statements. The post linked to here demonstrates how to use each of these DML commands, describes what Delta Lake is doing behind the scenes when you run one, and offers some performance tuning tips for each one. Very cool!
Streaming
- Introducing Confluent Platform 6.0. As the title of this post says; the post is about the new 6.0 release of Confluent Platform. Reading the post, this release looks huge. There are so many interesting things in there, but the ones that stand out for me are the ksqlDB improvements! For more information about the new ksqlDB functionality, look at the post ksqlDB 0.12.0 Introduces Real-Time Query Upgrades and Automatic Query Restarts. This is awesome!
- How Real-Time Stream Processing Works with ksqlDB, Animated. While we are on the subject of ksqlDB, this post is doing a great job how ksqlDB works. If you are interested in ksqlDB at all, you must read the post!
- ksqlDB Meets Java: An IoT-Inspired Demo of the Java Client for ksqlDB. Even more ksqlDB. The post linked to here looks at the new ksqlDB Java client. So, instead of using REST API’s, you can now do ksqlDB “stuff” programmatically, using this new client, That is very, very interesting!
WIND (What Is Niels Doing)
Yes, what AM I doing? Sometimes, quite often actually, I wonder that myself. Today, however, I do know what I am doing, or more specifically, what I just did! Yesterday, (October 3), I delivered a virtual conference talk at SQLBits about SQL Server and Kafka.
Unfortunately, the talk was pre-recorded, and after I had uploaded the recording, the organizers did some editing. I messed up with what parts of the talk needed editing, so the result was that around a third of the talk was missing. Not good! Anyway, the organizers will do a re-edit and upload so that attendees can view it on demand. If you were one of the attendees, I do apologize again!
Anyway, today I uploaded the slide deck as well as all code for the talk, (including instructions). If you are interested, you can download it from here. If you have questions comments etc., please ping me.
~ Finally
That’s all for this week. I hope you enjoy what I did put together. If you have ideas for what to cover, please comment on this post or ping me.
comments powered by Disqus