Throughout the week, I read a lot of blog-posts, articles, and so forth, that has to do with things that interest me:
- data science
- data in general
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me, for the week just ending.
SQL Server
- Azure SQL Sessions Recap at Microsoft Build 2020. This post contains links to all the various sessions around Azure SQL Server at this year’s MS Build conference. Quite a few very interesting sessions!
Streaming
- Consistent Metastore Recovery for ksqlDB Using Apache Kafka Transactions. The post linked to here is a continuation of the post I covered in my week 18 roundup; about ksqlDB Execution Plans. This week’s post discusses some of the work that’s gone into preserving the integrity of ksqlDB’s internal state in interactive mode.
- Stream Processing with IoT Data: Challenges, Best Practices, and Techniques. In this post, the author looks at Tesla’s architecture and tech for handling IoT data. I found the post very interesting, and, even though at Derivco we do not deal with IoT data, we can definitely implement some of the principles outlined in the post.
- Taming Large State: Lessons from Building Stream Processing. In this InfoQ presentation, the presenters talk about how Netflix solved a complex join of two high-volume event streams using Flink. They also discuss managing out of order events and processing late arriving data.
- Real-Time Fleet Management Using Confluent Cloud and MongoDB. The post linked to here looks at how to build a system incorporating ksqlDB, Kafka Connect, MongoDB, all in the cloud. The solution, in this case, is for fleet management, but it could be anything. Very cool!
WIND (What Is Niels Doing)
As I wrote in the roundup from last week, lockdown restrictions here in SA have been relaxed, a bit. That means that you can now exercise whenever you want, instead of between 06:00 - 10:00 am; yay!, (that was sarcasm). For me, nothing has really changed, and I do not think I’ll be back in the office until July/August.
In our Durban Azure Transformation Labs user group, we had the first monthly News & Catchup meeting. This meeting is virtual, and we get together the first Tuesday every month chatting about what has happened in the industry during the month just gone by. If you are interested in what was said, the recording of the event 10 is up on YouTube: News & Catch up June 2020.
~ Finally
That’s all for this week. I hope you enjoy what I did put together. If you have ideas for what to cover, please comment on this post or ping me.
comments powered by Disqus