Kafka Git ksqlDB KStreams SQL Server 2019 Big Data Cluster

Interesting Stuff - Week 12, 2020

Posted by nielsb on Sunday, March 22, 2020

Throughout the week, I read a lot of blog-posts, articles, and so forth, that has to do with things that interest me:

  • data science
  • data in general
  • distributed computing
  • SQL Server
  • transactions (both db as well as non db)
  • and other “stuff”

This blog-post is the “roundup” of the things that have been most interesting to me, for the week just ending.

Misc.

  • Six Rules for Good Git Hygiene. My Git knowledge is minimal, so this post about how to be a team player with commits, pushes, and pulls was really useful for me.

Streaming

  • How to Use Stateful Operations in Kafka Streams. The post linked to here explores stateful operations in the Kafka Streams DSL API. It focuses on aggregation operations such as aggregate, count, and reduce along with a discussion of related concepts. The post is the second in a series about Kafka Streams API, and the first post is here.
  • How to Test Kafka Streams Applications. This post is the third in the series mentioned above, and the post explores a few examples of how to use the testing utilities provided by Kafka streams to validate topologies based on the Kafka Streams DSL API.
  • Announcing ksqlDB 0.8.0. As the title of the post says, the post covers the new version of ksqlDB. There are quite a few new features that I cannot wait to test!
  • KLIP 15 - ksqlDB Client and New Server API. From reading the announcement above about ksqlDB 0.8.0, I came across the page linked to here. Getting new ksqlDB client and server APIs to make stream developing easier is a game changer! I, for one, am eager to hear more about this. Oh, and here is a lengthy Google Group discussion around this.

NOTE: KLIP stands for “Kafka Language Improval Proposal”

WIND (What Is Niels Doing)

What a weird week this has been all thanks to the Coronavirus! On Sunday, (Mar 15), the president of South Africa - Cyril Ramaphosa - declared the Coronavirus a national disaster and more or less put the country in lock-down.

This resulted in that on Monday morning at Derivco, everyone that had remote working capabilities was sent home. For the remainder of staff, plans were made how to get them up-and-running remotely. At the end of the week most of the company, (~1800 people), worked from home. Way to go Derivco!

So since Monday afternoon, I have been working from home, and even though it is a bit strange initially, the whole experience has been overall positive.

You may remember how I in last weeks roundup wrote that I am “blogifying” one of the conference talks I do about SQL Server 2019 Big Data Cluster: A Lap Around SQL Server 2019 Big Data Cluster. Working from home has not given me any more time with the post, but I am nearly there, and it should be out in the next week.

~ Finally

That’s all for this week. I hope you enjoy what I did put together. If you have ideas for what to cover, please comment on this post or ping me. Most importantly stay safe out there!

comments powered by Disqus
CATALOG