Interesting Stuff - Week 43, 2021

Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:

  • AI/data science
  • data in general
  • data architecture
  • streaming
  • distributed computing
  • SQL Server
  • transactions (both db as well as non db)
  • and other “stuff”

This blog-post is the “roundup” of the things that have been most interesting to me for the week just ending.

Big Data

  • The Hitchhiker’s Guide to the Data Lake. This post discusses considerations and best practices around how to effectively utilize Azure Data Lake Storage Gen2 in large scale Big Data platform architectures. I found this post to be extremely useful!

Streaming

  • Introducing Apache Spark 3.2. In last week’s roundup, I linked to a post about a new Window type coming in Apache Spark 3.2: the session window. The post linked to here looks at other new interesting features in the 3.2 release!
  • Best Apache Kafka Books in 2021. Well, not much to say really here. As the title says, the post lists the Kafka books the author likes best.

WIND (What Is Niels Doing)

Today and tomorrow, I am putting the finishing touches on my video recording for the PASS Data Community Summit 2021:

If you are interested you can register here. The conference sessions are free!

In addition to the above, I am also working on a blog post looking at ingesting data from Kafka into Azure Data Explorer. I’ve been working on it for quite a while now. Hopefully, I’ll have it done within a week or two.

~ Finally

That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.


Blog Feed:

To automatically receive more posts like this, please subscribe to my RSS/Atom feed in your feed reader!

Interesting Stuff - Week 42, 2021 How to Ingest Into Azure Data Explorer From Apache Kafka using Kafka Connect

Related Articles

comments powered by Disqus