Interesting Stuff - Week 38, 2021

Posted by nielsb on Sunday, September 19, 2021

Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:

  • AI/data science
  • data in general
  • data architecture
  • streaming
  • distributed computing
  • SQL Server
  • transactions (both db as well as non db)
  • and other “stuff”

This blog-post is the “roundup” of the things that have been most interesting to me for the week just ending.

Big Data

  • Launching at LinkedIn: The Story of Apache Pinot. This is the story of how Apache Pinot started from a “simple” beginning at LinkedIn, how it grew over time to being adopted at Uber. Very interesting!
  • Timeliness and Reliability in the Transmission of Regulatory Reports. Regulations impact more and more companies. Part of most regulations is the requirement to create reports for the regulators. God knows that we at Derivco feel the pain around this subject. The post linked to here demonstrates the benefits of the Databricks Lakehouse architecture in the ingestion, processing, validation and transmission of regulatory data.

Streaming

  • Confluent Unlocks the Full Power of Event Streams with Stream Governance. Data governance has become a requirement for most organizations, and the organizations have adopted the governance tools needed to manage their data. However, most of the tools are built for data at rest. What about streaming data? In this blog post, Confluent announces the release of their Stream Governance Suite, a set of tools allowing you to govern your streaming data. This is something we have wished for here at Derivco!
  • Kafka Summit Americas 2021 Recap. This year’s final Kafka Summit (Kafka Summit Americas) was a wrap earlier this week. The blog post lists some of the highlights of the summit. Have a look and see what catches your interest!

~ Finally

That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.


comments powered by Disqus