Interesting Stuff - Week 4, 2021

Posted by nielsb on Sunday, January 24, 2021

Throughout the week, I read a lot of blog-posts, articles, and so forth, that has to do with things that interest me:

  • data science
  • data in general
  • distributed computing
  • SQL Server
  • transactions (both db as well as non db)
  • and other “stuff”

This blog-post is the “roundup” of the things that have been most interesting to me, for the week just ending.

Data Architecture

  • How to Build a Modern Data Lake with MinIO. This is a very “cool” post looking at creating a “poor man’s data lake”, by using open source technologies. In this case the technologies used are MinIO, and Trino. MinIO is an object store compatible with S3, and Trino is a distributed SQL query engine, (formerly known as Presto). As I said, a very interesting post! See below for a follow-up post.
  • Modern Data Platform using Open Source Technologies. This is the follow-up post, mentioned above. This post gives an overview of Trino and MinIO, and it also touches upon some features that they offer when implemented together as a data platform.
  • Data Engineering Weekly #21: Metadata Edition. This particular post is from the Data Engineering Weekly newsletter. This edition focuses on recent breakthroughs in metadata management. Very interesting! Oh, and do yourself a favor and subscribe to the newsletter!


WIND (What Is Niels Doing)

~ Finally

That’s all for this week. I hope you enjoy what I did put together. If you have ideas for what to cover, please comment on this post or ping me.

comments powered by Disqus