Interesting Stuff - Week 16, 2021

Posted by nielsb on Sunday, April 18, 2021

Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:

  • AI/data science
  • data in general
  • data architecture
  • streaming
  • distributed computing
  • SQL Server
  • transactions (both db as well as non db)
  • and other “stuff”

This blog-post is the “roundup” of the things that have been most interesting to me for the week just ending.

Databases

  • RocksDB Is Eating the Database World. This blog post looks at RocksDB, what it is and how it works. When reading the post, I was surprised by how many distributed databases used RocksDB as the layer to abstract access to local storage.

Machine Learning / AI

  • Microsoft Releases AI Training Library ZeRO-3 Offload. This InfoQ article looks at Microsoft’s ZeRO-3 Offload, which is an extension of the DeepSpeed AI training library. ZeRO-3 Offload improves memory efficiency while training very large deep-learning models. It allows users to train models with up to 40 billion parameters on a single GPU and over 2 trillion parameters on 512 GPUs. Impressive!

Azure SQL

Streaming

~ Finally

That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.


comments powered by Disqus