Throughout the week, I read a lot of blog-posts, articles, and so forth, that has to do with things that interest me:
- data science
- data in general
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me, for the week just ending.
Misc.
- Microsoft Releases Application Inspector, a Tool for Examining Code Security. This InfoQ article discusses Microsoft Application Inspector a source code analyzer with some interesting features. The application not only detects “poor” programming practices, but it also surfaces and reports interesting characteristics the code that would be difficult/time-consuming to identify.
Data Science / Machine Learning
- ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters. The blog post linked to here looks at ZeRO, ( Zero Redundancy Optimizer), which is a memory optimization technology for large-scale distributed deep learning. From the post: ZeRO can train deep learning models with 100 billion parameters on the current generation of GPU clusters at three to five times the throughput of the current best system. Wowza! Those are large numbers!
Streaming
- Domain Events versus Change Data Capture. The topics of change data capture and event-based systems come more and more up in various discussions. In the linked post, the author looks at these topics and explains the differences as well as when to use what.
- Announcing ksqlDB 0.7.0. In last weeks roundup I covered a post by Robin Moffat where he looked at a new feature in the upcoming ksqlDB 0.7 release. The post linked to here is the official announcement of ksqlDB 0.7. There are quite a few new interesting features in the release, and us at Derivco will definitely look at the release.
- Integrating Elasticsearch and ksqlDB for Powerful Data Enrichment and Analytics. In the post linked to here, the author looks at how we can use both Elasticsearch and ksqlDB to get more intelligence from your streaming data.
~ Finally
That’s all for this week. I hope you enjoy what I did put together. If you have ideas for what to cover, please comment on this post or ping me.
comments powered by Disqus