Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:
- AI/data science
- data in general
- data architecture
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me for the week just ending.
- Announcing Photon Public Preview: The Next Generation Query Engine on the Databricks Lakehouse Platform. This post looks at the new vectorized query engine on Databricks; Photon. It is included as part of a new high-performance runtime designed to run SQL workloads faster and reduce the total cost per workload.
- Introduction to Geospatial Queries in Apache Pinot. Geospatial data has become increasingly important when analyzing Big Data. Deriving insights from timely and accurate geospatial data can enable mission-critical use cases in organizations and give them a competitive edge. Geospatial support has recently been added to Apache Pinot, and this post looks at the challenges of analyzing geospatial at scale and how it is implemented in Apache Pinot.
- Gently down the stream: A gentle introduction to Apache Kafka. This is a fantastic introduction to Kafka! Nothing more needs to be said!
- Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka. As the title implies, this post looks at how Consistency and Completeness are implemented in Apache Kafka and Kafka Streams. Very interesting!
WIND (What Is Niels Doing)
- Revolutionise how you develop software with GitHub. This is not so much what I am doing, but what a colleague and mate is doing. Gordon Beeming, Microsoft MVP and Devops guru, is doing a Derivco Tech-Thursday Webinar Thursday, June 24. Gordon looks at some new GitHub features in the webinar, allowing you to deliver more value to your customers. The webinar is public, and you can sign up here. Don’t miss it!
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.