As opposed to last week with no Kafka related “stuff”, this week there is a fair chunk. So, in this roundup you get a link to Linux containers on Apple Silicon. A deep dive into Microsoft LMOps, Mastodon, Kafka and OpenSearch.
I appear in this roundup with a link to the first post in a series about developing Leaderboards using Kafka and Azure Data Explorer. Oh, there is also something about running Kafka on Kubernetes.
Misc.
- You can run a SQL Server Docker container on Apple M1 and M2 Silicon. This link is thanks to a colleague (and mate) of mine Yannick Dufour. He is a “sh*t hot” SQL Server Developer and DBA. He went over to the “dark side” (Apple Mac) many, many years ago while MacOS was still Intel based. Since then, he has upgraded to the newer Macs with Apple Silicon. He has been despondent since the Apple Silicon upgrade as he needs to run SQL Server, and SQL Server containers have not been supported on Apple Silicon (no ARM-based SQL containers). As you may know, I also switched over to Mac a while ago and have had the same issues as Yannick. So back to the link that Yannick sent me - the linked post discusses how you can now run Linux based containers on Apple Silicon. Yay!
AI/ML
- Microsoft Open Sources LMOps: A New Research Initiative to Enable Applications Development with Foundation Models, Part I. Some weeks ago, I wrote about Microsoft Open-Sourcing, their AI Prompt Optimization Toolkit LMOps. The post linked to is the first in a series drilling deeper into LMOps and looking at what it can do. Very interesting!
Streaming
- Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - Prelude. This is a post from yours, truly. As the title implies, it is the first post in a series looking at developing an online gaming leaderboard using Kafka and Azure Data Explorer. This first post lays the foundation and introduces a Python application for generating and publishing events running in a Docker container.
- Exploring Mastodon data with Apache Kafka and OpenSearch. This post describes how Mastodon can be integrated with Kafka and OpenSearch. Kafka can be used to process Mastodon’s data streams, allowing for real-time processing and analysis. OpenSearch can be used to store and search Mastodon’s data, making it easy to find and analyze information.
- What Is Kafka On Kubernetes?. This post explains how Kafka can be deployed on a Kubernetes cluster, which can provide benefits such as improved scalability, fault tolerance, and resource utilization. It provides a detailed walkthrough of deploying Kafka on a Kubernetes cluster using the Strimzi operator, an open-source Kubernetes operator for running Kafka on Kubernetes. The article also covers some critical benefits of using Kafka on Kubernetes, including the ability to scale up and down dynamically, automate the deployment and management of Kafka, and other “cool” Kubernetes features.
WIND (What Is Niels Doing)
Let me first start with what I have been doing. At Derivco, we take in graduates every year. Part of the graduate programme is that the graduates meet with Derivco staff who talks to them about “life at Derivco”:
- Derivco Graduates. In this link you see me and Mike Mallet, who is one of our Execs, “imposing” 😄 our “wisdom” on the graduates.
So, onto what I am doing. You may have seen me publishing the first post in a series: Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer. So right now I am figuring out what to cover in the next post in the series.
~ Finally
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.
comments powered by Disqus