Niels Berglund

Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - II

In this post, I do not cover that much about leaderboards. I instead look at ingesting large volumes of data into ADX and how to transform that data using Azure Data Explorer Update Policies.

Posted by nielsb on Monday, April 3, 2023

Interesting Stuff - Week 13, 2023

This week: be cool, read about Polar vs Pandas. How to ingest data into ADX. On the streaming side really interesting about how to do Canary releases for streaming platforms. Also something extremely interesting: Machine Learning and Data Streaming!

Posted by nielsb on Sunday, April 2, 2023

Interesting Stuff - Week 12, 2023

This week I link to posts about creating customised chatbots using GPT-4. It is also a link to an interesting post about developing a realtime ticketing booking system.

Posted by nielsb on Sunday, March 26, 2023

Interesting Stuff - Week 11, 2023

This week I link to a learning path for Azure Data Explorer and Kusto Query Language. I finally published the second post about Leaderboards using Kafka and ADX. In the post you also find OpenAI "stuff".

Posted by nielsb on Sunday, March 19, 2023

Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - I

This post continues the journey towards creating a leaderboard system. In this post we learn more about ADX and why it is an excellent choice for near real-time applications, how to 'hook up' Kafka to ADX and how to ingest data into an ADX database.

Posted by nielsb on Sunday, March 19, 2023

Interesting Stuff - Week 10, 2023

Streaming, streaming, and more streaming. We start with an excellent introduction to Flink, followed by a look at the potential consequences of Confluent's acquisition of Immerok. I finish off with a link to a post looking at the benefits of event streaming.

Posted by nielsb on Sunday, March 12, 2023

Interesting Stuff - Week 9, 2023

This weekly roundup covers prompt engineering for Generative AI. I also cover stream processing vs real-time OLAP DBs; using Kafka and other open-source technologies to build AWS data lakes. To finish off: Spark Structured Streaming and REST APIs.

Posted by nielsb on Sunday, March 5, 2023

Interesting Stuff - Week 8, 2023

This week I cover Linux containers on Apple Silicon. There is also how to use Mastodon, Kafka and Open Search together. Let us not forget my post about leaderboards and Azure Data Explorer.

Posted by nielsb on Sunday, February 26, 2023

Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - Prelude

This post is the first in a series about developing online gaming leaderboards. This post sets the foundation and you use Docker to run Kafka as well as Python in a container generating and publishing events.

Posted by nielsb on Sunday, February 26, 2023

Interesting Stuff - Week 7, 2023

So this week, I link to posts about the new v2 Python programming model for Azure functions as well as 'Tinder' for Azure Data Explorer, a.k.a 'Find a Partner'. Then there is quite a bit about OpenAI: use OpenAI in Synapse Analytics, a link to a post by John Gruber about the new Bing, etc.

Posted by nielsb on Sunday, February 19, 2023

avatar

Technology musings about coding and data. Some topics: .NET, SQL Server, AI/ML, Big Data, Streaming, Kafka, Azure Data Explorer, and a lot more.