Niels Berglund

Interesting Stuff - Week 13, 2023

This week: be cool, read about Polar vs Pandas. How to ingest data into ADX. On the streaming side really interesting about how to do Canary releases for streaming platforms. Also something extremely interesting: Machine Learning and Data Streaming!

Interesting Stuff - Week 12, 2023

This week I link to posts about creating customised chatbots using GPT-4. It is also a link to an interesting post about developing a realtime ticketing booking system.

Interesting Stuff - Week 11, 2023

This week I link to a learning path for Azure Data Explorer and Kusto Query Language. I finally published the second post about Leaderboards using Kafka and ADX. In the post you also find OpenAI "stuff".

Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - I

This post continues the journey towards creating a leaderboard system. In this post we learn more about ADX and why it is an excellent choice for near real-time applications, how to 'hook up' Kafka to ADX and how to ingest data into an ADX database.

Interesting Stuff - Week 10, 2023

Streaming, streaming, and more streaming. We start with an excellent introduction to Flink, followed by a look at the potential consequences of Confluent's acquisition of Immerok. I finish off with a link to a post looking at the benefits of event streaming.

Interesting Stuff - Week 9, 2023

This weekly roundup covers prompt engineering for Generative AI. I also cover stream processing vs real-time OLAP DBs; using Kafka and other open-source technologies to build AWS data lakes. To finish off: Spark Structured Streaming and REST APIs.

Interesting Stuff - Week 8, 2023

This week I cover Linux containers on Apple Silicon. There is also how to use Mastodon, Kafka and Open Search together. Let us not forget my post about leaderboards and Azure Data Explorer.

Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - Prelude

This post is the first in a series about developing online gaming leaderboards. This post sets the foundation and you use Docker to run Kafka as well as Python in a container generating and publishing events.

Interesting Stuff - Week 6, 2023

You can read about the fully managed Azure Load and Performance testing service. The open sourcing of LMOps: a collection of tools for improving text prompts used as input to generative AI models. Also interesting is vector search, and what you can do with it. Finally if you are interested in Kafka there is an excellent introductory guide to Kafka.

Interesting Stuff - Week 5, 2023

In this week's roundup, you'll read about optimized locking in Azure SQL (very cool) and why Flink is so popular. Related to Flink, we also look at operational use cases for Flink, as well as some Flink CEP "stuff".