Niels Berglund

Interesting Stuff - Week 20, 2023

This week: Reinforcement Learning, Real-Time Streaming Ecosystem, Apache Spark Structured Streaming, Kafka Summit 2023, Data Saturday Johannesburg, Data Saturday Durban

Posted by nielsb on Sunday, May 21, 2023

Interesting Stuff - Week 19, 2023

ADX as Vector DB & Similarity search. Polars for Rust. ChatGPT and Pandas = PandasAI. Real-time streaming ecosystem and other cool stuff.

Posted by nielsb on Sunday, May 14, 2023

Interesting Stuff - Week 18, 2023

This week: Generative AI, pluse some more Generative AI. Build ML segments using chatbots, ChatGPT and LangChain. Confluent Platform 7.4 is released, some interesting things in that release.

Posted by nielsb on Sunday, May 7, 2023

Interesting Stuff - Week 17, 2023

The man that beat roulette, hooking up Azure Data Explorer and Kafka, real-time machine learning pipelines. Spark loader for Hugging Face datasets, processing data from multiple streaming platforms using Delta Live Tables and the real-time streaming ecosystem.

Posted by nielsb on Sunday, April 30, 2023

Interesting Stuff - Week 16, 2023

In this week's roundup, I cover some 'cool stuff': Azure Databricks Delta Engine, multi-platform Docker image for Kafka Connect and Kusto Sink. Generative AI for Synthetic Data creation. Using Databricks SQL together with LLMs.

Posted by nielsb on Sunday, April 23, 2023

Cross-Platform Compatibility Made Easy with Multi-Platform Docker Images: Azure Data Explorer Sink Connector & Kafka Connect

In this blog post, we'll explore the steps required to build and deploy multi-platform Docker images, without having to apply platform specific tags.

Posted by nielsb on Monday, April 17, 2023

Interesting Stuff - Week 15, 2023

This week: how Generative AI may shift focus from technology-driven to product-driven development. A game analytics framework/solution to help game developers analyze players. How to handle late-arriving events in Apache Flink. An introduction to materialized views and how they can help. Also, a plug for an upcoming post by me about how to build multi-platform Docker images.

Posted by nielsb on Sunday, April 16, 2023

Interesting Stuff - Week 14, 2023

This week: **Azure Data Explorer** (ADX) workshop, the third post in the series of building a real-time leaderboard using Kafka and ADX. Also links to building a GPT-powered application and a really interesting intro to reinforcement learning.

Posted by nielsb on Sunday, April 9, 2023

Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - II

In this post, I do not cover that much about leaderboards. I instead look at ingesting large volumes of data into ADX and how to transform that data using Azure Data Explorer Update Policies.

Posted by nielsb on Monday, April 3, 2023

Interesting Stuff - Week 13, 2023

This week: be cool, read about Polar vs Pandas. How to ingest data into ADX. On the streaming side really interesting about how to do Canary releases for streaming platforms. Also something extremely interesting: Machine Learning and Data Streaming!

Posted by nielsb on Sunday, April 2, 2023

Technology musings about coding and data. Some topics: .NET, SQL Server, AI/ML, Big Data, Streaming, Kafka, Azure Data Explorer, and a lot more.