Throughout the week, I read a lot of blog-posts, articles, and so forth, that has to do with things that interest me:
- data science
- data in general
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me, for the week just ending.
Azure SQL Server
- Azure SQL digital event: Transform your applications with Azure SQL. This post announces a webinar by Bob Ward about Azure SQL, and how you can get the most out of Azure SQL. As the post says: “During this hour-long virtual event, I’ll share my advice and guidance on getting the most out of Azure SQL, whether you’re looking to migrate from an on-premises SQL Server deployment or exploring ways to utilize the newest Azure SQL service options. You will also hear firsthand experiences and best practices from customers who have become expert Azure SQL users.”. Bob is a legend in the SQL Server world, so if you are interested, hurry up and register!
Big Data
- How we use Apache Druid’s real-time analytics to power kidtech at SuperAwesome. This post looks at real-time analytics of big data using Kafka and Apache Druid. I like the post a lot!
- Easily Clone your Delta Lake for Testing, Sharing, and ML Reproducibility. The post linked to here introduces new functionality in Databricks Delta Lake; the ability to clone tables. This can come in handy for several scenarios: ML result reproducibility, data migration, significant changes to production tables, etc.
Event Driven Architecture
- From Monolith to Event-Driven: Finding Seams in Your Future Architecture. An excellent InfoQ article looking at what we can do when we want to migrate from a monolithic architecture to a microservices/domain driven architecture.
Streaming
- Event-driven Autoscaling for Kubernetes with Kafka & Keda. A very cool post looking at how to scale Kafka consumers on Kubernetes. As I said, very cool!
- Streaming Data from Apache Kafka into Azure Data Explorer with Kafka Connect. This blog post shows how to stream events from Apache Kafka on Confluent Cloud on Azure, into Azure Data Explorer, using the Kafka Connect Kusto Sink Connector.
WIND (What Is Niels Doing)
I am prepping for one of the largest data platform conferences taking place, (virtually), beginning of December this year: DATA PLATFORM VIRTUAL SUMMIT 2020. I hear you asking: “why are you prepping?”. Well, that’s because:
Figure 1: SQL Server & Kafka
Yes, I am speaking at the conference! My topic is about, as you can see in Figure 1, the various ways we can stream data from SQL Server to Apache Kafka.
The conference has world class-speakers, (and me), so hurry up and register!
~ Finally
That’s all for this week. I hope you enjoy what I did put together. If you have ideas for what to cover, please comment on this post or ping me.
comments powered by Disqus