Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:
- AI/data science
- data in general
- data architecture
- streaming
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog post is the “roundup” of the things that have been most interesting to me for the week just ending.
Azure Data Explorer
- Ingesting Protobuf data from Kafka to Azure Data Explorer. As you know, I really like Azure Data Explorer and Kafka, and I have written a couple of posts about ADX and Kafka here and here. In my posts, the data I ingested was JSON. This post looks at how to ingest Protobuf data from Kafka into ADX. Very cool!
Data architecture
- Low-latency Streaming Data Pipelines with Delta Live Tables and Apache Kafka. Another Kafka-related post (you’d almost think Kafka is popular). This post looks at building a fully managed low-latency data pipeline to ingest, cleanse, transform and improve the quality of streaming data from Apache Kafka with Delta Live Tables. We at Derivco are very interested in this!
Data Science / AI / ML
- Artificial Intelligence for Beginners - A Curriculum. The link is to a GitHub repository containing an AI course for beginners, which was put together by Microsoft. It is free and consists of a 12-week, 24-lesson curriculum. This course introduces learners to a variety of AI concepts. It looks very, very interesting. At Derivco, we see AI/ML as the future, and our AI/ML champion Nadia is looking at what we can do to incorporate this curriculum with what we are doing.
- Announcing SynapseML for .NET – Large Scale ML with a Simple API. SynapseML (the artist formerly known as MMLSpark) has been around for a while and is an open-source library to simplify the creation of scalable machine learning pipelines. Recently SynapseML v0.10 was released, and part of that release was a new set of .NET APIs. This post looks at those APIs and how you can build scalable and intelligent systems for solving challenges using these new APIs. Very, very interesting!
Streaming
- Getting Started with Stream Processing: The Ultimate Guide. Regardless of your business, the ability to react in real-time has become increasingly important. We rely on streaming data to handle real-time data, and stream processing is critical to building real-time applications. This post looks at how ksqlDB can help your business create the types of applications that deliver rich, real-time customer experiences.
- Serverless Stream Processing with Apache Kafka, Azure Functions, and ksqlDB. We’re continuing with the stream processing theme from above. This post looks at serverless stream processing. More specifically, serverless in Microsoft Azure. The post builds an application that integrates ksqlDB and Azure Functions, using the best functions of each to really lean into the strengths of both.
~ Finally
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.
comments powered by Disqus