Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:
- AI/data science
- data in general
- data architecture
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me for the week just ending.
Machine Learning / AI
- Jump Start Your Data Projects with Pre-Built Solution Accelerators. There is pressure on data science teams/data engineers/etc., to deliver value fast. However, it takes time to research, build data pipelines, models, etc., and this can suck up momentum. To help to overcome these obstacles, Databricks introduces in this blog post Databricks Solution Accelerators. These accelerators are fully-functional pre-built code to tackle the most common and high-impact use cases for data scientists, data engineers, etc.
- New Smart App: Kafka to Kafka Bridge. This post introduces the Kafka to Kafka Bridge. The bridge allows you to create message bridges between topics of the same or different Kafka brokers. We have developed something similar here at Derivco, but I will definitely check this out!
- Detecting Patterns of Behaviour in Streaming Maritime AIS Data with Confluent. This is part two in a blog series on streaming a data feed Apache Kafka (the first part is here). This post looks at how ksqlDB can be used to do aggregations and pattern matching against a data feed. Very cool!
WIND (What Is Niels Doing)
Apart from working on my Big Data & Analytics with SQL Server 2019 Big Data Cluster training class for the 2021 Data Platform Summit, I have started looking into Azure Data Explorer.
Azure Data Explorer is a fast, fully managed data analytics service for real-time analysis on large volumes of data streaming from applications, websites, IoT devices, and more. I am looking into it because I am thinking of creating some presentations for upcoming conferences and maybe a training class. Watch this space!
Oh, and don’t forget - if you sign up for my training class, mentioned above, at the 2021 Data Platform Summit, you get free access to the summit itself!
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.