Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:
- AI/data science
- data in general
- data architecture
- streaming
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog post is the “roundup” of the things that have been most interesting to me for the week just ending.
Data Architecture
- Data Engineering in 2022: Architectures & Terminology. In this post by Robin Moffat, which is part of his Data Engineering 2022 series, he explains some of the terminology in the data engineering field: ETL, ELT, etc. If you are into data (and who isn’t), do yourself a favor and read his posts in this series.
- Data Engineering Annotated Monthly – September 2022. This is a data engineering newsletter I haven’t picked up on before. It looks at recent data engineering developments and highlights new ideas from the wider community. Some very interesting links here.
Azure Data Explorer
- Evaluate query performance of Azure Data Explorer. This post does what the title says. It looks at and provides guidance on evaluating performance through load testing your ADX cluster. It looks at what to consider when planning the test, the tools to execute the tests, and some load test results.
- Small Capacity Synapse. The cloud is great and makes things a lot easier when you want to test something. However, creating resource groups and resources can get a bit tedious, especially if you want to try something consisting of multiple components. That’s where what is presented in this link comes in. It leads to a GitHub repo which provides you with ready-made scripts to spin up a Synapse environment: the Small Capacity Synapse sandbox environment. Awesome!
Streaming
- Confluent Featured Among the Initial Wave of Partners for the Microsoft Intelligent Data Platform Partner Ecosystem. Back in May (2022), Microsoft introduced the Microsoft Intelligent Data Platform, whose goal is to provide an integrated set of data services unifying databases, analytics, and governance into a seamless experience. To achieve this, Microsoft needs partners from the industry, and since May, Microsoft has been busy signing up partners. This post announces how Confluent is now one of the initial partners in Microsoft Intelligent Data Platform. Watch out for great things to come!
WIND (What Is Niels Doing)
Related to the link above re. Confluent and Microsoft Intelligent Data Platform, I am doing a talk at Confluent’s Data In Motion Tour in Johannesburg October 26.
I will be talking about “Real-time customer experiences with Confluent & Microsoft”, a.k.a The Road to Data in Motion with Confluent & Microsoft.
The event is free, so if you are in the area, swing by and say Hi! You register here. Oh did I say it is free? Yes it is free 😄!
~ Finally
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.
comments powered by Disqus