Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:
- AI/data science
- data in general
- data architecture
- streaming
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me for the week just ending.
Big Data
- Azure Synapse and Delta Lake. If you are using Azure for Big Data, the chances are high that you also use Azure Databrick’s Delta Lake format. You may also use Azure Synapse for analysis, etc. This post looks at the support and interaction between Azure Synapse and Delta Lake.
Azure Data Explorer
- Create and Maintain Your Own KQL Demo Environment with the New Start-for-free Cluster. Azure Data Explorer is the “best thing since sliced bread”, together with Kusto Query Language (KQL). One slight problem with learning ADX and KQL is that you’s need to spin up an ADX cluster if you want to ingest data etc. Sure, there are help clusters around with data, but those are read-only. So, to make it easier to “play around” with ADX and KQL, Microsoft has just released a Start-for-free Cluster program. You can read all about it in the post linked.
Streaming
- Near real-time features for near real-time personalization. This is an exciting post by the LinkedIn engineering team. In the post, they look at LinkedIn’s personalization recommendation journey, from pretty much batch-oriented to doing this in near real-time. Obviously Kafka plays a big part!
WIND (What Is Niels Doing)
This:
Figure 1: London Calling
Yay, finally! Later today I am flying out to London for SQLBits 2022, where I deliver the following:
- A Day of Azure Data Explorer. Full day training class.
- ksqlDB - The Real-Time Streaming Database. Conference session.
- Analyze Billions of Rows of Data in Real-Time Using Azure Data Explorer. Conference session.
There are still seats available for my training class and the conference itself. You register here!
A HUGE shout-out to my employer Derivco, who helps with some of my costs for the trip. They also sponsor some SWAG - another reason to come to my sessions.
THANK YOU, Derivco
So, if you are at SQLBits, please come by and say Hi!
~ Finally
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.
comments powered by Disqus