This week a lot of AI/ML in the roundup. Specifically Generative AI and AI self-play. Really “cool” stuff.
Of course, I have some Kafka coverage as well. This in the form of a post about Confluent Platform 7.4 and all the new “goodies” in that release.
AI/ML - OpenAI
- AI self-play for algorithm design. This blog post by Microsoft Research discusses how AI systems can improve their programming abilities using self-play. Researchers show that AI can create, solve, and train on its own puzzles using easy-to-check, hard-to-solve programming problems. The researchers detail their work in a new paper, Language Models Can Teach Themselves to Program Better, which was accepted by the 2023 International Conference on Learning Representations (ICLR).
- Chat With Your Data To Build ML-Driven Customer Segments Using a Chatbot Built With ChatGPT and LangChain. The link is to a post about querying data using natural language, eliminating the need for SQL queries or coding skills. It explains how Natural Language Processing (NLP) and advanced AI technologies can allow users to interact with their data intuitively by asking questions in plain language.
- Using generative AI to imitate human behavior. This blog post discusses using diffusion models to mimic human behavior in interactive environments. The article explains how diffusion models can be used to generate diverse human behaviours and how they outperformed baselines in two aspects. The article also highlights the ability of diffusion to capture multimodal behaviour and how it can be leveraged to build agents that can behave in humanlike ways in interactive environments.
- Inferring rewards through interaction. This article discusses a new approach to solving the interaction-grounded learning (IGL) paradigm called IGL-P. IGL-P is the first IGL strategy for context-dependent feedback, the first use of inverse kinematics as an IGL objective, and the first IGL strategy for more than two latent states. This approach provides a scalable alternative to current personalized agent learning methods, which can require expensive high-dimensional parameter tuning, handcrafted rewards, and/or extensive and costly user studies. The success of IGL-P is demonstrated with experiments using simulations, as well as with real-world production traces.
Streaming
- Introducing Confluent Platform 7.4. The blog post linked announces the release of Confluent Platform 7.4. This release enhances scalability and simplifies architecture with production-ready KRaft support for new clusters. It also provides a self-service control plane for developers with Confluent for Kubernetes Blueprints and ensures trusted, high-quality data streams by leveraging Data Quality Rules for Schema Registry. The blog post explores each of these enhancements in detail, taking a deeper dive into the major feature updates and benefits.
WIND (What Is Niels Doing)
I am working on the fourth post in the Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer series. The post will cover how to query the data in Azure Data Explorer using Kusto Query Language (KQL), to satisfy the requirements for the leaderboard.
~ Finally
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.
comments powered by Disqus