The problem
In June 2025, T3 Chat Cloneathon (a hackathon) was launched. I have designed and implemented a system that features multi-model chats, resumable streams, chat sharing and other features.
Technical highlights
- I manually implemented a streaming library in Rust that supports OpenAI-compatible APIs.
- The frontend was implemented in React and Zustand was used for state management.
- The frontend state management quickly got very messy and was hard to debug.