The pattern is the same: the most sophisticated platforms are treating user behavior as sequences, not snapshots, recognizing that static embeddings miss the temporal dynamics and session context of how people actually use these products.
The difference becomes clear in how the feed responds to your behavior. Let’s say you click on a note about climate policy. In the old two-tower system, this single interaction would contribute minimally to your overall profile, especially if climate wasn’t already one of your core subscription topics. The model’s simplistic averaging approach... See more
The key difference is that sequential models maintain a dynamic representation of your current state. As you move through your feed, clicking on posts, subscribing to publications, engaging with notes, the model updates its understanding of where you are. It’s not just updating a long-term profile of your tastes. It’s tracking the momentum and... See more
The two-tower architecture has been the workhorse of modern recommendation systems, and for good reason: it’s elegant, scalable, and remarkably effective at learning patterns from massive amounts of data. Here’s how it worked for us once we deployed it in early 2024.
The system had two neural networks working... See more
Platforms like GoFundMe, reddit grief communities, mutual aid networks, real-time disaster storytelling, and global uprisings in reaction to systemic inequality are demonstrative, real world examples that connectivity breeds empathy and unity. The work of Taiwan’s digital minister Audrey Tang during the COVID-19 pandemic — quickly using the... See more
But I don’t think platform companies should—or can—act as the governance layer of our online lives. In this, I share tech journalist and Bluesky board member Mike Masnick’s informed belief that global centralized moderation is a dead end. And if centralized moderation isn’t a plausible way forward, then experimentation toward genuinely... See more
But digital media hasn’t become the antidote to television. Digital media, empowered by the serum of algorithmic feeds, has become super-television: more images, more videos, more isolation.