How U Digital Built a Recommendation Engine in Record Time with DataStax Astra DB
Arré is one of India’s leading digital media brands, owned by U Digital Content. It’s home to Arré Studio, where users tell engaging and meaningful stories in fiction and nonfiction through web series, short videos, essays, podcasts, and Arré Voice. This women-first short audio app enables creators to tell their stories in 30 seconds. Through Arré Voice and Arré Studio, the company is building a monetizable creator ecosystem that brings together the best of new and professional creators.
30 million recommendations in 30 days
Real-time, personalized content delivery
Seamless integration and scalability
30 million recommendations in 30 days
Real-time, personalized content delivery
Seamless integration and scalability
Challenge
U Digital wanted to enhance its user engagement on Arré by delivering personalized recommendations through AI-driven algorithms. To achieve this goal, it sought a scalable and efficient vector database capable of handling large volumes of data and supporting real-time queries. Additionally, it needed a platform that seamlessly integrated with its existing infrastructure.
Solution
U Digital explored alternative solutions like Pinecone and Milvus but ultimately chose DataStax Astra DB due to its highly scalable distributed architecture, real-time querying capabilities, low-latency performance, and seamless integration with Arré’s existing infrastructure.
Astra DB efficiently manages Arré’s substantial user data volumes and captured user interests via its vector search capabilities, laying the groundwork for tailored recommendations. The platform's real-time query execution facilitates instantaneous personalized suggestions.
“Astra DB's low-latency features and cloud-native design also simplify deployment and reduce operational complexities, while its robust developer tools empower Arré's team to optimize recommendation algorithms efficiently,” said Shabeer Muhammed, senior software engineer at U Digital.
U Digital also partnered with Amazon Web Services (AWS), which achieved a scalable and secure infrastructure. Arré hosted its infrastructure on the AWS cloud, taking advantage of AWS's scalability, reliability, and security features to ensure optimal service performance and availability.
Arre leverages AWS Bedrock to power its embedding models and build a social graph that connects users with similar interests and behaviors. By integrating Bedrock’s foundation models, Arre can efficiently generate high-quality embeddings that capture nuanced relationships in user interactions and content preferences. This capability is crucial for creating accurate social graphs reflecting community dynamics.
U Digital also uses AWS compute services such as Amazon EC2 to handle backend processing and user requests, allowing for flexible resource scaling based on demand.
Results
By choosing Astra DB, U Digital successfully launched a robust recommendation engine that delivers personalized content to users in real time.
"We created a recommendation engine generating 30 million+ suggestions monthly in just 30 days—a record time for building a recommendation engine,” said Muhammed. “DataStax Astra DB and AWS were pivotal in our success, helping us achieve our goal within a remarkably short timeframe.”
U Digital explored alternative solutions but ultimately chose Astra DB on the AWS Platform due to its highly scalable distributed architecture, real-time querying capabilities, low-latency performance, and seamless integration with Arré’s existing infrastructure.
Astra DB’s scalability, reliability, and low-latency capabilities were crucial in enhancing user engagement and satisfaction on the platform. Vector search's generative AI-elevated content recommendation offers a more personalized user interface. Beyond enhancing user experiences, these implementations streamlined the development process, providing ready-made solutions for U Digital developers.