GrocLM: Grocery Category Recommendation in E-Commerce with Large Language Models
GrocLM is a fine-tuned large language model designed for grocery category recommendation in e-commerce, addressing cyclical purchasing behavior and diverse user intents. It employs a two-stage LoRA-based training strategy to encode cyclical purchasing patterns directly into model parameters, improving the utilization of rebuying signals compared to prompt-based conditioning. A trie-based constrained decoding mechanism ensures valid and controllable outputs over a predefined category space. Exper
Analysis
TL;DR
- GrocLM is a fine-tuned large language model designed for grocery category recommendation in e-commerce, addressing cyclical purchasing behavior and diverse user intents.
- It employs a two-stage LoRA-based training strategy to encode cyclical purchasing patterns directly into model parameters, improving the utilization of rebuying signals compared to prompt-based conditioning.
- A trie-based constrained decoding mechanism ensures valid and controllable outputs over a predefined category space.
- Experiments show GrocLM outperforms strong baselines on both proprietary production data and public benchmarks, achieving a 7.5% relative improvement in cart-adds per impression in live production restocking tasks.
- The model generates all categories jointly, maintaining efficient inference while enhancing recommendation accuracy.
Why It Matters
This work is highly relevant to AI practitioners and researchers focused on recommendation systems, particularly in e-commerce contexts where capturing cyclical purchasing behavior is crucial. By integrating large language models with structured recommendation frameworks, GrocLM demonstrates how LMs can be effectively adapted to domain-specific tasks, offering a scalable and accurate solution that balances performance and efficiency.
Technical Details
- Model Architecture: GrocLM is based on a fine-tuned large language model (LLM) optimized for grocery category recommendation. It leverages a two-stage LoRA (Low-Rank Adaptation) training strategy to incorporate cyclical purchasing patterns directly into the model's parameters.
- Training Strategy: The first stage focuses on general recommendation tasks, while the second stage specializes in capturing cyclical purchasing behaviors, such as repeat purchases or seasonal trends. This approach allows the model to better utilize rebuying signals compared to traditional prompt-based conditioning methods.
- Constrained Decoding: To ensure valid and controllable outputs, GrocLM introduces a trie-based constrained decoding mechanism. This restricts the model's predictions to a predefined set of grocery categories, reducing the likelihood of generating irrelevant or invalid recommendations.
- Evaluation Metrics: The model was evaluated using metrics such as cart-adds per impression, precision, recall, and F1-score. Both proprietary production data and public benchmarks were used to validate its performance.
- Inference Efficiency: GrocLM generates all recommended categories simultaneously, enabling efficient inference without sacrificing accuracy. This joint generation approach is particularly beneficial for real-time recommendation systems.
Industry Insight
- Scalability and Accuracy: GrocLM highlights the potential of fine-tuned LMs to address scalability and accuracy challenges in item-level recommendation systems, making it a viable alternative for large-scale e-commerce platforms.
- Domain-Specific Adaptation: The success of GrocLM underscores the importance of adapting LMs to specific domains by incorporating domain-specific knowledge (e.g., cyclical purchasing patterns) directly into the model architecture.
- Practical Deployment: The model's ability to achieve significant improvements in live production environments suggests that similar approaches could be widely adopted across various recommendation tasks, driving higher engagement and conversion rates.
Disclaimer: The above content is generated by AI and is for reference only.