• Vũ Hoàng Anh's avatar
    feat: Add batch embedding optimization for multi-search performance · 5748e55c
    Vũ Hoàng Anh authored
    - Add create_embeddings_async() to support OpenAI batch embedding API
    - Refactor data_retrieval_tool to batch embed all queries in ONE request
    - Replace print() with logger.info() in product_search_helpers
    - Remove visual_search checks (only text search supported)
    
    Performance: 5-10x faster for multi-search queries (300ms vs 1.5s for 5 queries)
    Rate Limit: Saves RPM by batching multiple embeddings into single API call
    5748e55c
embedding_service.py 2.89 KB