• Vũ Hoàng Anh's avatar
    feat: Add batch embedding optimization for multi-search performance · 5748e55c
    Vũ Hoàng Anh authored
    - Add create_embeddings_async() to support OpenAI batch embedding API
    - Refactor data_retrieval_tool to batch embed all queries in ONE request
    - Replace print() with logger.info() in product_search_helpers
    - Remove visual_search checks (only text search supported)
    
    Performance: 5-10x faster for multi-search queries (300ms vs 1.5s for 5 queries)
    Rate Limit: Saves RPM by batching multiple embeddings into single API call
    5748e55c
Name
Last commit
Last update
..
__init__.py Loading commit data...
cache.py Loading commit data...
conversation_manager.py Loading commit data...
embedding_service.py Loading commit data...
image_storage.py Loading commit data...
jeager_log.py Loading commit data...
langfuse_client.py Loading commit data...
llm_factory.py Loading commit data...
middleware.py Loading commit data...
openai_client.py Loading commit data...
starrocks_connection.py Loading commit data...