leboncoin wanted to leverage LLMs internally but could not use public platforms like ChatGPT due to data security and privacy risks, particularly the risk of confidential or client data being exposed through external services.
How it works
Common implementation structure
How this type of workflow is generally built, generalized across documented cases — not tied to any one vendor's stack. Click any stage to read what happens there. Specific products that implement these stages appear in “Tools commonly seen” below.
Stage 1 · Employee submits question
Employees submit questions to Ada through dedicated Slack apps or a standalone web interface.
Ada became a trusted internal assistant before being sunset in Q1 2025. The project delivered significant GenAI expertise to leboncoin's ML team. Transition is underway to ChatGPT Enterprise, with key features being ported via MCP connectors and Custom GPTs.
What failed first
The initial attempt to self-host Meta's Llama 2 on AWS was complex, slow for chat, and more expensive than a managed alternative. A later pilot of Onyx as a replacement was rejected due to infrastructure instability from its Vespa database and limited customization.