The longer answer
1. Accuracy. Where does the AI take its answers from: your articles only, or general knowledge as well? What does it do when your articles don't cover a question? Ask to see a wrong answer and how you would correct it. A vendor's resolution rate is measured on other companies' questions; ask your own 20 most common questions during a trial instead.
2. Handover to a person. How does a visitor reach a person, and does the teammate see the whole conversation? What does the visitor see when nobody is online: an honest message and a way to leave an email, or a promise of an immediate answer?
3. Channels. Which channels are in the plan you would buy, and which are add-ons, beta or charged per message (WhatsApp messages, for example, are billed by Meta)? Check that email and chat replies land in one inbox.
4. Knowledge upkeep. Who writes and updates the articles the AI uses, and how long does that take each month? Can the tool draft articles from your website or documents, and do you review them before they go live?
5. Privacy and hosting. Where is the data stored, which AI provider processes the messages, and is there a data processing agreement? Ask whether the vendor holds certifications itself or relies on its hosting provider's.
6. Billing. Is AI use charged per reply, per conversation or per resolution, and what happens at the limit: does the AI stop, or do you pay overage? Count seats you need for holiday cover, and ask for the price after any introductory offer.
7. Import, export and leaving. Can you import past conversations and articles? Can you export them when you leave? Plan for the work of rewriting answers and retraining the team; it is usually larger than the switch itself.
For Replyze's own answers to these questions, see the facts page and pricing. To put numbers on a scenario, use the support cost calculator.