First, a disclosure: we sell an AI voice system. So read this with that in mind, and run every test below on us too.
The problem these tools solve is real.
That's vendor data from Invoca, which sells call software of its own, and it's about home services. The pattern shows up well beyond the trades, though: when the phone rings at a small business, there often isn't anyone free to answer.
So the demand is real, and the market is full. The demos all sound good, too. That's the catch. A demo is a scripted call on a quiet line about an easy question. Your phone gets a caller in a parking lot with a half-formed problem and a bad connection.
Here's how to tell the difference.
Eight red flags
1. It doesn't say it's AI
Ask to hear the first ten seconds. If it pretends to be a person, walk away. People find out, and it costs you more trust than the call was worth. Ours says it's an AI in the first sentence. Disclosure rules are also changing state by state, so a vendor who treats this as optional is taking a risk with your name on it.
2. It can't hand off to a person
Every system handles the easy calls. The test is what happens when someone asks for a human or says there's an emergency. It should transfer live to a person you've named, or take a message and alert someone right away. "We'll email you a summary" isn't good enough for water coming through a ceiling.
3. It doesn't write back to your CRM
If call notes live in the vendor's dashboard, you've added another inbox, and that's how leads get lost in the first place. After a test call, open your CRM. The contact, a call summary, the outcome and any appointment should be there without anyone typing them in.
4. It says things you never approved
Ask it about price. Ask whether you can come tomorrow. Ask if you're the cheapest in town. A good system works from a script and FAQ you've signed off on, and it says "I'll have someone confirm that" for everything else. Find out how you change what it says, and how long a change takes.
5. You don't own the pieces
Ask this exactly: "If I leave tomorrow, what do I keep?" You want your phone number, call recordings, transcripts and customer data, in writing. If the vendor owns the number your customers call, leaving means losing it, and that gives them a lot of power over your price.
6. It treats outbound like inbound
Answering a call someone made to you is one thing. Having an AI call people is another. The FCC ruled in February 2024 that AI-generated voices count as artificial voices under the Telephone Consumer Protection Act. It didn't ban the technology, but those calls generally need prior consent, and written consent for marketing. If a vendor offers to have its AI "call all your old leads" and never asks about consent, the liability it's handing you may outweigh anything it books.
7. There's no plan for recording
Many of these tools record or transcribe calls. Some states, including Florida, California, Washington, Pennsylvania and Illinois, generally require everyone on a call to consent to recording. Ask what the system says at the start of a call, and whether it changes for callers in those states. If the vendor looks blank, ask your lawyer before going any further.
8. The only numbers are theirs
If success is measured only on the vendor's dashboard, they're marking their own homework. You want a weekly report you can check against your own phone logs and CRM: calls in, calls answered, calls handled by AI, transfers, bookings, and a few calls worth listening to. Then listen to them.
A 20-minute test you can run on anyone
Don't accept the demo. Ask for a trial on a test number loaded with your own FAQ, then make these calls yourself. Better still, get someone who doesn't know the script to make them.
| Call this | Say this | What should happen |
|---|---|---|
| After-hours new customer | "I need a quote, what do you need from me?" | Asks your questions, books or promises a callback |
| Emergency | "There's water coming through my ceiling right now" | Transfers or alerts a person immediately |
| Wants a person | "I don't talk to robots. Get me a person." | No arguing. Hands off or takes a message |
| Price shopper | "How much is it? Just give me a number." | Only what you've approved, then offers next steps |
| Upset customer | "You guys never showed up on Tuesday." | Doesn't defend or invent. Flags it urgently |
| Noisy line | Call from a truck, with the radio on | Copes, or asks to repeat, without collapsing |
| Off-script | "Do you also do gutters?" when you don't | Says no honestly, doesn't improvise |
| Spam | A robocall recording, or a sales pitch | Ends the call and doesn't book it as a lead |
Then open your CRM and calendar. Did everything land? Was the summary right? Did anyone get told? If it fails on a test line with friendly callers, it'll fail on real ones.
When you shouldn't buy one at all
Sometimes the right answer is no, from anyone.
- You already answer. If almost every call gets a person within a few rings and web leads get a reply in minutes, spend your money elsewhere.
- You've got nowhere for it to write. If leads live in a notebook, set up a simple CRM first.
- Your calls are mostly complex. If every call needs real judgment, AI can take the overflow and the after-hours, but it won't replace the person.
- A person is cheaper for you. At some volumes, a part-time hire or answering service wins. Do the sum, including nights and weekends.
What good looks like
A good system is boring. It answers what nobody was going to answer, says it's AI, knows when to stop, and leaves everything in your tools. You own the accounts, and you can see what it did on Monday morning.
That's what we build with the Never-Miss Lead Desk, and we'll happily take this test. Or start by seeing what your callers get today: the free Leak Report calls your line and sends you a video.