Digital Business Marketing
Strategy

Case Study: Winning With AI in Marketing

An illustrative walkthrough of how a mid-sized online retailer used a Messenger bot and Google's smart bidding in 2017, including what failed first.

By /

Featured image for “Case Study: Winning With AI in Marketing”: AI in Marketing

To make this concrete, consider a composite scenario built from the kind of rollout many mid-sized online retailers ran in 2017: a home goods store doing a few million dollars a year in revenue, a small marketing team of two and a support inbox that was getting harder to keep up with.

The problem

Customer support requests were eating a growing share of the team’s day. Most of them were the same handful of questions: where’s my order, does this come in another size, what’s your return policy. Meanwhile, the paid search account was being managed by hand, with bids adjusted maybe once a week when someone had time to look at it. Neither problem was dramatic on its own, but together they were quietly capping how fast the business could grow.

What they tried first, and what didn’t work

Their first move was ambitious: a Facebook Messenger bot meant to handle support questions and also recommend products based on what a customer said they were looking for. Built by a freelance developer over a few weeks, it launched with a lot of conditional logic trying to anticipate every kind of question. It did not go well. Customers phrased things in ways the bot’s rules didn’t cover and conversations dead-ended: within a month, roughly a third of bot conversations ended with a customer typing “talk to a person” in frustration. The team’s early instinct, that a smarter bot would fix it, was wrong. The problem was scope, not sophistication.

The narrower version that worked

They stripped the bot down to three jobs: order status lookup, a return policy answer and size-guide links. Nothing else. Anything outside those three intents routed straight to a human, immediately, with no attempt by the bot to guess. That version launched in June. Within six weeks, roughly 40 percent of inbound Messenger conversations were resolved without a human touching them, and the ones that did reach a person arrived with context already established, which cut average handling time. The lesson the team took away: a narrow tool that reliably does three things beats a broad tool that unreliably attempts twenty.

The quieter win: search account changes

At the same time, they turned on Google’s automated bidding for their branded and top-converting product campaigns, giving the algorithm about a month of stable spend to learn from before judging results. Cost per conversion on those campaigns dropped by roughly a fifth over the following quarter, mostly because the system could react to signals (time of day, device, location) far faster than a person checking the account weekly ever could. It wasn’t glamorous, and nobody wrote a press release about it, but it freed up hours that had been going into manual bid adjustments.

What the case demonstrates

Neither change was revolutionary in isolation. What made the quarter work was sequencing: fix the highest-friction, most repetitive problem first, keep the scope narrow enough that the tool could succeed at it and only then layer in the next improvement. Businesses that tried to do everything (a do-everything bot, a fully automated ad account, personalized email all in the same month) in 2017 tended to end up managing three half-finished projects instead of one that worked. The retailer in this scenario didn’t win by being early or clever. It won by being specific about the problem before reaching for the tool.

Newsletter

The marketing brief, every week

One email a week: the sharpest new guides, tool reviews and Awards updates. No fluff, unsubscribe anytime.

We respect your inbox. Read our approach.

Keep reading

Related articles

All Strategy →

Explore more topics