This morning we sent Ask Lee, the tea adviser on teas.co.uk, to school. He came home this evening with a report card. We're proud of him. Mostly.
The day he answered "How much tea is in a tea bag?" with a rooibos
First, a confession. Ask Lee has always been very good at one thing: finding you a tea. Ask him for "something strong for the morning that takes milk" and he'll find it, check the price, check the stock, and tell you how many pence a cup it costs.
The trouble was that he treated every question as a shopping trip.
At lunchtime today we gave him a little test. We asked him:
- "How much tea is in a tea bag?" He recommended a chai rooibos.
- "Tell me about the history of British tea." He recommended a selection box.
- "Do cafés get free delivery?" He said £35. It's £150 for cafés and businesses.
We have a 1,953-entry Tea Wiki. There's an article called, word for word, How Much Tea Is in a Tea Bag? He just didn't know it was there. It was a bit like asking a librarian where the loo is and being handed a cookbook.
So we did what any sensible family would do. We enrolled him.
Not that kind of AI
Before we go on, a small but important point. Ask Lee is not one of those chatbots that makes things up when it doesn't know. In the textbooks he's what's called an expert system: a body of checked knowledge (our Truth Spine) plus rules for reasoning over it.
That means he can't invent an answer. It also means he can't learn by osmosis. Nobody "trains" him by feeding him the internet. You teach him, the way you'd teach a child: one lesson at a time, then an exam, and he only moves up a level when he passes.
That idea came from Lee, at about one o'clock this afternoon: "He needs to go to school. Treat it literally like a child."
The concierge training, level by level
Level 0: his words. He learned his nouns and adjectives: 402 products, 40 brands, the ingredients, the tastes. Strong, light, fruity, caffeine free.
Level 1: what kind of sentence is this? This was the big one. A person's first words tell you what they want:
- "Does…" or "Is…" means they're checking something, so you say yes or no first.
- "How much…" wants a number.
- "Tell me about…" wants a story.
- "Show me…" wants a list.
He also learned to strip off the politeness. "Could you possibly tell me how much caffeine is in green tea, please?" is really just "How much caffeine is in green tea?"
Level 2: what is it about? Here he learned that "tea bag" in "How much tea is in a tea bag?" is the subject, not a request to buy tea bags. He learned which questions are about shop rules, which are about tea knowledge, and which are about buying.
Level 3: the library. We turned every section of every wiki article into a library card: 18,718 cards from 1,954 articles. Now when you ask him something, he looks it up first and decides second.
Level 4: answering properly. Short answers, in our own words, with the article they came from. A number first if you asked for a number. And on money and shop rules, he had to get every single one right. No rounding, no "about". Cafés get free delivery over £150. You need 500 points before you can spend them. Last Christmas orders: Thursday 17 December.
The exam results
We sat him an exam of 116 real questions: real customer questions from the last five months, and real titles from our own wiki. Then we sat him the same exam after school. Here's how it went:
| Exam | Before school | After school |
|---|---|---|
| Knowing a tea question when he sees one | 12% | 97% |
| Shop rules (delivery, points, Christmas) | 0% | 100% |
| Leaving shopping questions to the shop | 100% | 97% |
| Finding the right article first | 8% | 90% |
| Answering properly, with the source | 7% | 90% |
| Getting the money exactly right | 0% | 100% |
He passed five of his six exams, which takes him to concierge level 4. The sixth needs 95% and he got 90%. Most of his misses were near misses: asked "Who owns PG Tips?", he went to our article on who owns Lipton. The answer was right, because it's the same company. The article just wasn't the one the examiner wanted. We've had words.
He also answers in about a tenth of a second. Children these days.
He's on duty from tonight
Ask Lee the Tea Curator is now answering customers on teas.co.uk, in the chat on every page and through the assistants that use our shop. Ask him "Do cafés get free delivery?" and he'll tell you, correctly, that trade accounts get it over £150. Ask him how much tea is in a tea bag and he'll quote our own article, and tell you where to read the rest.
If he isn't sure, he doesn't guess. He hands the question back to the shop side he's always been good at.
What's next in his training
- Level 5: conversation. "Tell me more," so he can walk you through a long article a section at a time.
- Level 6: joining things up. The same tea in a different box, what to try if something's out of stock, the recipe that uses the tea you're looking at.
- Levels 7 and 8: knowing what he doesn't know, and understanding you when you say the same thing in different words.
Every week, the questions he got wrong become next week's homework.
We'll publish his report card each time. If he fails something, you'll see that too. That's rather the point: a tea adviser you can check is one you can trust.
Try him now
Ask Lee lives on every page of teas.co.uk, this one included. Look for the Ask Lee button in the bottom corner of your screen, tap it, and type your question in plain English, the way you'd ask a person.
Here are a few to start with:
- "How much tea is in a tea bag?"
- "Does peppermint tea have caffeine?"
- "Do cafés get free delivery?"
- "How many points do I need before I can use them?"
- "Tell me about the history of British tea."
Catch him out? Good. Every question he gets wrong becomes his homework for next week. You can read more about him at https://teas.co.uk/ai/ask-lee/
Ask Lee is free to use on every page of teas.co.uk. Go on, ask him something. He's been studying.
