Skip to main content

Find and fix knowledge gaps on the Unanswered tab

See the product questions Olvio's AI couldn't answer, add the missing information, and clear them from the Unanswered tab.

Find and fix knowledge gaps on the Unanswered tab

When Olvio's AI can't answer a shopper's question about a product because the information isn't available, Olvio usually lists the question on the Unanswered tab of the Conversations page. Use this list to see what's missing from your product information, add it, and clear the question.

The Unanswered tab is available on the Starter, Growth and Scale plans. Olvio doesn't record unanswered questions while your store has no plan.

When a question is recorded

Questions are recorded from the chat on your product pages. Olvio's AI flags its reply when it tells a shopper that a product detail isn't available (for example, that the product page doesn't say) or refers them to customer support for a product fact. Olvio then records the question. The AI decides when to flag a reply, so the list may not include every question it couldn't answer.

  • The AI is told not to flag questions that no product information could answer, such as order or delivery status or store hours.

  • Each AI reply records at most one question.

  • Olvio Advisor conversations (Growth and Scale) don't add questions to this tab.

  • Shoppers don't see that a question was recorded: the chat reply looks the same.

The AI saves a short description of the missing information, usually in the shopper's language. It normally describes the underlying question rather than the shopper's exact words, for example the board's exact length or available sizes. Email addresses, phone numbers, card numbers, some ID number formats and secret keys are masked before the question is saved. If the AI gives no description, Olvio saves the shopper's message instead, with the same details masked. Each question is linked to the conversation it came from.

Which product a question is listed under

Each question is listed under one product:

  • If the AI indicates that the question is about another product discussed in the chat, the question is listed under that product.

  • If not, and earlier replies in the conversation showed other products as product cards, or the shopper named other products in their recent messages, a short background request with your Anthropic API key works out which of these products, or the page's product, the question is about. See What uses your Anthropic API key, and what doesn't.

  • Otherwise, the question is listed under the product whose page the chat took place on.

Read the Unanswered tab

In the Olvio admin, open Conversations, then click the Unanswered tab at the top of the page. When your store has unanswered questions, the number next to the tab shows how many different questions there are across all your products.

Each product with unanswered questions has its own card. Cards are in alphabetical order, so a card stays in place while you clear its questions. Each card shows:

  • The product's title, and its image if it has one.

  • A badge such as 5 unanswered: how many times the questions listed on the card were asked.

  • The Add info button, which opens the product in your Shopify admin.

  • One line per question, with the number of times it was asked. The most-asked questions come first.

To find a product, type part of its title in the Search a product… field. If no card matches, you see No product matches your search.

The tab is built from your most recent unanswered questions. It shows up to 100 products (the ones whose questions were asked most often) and up to 30 questions per product. The number next to the Unanswered tab counts all your different questions, including any the list doesn't show, so it can be higher than the number of lines in the list.

When there are no unanswered questions, the tab shows No knowledge gaps yet.

See when a question was asked

Click the arrow at the start of a line, or the question itself, to see the dates the question was asked, most recent first. Up to the 20 most recent dates are shown. Next to each date:

  • View conversation opens the transcript of that conversation in a new tab, so the list stays open. See Read your Conversations list and transcripts.

  • conversation not recorded appears instead when no conversation is linked to that date.

How similar questions are grouped

The AI can describe the same missing information in slightly different words. Olvio groups similar questions about the same product into one line, and the line's number adds up the times each wording was asked. A line is named after the most-asked wording at the time its questions were grouped, so the name may not match the wording asked most often today. A similar question can also end up on a line of its own.

Olvio groups questions every night. To group new questions right away, click Reorganize at the top of the tab. The button shows a spinner while Olvio groups the questions, and the list updates when it's done. Next to the button, Updated tells you when questions were last grouped, for example Updated 3 h ago. Until the next grouping, a new question appears on its own line with its own wording. If it's worded exactly like a line already listed for that product, it's counted on that line instead.

If your storefront publishes more than one language, grouping also translates the questions into your store's default language, so the list reads in one language. Each grouping makes one request with your Anthropic API key for this. The nightly grouping, and this request, continue while your store has no plan, as long as unanswered questions remain. If your default language isn't English, French, German, Spanish, Italian or Portuguese, the questions are translated into English. If the translation fails, existing lines keep their current wording, and new lines keep the wording they were saved in, usually in the shopper's language, until a later grouping translates them.

Add the missing information

  1. Click Add info on the product's card. The product opens in your Shopify admin in a new tab.

  2. Add the missing fact where the AI reads it: in the product description, in a product metafield, or in the product's custom.olvio_knowledge note. The AI doesn't read metafields from review apps, or metafields that point to something else, such as a file, a metaobject entry, another product or a page. See Add product-specific notes with the custom.olvio_knowledge metafield.

  3. Click Save in Shopify. Olvio picks up a change to the description or to the custom.olvio_knowledge note shortly after you save. If the chat still doesn't use the new information a few minutes after you save, run a resync: in your Shopify admin, open Olvio, and on the Dashboard page click Resync now (Retry sync if the last sync failed). A resync typically takes 2 to 10 minutes, and the chat may keep using the old information until it finishes. Wait until the Dashboard no longer shows Catalog sync in progress before you test. You can resync once a day; if the button is grayed out, hover over it to see when it's available again. See Resync your product catalog.

  4. To check the fix, ask the same question in the chat on that product page. See Test Olvio on your storefront.

  5. Back on the Unanswered tab, click the check mark button (Mark as done) on the question's line.

For information that applies to many products, such as a size guide for a whole range or care instructions, add it in the Knowledge files or External web pages section of AI Setup instead. See Add knowledge files and web pages to Olvio's knowledge base.

Clear a question from the list

Each line ends with two buttons: Mark as done (check mark) and Dismiss (cross). Hover over a button to see its name. Both remove the question from the list. Use Mark as done once you've added the information, and Dismiss for a question you don't plan to act on.

Removing a line deletes every record of that question for that product, with its dates and conversation links. The conversations themselves stay on the Conversations tab. There's no confirmation, and you can't undo it.

If a shopper asks the question again and the AI still can't answer, it comes back as a new line.

How long unanswered questions are kept

Unanswered questions are kept for the same period as your conversations, based on your current plan:

  • Starter: 30 days.

  • Growth: 90 days.

  • Scale: 365 days.

If you move to a plan with a shorter period, questions older than that period are deleted at the next nightly cleanup. If your store no longer has a plan, for example after your subscription ends, questions older than 30 days are deleted.

Olvio removes older questions automatically every night. During that nightly cleanup, Olvio also removes questions whose conversation no longer exists. About 48 hours after you uninstall Olvio, your unanswered questions are deleted with the rest of your store's data. See What happens to my data when I uninstall Olvio.

Did this answer your question?