The Inbox module allows you (or your bot trainers) to validate the work of the bot, to teach him new things to make him smarter. In the AI jargon, this task is called "Supervised Learning"
A module to improve your bot performance
The inbox is basically a list of all the incoming messages users have sent to your bot along with the way your bot managed to handle them.
Browsing the incoming messages
Each message comes with a set of fields:
Occurences: The number of times this message was sent to the bot. May be a good indication of the importance of taking action on the said message.
Message: The user message
Intent: The intent found for the message. May be empty if the message was not understood. May also be wrong if the bot has been confused with another similar intent.
Confidence: The score attached to the intent detection of the bot, of course, the higher is the best.
Time: The date and time where the message was received. Time can be seen on mouse on hover of the date.
Each message also comes with a green / orange / green light as shown below
Green : the message is on the training dataset, and was understood
All good, nothing to do there.
Orange : the message was understood but the message is not in the training dataset.
If the bot was right, you can approve the interpretation , the new message will be added to your dataset. If the bot was wrong, you can fix this by attaching this message to another intent.
Red : the message was not understood or with a confidence that was below the confidence threshold
You have two options there:
- Attach the message to the appropriate intent, either an existing or a new one
- Archive the message in a waiting box so you can manage it later
We hope that, at one point, your bot will have much much success, then you may use our filters to target some specific messages.
Here is the current available filters.
1/ Search bar : the search box let you search for specific words in user messages
2/ Language : the language version of your bot ( can be different of the true language used by the user)
3/ Channel : the channel used by the user to send his messages
4/ Status : let you focus on the status of the message in the platform.
Here is the current available options in the status filter:
All status: will give you all the messages
Understood: will give access to all the understood messages
Not understood: will give you access to all the messages not understood by the bot
Learned: will give you access to all the messages you have approved or allocated to an intent
5/ Archived : let you see the messages you have archived for future analysis
6/ Date : let you define the specific period of time of the search.
By default, this filter is set with the last 7 days.
Supervised machine learning
Once you have narrowed your search with the filters, you can work on the production data to improve your training data
Here is the meaning of each Quick action:
- Validate: This let you flag the message as properly understood and does nothing to your dataset. This is useful when the bot inference is OK but the data itself is not necessarly useful for your dataset.
- Validate and insert: This button validates the bot inference AND adds the selected messages in the intents found
- Move to an intent: This is mostly useful when the bot is wrong. After clicking this button, you will be asked to pick the destination intent where the messages should be copied.
Remember: Try to only add clean data to your model
Although it may be tempting to add as much as possible to your data it can have a bad side effect because you may add noise or unclean data to your model.
👉 Prefer short sentences than long ones with many intents on a single phrase
👉 Fix typos before adding a sentence to your model, it will help the typo correction module stay efficient
The bulk action selector allows you to apply an action to multiple messages
The available actions are the 3 quick actions plus a few others:
- Use for a new intent: What if a new question emerges? You can use this feature to put one or several messages in a new intent that you will reuse later.
- Archive: Allows you to hide messages from in your inbox
- Delete: Allows you to delete messages from your inbox
Don't forget to train your bot 😉
Once the supervision is done, you may ask the admin or a developer to train the bot so the changes you made become effective in your bot
And last, you have some generic actions for your bot:
1- Train: Run the training of the model on your existing dataset
2 - Export all messages: Allows you to retrieve all the messages, the way the bot understood them
Updated 6 days ago