7 things to avoid when implementing speech analytics for risk

Written on
byJames Gallagher

Remember when you got that new mobile, or update on your phone? You no longer had a thumb print but a facial recognition scanner to unlock it. Now, if you swipe one way or the other a new pop up can be used to perform an action much faster. At first you were a bit confused, but now you wonder how you used to live without that ‘do not disturb’ function, to have peace and quiet after work hours.

This neatly illustrates a time where you implemented a piece of software, somewhat unaware; to understand your needs, understand the features, and finally improve your user experience by applying those features to your needs. This methodology is the starting block your firm needs to adopt, when using speech analytics, to boost off toward better meeting customer needs and company goals.


Goals, Comprehension and Implementation

There’s little point in buying a top of the line fancy new smart phone just to make calls. So too is there little point in purchasing speech analytics software if there’s no intention of trying to understand and use it for its wealth of potential.

It’s paramount that you understand what you want from speech analytics. Apple and Android do that for you with your new phone, but it’s up to you to realise how to adopt technology to better meet the goals of your firm. To understand what your firm’s goals are there are three approaches. The first is clearly asking the customer what they feel they need and want. The next two approaches take this further by predicting what the customer may need or want even if they do not realise this. This can be done upfront by interviewing frontline workers. Asking them what they believe customers think and most want from the company. Also, by working with senior management and their strategic goals for the future of the company. Once goals are set, it‘s much easier for employees to figure out to what end they are working toward and how best to use resources at their disposal to achieve it.

For a firm to understand how best to implement and integrate systems to meet these goals, it’s necessary for an individual or team to spearhead complete understanding of the software with its functions and metrics. This group can then be a bridge between the specialism of the firm and the speech analytics tools, adopting them where it is most efficient.


7 Common mistakes:

  1. Lack  of data – To create an accurate, meaningful solution, NLP platforms need to be fed with a certain amount of data specific to the company and the insights it wants to uncover or processes it wants to streamline. The reason why AI is so great is that it learns and so the more you feed it, the smarter it will be. For example, if you have a large volume of calls where customers are distressed then speech analytics can show how certain responses by the agent improved or worsened the situation across a population. This will help in training call centre agents. To learn more on how NLP works check out our very own Barry Haddow’s blog. He highlights the importance of using a large amount of data to create the best contextual embedding for your audio calls.
  2. Unclear labelling – Insufficient data labelling is a common challenge. Many firms provide completely raw data but to create a solution that solves a specific problem, engineers need to understand what the data means in relation to the firm’s service or product. It’s mutually advantageous for firms to help the engineers understand what your data is and what you want to learn from it. Like a personal trainer the engineer can help you to achieve your fitness goals but you need to set out those goals and state what you can or cannot do so they can tailor a programme for you.
  3. Generalisations – We all know that writing a sentence into Google may not give you the right result. It’s about using keywords. Further, it’s about using the right keywords. For example, if a customer says he is “very disappointed” he may be speaking about the weather or the football result and not the firm’s service. However, if certain keywords are persistent such as “interface” the probability that a customer is referencing another issue is much less likely. Therefore highlight specific words or phrases (not just “disappointing” or “bad”) that are unlikely to be used in another context – or are central to your service/product.
  4. Not making the most of the solution – As we said before, don’t buy a new smartphone if all you want to do is use it for calls! Use the software functions specifically for every process that it can enhance. You will know if speech analytics will be useful to your firm’s issues if you put in the proper research. Ask many questions and you will find many answers in the form of solutions to your problems. How can we use this for frontline employee training? Will we be able to more easily identify vulnerable customers? Do frontline employees prefer using speech analytics technologies, if so will this reduce turnover?
  5. Lack of demographic understanding – Speech analytics and NLP is a fine tuning art. Basic BERT software has been developed but needs you to understand what it is being applied to and looking for. This means understanding your customer base and its different segments. Young versus old customers may use different terminology. Therefore, embedding words into a context will require thorough research, especially if terminology is not financially sophisticated as may be more prevalent in younger customers.
  6. Not using metadata – Speech analytics doesn’t just look at the actual words. Just as in real life we pick up lots of clues from body language, so too can we learn from data such as tone. Many customers can be very polite and it will take them a long time to open up about any problems they have. Understanding metadata such as the length of pauses can contribute to understanding the feelings of a customer – a longer pause could be a sign of deep rooted frustration.
  7. Incorrect risk weighting risk – When determining the risk magnitude of a call it is important to remember that different customer circumstances have different needs. Therefore, someone who has become, for example, a widow may not be as risky as someone who; has lost their job, has low financial resilience, and does not have a computer to access online banking services. In other words, risk weighting is not just identifying the most risky circumstance but viewing all circumstances on a cumulative level of risk.


Improvement, Innovation and People

When implementing speech analytics, it’s good to set a starting point and after a specified time to look back at what has been done and determine if your goals have been met. This self evaluation helps you to reconfigure your approach to better meet targets. It will also help you and your employees to realise the benefits it provides, continuing the motivation to keep using and improve the program.

Innovation is the next step. After reviewing how speech analytics has benefitted your firm, you can expand its functionalities, and continue to fine tune the software to better meet your new goals. Feedback from employees and the specialist team on how well it is working and how it can be expanded will be crucial.

Consideration of who to work with to build a solution is a crucial stage. You may think that all solutions are the same so that the cheapest off the shelf option will do, but not all solutions are the same! Choosing the right firm is the differentiator between a competing success or a stagnating failure. It should be noted that larger speech analytic firms tend to churn through adding new businesses to their portfolio. Whereas we understand the importance of taking care of each client throughout their journey to build the best bespoke solution with them. Further, just like any consultant you want an expert in your field who has experience with companies similar to yours so they can flag potential pitfalls before they are arises. Like a seasoned Sherpa, small experienced firms will direct you to what you need to provide and consider before the journey so as to find the most suitable path for you.

To round off the benefits of AI-driven speech analytics in a more tangible way, Gallup research shows that employees who are not engaged in their work cost the business 18% of their annual salary; but those who are engaged are 43% less likely to leave with profits 23% higher for the firm! Despite the rhetoric robots are not taking over the world of work and technology is a great way to enhance engagement of employees. Gallup also finds that employees feel they can do their work better with new technology. Speech analytics must be used in tandem with your employees – so continue to enhance performance and the software so as to make both work better for you.


To learn more about how we use speech analytics, visit Aveni Detect 

Follow us on LinkedIn , Instagram and Twitter

Other recent posts

consumer duty resources

5 top RegTech trends Chief Risk Officers need to be on top of in 2023

As we progress into the new year, it’s important for Chief Risk Officers (CROs) to keep an eye on the latest RegTech trends. By adopting the right technologies, CROs can ensure that their organisation...


A quick history of Natural Language Processing 

Natural Language Processing (NLP) is a field of artificial intelligence that involves the use of algorithms, statistical models, and other techniques to analyse, understand, and generate human language. NLP has a wide range of...

consumer duty resources

Aveni’s 2022 Consumer Duty Resources

As the year comes to an end, it’s a good time to reflect on the events of the past 12 months, both the good and the not-so-good. For both the Financial Services industry and...

Female customer support operator with headset and smiling, with collegues at background.

Aveni Detect now available on Genesys AppFoundry to transform Consumer Duty compliance

Aveni Detect is now available on the Genesys AppFoundry ™, a marketplace of solutions offering a curated selection of applications and integrations that elevate customer and employee experiences.   Developed as a ‘Machine Line...

consumer duty survey

CRO Consumer Duty survey findings: Consumer Outcomes not prioritised?

We conducted a consumer duty survey to fully understand the preparedness of CRO and Senior Risk and Compliance Executives for the Consumer Duty, what activities they are prioritising to meet tightening regulations and ensure good customer...

CRO survey promo 1 (1)

CRO Consumer Duty survey findings: Customers at the heart of your business? Now is the time to prove it.

We surveyed +80 Senior Compliance and Risk Officers from across the UK’s Financial Services sector to find out their top priorities and investment plans for Consumer Duty and how they’ll meet the tightening data-driven...


Aveni's end of the year Reunion!

Aveni works at the forefront of innovation in AI and Natural Language Processing, providing quality assurance and regulatory compliance solutions for financial services and utilities companies in the UK. However, that’s not all we...

pexels-thisisengineering-3861969 (1)

Adoption of machine learning and data driven technologies at the heart of human centred advice

This is an excerpt from our Human+ whitepaper. Download here for full details about how data driven technologies can power human centred advice.   The recent acceleration in digitisation of financial advice combined with advances...

executive understanding ai

AI: Why an executive understanding is so important’  - 5 key takeaways from Aveni Labs webinar

Data-driven technologies underpinned by rapidly evolving AI, are set to be placed at the heart of firms’ operating models. It emphasises the need for Financial Services Executives to have a clear understanding of AI,...