Open Forum

 View Only
Expand all | Collapse all

Speech & Transcript

Anonymous Member

Anonymous Member03-21-2024 12:16

  • 1.  Speech & Transcript

    Posted 03-19-2024 06:43

    Does anyone else have issues with the transcription element of Speech Analytics? Might be our northern UK accents that it struggles with, but the accuracy of text -to-speech is quite laughable. Not sure how accurate it can measure the overall emotion when it doesn't understand the context?

    Surely there's a better speech engine out there to stop this - sometimes it virtually unusable!



    ------------------------------
    Lee Heppenstall
    ------------------------------


  • 2.  RE: Speech & Transcript

    Posted 03-19-2024 07:17

    We've just started looking in to the speech analytics to set some bits up for evaluations and its bit hit and miss with the Scottish accents as well. I think its main issue is the speed we speak, a lot of words end up running together and so the transcript ends up being gibberish. We're setting up some test categories right now to trail it with one service.



    ------------------------------
    Dawn Guthrie
    ------------------------------



  • 3.  RE: Speech & Transcript

    Posted 03-19-2024 07:25

    Glad it's not just us. We have agents in Scotland, Ireland and up and down England and have the issue on all accents. maybe it just likes the Queens English :)



    ------------------------------
    Lee Heppenstall
    ------------------------------



  • 4.  RE: Speech & Transcript

    Posted 03-20-2024 02:13

    Hate to make this a UK thread (I don't really) but it's currently bad for East London accents too. At one of the London roadshows when it was asked about they said they were going to replace the transcription engine with Whisper; and they're already using Whisper for PCS transcription so it seems like it will happen.

    Fingers crossed it's changed over sooner rather than later!



    ------------------------------
    David
    ------------------------------



  • 5.  RE: Speech & Transcript

    Posted 03-20-2024 04:01

    Hi

    It is dreadful to be honest. We have had a lot of complaints about it, particularly from one of staff members who has hearing difficulties. They need to up their game on it.



    ------------------------------
    Ciaran Murtagh
    ------------------------------



  • 6.  RE: Speech & Transcript

    Level 2 Contributor
    Posted 03-20-2024 07:56

    Hi Lee,

    Thank you for contributing to the 8x8 Community.  I'm sorry you are having problems with the speech transcription. Our current transcription service aims to maintain high accuracy across all available languages and please note we are continuously trying to improve the quality of the transcriptions and take into account multiple scenarios (including some specific accents).

    We welcome your feedback as this helps us improve our products.



    ------------------------------
    Alison Stewart
    8x8
    ------------------------------



  • 7.  RE: Speech & Transcript

    Posted 03-21-2024 09:39

    Hello everyone,

    I have forwarded this thread over to our product manager, who handles voice-to-text services, so we can discuss it with the AI vendors who support us and look at the solution.  May I ask if anyone knows of a particular vendor that excels at Scottish or East London accents?

    Samuel Wilson, CEO, 8x8



    ------------------------------
    Samuel Wilson
    ------------------------------



  • 8.  RE: Speech & Transcript

    This message was posted by a user wishing to remain anonymous
    Posted 03-21-2024 12:16
    This post was removed


  • 9.  RE: Speech & Transcript

    Posted 03-22-2024 02:28

    and dont forget the Irish accents too .... 



    ------------------------------
    Ciaran Murtagh
    ------------------------------



  • 10.  RE: Speech & Transcript

    Level 2 Contributor
    Posted 03-24-2024 12:37

    Or the Aussie accents!! Currently atrocious, which impacts the functionality of keyword searches and future summarisation. 



    ------------------------------
    Ben Fischer
    ------------------------------



  • 11.  RE: Speech & Transcript

    Posted 03-29-2024 17:25

    Okay Team,

    We are asking for some help, I need some audio files with Scottish, Irish, East London, and Aussie accents.  Please provide NOTHING with customer or proprietary information but something we can give to additional vendors we are looking at and test out their products.  I'm got several that can claim they can do it.  Anyone can help us, because I don't have good examples to ensure we get this right. 

    Best, 



    ------------------------------
    Samuel Wilson
    ------------------------------



  • 12.  RE: Speech & Transcript

    Posted 04-09-2024 08:11

    Team, 

    One last push on asking for help, we want to do better on this topic, but need some audio files we can use to test systems??  If  Scottish, Irish, East London, and Aussie accents are the problem, can anyone provide some that we can use?  Again, nothing with customer or proprietary information.  My plan is to get a human to do a transcription and compare it to a vendor.  



    ------------------------------
    Samuel Wilson
    ------------------------------



  • 13.  RE: Speech & Transcript

    Posted 04-09-2024 08:32

    Hi Samuel - from my side it appears to struggle with most UK/Ireland accents but we won't be able to provide any audio files as the information is governed by GDPR. All of the audio branding companies we have used for our IVR messages provide local/regional accents so I would assume in the industry there are companies that could provide this. PHMG are an example of this PHMG - The world leaders in audio branding



    ------------------------------
    Lee Heppenstall
    ------------------------------



  • 14.  RE: Speech & Transcript

    Level 2 Contributor
    Posted 04-09-2024 14:35

    Lee, I've been meaning to record a mock phone interaction between myself and an agent using the words which are consistently not correct. Surely this wouldn't fall under GDPR for you? No PI customer data included?



    ------------------------------
    Ben Fischer
    ------------------------------



  • 15.  RE: Speech & Transcript

    Level 2 Contributor
    Posted 04-09-2024 20:42

    Naturally, my test script transcribed better than customer calls... figures right. But I do have an example to send with issues for

    Arrears

    Fortnight 

    Resimac

    Where do you want us to send the audios and transcriptions?



    ------------------------------
    Ben Fischer
    ------------------------------



  • 16.  RE: Speech & Transcript

    Posted 04-10-2024 07:47

    Everyone can just send to me directly, samuel.wilson@8x8.com, I'll make sure it get's done and used.



    ------------------------------
    Samuel Wilson
    ------------------------------



  • 17.  RE: Speech & Transcript

    Posted 04-16-2024 04:32

    Hi Samuel.

    I could certainly provide some sample calls with Scottish accents, if that would still be helpful?

    Please let me know what you require - e.g. how long you'd like the calls to be.

    Regards,

    Ruth



    ------------------------------
    Ruth Scott
    ------------------------------



  • 18.  RE: Speech & Transcript

    Posted 04-17-2024 07:45

    I would love some recordings, I think 5-10 minutes in length is fine, just enough that we can compare various vendors and technologies.  

    My email is Samuel.Wilson@8x8.com

    I'll get the information to the product manager who owns this technology.

    Best,

    Samuel Wilson

    CEO



    ------------------------------
    Samuel Wilson
    ------------------------------



  • 19.  RE: Speech & Transcript

    Posted 08-28-2024 14:58

    Team, 

    I don't know if this is the right place to follow up, but we have made changes per the comments in this group thread. We have now rolled out an enhanced transcription engine (it's costing us more-don't worry, your bill isn't going up; we are eating it). I want to know if you are seeing the difference.  We put a lot of time into testing and improving. I hope it's noticeable??



    ------------------------------
    Samuel Wilson
    CEO, 8x8
    ------------------------------



  • 20.  RE: Speech & Transcript

    Level 2 Contributor
    Posted 08-28-2024 15:13

    Sam, it's night and day. With the exception of non dictionary words, such as company names, it's almost perfect. 

    I was demoing the speech analytics to another department yesterday and they were blown away. The had previous been exposed to the old transcription service and were amazed at the quality increase.

    :)



    ------------------------------
    Ben Fischer
    ------------------------------



  • 21.  RE: Speech & Transcript

    Level 2 Contributor
    Posted 08-28-2024 15:21

    While you're here...

    We are using Speech Analytics Topics for potential fraud and financial hardship detection. The increased accuracy of transcriptions is a godsend for this use. Unfortunately, we cannot get emailed/notified when there is a topic hit. I have a Power Automate running every 10 mins to get the last 10 mins of interactions, cycle through every interaction to get the topics, and if a topic hit is found, message a teams group. This requires me to process 1000-2000 interactions a day to find 3 potential calls.

    If would be amazing if you could set Topic to email a user/users if an interaction is tagged with that topic. We would get near real time notification of customers in financial stress, potential abuse and fraud.

    Best, 

    Ben



    ------------------------------
    Ben Fischer
    ------------------------------



  • 22.  RE: Speech & Transcript

    Posted 08-28-2024 19:56

    Let me see what I can do....

    And thank you for the positive words, it means the world to the teams that do this!



    ------------------------------
    Samuel Wilson
    CEO, 8x8
    ------------------------------



  • 23.  RE: Speech & Transcript

    Posted 08-29-2024 03:05

    Hi Ben,

    We're developing the custom-dictionary feature to address exactly what you pointed out - improving transcription accuracy for business-related terms (company names, product names etc). This feature is currently in limited-availability and will be GAed soon. We'll reach out to show you how it works



    ------------------------------
    Gabriel-Alin Cocis
    ------------------------------



  • 24.  RE: Speech & Transcript

    Posted 08-29-2024 08:54

    Gabriel stole my thunder!Happy Smile Face Emoji Clipart: Spread Joy I didn't know this, but the PMs are already ahead of me. They have a customer dictionary function being built!



    ------------------------------
    Samuel Wilson
    CEO, 8x8
    ------------------------------



  • 25.  RE: Speech & Transcript

    Level 2 Contributor
    Posted 08-29-2024 15:16

    Great! Thank you!



    ------------------------------
    Ben Fischer
    ------------------------------