topic Re: Survey123 and Speech Recognition integration in ArcGIS Survey123 Questions

Survey123 and Speech Recognition integration

Yuriko — Tue, 22 Jun 2021 08:50:58 GMT

The idea to integrate speech recognition technology in field data collection has been proposed (see below), but is there anyone who can share or speak to their current workflow integrating Survey123 and Dragon NaturallySpeaking (or similar speech recognition) software? Has anyone customized their application to enable the transcription directly within Survey123 or is the voice recording transcription performed post-data collection?

Add Speech Capabilities such as Dragon Naturally Speaking to Control and Interact with Map Applications

https://community.esri.com/ideas/13487

Re: Survey123 and Speech Recognition integration

JamesTedrick — Wed, 19 Dec 2018 18:42:22 GMT

Hi Yuriko,

On both iOS and Android, speech recognition is built-in to the keyboard and works to fill in values in a form.

Re: Survey123 and Speech Recognition integration

Yuriko — Wed, 19 Dec 2018 19:55:21 GMT

Hi James,

This discussion branches off from this thread (https://community.esri.com/ideas/13487-speech-recognition-software-for-collecting-data-in-the-field) regarding the integration of voice commands/controls. Siri isn't yet integrated with Workflow but could Siri Shortcuts voice commands be employed to navigate the form controls? Dictation to text is nice but what is desired is the voice command controls functionality that NaturallySpeaking provides. I will mark this thread as answered and hope this comment directs folks to the ESRI Idea discussion.

Re: Survey123 and Speech Recognition integration

BillSimper — Wed, 19 Dec 2018 21:02:55 GMT

I really like this idea, admittedly a big ask for S123 developers. Bird surveys are notorious for massive amounts of data that needs inputting in a ridiculously short span of time, ideally without taking your eyes off the action.

In an ideal world the app would work something like:

surveyor says "Collect" <form opens>

"species, red-tailed hawk" <species select_one question populates with 'Red-tailed hawk'>

"quantity, two" <quantity integer field populates with '2'>

"nest present, no" <nest present select_one toggles to 'no'>

"save to Outbox" <form saves to Outbox, chime sounds to notify user that task accomplished>

Of course, to be useful in most field conditions the voice recognition needs to work without having an active internet connection (possibly via user-programmable vocabulary, e.g. ""black-capped vireo" != "dance the rio").

Re: Survey123 and Speech Recognition integration

BryceHancock — Fri, 26 Apr 2019 21:21:51 GMT

I have a Juniper CT7G running Android version 6 and the Gboard voice recognition feature does not work in Survey123. Also, Gboard is not capitalizing the first letter in a sentence in any of text fields. Any ideas on how to fix this? The voice recognition and capitalization work fine in all other apps.

Re: Survey123 and Speech Recognition integration

Anonymous User — Sun, 28 Apr 2019 23:59:29 GMT

Hi Bryce,

The Gboard keyboard capitalize issue with the first letter of sentence is a known limitation of Gboard that we have documented for our 3.4 release as a known limitation. Unfortunately the issue is with the Gboard keyboard and not Survey123 app as the keyboard is not recognising the type of input field being used and applying the correct auto-capitalization. The issue has been logged with Google. For now, the only workaround would be to use another keyboard.

As for the Gboard voice recognition feature does not work, can you give more information, do you see the icon to enable voice recognition, what happens when selected? Also, have you tried other keyboards and do they work? It could be related to the same problem above that the Gboard keyboard does not recognise the type of input field being used and therefore not enabling the microphone.

Phil.

Re: Survey123 and Speech Recognition integration

BryceHancock — Fri, 17 May 2019 23:19:06 GMT

Thanks for your prompt response Philip and sorry for my delayed one. The icon to enable voice recognition is not visible on the keyboard in Survey123 but it is visible in all other apps. Thank you.

Re: Survey123 and Speech Recognition integration

Anonymous User — Sun, 19 May 2019 11:47:59 GMT

Hi Bryce,

Thanks for the extra info, can you confirm what version of Survey123 are you using, and have you tested with 3.4 beta available on EAC: https://earlyadopter.esri.com/project/version/default.html?cap=e69ef91f45744b98882c651f7b518eb7&arttypeid=974ee061d12c4296a02a481c0c8fb8ce

Also, could you send some screenshots of the difference between Survey123 keyboard that pops up, and other apps?

Thanks,

Phil.

Re: Survey123 and Speech Recognition integration

BryceHancock — Mon, 20 May 2019 17:52:11 GMT

Re: Survey123 and Speech Recognition integration

BryceHancock — Mon, 20 May 2019 17:57:57 GMT

I am using Survey123 version 3.3.64. I will give version 3.4 a shot. The first photo shows MS Excel app with the keyboard microphone icon.The second photo shows Survey123 without the keyboard microphone icon, instead numbers show at the top of the keyboard.

Re: Survey123 and Speech Recognition integration

Anonymous User — Mon, 27 May 2019 00:16:03 GMT

Hi Bryce,

I believe the microphone not displaying on a text input question is related to the known issue with Gboard. Can you try a different keyboard on that device and see if you still have that problem?

The Excel app is developed slightly different to how the keyboard works in Survey123, they have created a new button inide their app (not a keyboard button) that switches the keyboard type (letters to numeric), whereas Survey123 does not have such a button. You could raise this as an idea on the Survey123 Ideas page here if you think it is a good enhancement: https://community.esri.com/community/arcgis-ideas/content?filterID=contentstatus%5Bpublished%5D~category%5Bsurvey123-for-arcgis%5D

Phil.

Re: Survey123 and Speech Recognition integration

ChrisShuck — Sat, 05 Sep 2020 00:22:35 GMT

My default keyboard was Gboard. It works fine on all other apps, but on Survey123, I cannot utilize talk to to text or swipe texting. I downloaded and set MS SwiftKey as my default keyboard. I can now use talk to text, but I still can't use swipe texting, my preferred data entry method. That seems to be disabled for this app, but it works fine on others. I'm happy to have talk to text capability now though. Thanks for the tip.

-Chris