Survey123 analysis tools (beta)
AI assistants in Survey123 are maturing. In a separate post you can read about the Survey123 assistant and how to use a conversation to help you design a survey and translate survey designs.
Also as exciting, is our progress in extracting information from images using natural language prompt (by generative AI). Over the last year our early adopters have provided great feedback about this capability, and it is now included in the Survey123 web designer as a beta feature for everyone to try.
Consider the following scenarios:
- When recording a traffic violation, after capturing a photo of the vehicle, you want to enter the details of license plate number, vehicle color, and vehicle model into separate questions in the survey.
- During a hydrant inspection, from the hydrant photo, you need to describe the state of the hydrant: in good condition, need maintenance, or is missing.
In both examples, the respondent could manually enter these details directly into the questions in the form themselves. But if many records are being captured, any opportunity to automate data entry is good, to minimize errors and to save time. The respondent can always correct the response that is generated, but human data validation is more efficient (and accurate) than human data entry.
Let’s focus on the traffic violation scenario above. The survey author would configure each of the text questions in the survey to perform a calculation on the image question to extract the information required:
- In the web designer, choose to edit the calculation of the text question (say License plate number)
- Select Vehicle image, and Analyze image from Extract property from the question
- Enter the prompt “Extract the license plate number from the vehicle”
Once the survey is published, the web app will automatically populate the questions that have been configured using the assistant, once they capture a photo:
To use the image analysis tool (beta), the following must be configured by an ArcGIS organization administrator:
- Disable the Block Esri apps and capabilities while they are in beta toggle. For more information see Blocked Esri apps.
- Enable the Allow use of AI assistants by members of your organization toggle button. For more information see Allow AI assistants
- Enable Analysis tools in the Survey123 website organization settings. For more information see Organization settings
Not yet available on survey123.arcgis.com but under development, are audio transcription and text analysis from within the web designer. Before clicking the following link, be sure to register and sign into the Early Adopter Community.
Learn more about audio transcription and text analysis in Survey123.