AI tool designed to help NT’s communicate with us

Post Reply New Topic

A team of Tufts University scientists recently took up the challenge of creating a tool to bridge this communication gap.

Instead of pushing autistic people to communicate in non-autistic ways, which can make social interactions inauthentic and cognitively draining for them—and which is the focus of many existing interventions—they created NeuroBridge, an AI-based learning tool that uses large language models to help neurotypical people learn how to better communicate with autistic people.

The researchers describe it in a new research paper published in the 27th International ACM SIGACCESS Conference on Computers and Accessibility.

“NeuroBridge is not so much a tool to use on-demand to assist during interactions, like you might use a translator when traveling to a country with a different language,” says Rukhshan Haroon, a PhD candidate in the computer science department, who led the research project.

“It is more useful as a way for non-autistic people to gain firsthand experience with cross-neurotype communication, learn about autistic communication preferences, and use that understanding to adjust their own communication when interacting with autistic people,” he says.

“Through NeuroBridge,” he adds, “our aim is to create an environment—among friends, coworkers, and organizations—that enables people to better recognize and appreciate neurodiverse communication styles, as well as the interdependent nature of social interactions.”

Fahad Dogar, an associate professor in the computer science department and at Tisch College for Civic Life, oversaw the project and says their approach was “grounded in the social model of disability, which emphasizes that disability arises not from individual deficits, but from the mismatch between individuals and their social environment.”

He notes that the system was developed with iterative feedback from a board of autistic volunteers, who helped improve its design and accuracy.

“We’re excited to build on this work and believe it has the potential for meaningful social impact,” he says.

“We are already exploring ways to use it to enhance support for neurodiverse students at Tufts, collaborate with departments, and campus resources that could benefit from it—such as the StAAR Center, which provides academic and accessibility support to students with disabilities—and pursue new opportunities to scale and evaluate its impact.”

NeuroBridge creates a conversational scenario tailored for the user based on information that they provide about themselves, making it interesting and relatable.

At different points in the conversation, NeuroBridge presents the neurotypical user with three response options, each similar in meaning but varying in tone, clarity, or phrasing. For example, the user may ask it, “How can I speed up shoveling snow from my driveway?”

NeuroBridge then may present three different ways to phrase that question: Is there a way to speed up shoveling a driveway? Do you know how to speed up shoveling snow from a driveway? What methods can be used to speed up shoveling snow from a driveway?

It will point out that two of these options (those starting with ‘Is there a way…?’ and ‘Do you know…?’) can be interpreted differently than intended because they can be answered with ‘yes’ or ‘no,’ rather than advice on shoveling. The third option is clearest, because it explicitly asks for the information being sought.

The researchers note that the application tends to train users toward principles called Gricean maxims, developed by philosopher H. Paul Grice, that guide a conversational style that is clear, brief, orderly, and avoids ambiguity.

“We tested NeuroBridge with 12 individuals,” says Haroon. “We received positive feedback on the utility of the application. Many neurotypical users were surprised to find the interpretations of the response options were obvious in hindsight, but never occurred to them.”

The participants also found that the feedback the program provided helped them understand exactly what parts of their conversation could be received differently by an autistic person, making it useful for navigating future real-world interactions.