Bridging the Gap Between Engineering and Social Sciences in Technology
Engineering and social sciences have long been viewed as separate domains, each with its own methodologies and objectives. Yet, the technology developed within the engineering realm holds the unique capability to shape, challenge, and redefine societal structures. This intersection has become increasingly important as we consider the broader implications of the technologies we create, and it is a theme that has motivated new initiatives in academia.
This spring, Tufts University’s computer science department welcomed Dr. Jaylin Herskovitz, an assistant professor whose pioneering research emphasizes the fusion of social science with technical expertise. Herskovitz’s work is centered around designing personal assistive software, especially critical for blind and visually impaired individuals, who often employ technology in innovative ways to meet their specific needs.
The Journey to Integration
Herskovitz’s entry into the field of computer science is notable; she discovered her interest while studying at the University of Michigan. During her second year, she joined a human-computer interaction (HCI) lab, where she was captivated by the potential for technology to focus on human needs. “I thought all of CS research must be extremely technical, like inventing new algorithms… but the element of getting to work with people was very interesting to me,” she shared. This realization set her on a path that would ultimately lead to a Ph.D. in computer science and a new role at Tufts.
Her doctoral work involved studying how blind and visually impaired (BVI) people interact with AI technology. Herskovitz highlighted that BVI users often emerge as extreme early adopters, utilizing technology in practical situations that are often overlooked by the average user. While many experiment with AI for casual purposes—like asking it to tell a joke—BVI individuals leverage it for critical daily tasks, revealing essential insights for enhancing AI technology.
Innovating with Empathy
Herskovitz’s research unveiled a range of techniques used by BVI individuals to “hack, switch, and combine” AI assistive programs, serving as a foundation for her projects, such as ProgramAlly and AllyExtensions. ProgramAlly enables users to program AI systems to identify significant visual information within their environment easily. In contrast, AllyExtensions allows users to create shortcuts that consolidate multiple accessibility tools, bridging gaps that may exist in standard applications.
What distinguishes Herskovitz’s approach is her application of social science principles in software design and analysis. HCI emerges as a melting pot of disciplines—encompassing anthropology, psychology, cognitive science, and engineering techniques. Even though Herskovitz wasn’t formally trained in social science, she has been intentional about incorporating these perspectives throughout her academic journey. “As I went through my Ph.D., I’ve tried to expand and learn from those other disciplines,” she noted, reflecting on the diverse influences that fueled her research.
Empowering Disability Communities
The intersection of her technical and social science expertise enables Herskovitz to refine her goals in assistive technology further. She emphasizes the significance of community and interdependence within the disability community. “People with disabilities are domain experts in their own lives,” she explained. Recognizing their unique insights fosters a collaborative approach where technology serves their needs rather than imposing a one-size-fits-all solution.
Contrary to the stereotype that technology should promote complete independence, Herskovitz highlights that many BVI individuals prefer communal living and mutual support. Her work strives to enhance these communal ties rather than isolate users through rigid conceptions of independence.
The Future of Accessibility Lab Initiatives
At Tufts, Herskovitz is also establishing the AI, Design, and Accessibility Lab. She welcomes new student members eager to explore projects that integrate AI with social considerations. One notable initiative involves studying AI “hallucinations”—when AI generates inaccuracies—and developing strategies to help BVI individuals comprehend and navigate these errors. This project is critical in empowering users, particularly when they lack visual access to inputs, enabling them to make sense of technology’s limitations better.
As her lab develops, Herskovitz aspires to continue intertwining social science perspectives with assistive AI, showcasing that a holistic, multidisciplinary approach can profoundly enhance technological efficacy. Through her work, she illustrates the pivotal role that social understanding can play in advancing the technology we create, encouraging a future where technology not only serves but celebrates the nuances of human experience.
