Speaker
Description
At large-scale scientific facilities such as High Energy Photon Source (HEPS), diverse experimental techniques and detection methods have led to a proliferation of highly specialized data processing software. These tools often feature heterogeneous interfaces and complex parameters, imposing significant cognitive and operational burdens on users, software developers, and technical support staff across various disciplines.
To address these challenges, we propose a Dialogic and Collaborative Software Interaction Paradigm, aiming to transform traditional graphical user interface (GUI)-centric workflows into a new experience driven by natural language and characterized by real-time human-machine collaboration. The core architecture of this paradigm consists of three key modules: (1) a Dynamic Context-Awareness Module, responsible for capturing software state, operation history, and data semantics in real time; (2) a Structured Tool-Calling Module, which accurately maps user instructions in natural language into executable sequences of software functions; and (3) an Interface Synchronization and Execution Module, which drives the native graphical interface to respond step-by-step, creating a transparent interactive loop of "what you say is what you see."
To validate this paradigm, we have implemented the "Data Conversion Smart Assistant" software. This assistant allows users to express data processing intents—such as format conversion and batch filtering—in natural language. It then automatically parses the instructions, invokes the corresponding functional modules, and executes each step synchronously and visually within the software's main interface. This enables users to observe, confirm, and participate in the entire workflow in real time.
By shifting the user's focus from "how to operate" to "how to discover", this work provides both a practical tool for reducing interaction barriers and a conceptual framework for designing more human-centric scientific software.