Turning Immersive Viewers into Analytical Workspaces: ASCRIBE-XR and Agent-Driven Scientific Visualization

Scientific visualization is changing from passive observation to active, AI-assisted collaboration. While Extended Reality (XR) has proven valuable for comprehending dense 3D arrays, traditional VR applications are typically deployed in rigid, single-purpose, and monolithic architectures. In this paper, we present the evolution of ASCRIBE-XR: a virtual reality platform backed by remote computation that has been re-engineered into a dynamic, service-oriented ecosystem. We introduce three core innovations that make immersive data analysis easier, faster, and more flexible when using multimodal scientific imaging. First, a lightweight Python REST interface decouples XR logic from the rendering engine, enabling real-time, programmable scene customization and on-demand data generation. Second, we present a Specimen Catalog architecture that lets the platform pivot between radically different disciplines, ranging from archaeological heterogeneous concrete and fuel-cell membranes to the root system of a bioenergy grass, by describing each dataset through portable metadata rather than hard-coded application logic. Finally, we introduce a prompt-driven layer powered by the Claude Agent SDK, allowing researchers to generate, segment, and manipulate volumetric and mesh data through natural language dialogue within the virtual space. For example, applying foundation models such as the Segment Anything Model (SAM) to perform zero-shot segmentation on demand. By bridging human intent with remote computation, ASCRIBE-XR relaxes the constraints of conventional visualization tools, offering a highly adaptable, conversational platform for scientific discovery with human auditing.