Pervasive simulation and visualization with resource- and time-constraints (PerSiVal)

PN 7-1 (II)

Project description

Pervasive simulation envisions people making use of simulation technology anytime, anywhere. Contributing to this, the overarching goal of this project is to enable the visualization of complex biomechanical simulations directly on the body of a person observed in a virtual or augmented reality (VR/AR) setup. The focus of the first phase of project PerSiVal was to establish the necessary conceptual and methodological foundations. As a proof-of-concept a three-dimensional, continuum-mechanical upper-arm model was optimized using machine learning techniques, surrogate modeling, and distributing computations to different systems while keeping any loss of accuracy to a minimum. In the next phase of project PerSiVal we will build upon this and significantly widen our scope and increase the complexity of our work. Beyond simulating upper arm muscles and visualizing them on a real body, we will specifically utilize VR and haptic feedback technologies for an immersive "beyond reality" experience. Extended biomechanical models, model ensembles, and the live integration of experimental data, as well as concepts for a distributed and adaptive pervasive computing systems with multiple devices will contribute toward this.

Project information

Project title Pervasive simulation and visualization with resource- and time-constraints (PerSiVal)
Project leaders Oliver Röhrle, Michael Sedlmair, Christian Becker (Frank Dürr)
Project staff Michael Schramm, doctoral researcher
David Rosin, doctoral researcher
Xingyao Yu, doctoral researcher
Project duration September 2022 - March 2025
Project number PN 7-1(II)
  • Preceding project 7-1
    Pervasive simulation and visualization with resource- and time-constraints (PerSiVal)

Publications PN 7-1 and PN 7-1 (II)

  1. 2024

    1. S. Beck et al., ChoreoVis: Planning and Assessing Formations in Dance Choreographies, vol. 43, no. 3. in Computer Graphics Forum, vol. 43. The Eurographics Association and John Wiley & Sons Ltd., 2024. doi: 10.1111/cgf.15104.
    2. X. Yu, B. Lee, and M. Sedlmair, “Design Space of Visual Feedforward And Corrective Feedback in XR-Based Motion Guidance Systems,” in Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI), in Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI). ACM, 2024, pp. 1--7. doi: https://doi.org/10.1145/3613904.3642143.
    3. C. Krauter, K. Angerbauer, A. Sousa Calepso, A. Achberger, S. Mayer, and M. Sedlmair, “Sitting Posture Recognition and Feedback: A Literature Review,” in CHI ’24: Proceedings of the CHI Conference on Human Factors in Computing Systems, in CHI ’24: Proceedings of the CHI Conference on Human Factors in Computing Systems. NY: ACM, 2024. doi: 10.1145/3613904.3642657.

  2. 2023

    1. X. Yu, “DC Limb Motion Guidance in Extended Reality,” in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). Mar. 2023, pp. 967–968. doi: 10.1109/VRW58643.2023.00326.
    2. J. Haischt and M. Sedlmair, “What’s (Not) Tracking? Factors of Influence in Industrial Augmented Reality Tracking: A Use Case Study in an Automotive Environment,” in Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, in Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. Ingolstadt, Germany: Association for Computing Machinery, Sep. 2023, pp. 42–51. doi: 10.1145/3580585.3607156.
    3. P. Gebhardt et al., “Auxiliary Means to Improve Motion Guidance Memorability in Extended Reality,” in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). Mar. 2023, pp. 689–690. doi: 10.1109/VRW58643.2023.00187.
    4. M. Wieland, M. Sedlmair, and T.-K. Machulla, “VR, Gaze, and Visual Impairment: An Exploratory Study of the Perception of Eye Contact across different Sensory Modalities for People with Visual Impairments in Virtual Reality,” in Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, in Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany: Association for Computing Machinery, Apr. 2023, pp. 1–6. doi: 10.1145/3544549.3585726.
    5. N. Hube, M. Reinelt, K. Vidackovic, and M. Sedlmair, “Work vs. Leisure – Differences in Avatar Characteristics Depending on Social Situations,” in Proceedings of the 16th International Symposium on Visual Information Communication and Interaction (VINCI ’23), in Proceedings of the 16th International Symposium on Visual Information Communication and Interaction (VINCI ’23). Association for Computing Machinery, 2023. doi: https://doi.org/10.1145/3615522.3615537.
    6. J. Kässinger, H. Trötsch, F. Dürr, and J. Edinger, “SimEdge: Towards Accelerated Real-Time Augmented Reality Simulations Using Adaptive Smart Edge Computing,” in Proceedings of the Int’l ACM Conference on Modeling Analysis and Simulation of Wireless and Mobile Systems, in Proceedings of the Int’l ACM Conference on Modeling Analysis and Simulation of Wireless and Mobile Systems. Association for Computing Machinery, 2023, pp. 181–190. doi: 10.1145/3616388.3617526.
    7. S. Rigling, X. Yu, and M. Sedlmair, “‘In Your Face!’: Visualizing Fitness Tracker Data in Augmented Reality,” in Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, in Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany: Association for Computing Machinery, Apr. 2023, pp. 1–7. doi: 10.1145/3544549.3585912.
    8. J. Kässinger, D. Rosin, F. Dürr, B. Mehler, T. Hubatscheck, and K. Rothermel, “Persival: Using Delayed Remote Updates in a Distributed Mobile Simulation,” 2023.
    9. L. R. Skreinig et al., “guitARhero: Interactive Augmented Reality Guitar Tutorials,” IEEE Transactions on Visualization and Computer Graphics, pp. 1–10, 2023, doi: 10.1109/TVCG.2023.3320266.
    10. J. Kneifl, D. Rosin, O. Avci, O. Röhrle, and J. Fehr, “Low-dimensional data-based surrogate model of a continuum-mechanical musculoskeletal system based on non-intrusive model order reduction,” Archive of Applied Mechanics, vol. 93, pp. 3637–3663, 2023, doi: 10.1007/s00419-023-02458-5.

  3. 2022

    1. A. Sousa Calepso, N. Hube, N. Berenguel Senn, V. Brandt, and M. Sedlmair, “cARdLearner: Using Expressive Virtual Agents when Learning Vocabulary in Augmented Reality,” in ACM Conference on Human Factors in Computing Systems Extended Abstracts (CHI-EA)), in ACM Conference on Human Factors in Computing Systems Extended Abstracts (CHI-EA)). New Orleans, LA, USA, 2022. doi: 10.1145/3491101.3519631.
    2. L. R. Skreinig et al., “AR Hero: Generating Interactive Augmented Reality Guitar Tutorials,” in 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), in 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). Mar. 2022, pp. 395–401. doi: 10.1109/VRW55335.2022.00086.
    3. J. Kässinger, D. Rosin, F. Dürr, N. Hornischer, K. Rothermel, and O. Röhrle, “Persival: Simulating Complex 3D Meshes on Resource-Constrained Mobile AR Devices Using Interpolation,” in Proceedings of the 2022 IEEE International Conference on Distributed Computing Systems (ICDCS), in Proceedings of the 2022 IEEE International Conference on Distributed Computing Systems (ICDCS). 2022, pp. 961--971. doi: 10.1109/ICDCS54860.2022.00097.
    4. P. Gebhardt, X. Yu, A. Köhn, and M. Sedlmair, “MolecuSense: Using Force-Feedback Gloves for Creating and Interacting with Ball-and-Stick Molecules in VR,” in Proceedings of the 15th International Symposium on Visual Information Communication and Interaction, in Proceedings of the 15th International Symposium on Visual Information Communication and Interaction. Chur, Switzerland: Association for Computing Machinery, Oct. 2022, pp. 1–5. doi: 10.1145/3554944.3554956.
    5. N. Hube, K. Vidackovic, and M. Sedlmair, “Using Expressive Avatars to Increase Emotion Recognition: A Pilot Study,” in Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems, in Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems. New Orleans, LA, USA: Association for Computing Machinery, Apr. 2022, pp. 1–7. doi: 10.1145/3491101.3519822.
    6. J. Eirich, M. Münch, D. Jäckle, M. Sedlmair, J. Bonart, and T. Schreck, “RfX: A Design Study for the Interactive Exploration of a Random Forest to Enhance Testing Procedures for Electrical Engines,” Computer Graphics Forum, vol. 41, no. 6, Art. no. 6, Mar. 2022, doi: 10.1111/cgf.14452.

  4. 2020

    1. X. Yu, K. Angerbauer, P. Mohr, D. Kalkofen, and M. Sedlmair, “Perspective Matters: Design Implications for Motion Guidance in Mixed Reality,” in Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR), in Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 2020. doi: 10.1109/ISMAR50242.2020.00085.
To the top of the page