Pervasive simulation and visualization with resource- and time-constraints (PerSiVal)

PN 7-1

01:53

Project description

Pervasive simulation envisions people making use of simulation technology anytime, anywhere. As such, the overarching goal of this project is to enable the visualisation of complex biomechanical simulations, specifically of a human arm, directly on the body of a person to be observed in a virtual or augmented reality (VR/AR) setup. As a proof-of-concept a three-dimensional, continuum-mechanical upper-arm model will be developed and its performance optimized using machine learning techniques, surrogate modelling, as well as distributing it to different systems while keeping any loss of accuracy to a minimum. The VR/AR nature of the visualization will allow for the exploration of novel methods for displaying and interacting with the results and the simulation model itself. Finally, we will develop methods to map all necessary simulation components and the visualisation onto a distributed, heterogeneous hardware infrastructure, taking into account all available resources and imposed time constraints, while prioritising simulation quality as much as possible.

Project information

Project title Pervasive simulation and visualization with resource- and time-constraints (PerSiVal)
Project leaders

Oliver Röhrle, Miriam Schulte, Michael Sedlmair (Frank Dürr)
Project duration March 2019 - December 2022
Project number PN 7-1

Publications PN 7-1 and PN 7-1 (II)

  1. 2024

    1. S. Beck et al., ChoreoVis: Planning and Assessing Formations in Dance Choreographies, vol. 43, no. 3. in Computer Graphics Forum, vol. 43. The Eurographics Association and John Wiley & Sons Ltd., 2024. doi: 10.1111/cgf.15104.
    2. X. Yu, B. Lee, and M. Sedlmair, “Design Space of Visual Feedforward And Corrective Feedback in XR-Based Motion Guidance Systems,” in Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI), in Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI). ACM, 2024, pp. 1--7. doi: https://doi.org/10.1145/3613904.3642143.
    3. C. Krauter, K. Angerbauer, A. Sousa Calepso, A. Achberger, S. Mayer, and M. Sedlmair, “Sitting Posture Recognition and Feedback: A Literature Review,” in CHI ’24: Proceedings of the CHI Conference on Human Factors in Computing Systems, in CHI ’24: Proceedings of the CHI Conference on Human Factors in Computing Systems. NY: ACM, 2024. doi: 10.1145/3613904.3642657.

  2. 2023

    1. X. Yu, “DC Limb Motion Guidance in Extended Reality,” in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). Mar. 2023, pp. 967–968. doi: 10.1109/VRW58643.2023.00326.
    2. J. Haischt and M. Sedlmair, “What’s (Not) Tracking? Factors of Influence in Industrial Augmented Reality Tracking: A Use Case Study in an Automotive Environment,” in Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, in Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. Ingolstadt, Germany: Association for Computing Machinery, Sep. 2023, pp. 42–51. doi: 10.1145/3580585.3607156.
    3. P. Gebhardt et al., “Auxiliary Means to Improve Motion Guidance Memorability in Extended Reality,” in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). Mar. 2023, pp. 689–690. doi: 10.1109/VRW58643.2023.00187.
    4. M. Wieland, M. Sedlmair, and T.-K. Machulla, “VR, Gaze, and Visual Impairment: An Exploratory Study of the Perception of Eye Contact across different Sensory Modalities for People with Visual Impairments in Virtual Reality,” in Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, in Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany: Association for Computing Machinery, Apr. 2023, pp. 1–6. doi: 10.1145/3544549.3585726.
    5. N. Hube, M. Reinelt, K. Vidackovic, and M. Sedlmair, “Work vs. Leisure – Differences in Avatar Characteristics Depending on Social Situations,” in Proceedings of the 16th International Symposium on Visual Information Communication and Interaction (VINCI ’23), in Proceedings of the 16th International Symposium on Visual Information Communication and Interaction (VINCI ’23). Association for Computing Machinery, 2023. doi: https://doi.org/10.1145/3615522.3615537.
    6. J. Kässinger, H. Trötsch, F. Dürr, and J. Edinger, “SimEdge: Towards Accelerated Real-Time Augmented Reality Simulations Using Adaptive Smart Edge Computing,” in Proceedings of the Int’l ACM Conference on Modeling Analysis and Simulation of Wireless and Mobile Systems, in Proceedings of the Int’l ACM Conference on Modeling Analysis and Simulation of Wireless and Mobile Systems. Association for Computing Machinery, 2023, pp. 181–190. doi: 10.1145/3616388.3617526.
    7. S. Rigling, X. Yu, and M. Sedlmair, “‘In Your Face!’: Visualizing Fitness Tracker Data in Augmented Reality,” in Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, in Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany: Association for Computing Machinery, Apr. 2023, pp. 1–7. doi: 10.1145/3544549.3585912.
    8. J. Kässinger, D. Rosin, F. Dürr, B. Mehler, T. Hubatscheck, and K. Rothermel, “Persival: Using Delayed Remote Updates in a Distributed Mobile Simulation,” 2023.
    9. L. R. Skreinig et al., “guitARhero: Interactive Augmented Reality Guitar Tutorials,” IEEE Transactions on Visualization and Computer Graphics, pp. 1–10, 2023, doi: 10.1109/TVCG.2023.3320266.
    10. J. Kneifl, D. Rosin, O. Avci, O. Röhrle, and J. Fehr, “Low-dimensional data-based surrogate model of a continuum-mechanical musculoskeletal system based on non-intrusive model order reduction,” Archive of Applied Mechanics, vol. 93, pp. 3637–3663, 2023, doi: 10.1007/s00419-023-02458-5.

  3. 2022

    1. A. Sousa Calepso, N. Hube, N. Berenguel Senn, V. Brandt, and M. Sedlmair, “cARdLearner: Using Expressive Virtual Agents when Learning Vocabulary in Augmented Reality,” in ACM Conference on Human Factors in Computing Systems Extended Abstracts (CHI-EA)), in ACM Conference on Human Factors in Computing Systems Extended Abstracts (CHI-EA)). New Orleans, LA, USA, 2022. doi: 10.1145/3491101.3519631.
    2. L. R. Skreinig et al., “AR Hero: Generating Interactive Augmented Reality Guitar Tutorials,” in 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), in 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). Mar. 2022, pp. 395–401. doi: 10.1109/VRW55335.2022.00086.
    3. J. Kässinger, D. Rosin, F. Dürr, N. Hornischer, K. Rothermel, and O. Röhrle, “Persival: Simulating Complex 3D Meshes on Resource-Constrained Mobile AR Devices Using Interpolation,” in Proceedings of the 2022 IEEE International Conference on Distributed Computing Systems (ICDCS), in Proceedings of the 2022 IEEE International Conference on Distributed Computing Systems (ICDCS). 2022, pp. 961--971. doi: 10.1109/ICDCS54860.2022.00097.
    4. N. Hube, K. Vidackovic, and M. Sedlmair, “Using Expressive Avatars to Increase Emotion Recognition: A Pilot Study,” in Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems, in Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems. New Orleans, LA, USA: Association for Computing Machinery, Apr. 2022, pp. 1–7. doi: 10.1145/3491101.3519822.
    5. P. Gebhardt, X. Yu, A. Köhn, and M. Sedlmair, “MolecuSense: Using Force-Feedback Gloves for Creating and Interacting with Ball-and-Stick Molecules in VR,” in Proceedings of the 15th International Symposium on Visual Information Communication and Interaction, in Proceedings of the 15th International Symposium on Visual Information Communication and Interaction. Chur, Switzerland: Association for Computing Machinery, Oct. 2022, pp. 1–5. doi: 10.1145/3554944.3554956.
    6. J. Eirich, M. Münch, D. Jäckle, M. Sedlmair, J. Bonart, and T. Schreck, “RfX: A Design Study for the Interactive Exploration of a Random Forest to Enhance Testing Procedures for Electrical Engines,” Computer Graphics Forum, vol. 41, no. 6, Art. no. 6, Mar. 2022, doi: 10.1111/cgf.14452.

  4. 2020

    1. X. Yu, K. Angerbauer, P. Mohr, D. Kalkofen, and M. Sedlmair, “Perspective Matters: Design Implications for Motion Guidance in Mixed Reality,” in Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR), in Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 2020. doi: 10.1109/ISMAR50242.2020.00085.
1
2
3
4
To the top of the page