Publications at NUILab
Table of Contents
The Natural User Interaction (NUI) Lab’s primary research focuses on multi-modal interaction (gestures, gestures + speech, etc.) using elicitation, development of techniques, and recognition (when appropriate) for 3D user interfaces.
The lab uses Augmented Reality and Virtual Reality technology to accomplish its primary objective. In addition, NUILab has been expanding to understand collaborative nature in augmented reality. A secondary focus is understanding how virtual reality can be used to promote larger diversity in computer science.
In addition to our core research, this is a very multi-disciplinary lab, where we collaborate with Vision, Software Engineering, Psychology, Human-Factors, and Networking, among others.
Publications can be additionally found on Dr. Francisco Ortega’s Google Scholar page.
Legend
Legend: Additional information about the publications is included at the end of the citation, enclosed by brackets ([]). The acceptance rate for papers is denoted by AR. The impact factor is denoted by IF. The 5-Year impact factor is denoted by 5-IF. Citation count (greater than 3) is denoted by CC. All categories are sorted by year in descending order. Publications last updated: June 2023.
Books
Williams, A.S. and Ortega, F.R., A Concise Guide to Elicitation Methodology. 2021. Fort Collins, CO. Open Access. [CC:1]. Link
Barreto, A., Adjounadi, M., Ortega, F. and O-Larnnithipong, N., Intuitive Understanding of Kalman Filtering Using MatLab, CRC Press, New York, NY, 2020. (Completed). In Press. Link.
Ortega, F.R., Abyarjoo, F., Barreto, A., Rishe, N., and Adjouadi, M., Interaction Design for 3D User Interfaces: The World of Modern Input Devices for Research, Applications, and Game Development. CRC Press/AK Peters, New York, NY, 2016. ISBN-13: 978-1482216943. [CC:23]. Link
Refereed Journal Articles
Oselinsky, K., Spitzer, A.N., Yu, Y., Ortega, F.R., Malinin, L.H., Curl, K.A., Leach, H., and Graham, D.J.. Virtual Reality Assessment of Walking in a Modifiable Urban Environment: A Feasibility and Acceptability Study. Scientific Reports (13), p.5867. In Scientific Reports 2023. Link • PDF
Warden, A.C., Wickens, C.D., Rehberg D., Ortega, F.R., and Clegg, B.A.. Fast, Accurate, but Sometimes Too-Compelling Support: The Impact of Imperfectly Automated Cues in an Augmented Reality Head-Mounted Display on Visual Search Performance. Under Revision in IEEE Transactions on Human-Machine Systems. 2023. Link • PDF
Williams, A. S. and Ortega, F. R.. The Impacts of Referent Display on Gesture and Speech Elicitation. IEEE vol. 28, iss. 11. (September 2022), pp. 3885–3895. In IEEE Transactions on Visualization and Computer Graphics. [IF: 5.226, AR: 26.6%]. 2022. Link • PDF
Warden, A. C., Wickens, C.D., Rehberg, D., Clegg, B. A., and Ortega, F. R.. Information Access Effort: The Role of Head Movements for Information Presented at Increasing Eccentricity on Flat Panel and Head-Mounted Displays. In Human Factors Journal. In Press. [IF:3.598, 5-IF: 4.212]. 2022. PDF
Wickens, C. D., Mifsud, D., Rodriguez, R., and Ortega, F. R. (2021). Mitigating the costs of spatial transformations with a situation awareness augmented reality display: Assistance for the Joint Terminal Attack Controller. SAGE (June 2022), pp. 3–17. In Human Factors: The Journal of the Human Factors and Ergonomics Society. SAGE. [IF:3.598, 5-IF: 4.212]. 2022. Link
Wang, H., Gaddy, V., Beveridge, J.R., and Ortega, F. R. Building an Emotionally Responsive Avatar with Dynamic Facial Expressions in Human—Computer Interactions. MDPI vol. 5, iss. 3. (March 2021), pp. 1–13. In Multimodal Technologies and Interaction. [IF: 3.08, CC:5]. 2021. Link • PDF
Silva-Calpa, G.F.M., Raposo, A.B. and Ortega, F.R.. Collaboration Support in Co-located Collaborative Systems for Users with Autism Spectrum Disorders: A Systematic Literature Review. Taylor & Francis Online vol. 37, iss. 1. (January 2021), pp. 15–35. In International Journal of Human-Computer Interactions. [IF: 4.9]. 2021. Link • PDF
Williams, A.S., Garcia, J., De Zayas, F., Hernandez, F., Sharp, J, and Ortega, F.R.. The Cost of Production in Elicitation Studies and the Legacy Bias-Consensus Trade off. MDP vol. 4, iss. 4. (December 2020), pp. 1–88. In Multimodal Technologies and Interaction. [IF: 2.3, CC:6]. 2020. Link • PDF
Williams, A.S., Garcia, J., and Ortega, F.R.. Understanding Multimodal User Gesture and Speech Behavior for Object Manipulation in Augmented Reality Using Elicitation. IEEE vol. 26, iss. 12. (December 2020), pp. 3479–3489. In IEEE Transactions on Visualization and Computer Graphics. [IF: 5.226, AR:6%, CC:9]. 2020. Link • PDF
Williams, A.S. and Ortega, F. R.. Understanding Gesture and Speech Multimodal Interactions for Manipulation Tasks in Augmented Reality Using Unconstrained Elicitation. ACM vol. 4, iss. ISS. (November 2020), pp. 1–21. In Proceedings of the ACM on Human-Computer Interaction. [IF:4.568, AR:28%, CC:13]. 2020. Link • PDF
Ortega, F.R., Williams, A.S., Tarre, K., Barreto, A. and Rishe, N. 3D Travel Comparison Study between Multi-Touch and GamePad. Taylor & Francis vol. 36, iss. 18. (November 2020), pp. 1699–1713. In International Journal of Human-Computer Interaction. [IF: 4.920]. 2020. Link • PDF
Vieira, E.R., Civitella, F., Carreno, J., Junior, M.G., Amorim, C.F., D’Souza, N., Ozer, E., Ortega, F.R. and Estrazulas, J.A. Using Augmented Reality with Older Adults in the Community to Select Design Features for an Age-Friendly Park: A Pilot Study. Hindawi vol.2020, Article ID 8341034. (September 2020), pp. 1–8. In Journal of Aging Research. [IF: 2.381]. 2020. Link • PDF
Coffino, J., Barreto, A., Abyarjoo, F., and Ortega, F. R. Sonically-Enhanced Tabular Screen-Reading. vol. 2. (December 2014), pp. 46–57. In Journal on Technology & Persons with Disabilities (JTPD). [CC: 3]. 2014. Link • PDF
Ren, P., Barreto, A., Huang, J., Gao, Y., Ortega, F.R., and Adjouadi, M. Off-line and Online Stress Detection through Processing of the Pupil Diameter Signal. Springer Link vol. 42, iss. 1. (January 2014), pp. 162–176. In Annals of Biomedical Engineering. [IF: 4.167, CC: 67]. 2014. Link • PDF
Refereed Chapters in Books
Daunhauer, L., Ortega, F. R., Beveridge, R., Strout, J., and Bundy, A. Chapter Five – Captivating: Avatars as therapeutic agents for children with intellectual and developmental disabilities. Editors: Riggs, N, Rigles, B, in International Review of Research in Developmental Disabilities. Academic Press, Vol. 61, 2021, pp. 133–157, ISSN 2211-7095, ISBN 9780128245859. Link
Hernandez, H., Ortega, F.R., Reducing Video Game Creation Effort with Eberos GML2D. Chapter in Game Development Tools edited by Marwan Y. Ansari. AK Peters/CRC Press. New York, NY, 2011.
Refereed Proceeding/Transactions
Plabst, L., Oberdorfer, S., Ortega, F. R., and Niebling, F. 2022. Push the Red Button: Comparing Notification Placement with Augmented and Non-Augmented Tasks in AR. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction (SUI ’22). Association for Computing Machinery. pp. 1–11. 2022. Link • PDF
Zhou, X., Williams, A.S., and Ortega, F.R. 2022. Eliciting Multimodal Gesture+Speech Interactions in a Multi-Object Augmented Reality Environment. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (VRST ’22). Association for Computing Machinery. pp. 1–10. [AR: 26%]. 2022. Link • PDF
Masters, R., Interrante, V.,Watts, M., and Ortega, F. R. 2022. Virtual Nature: Investigating the Effect of Biomass on Immersive Virtual Reality Forest Bathing Applications For Stress Reduction. In ACM Symposium on Applied Perception 2022 (SAP ’22). Association for Computing Machinery. pp. 1–10. 2022. Link • PDF
Warden, A. C., Wickens, C. D., Rehberg, D., Clegg, B. A., and Ortega, F. R.. 2022. Information Access Effort: Are Head Movements “Cheap” or Even “Free”?. In Proceedings of the Human Factors and Ergonomics Society 66th Annual Meeting. SAGE. pp. 2203–2207. HFES Best Student Paper Award (to all authors). 2022. Link • PDF
Warden, A. C., Wickens, C. D., Mifsud, D., Ourada, S., Clegg, B. A., and Ortega, F.R. 2022. Visual Search in Augmented Reality: Effect of Target Cue Type and Location. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. SAGE. pp. 373–377. 2022. Link • PDF
Mifsud, D., Wickens, C., Maulbeck, M., Crane, P., and Ortega, F. R.. 2022. The Effectiveness of Gaze Guidance Lines in supporting JTAC’s attention allocation. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. SAGE. pp. 2198–2201. 2022. Link • PDF
Zhou, X., Williams, A.S., Ortega, F.R. 2022. Towards Establishing Consistent Proposal Binning Methods for Unimodal and Multimodal Interaction Elicitation Studies. In Human-Computer Interaction. Theoretical Approaches and Design Methods. Springer, Cham. pp. 356–368. 2022. Link
Al Azad, M. W., Shannigrahi, S., Stergiou, N., Ortega, F.R., and Mastorakis, S. 2021. CLEDGE: A Hybrid Cloud-Edge Computing Framework over Information Centric Networking. In 2021 IEEE 46th Conference on Local Computer Networks. IEEE. pp. 589–596. [AR: 28%, CC: 6]. 2021. Link • PDF
Rodriguez, R., Mifsud, D., Wickens, C., Williams, A.S., Tarre, K., Crane, P., and Ortega, F.R.. 2021. Virtual Reality Compensatory Aid for Improved Weapon Splash-Zone Awareness. In Human-Computer Interaction. Virtual, Augmented and Mixed Reality. Springer, Cham. pp. 533–544. [AR: 30%]. 2021. Link
Williams, A. S., Angelini, C., Kress, M., Ramos Vieira, E., D’Souza, N., Rishe, N. D., Medina, J., Ozer, E., and Ortega, F.. 2020. Augmented Reality for City Planning. In Human-Computer Interaction International. Springer, Cham. pp. 256–271. [AR: 26.5%, CC: 5]. 2020. Link
McNeely-White, D.G., Ortega, F.R., Beveridge, J.R., Draper, B.A., Bangar, R., Patil, D., Pustejovsky, J., Krishnaswamy, N., Rim, K., Ruiz, J., and Wang, I. 2019. User-Aware Shared Perception for Embodied Agents. In 2019 IEEE International Conference on Humanized Computing and Communication (HCC). IEEE. pp. 46–51. [CC:6]. 2019. Link • PDF
O-Larnnithipong, N., Ratchatanantakit, N., Tangnimitchok, S., Ortega, F.R., Barreto, A., and Adjouadi, M. 2019. Statistical Analysis of Novel and Traditional Orientation Estimates from an IMU-Instrumented Glove. In Antona M., Stephanidis C. (eds) Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments. Springer, Cham. pp. 282–299. 2019. Link
Ozer, E., D’Souza, N., Vieira, E., Ortega, F.R.. 2019. An Underline for the Underserved: A Pilot Study to Explore Simulation Research for Sustainable Aging Around Miami’s Metrorail. In Sustainable Urban Environments: Research, Design and Planning for the Next 50 Years. EDRA. 2019. Link
Tangnimitchok, S., O-larnnithipong, N., Ratchatanantakit, N., Barreto, A., Ortega, F. R., and Rishe, N. D. 2018. A System for Non-Intrusive Affective Assessment in the CircumplexModel from Pupil Diameter and Facial Expression Monitoring. In Human-Computer Interaction. Theories, Methods, and Human Issues. Springer, Cham. pp. 465–477. [AR: 27, CC:5%]. 2018. Link
Balcazar, R., Ortega, F. R., Tarre, K., Barreto, A., Weiss, M., and Rishe, N. D. 2017. CircGR: Interactive Multi-Touch Gesture Recognition using Circular Measurements. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. Association for Computer Machinery. pp. 12–21. [AR: 26.90%, CC:6]. 2017. Link • PDF
Ortega, F.R., Galvan, A., Tarre, K., Barreto, A., Rishe, N., Bernal, J., Balcazar, R., and Thomas, J. L.. 2017. Gesture Elicitation for 3D Travel via Multi-Touch and Mid-Air Systems for Procedurally Generated Pseudo-Universe. In 2017 IEEE Symposium on 3D User Interfaces. IEEE. pp. 144–153. DOI: 10.1109/3DUI.2017.7893331. [AR:32%, CC:31]. 2017. Link • PDF
Tangnimitchok, S., O-Larnnithipong, N., Barreto, A., Ortega, F. R., and Rishe, N. D. 2016. Finding an Efficient Threshold for Fixation Detection in Eye Gaze Tracking. In International Conference on Human-Computer Interaction, Interaction Platforms and Techniques of the series Lecture Notes in Computer Science. Springer, Cham. pp. 93–103. [AR:29%]. 2016. Link
Abyarjoo, F., O-Larnnithipong, N., Tangnimitchok, S., Ortega, F.R., and Barreto, A. 2015. PostureMonitor: Real-Time IMU Wearable Technology to Foster Poise and Health. In International Conference of Design, User Experience, and Usability of the series Lecture Notes in Computer Science. Springer, Cham. pp. 543–552. [AR:30%, CC:13]. 2015. Link
Ortega, F.R., Barreto, A., Rishe, N., O-Larnnithipong, N., Adjouadi, M., and Abyarjoo, F. 2015. GyroTouch: Wrist Gyroscope with a Multi-Touch Display. In International Conference on Human-Computer Interaction, Human-Computer Interaction: Interaction Technologies of the series Lecture Notes in Computer Science. Springer, Cham. pp. 262–270. [AR:30%]. 2015. Link
Ortega, F.R., Rishe, N., Barreto, A., Abyarjoo, F., and Adjouadi, M. 2015. Multi-Touch Gesture Recognition Using Feature Extraction. In Innovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering of the series Lecture Notes in Electrical Engineering. Springer, Cham. pp. 291–296. [CC:4]. 2015. Link
Abyarjoo, F., Barreto, A., Cofino, J., and Ortega, F.R. 2015. Implementing a Sensor Fusion Algorithm for 3D Orientation Detection with Inertial/Magnetic Sensors. In Innovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering of the series Lecture Notes in Electrical Engineering. Springer, Cham. pp. 305–310. [CC:100]. 2015. Link
Ortega, F.R., Liu, S., Hernandez, F.⋆, Barreto, A., Rishe, N., and Adjouadi, M. 2014. PeNTa: Multi-Touch Modeling using Petri Nets. In International Conference on Human-Computer Interaction, Human-Computer Interaction: Theories, Methods, and Tools of the series Lecture Notes in Computer Science. Springer, Cham. pp. 361-372. [AR:31%]. 2014. Link
Abyarjoo, F., Barreto, A., Abyarjoo, S., Ortega, F.R., and Cofino, J. 2013. Monitoring Human Wrist Rotation in Three Degrees of Freedom. In 2013 Proceedings of IEEE SoutheastCon. IEEE. pp. 1-5. DOI: 10.1109/SECON.2013.6567517. [CC: 10]. 2013. Link • PDF
Cofino, J., Barreto, A., Abyarjoo, F., Ortega, F.R.. 2013. Sonifying HTML tables for audiospatially enhanced non-visual navigation. In 2013 Proceedings of IEEE Southeastcon. IEEE. pp. 1–5. Link • PDF
Ortega, F.R., Barreto, A., Rishe, N., and Adjouadi, M. 2013. Interaction with 3D Environments Using Multi-Touch Screens. In Innovations and Advances in Computer, Information, Systems Sciences, and Engineering of the series Lecture Notes in Electrical Engineering. vol. 152, pp. 381–392, CISSE. Springer. [AR:41%]. 2013. Link
Verhoef, T., Lisetti, C., Barreto, A., Ortega, F.R., Van der Zant, T., and Cnossen, F. 2009. Bio-sensing for Emotional Characterization without Word Labels. In Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction, 13th International Conference, HCI International. Lecture Notes in Computer Science. Springer, Cham. pp. 693–702. [AR:32%, CC:27]. 2009. Link
Refereed Workshop Articles
Masters, R., Ortega, F.R., and Interrante, V.. A Multisensory Approach to Virtual Reality Stress Reduction. ACM (2023), pp. 1-5. In Smell, Taste, Temperature at ACM SIGCHI 2023. Link • PDF
Karduna, A., Williams, A.S., and Ortega, F.R.. NUI-Spatial Markers: AR Spatial Markers For the Rest of Us. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops. IEEE VR 2022 Workshop – Open Access Tools and Libraries for Virtual Reality. (VRW ’22), March 12-16, 2022, Christchurch, New Zealand. IEEE, pp. 58-60. Link • PDF
Gaddy, V. and Ortega, F.R.. Exploring Factors Associated with Retention in Computer Science Using Virtual Reality. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW ’2022), March 12–16 2022, Christchurch, New Zealand, pp. 271–276. Link • PDF
Batmaz, A.U., Mifsud, D., Steed, A., Stuerzlinger, W., and Ortega, F.R. Researchers’ and Participants’ Experiences on Distributed User Studies Conducted in the First Year of COVID-19 Pandemic. In First XR Remote Research Workshop (ACM CHI ’21), March 27– April 1, 2021, Lisbon, Portugal. IEEE, pp. 1–3.
Williams, A.S. †and Ortega, F. R.. Using a 6 Degrees of Freedom Virtual Reality Input Device With An Augmented Reality Headset In A Collaborative Environment. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). Third Workshop on Novel Input Devices and Interaction Techniques (NIDIT). March 27 – April 1, 2021, Lisbon, Portugal. IEEE, pp. 205–209. Link • PDF
Ratcliffe, J., Soave, F., Hoover, M. Ortega, F.R., Bryan-Kinns, N., Tokarchuk, L., and Farkhatdinov, I. Remote XR Studies: Exploring Three Key Challenges of Remote XR Experimentation. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA ’21). May 2021, Association for Computing, pp. 1–4. [CC:5]. Link • PDF
Pustejovsky, J., Krishnaswamy, N., Beveridge, R., Ortega, F.R., Patil, D., Want, H.y, and White, D.y. Interpreting and Generating Gestures with Embodied Human Computer Interactions. In ACM IVA ’20, Generation and Evaluation of Nonverbal Behaviour for Embodied Agents Workshop. 2020. PDF
Willams, A.S., Coler, S., and Ortega, F.. Conversations On Multimodal Input Design With Older Adults. In ACM CHI 2020 Designing Interactions for the Ageing Populations Addressing Global Challenges Workshop, pp. 1-4, 2020. PDF
Shannigrahi, S., Mastorakis, S., and Ortega, F. R. Next-Generation Networking and Edge Computing for Mixed Reality Real-Time Interactive Systems. In 2020 IEEE International Conference on Communications Workshops (ICC Workshops), June 7-11, 2020, Dublin, Ireland. IEEE, pp. 1–6. [CC: 22]. Link
Gaddy, V. and Ortega, F.. Exploring the Impact of Belonging on Computer Science Enrollment Using Virtual Reality. In 2020 IEEE Conf. Fifth workshop on K-12+ Embodied Learning through Virtual and Augmented Reality (KELVAR) 20. Atlanta, GA, USA, 2020, pp. 444-448. Link • PDF
Williams, A. S. and Ortega, F.. Insights on visual aid and study design for gesture interaction in limited sensor range Augmented Reality devices. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts andnWorkshops (VRW). Second workshop on Novel Input Devices and Interaction Techniques (NIDIT) ’20. Atlanta, GA, USA, 2020, pp. 19-22. Link • PDF
N. O-Larnnithipong, N. Ratchatanantakit, S. Tangnimitchok, F. Ortega and A. Barreto. Hand Tracking Interface for Virtual Reality Interaction based on MARG sensors. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Workshop on Novel Input Devices and Interaction Techniques (NIDIT)Osaka, Japan, 2019, pp. 1717-1722. [CC:4] Link • PDF
Ortega, F. R., K. Tarre, M. Kress, A. S.Williams, A. B. Barreto and N. D. Rishe. Selection and Manipulation Whole-Body Gesture Elicitation Study in Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Workshop on Novel Input Devices and Interaction Techniques (NIDIT), Osaka, Japan, 2019, pp. 1723-1728. [CC:12] PDF
Raikwar, S., D’Souza, N., Rogers, C., Kress, M., Williams, A., Rishe, N., Ortega, F. CubeVR: Digital Affordances for Architecture Undergraduate Education using Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces, Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR), Osaka, Japan, 2019, pp. 1623-1626. [CC:7] Link • PDF
Ortega, F., Bolivar, S., Bernal, J., Galvan, A., Tarre, K., Rishe, N., and Barreto, A. Towards a 3D Virtual Programming Language to Increase the Number of Women in Computer Science Education. In 2017 IEEE Virtual Reality Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR), Los Angeles, CA. pp. 1-6. [CC:12] Link • PDF
Ortega, F., Jamides, S., Barreto, A., and Rishe, N., The Tabletop is dead. Long Live the Tabletop!. In The Disappearing Tabletop: Social and Technical Challenges for Cross-Surface Collaboration workshop on Interactive Surfaces and Spaces (ISS ’17). 2017. Link • PDF
Ortega, F., Balcazar, R., Barreto, A., and Rishe, N. Smart Learning Desk: Towards an Interactive Classroom. In IEEE Virtual Reality 2016 Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR ’16), Mar. 2016. Link • PDF
Wu, Y., Hernandez, F., Ortega, F., Clarke, P., and France, R. Measuring the Effort for Creating and Using Domain-Specific Models. In Proceedings of the 10th Workshop on Domain-Specific Modeling (DSM ’10). ACM, New York, NY, USA, article 14, pages 6, 2010. [AR:66%,CC:32]. Link • PDF
Hernandez, H., Ortega, F. Eberos GML2D: A Graphical Domain-Specific Language for Modeling 2D Video Games. In Proceedings of the 10th Workshop on Domain-Specific Modeling (DSM ’10). ACM, New York, NY, USA, article 4, pages 6, 2010. [AR:66%, CC:28]. PDF
Refereed Poster Articles
Plabst, L., Obertdorfer, S. Ortega, F.R., and Niebling, F. Press the red button: A user study comparing notification placement with augmented and non-augmented tasks in AR. In The 21st IEEE International Symposium on Mixed and Augmented Reality (ISMAR). October 17 – 21, 2022, Singapore, Singapore. IEEE, pp. 483–484. Link • PDF
Mifsud, D. M., Williams, A. S., Ortega, F. and Teather, R. J. Augmented Reality Fitts’Law Input Comparison Between Touchpad, Pointing Gesture, and Raycast. In 2022 IEEEConference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). March 12 – 16, 2022, Christchurch, New Zealand. IEEE, pp. 590–591. Link • PDF
Vieira, E. R., Estrázulas, J. A., Civitella, F., Carreno, J., D’Souza, N., Ozer, E., Ortega, F. (2019). Does wearing augmented-reality goggles affect older adults’ kinematics during gait? The Gerontological Society of America’s 71st Annual Scientific Meeting. Austin, Texas. November 13-17, 2019. Innovation in Aging, 3(S1), S338. Link • PDF
Johnston, D., Flack, J., Ray, I., and Ortega, F. Towards a Virtual Reality Home IoT Network Visualization. In 2019 Graphics Interface – Human-Computer Interaction Track, pp. 1-2. Link • PDF
Angelini, C., Williams, A., Kress, M., Vieira, E., D’Souza, N., Rishe, N., Medina, J., Ortega, F. City Planning with Augmented Reality. In 2019 Graphics Interface – Human-Computer Interaction Track, pp. 1-2. Link • PDF
Ortega, F. R., Tarre, K., Kress, M., Williams, A. S., Barreto, A. B., and Rishe, N. D. Selection and Manipulation Whole-Body Gesture Elicitation Study. In Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), March 23 – 27, 2019, Osaka, Japan. IEEE, pp. 1723–1728. Link • PDF
Tarre, K., Williams, A.S., Borges, L., Rishe, N.D., Barreto, A.B., and Ortega, F.R. Towards first person gamer modeling and the problem with game classification in user studies. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (VRST ’18). 2018, Stephen N. Spencer (Ed.). Link • PDF
Galvan, A., Ortega, F., and Rishe, N. Procedural Celestial Rendering for 3D Navigation. In 2017 IEEE Symposium on 3D User Interfaces (3DUI), Los Angeles, CA. 2017. pp. 211-212 Link • PDF
Calella, J., Ortega, F., Rishe, N., Barreto, A., and Bernal, J. Hand Magic: Towards User Interaction with Inertial Measuring Units. In 2016 IEEE SENSORS. Orlando, FL. 2016, pp. 1-3. [AR:58%, CC: 4] PDF
Vassigh, S., Elias, A., Ortega, F., Davis, D., Gallardo, G., Alhaffar, H., Borges, L., Bernal, J., and Rishe, N. Integrating Building Information Modeling with Augmented Reality for Interdisciplinary Learning. In 2016 IEEE International Symposium Mixed and Augmented Reality (ISMAR-Adjunct), pp. 260-261, IEEE, 2016. [CC: 28]. Link • PDF
Ortega, F., Rishe, N., and Barreto, A. TAMGeF: Touch-midAir-Motion Framework for Spatial Input. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI ’15). ACM, New York, NY, USA, pp. 136, 2015. Link • PDF
Ortega, F., Barreto, A., Rishe, N., Adjouadi, M., and Liu, S., Exploring Modeling Language for Multi-Touch Systems Using Petri Nets. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS ’13), ACM, New York, NY, USA. pp. 361–364. 2013. [CC: 8]. PDF
Ortega, F., Barreto, A., and Rishe, N., Augmenting Multi-Touch with Commodity Devices. In Proceedings of the 1st Symposium on Spatial User Interaction (SUI ’13). ACM, New York, NY, USA, p. 95. 2013. PDF
Ortega, F., Barreto, A., Rishe, N. and Adjouadi, M., and Abyarjoo, F., Poster: Real-Time Gesture Detection for Multi-Touch Devices. In IEEE 8th Symposium on 3D User Interfaces (3DUI ’13), Orlando, FL, pp. 167-168. PDF
Refereed Demo Papers
Raikwar, A., Plabst, L., and Ortega, F.R.. ARtisan Bistro: A Cooking Task Environment to Conduct Studies in Augmented Reality. In The 21st IEEE International Symposium on Mixed and Augmented Reality (ISMAR). October 17 – 21, 2022, Singapore, Singapore. IEEE, pp. 909–910. Link • PDF
Pustejovsky, J., Krishnaswamy, N., Beveridge, R., Patil, D.†, McNeely-White, D.G.†,Wang, H.†, and Ortega, F.R. Situational Awareness in Human Computer Interaction: Diana’sWorld. In International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments (ICAT-EGVE): Demos. December 2 – 4, 2020. ACM/Eurographics. Best DemoAward.
Raikwar, A., Stephens, J., Ortega, F., Demo: Assessing Sports Related Concussion in Soccer Players Using Immersive VR Soccer, in in IEEE VR and 3DUI 2020, pp. 1-2. Atlanta, GA, USA. 2020. Link • PDF
Balcazar, R., Ortega, F., Tarre, K., Barreto, A., Weiss, M., Rishe, N., [DEMO] CircGR: Interactive Multi-Touch Gesture Recognition using Circular Measurements, in Proceedings of the 2017 ACM on Interactive Surfaces and Spaces (ISS ’17). Brighton, England. Link • PDF
Scientific/Trade Magazine Articles
Williams, A.S. and Ortega, F.R.. 2020. Evolutionary gestures: when a gesture is not quite legacy biased. In Intractions 27, 5 (September – October 2020), pp. 50–53. Link • PDF
Steed, A., Ortega, F.R., Williams, A. S., Kruijff, E., Stuerzlinger, W., Batmaz, A. U., Won, A.S., Rosenberg, E.S., Simeone, A.L., and Hayes, A. Evaluating immersive experiences during Covid-19 and beyond. In Intractions 27, 4 (July – August 2020), pp. 62–67 [CC: 45]. Link • PDF
Ph.D. Student Refereed Doctoral Consortium
Borhani, Z. (2022, March). [DC] Annotation in Asynchronous Collaborative Immersive Analytic Environments using Augmented Reality. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pp. 950-951. Link • PDF
Willams, Adam S., and Ortega, F., [DC] Multimodal User-Defined inputs for Optical See Through Augmented Reality Environments. in in IEEE VR and 3DUI 2020, pp. 1-2. Atlanta, GA, USA. Link • PDF
Other Refereed Papers
- Aazhang, B., Abler, R. T., Allebach, J. P., Bost, L. F., Cavallaro, J. R., Chong, E. K. P., Coyle, E. J., Cullers, J. B. S., Dennis, S. M., Dong, Y., Enjeti, P. N., Filippas, A. V., Froyd, J. E., Garmire, D., George, J., Gilchrist, B. E., Hohner, G. S., Hughes, W. L., Johnson, A., Kim, C., Kim, H., Klenke, R. H., Lagoudas, M. Z., Llewellyn, D. C., Lu, Y., Lybarger, K. J., Marshall, S., Muralidharan, S., Ohta, A. T., Ortega, F. R., Riskin, E. A., Rizzo, D. M., Ryder, C. R., Shiroma, W. A., Siller, T. J., Sonnenberg-Klein, J., Sadjadi, S. M., Strachan, S. M., Taheri, M., Woods, G. L., Zoltowski, C. B., Fabien, B. C., Johnson, P., Collins, R., and Murray, P. Vertically Integrated Projects (VIP) Programs: Multidisciplinary Projects with Homes in Any Discipline In 2017 ASEE Annual Conference & Exposition, Columbus, Ohio. June, 2017. Link
Invited Papers
Bolivar, S., Perez, D., Carrasquillo, A., Willams, AdamS., Rishe, N., and Ortega, F., 3D Interaction for Computer Science Educational VR Game. In Universal Access in Human-Computer Interaction. Virtual, Augmented, and Intelligent Environments. UAHCI 2019. Orlando, FL. 2019.
O-larnnithipong, N. Barreto, A., Ratchatanantakit, N., Tangnimitchok, S., and Ortega, F., Real-Time Implementation of Orientation Correction Algorithm for 3D Hand Motion Tracking Interface. In Universal Access in Human-Computer Interaction. Methods, Technologies, and Users. UAHCI 2018. Lecture Notes in Computer Science, Springer, vol 10907, pp. 228–242. Invited session: Spatial User Interaction Beyond the Mouse, Las Vegas, NV, 2018.
Bolivar, S., Ortega, F., Zock-Obregon, M., and Rishe, N., 3D Spatial Gaming Interaction to Broad CS Participation. In Universal Access in Human-Computer Interaction. Virtual, Augmented, and Intelligent Environments. UAHCI 2018. Lecture Notes in Computer Science, Springer, vol 10908, pp. 39–47. Invited session: Spatial User Interaction Beyond the Mouse, Las Vegas, NV, 2018.
Torres, N., Ortega, F., Bernal, J., Barreto, A., and Rishe, N., Towards Multi-Modal Interaction with Interactive Paint. In Universal Access in Human-Computer Interaction. Virtual, Augmented, and Intelligent Environments. UAHCI 2018. Lecture Notes in Computer Science, Springer, vol 10907, pp. 299–308. Invited session: Spatial User Interaction Beyond the Mouse, Las Vegas, NV, 2018.
Vassigh, S., Ortega, F., Barreto, A., Tarre, K., and Maldonado, J., Use of 3D Human-Computer Interaction for Teaching in the Architectural Engineering and Construction Fields. In Universal Access in Human-Computer Interaction. Virtual, Augmented, and Intelligent Environments. UAHCI 2018. Lecture Notes in Computer Science, Springer, vol 10908, pp. 149–159. Invited session: Spatial User Interaction Beyond the Mouse, Las Vegas, NV, 2018.
Non-Refereed Articles
Ortega, F., Barreto, A., Rishe, N., and Adjouadi, M., Towards 3D Data Environments Using Multi-Touch Screens. In ACHI 2012: The Fifth International Conference on Advances in Computer-Human Interactions, pp. 118–121, 2012.
Ortega, F., Barreto, A., Rishe, N., Adjoudi, M., and Abyarjoo, F., GyroTouch: Complementing the Multi-Touch Display. In ACM Richard Tapia Celebration of Diversity in Computing, 2014.
Cofino, J., Barreto, A., Abyarjoo, F., and Ortega, F., B.A.S.S. Blind-Assistive Spatialized Screen-reading. In ACM Richard Tapia Celebration of Diversity in Computing, 2014.
Patents
Francisco Ortega, Jules Calella, Naphtali Rishe, S.S. Iyengar. ree Dimensional Touch Conductive Fabric. Publication No. US20190391683A1. Application No. 16015801. Filed: June 22, 2018. Publication Date: December 26, 2019. FIU-IP-1744.
Ortega, F., Rishe, N., and Barreto, A., Gesture Discernment and Processing System.Patent No.: US 9,886,190 B2. Date of Patent: Feb. 6, 2018. US Utility Patent led November 28th, 2014, USPS Application Number 20160091977, publication date March 31st, 2016.
Barreto, A., Rishe, N., Ortega, F., O-Larnnithipong, N., VRT: Virtual Round Table. Patent No.: US 9,900,555 B1, Date of Patent: Feb. 20, 2018. Disclosed to FIU, January, 2017