Publications at NUILab

Table of Contents

The Natural User Interaction (NUI) Lab primary research focused on Multi-Modal interaction (gestures, gestures+speech, etc.) using elicitation, development of techniques, and recognition (when appropriate) for 3D User Interfaces and its selection, manipulation, and travel. The lab uses Augmented Reality and Virtual Reality technology to accomplish its primary objective. In addition, we have been expanding to understand collaborative nature in augmented reality. A secondary focus is understanding how virtual reality can be used to promote larger diversity in computer science. In addition to our core research, this is a very multi-disciplinary lab, where we collaborate with Vision, Software Engineering, Psychology, Human-Factors, and Networking, among others.

Publications can also be found at Dr. Francisco Ortega’s Google Scholar page. 

Publications

Legend

Legend: Additional information about the publications is included at the end of the citation, enclosed by brackets ([]). The acceptance rate for papers is denoted by AR. The impact factor is denoted by IF. The 5-Year impact factor is denoted by 5-IF. Citation count (greater than 3) is denoted by CC. All categories are sorted by year in descending order. Publications last updated: 1/3/2023.

Books

  • Williams, A.S. and Ortega, F.R., A Concise Guide to Elicitation Methodology. Access: https://arxiv.org/abs/2105.12865. 2021. Fort Collins, CO. Open Access. [CC:1].

  • Barreto, A., Adjounadi, M., Ortega, F. and O-larnnithipong, N., Intuitive Understanding of Kalman Filtering Using MatLab, CRC Press, New York, NY, 2020. (Completed). In Press. Link. Ortega, F., Abyarjoo, F., Barreto, A., Rishe, N., and Adjouadi, M. Interaction design for 3D user interfaces: the world of modern input devices for research, applications, and game development. CRC Press/AK Peters, New York, NY, 2016. ISBN-13 978-1482216943. [CC:27]. Link.

  • Ortega, F.R., Abyarjoo, F., Barreto, A., Rishe, N., and Adjouadi, M., Interaction Design for 3D User Interfaces: The World of Modern Input Devices for Research, Applications, and Game Development. CRC Press/AK Peters, New York, NY, 2016. ISBN-13: 978-1482216943. [CC:23]. Link

Refereed Journal Articles

  • Williams, A. S. and Ortega, F. R.. The Impacts of Referent Display on Gesture and Speech Elicitation. IEEE vol. 28, iss. 11. (September 2022), pp. 3885–3895. In IEEE Transactions on Visualization and Computer Graphics. DOI:https://doi.org/10.1109/TVCG.2022.3203090. [IF: 5.226, AR: 26.6%]. 2022.

  • Warden, A. C., Wickens, C.D., Rehberg, D., Clegg, B. A., and Ortega, F. R.. Information Access Effort: The Role of Head Movements for Information Presented at Increasing Eccentricity on Flat Panel and Head-Mounted Displays. In Human Factors Journal. In Press. [IF:3.598, 5-IF: 4.212]. 2022.

  • Wickens, C. D., Mifsud, D., Rodriguez, R., and Ortega, F. R. (2021). Mitigating the costs of spatial transformations with a situation awareness augmented reality display: Assistance for the Joint Terminal Attack Controller. SAGE (June 2011), pp. 3–17. In Human Factors: The Journal of the Human Factors and Ergonomics Society. SAGE. DOI: https://doi.org/10.1177/00187208211022468. [IF:3.598, 5-IF: 4.212]. 2022.

  • Wang, H., Gaddy, V., Beveridge, J.R., and Ortega, F. R. Building an Emotionally Responsive Avatar with Dynamic Facial Expressions in Human—Computer Interactions. MDPI vol. 5, iss. 3. (March 2021), pp. 1–13. In Multimodal Technologies and Interaction. DOI: https://doi.org/10.3390/mti5030013. [IF: 3.08, CC:5]. 2021.

  • Silva-Calpa, G.F.M., Raposo, A.B. and Ortega, F.R.. Collaboration Support in Co-located Collaborative Systems for Users with Autism Spectrum Disorders: A Systematic Literature Review. Taylor & Francis Online vol. 37, iss. 1. (January 2021), pp. 15–35. In International Journal of Human-Computer Interactions. DOI: https://doi.org/10.1080/10447318.2020.1801224. [IF: 4.9]. 2021.

  • Williams, A.S., Garcia, J., De Zayas, F., Hernandez, F., Sharp, J, and Ortega, F.R.. The Cost of Production in Elicitation Studies and the Legacy Bias-Consensus Trade off. MDP vol. 4, iss. 4. (December 2020), pp. 1–88. In Multimodal Technologies and Interaction. DOI: https://doi.org/10.3390/mti4040088. [IF: 2.3, CC:6]. 2020.

  • Williams, A.S., Garcia, J., and Ortega, F.R.. Understanding Multimodal User Gesture and Speech Behavior for Object Manipulation in Augmented Reality Using Elicitation. IEEE vol. 26, iss. 12. (December 2020), pp. 3479–3489. In IEEE Transactions on Visualization and Computer Graphics. DOI: https://doi.org/10.1109/TVCG.2020.3023566. [IF: 5.226, AR:6%, CC:9]. 2020.

  • Williams, A.S. and Ortega, F. R.. Understanding Gesture and Speech Multimodal Interactions for Manipulation Tasks in Augmented Reality Using Unconstrained Elicitation. ACM vol. 4, iss. ISS. (November 2020), pp. 1–21. In Proceedings of the ACM on Human-Computer Interaction. DOI: https://doi.org/10.1145/3427330. [IF:4.568, AR:28%, CC:13]. 2020.

  • Ortega, F.R., Williams, A.S., Tarre, K., Barreto, A. and Rishe, N. 3D Travel Comparison Study between Multi-Touch and GamePad. Taylor & Francis vol. 36, iss. 18. (November 2020), pp. 1699–1713. In International Journal of Human-Computer Interaction. DOI: https://doi.org/10.1080/10447318.2020.1780016. [IF: 4.920]. 2020.

  • Vieira, E.R., Civitella, F., Carreno, J., Junior, M.G., Amorim, C.F., D’Souza, N., Ozer, E., Ortega, F.R. and Estrazulas, J.A. Using Augmented Reality with Older Adults in the Community to Select Design Features for an Age-Friendly Park: A Pilot Study. Hindawi vol.2020, Article ID 8341034. (September 2020), pp. 1–8. In Journal of Aging Research. DOI: https://doi.org/10.1155/2020/8341034. [IF: 2.381]. 2020.

  • Coffino, J., Barreto, A., Abyarjoo, F., and Ortega, F. R. Sonically-Enhanced Tabular Screen-Reading. vol. 2. (December 2014), pp. 46–57. In Journal on Technology & Persons with Disabilities (JTPD). Available at: https://scholarworks.calstate.edu/downloads/xs55mg57v#page=53. [CC: 3]. 2014.

  • Ren, P., Barreto, A., Huang, J., Gao, Y., Ortega, F.R., and Adjouadi, M. Off-line and Online Stress Detection through Processing of the Pupil Diameter Signal. Springer Link vol. 42, iss. 1. (January 2014), pp. 162–176. In Annals of Biomedical Engineering. DOI: https://doi.org/10.1007/s10439-013-0880-9. [IF: 4.167, CC: 67]. 2014.

Refereed Chapters in Books

  • Daunhauer, L., Ortega, F. R., Beveridge, R., Strout, J., and Bundy, A. Chapter Five – Captivating: Avatars as therapeutic agents for children with intellectual and developmental disabilities. Editors: Riggs, N, Rigles, B, in International Review of Research in Developmental Disabilities. Academic Press, Vol. 61, 2021, pp. 133–157, ISSN 2211-7095, ISBN 9780128245859. https://doi.org/10.1016/bs.irrdd.2021.08.006.

  • Hernandez, H., Ortega, F.R., Reducing Video Game Creation Effort with Eberos GML2D. Chapter in Game Development Tools edited by Marwan Y. Ansari. AK Peters/CRC Press. New York, NY, 2011.

Refereed Proceeding/Transactions

  • Plabst, L., Oberdorfer, S., Ortega, F. R., and Niebling, F. 2022. Push the Red Button: Comparing Notification Placement with Augmented and Non-Augmented Tasks in AR. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction (SUI ’22). Association for Computing Machinery. pp. 1–11. DOI: https://doi.org/10.1145/3565970.3567701. 2022.

  • Zhou, X., Williams, A.S., and Ortega, F.R. 2022. Eliciting Multimodal Gesture+Speech Interactions in a Multi-Object Augmented Reality Environment. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (VRST ’22). Association for Computing Machinery. pp. 1–10. DOI: https://doi.org/10.1145/3562939.3565637. [AR: 26%]. 2022.

  • Masters, R., Interrante, V.,Watts, M., and Ortega, F. R. 2022. Virtual Nature: Investigating the Effect of Biomass on Immersive Virtual Reality Forest Bathing Applications For Stress Reduction. In ACM Symposium on Applied Perception 2022 (SAP ’22). Association for Computing Machinery. pp. 1–10. DOI: https://doi.org/10.1145/3548814.3551459. 2022.

  • Warden, A. C., Wickens, C. D., Rehberg, D., Clegg, B. A., and Ortega, F. R.. 2022. Information Access Effort: Are Head Movements “Cheap” or Even “Free”?. In Proceedings of the Human Factors and Ergonomics Society 66th Annual Meeting. SAGE. pp. 2203–2207. DOI: https://doi.org/10.1177/1071181322661127.  HFES Best Student Paper Award (to all authors). 2022.

  • Warden, A. C., Wickens, C. D., Mifsud, D., Ourada, S., Clegg, B. A., and Ortega, F.R. 2022. Visual Search in Augmented Reality: Effect of Target Cue Type and Location. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. SAGE. pp. 373–377. DOI: https://doi.org/10.1177/1071181322661260. 2022.

  • Mifsud, D., Wickens, C., Maulbeck, M., Crane, P., and Ortega, F. R.. 2022. The Effectiveness of Gaze Guidance Lines in supporting JTAC’s attention allocation. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. SAGE. pp. 2198–2201. https://journals.sagepub.com/doi/pdf/10.1177/1071181322661143. 2022.

  • Zhou, X., Williams, A.S., Ortega, F.R. 2022. Towards Establishing Consistent Proposal Binning Methods for Unimodal and Multimodal Interaction Elicitation Studies. In Human-Computer Interaction. Theoretical Approaches and Design Methods. Springer, Cham. pp. 356–368. DOI: https://doi.org/10.1007/978-3-031-05311-525. 2022.

  • Al Azad, M. W., Shannigrahi, S., Stergiou, N., Ortega, F.R., and Mastorakis, S. 2021. CLEDGE: A Hybrid Cloud-Edge Computing Framework over Information Centric Networking. In 2021 IEEE 46th Conference on Local Computer Networks. IEEE. pp. 589–596. DOI: https://doi.org/10.1109/LCN52139.2021.9525006. [AR: 28%, CC: 6]. 2021.

  • Rodriguez, R., Mifsud, D., Wickens, C., Williams, A.S., Tarre, K., Crane, P., and Ortega, F.R.. 2021. Virtual Reality Compensatory Aid for Improved Weapon Splash-Zone Awareness. In Human-Computer Interaction. Virtual, Augmented and Mixed Reality. Springer, Cham. pp. 533–544. DOI: https://doi.org/10.1007/978-3-030-77599-536. [AR: 30%]. 2021.

  • Williams, A. S., Angelini, C., Kress, M., Ramos Vieira, E., D’Souza, N., Rishe, N. D., Medina, J., Ozer, E., and Ortega, F.. 2020. Augmented Reality for City Planning. In Human-Computer Interaction International. Springer, Cham. pp. 256–271. DOI: https://doi.org/10.1007/978-3-030-49695-117. [AR: 26.5%, CC: 5]. 2020.

  • McNeely-White, D.G., Ortega, F.R., Beveridge, J.R., Draper, B.A., Bangar, R., Patil, D., Pustejovsky, J., Krishnaswamy, N., Rim, K., Ruiz, J., and Wang, I. 2019. User-Aware Shared Perception for Embodied Agents. In 2019 IEEE International Conference on HumanizedComputing and Communication (HCC). IEEE. pp. 46–51. DOI: https://doi.org/10.1109/HCC46620.2019.00015. [CC:6]. 2019.

  • O-Larnnithipong, N., Ratchatanantakit, N., Tangnimitchok, S., Ortega, F.R., Barreto, A., and Adjouadi, M. 2019. Statistical Analysis of Novel and Traditional Orientation Estimates from an IMU-Instrumented Glove. In Antona M., Stephanidis C. (eds) Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments. Springer, Cham. pp. 282–299. DOI: https://doi.org/10.1007/978-3-030-23563-523. 2019.

  • Ozer, E., D’Souza, N., Vieira, E., Ortega, F.R.. 2019. An Underline for the Underserved: A Pilot Study to Explore Simulation Research for Sustainable Aging Around Miami’s Metrorail. In Sustainable Urban Environments: Research, Design and Planning for the Next 50 Years. EDRA. Available at: https://edra.confex.com/edra/EDRA50/meetingapp.cgi/Paper/6959. 2019.

  • Tangnimitchok, S., O-larnnithipong, N., Ratchatanantakit, N., Barreto, A., Ortega, F. R., and Rishe, N. D. 2018. A System for Non-Intrusive Affective Assessment in the CircumplexModel from Pupil Diameter and Facial Expression Monitoring. In Human-Computer Interaction. Theories, Methods, and Human Issues. Springer, Cham. pp. 465–477. DOI: https://doi.org/10.1007/978-3-319-91238-738. [AR: 27, CC:5%]. 2018.

  • Balcazar, R., Ortega, F. R., Tarre, K., Barreto, A., Weiss, M., and Rishe, N. D. 2017. CircGR: Interactive Multi-Touch Gesture Recognition using Circular Measurements. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. Association for Computer Machinery. pp. 12–21. [AR: 26.90%, CC:6]. 2017.

  • Ortega, F.R., Galvan, A., Tarre, K., Barreto, A., Rishe, N., Bernal, J., Balcazar, R., and Thomas, J. L.. 2017. Gesture Elicitation for 3D Travel via Multi-Touch and Mid-Air Systems for Procedurally Generated Pseudo-Universe. In 2017 IEEE Symposium on 3D User Interfaces. IEEE. pp. 144–153. DOI: 10.1109/3DUI.2017.7893331. [AR:32%, CC:31].2017.

  • Tangnimitchok, S., O-Larnnithipong, N., Barreto, A., Ortega, F. R., and Rishe, N. D. 2016. Finding an Efficient Threshold for Fixation Detection in Eye Gaze Tracking. In International Conference on Human-Computer Interaction, Interaction Platforms and Techniques of the series Lecture Notes in Computer Science. Springer, Cham. pp. 93–103. DOI: https://doi.org/10.1007/978-3-319-39516-69. [AR:29%]. 2016.

  • Abyarjoo, F., O-Larnnithipong, N., Tangnimitchok, S., Ortega, F.R., and Barreto, A. 2015. PostureMonitor: Real-Time IMU Wearable Technology to Foster Poise and Health. In International Conference of Design, User Experience, and Usability of the series Lecture Notes in Computer Science. Springer, Cham. pp. 543–552. DOI: https://doi.org/10.1007/978-3-319-20889-3_50. [AR:30%, CC:13]. 2015.

  • Ortega, F.R., Barreto, A., Rishe, N., O-Larnnithipong, N., Adjouadi, M., and Abyarjoo, F. 2015. GyroTouch: Wrist Gyroscope with a Multi-Touch Display. In International Conference on Human-Computer Interaction, Human-Computer Interaction: Interaction Technologies of the series Lecture Notes in Computer Science. Springer, Cham. pp. 262–270. DOI: https://doi.org/10.1007/978-3-319-20916-6_25. [AR:30%]. 2015.

  • Ortega, F.R., Rishe, N., Barreto, A., Abyarjoo, F., and Adjouadi, M. 2015. Multi-Touch Gesture Recognition Using Feature Extraction. In Innovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering of the series Lecture Notes in Electrical Engineering. Springer, Cham. pp. 291–296. DOI: https://doi.org/10.1007/978-3-319-06773-539. [CC:4]. 2015.

  • Abyarjoo, F., Barreto, A., Cofino, J., and Ortega, F.R. 2015. Implementing a Sensor Fusion Algorithm for 3D Orientation Detection with Inertial/Magnetic Sensors. In Innovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering of the series Lecture Notes in Electrical Engineering. Springer, Cham. pp. 305–310. DOI: https://doi.org/10.1007/978-3-319-06773-5_41. [CC:100]. 2015.

  • Ortega, F.R., Liu, S., Hernandez, F.⋆, Barreto, A., Rishe, N., and Adjouadi, M. 2014. PeNTa: Multi-Touch Modeling using Petri Nets. In International Conference on Human-Computer Interaction, Human-Computer Interaction: Theories, Methods, and Tools of the series Lecture Notes in Computer Science. Springer, Cham. pp. 361-372. DOI: https://doi.org/10.1007/978-3-319-07233-3_34. [AR:31%]. 2014.

  • Abyarjoo, F., Barreto, A., Abyarjoo, S., Ortega, F.R., and Cofino, J. 2013. Monitoring Human Wrist Rotation in Three Degrees of Freedom. In 2013 Proceedings of IEEE SoutheastCon. IEEE. pp. 1-5. DOI: 10.1109/SECON.2013.6567517. [CC: 10]. 2013.

  • Cofino, J., Barreto, A., Abyarjoo, F., Ortega, F.R.. 2013. Sonifying HTML tables for audiospatially enhanced non-visual navigation. In 2013 Proceedings of IEEE Southeastcon. IEEE. pp. 1–5. DOI: 10.1109/SECON.2013.6567417. 2013.

  • Ortega, F.R., Barreto, A., Rishe, N., and Adjouadi, M. 2013. Interaction with 3D Environments Using Multi-Touch Screens. In Innovations and Advances in Computer, Information, Systems Sciences, and Engineering of the series Lecture Notes in Electrical Engineering. vol. 152, pp. 381–392, CISSE. Springer. [AR:41%]. 2013.

  • Verhoef, T., Lisetti, C., Barreto, A., Ortega, F.R., Van der Zant, T., and Cnossen, F. 2009. Bio-sensing for Emotional Characterization without Word Labels. In Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction, 13th International Conference, HCI International. Lecture Notes in Computer Science. Springer, Cham. pp. 693–702. DOI: https://doi.org/10.1007/978-3-642-02580-8_76. [AR:32%, CC:27]. 2009.

Refereed Workshop Articles

  • Karduna, A., Williams, A.S., and Ortega, F.R.. NUI-SpatialMarkers: AR Spatial Markers For the Rest of Us. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops. IEEE VR 2022 Workshop – Open Access Tools and Libraries for Virtual Reality. (VRW ’22), March 12-16, 2022, Christchurch, New Zealand. IEEE, pp. 58-60. DOI: 10.1109/VRW55335.2022.00022. 2022.

  • Gaddy, V. and Ortega, F.R.. Exploring Factors Associated with Retention in Computer Science Using Virtual Reality. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW ’2022), March 12–16 2022, Christchurch, New Zealand, pp. 271–276. DOI: https://doi.org/10.1109/VRW55335.2022.00062. Seventhworkshop on K-12+ Embodied Learning through Virtual and Augmented Reality (KELVAR). 2022.

  • Batmaz, A.U., Mifsud, D., Steed, A., Stuerzlinger, W., and Ortega, F.R. Researchers’ and Participants’ Experiences on Distributed User Studies Conducted in the First Year of COVID-19 Pandemic. In First XR Remote Research Workshop (ACM CHI ’21), March 27– April 1, 2021, Lisbon, Portugal. IEEE, pp. 1–3. DOI: 10.1109/VRW52623.2021.00045. 2021.

  • Williams, A.S. †and Ortega, F. R.. Using a 6 Degrees of Freedom Virtual Reality Input Device With An Augmented Reality Headset In A Collaborative Environment. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). Third Workshop on Novel Input Devices and Interaction Techniques (NIDIT). March 27 – April 1, 2021, Lisbon, Portugal. IEEE, pp. 205–209. DOI: https://doi.org/10.1109/VRW52623.2021.00045. 2021.

  • Ratcliffe, J., Soave, F., Hoover, M. Ortega, F.R., Bryan-Kinns, N., Tokarchuk, L., and Farkhatdinov, I. Remote XR Studies: Exploring Three Key Challenges of Remote XR Experimentation. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA ’21). May 2021, Association for Computing, pp. 1–4. DOI: https://doi.org/10.1145/3411763.3442472. [CC:5]. 2021.

  • Barreto, A., Adjounadi, M., Ortega, F. and O-larnnithipong, N., Intuitive Understanding of Kalman Filtering Using MatLab, CRC Press, New York, NY, 2020. (Completed). In Press. Link. Ortega, F., Abyarjoo, F., Barreto, A., Rishe, N., and Adjouadi, M. Interaction design for 3D user interfaces: the world of modern input devices for research, applications, and game development. CRC Press/AK Peters, New York, NY, 2016. ISBN-13 978-1482216943. [CC:14]. Link.

  • Pustejovsky, J., Krishnaswamy, N., Beveridge, R., Ortega, F.R., Patil, D., Want, H.y, and White, D.y. Interpreting and Generating Gestures with Embodied Human Computer Interactions. In ACM IVA ’20, Generation and Evaluation of Nonverbal Behaviour for Embodied Agents Workshop. 2020. In print.

  • Willams, A.S., Coler, S., and Ortega, F.. Conversations On Multimodal Input Design With Older Adults. In ACM CHI 2020 Designing Interactions for the Ageing Populations Addressing Global Challenges Workshop, pp. 1-4, 2020. PDF.

  • Shannigrahi, S., Mastorakis, S., and Ortega, F. R. Next-Generation Networking and Edge Computing for Mixed Reality Real-Time Interactive Systems. In 2020 IEEE International Conference on Communications Workshops (ICC Workshops), June 7-11, 2020, Dublin, Ireland. IEEE, pp. 1–6. DOI: 10.1109/ICCWorkshops49005.2020.9145075. [CC: 22]. 2020.

  • Gaddy, V. and Ortega, F.. Exploring the Impact of Belonging on Computer Science Enrollment Using Virtual Reality. In 2020 IEEE Conf. Fifth workshop on K-12+ Embodied Learning through Virtual and Augmented Reality (KELVAR) 20. Atlanta, GA, USA, 2020, pp. 444-448. PDF.

  • Williams, A. S. and Ortega, F.. Insights on visual aid and study design for gesture interaction in limited sensor range Augmented Reality devices. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts andnWorkshops (VRW). Second workshop on Novel Input Devices and Interaction Techniques (NIDIT) ’20. Atlanta, GA, USA, 2020, pp. 19-22. PDF.

  • N. O-Larnnithipong, N. Ratchatanantakit, S. Tangnimitchok, F. Ortega and A. Barreto, Hand Tracking Interface for Virtual Reality Interaction based on MARG sensors. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Workshop on Novel Input Devices and Interaction Techniques (NIDIT)Osaka, Japan, 2019, pp. 1717-1722. DOI: 10.1109/VR.2019.8797982 . PDF. [CC:4]

  • Ortega, F. R., K. Tarre, M. Kress, A. S.Williams, A. B. Barreto and N. D. Rishe, Selection and Manipulation Whole-Body Gesture Elicitation Study In Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Workshop on Novel Input Devices and Interaction Techniques (NIDIT), Osaka, Japan, 2019, pp. 1723-1728. doi: 10.1109/VR.2019.8798105. PDF[CC:12]

  • Raikwar, S., D’Souza, N., Rogers, C., Kress, M., Williams, A., Rishe, N., Ortega, F., CubeVR: Digital Affordances for Architecture Undergraduate Education using Virtual Reality In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces, Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR), Osaka, Japan, 2019, pp. 1623-1626. doi: 10.1109/VR.2019.8798115. PDF[CC:7]

  • Ortega, F., Bolivar, S., Bernal, J., Galvan, A., Tarre, K., Rishe, N., and Barreto, A. Towards a 3D Virtual Programming Language to Increase the Number of Women in Computer Science Education. In 2017 IEEE Virtual Reality Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR), Los Angeles, CA. pp. 1–6. PDF. [CC:12]

  • Ortega, F., Jamides, S., Barreto, A., and Rishe, N., The Tabletop is dead. Long Live the Tabletop!. In The Disappearing Tabletop: Social and Technical Challenges for Cross-Surface Collaboration workshop on Interactive Surfaces and Spaces (ISS ’17). 2017. Available at: https://thedisappearingworkshop.wordpress.com/at-the-workshop/.

  • Ortega, F., Balcazar, R., Barreto, A., and Rishe, N., Smart Learning Desk: Towards an Interactive Classroom. In IEEE Virtual Reality 2016 Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR ’16), Mar. 2016. Available at: https://sites.google.com/site/vrkelvar/vr2016.

  • Wu, Y., Hernandez, F., Ortega, F., Clarke, P., and France, R., Measuring the Effort for Creating and Using Domain-Specific Models. In Proceedings of the 10th Workshop on Domain-Specific Modeling (DSM ’10). ACM, New York, NY, USA, article 14, pages 6, 2010. [AR:66%,CC:32]. PDF.

  • Hernandez, H., Ortega, F., Eberos GML2D: A Graphical Domain-Specific Language for Modeling 2D Video Games. In Proceedings of the 10th Workshop on Domain-Specific Modeling (DSM ’10). ACM, New York, NY, USA, article 4, pages 6, 2010. [AR:66%, CC:28]. PDF.

Refereed Workshop Articles

  • Plabst, L., Obertdorfer, S. Ortega, F.R., and Niebling, F. Press the red button: A user study comparing notification placement with augmented and non-augmented tasks in AR. In The 21st IEEE International Symposium on Mixed and Augmented Reality (ISMAR). October 17 – 21, 2022, Singapore, Singapore. IEEE, pp. 483–484. DOI: 10.1109/ISMAR-Adjunct57072. 2022.00101. 2022.

  • Mifsud, D. M., Williams, A. S., Ortega, F. and Teather, R. J. Augmented Reality Fitts’Law Input Comparison Between Touchpad, Pointing Gesture, and Raycast. In 2022 IEEEConference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). March 12 – 16, 2022, Christchurch, New Zealand. IEEE, pp. 590–591. DOI: 10.1109/VRW55335.2022.00146. 2022.

  • Vieira, E. R., Estrázulas, J. A., Civitella, F., Carreno, J., D’Souza, N., Ozer, E., Ortega, F. (2019). Does wearing augmented-reality goggles affect older adults’ kinematics during gait? The Gerontological Society of America’s 71st Annual Scientific Meeting. Austin, Texas. November 13-17, 2019. Innovation in Aging, 3(S1), S338. PDF.

  • Johnston, D., Flack, J., Ray, I., and Ortega, F., Towards a Virtual Reality Home IoT Network Visualization. In 2019 Graphics Interface – Human-Computer Interaction Track, pp. 1–2. May, 2019. PDF.

  • Angelini, C., Williams, A., Kress, M., Vieira, E., D’Souza, N., Rishe, N., Medina, J., Ortega, F., City Planning with Augmented Reality. In 2019 Graphics Interface – Human-Computer Interaction Track, pp. 1–2. May, 2019. PDF.

  • Ortega, F. R., Tarre, K., Kress, M., Williams, A. S., Barreto, A. B., and Rishe, N. D. Selection and Manipulation Whole-Body Gesture Elicitation Study In Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), March 23 – 27, 2019, Osaka, Japan. IEEE, pp. 1723–1728. DOI: 10.1109/VR.2019.8798182. [CC: 12]. 2019. PDF.

  • Tarre, K., Williams, A.S., Borges, L., Rishe, N.D., Barreto, A.B., and Ortega, F.R. Towards first person gamer modeling and the problem with game classification in user studies. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (VRST ’18). 2018, Stephen N. Spencer (Ed.). ACM, 2 pages. DOI: https://doi.org/10.1145/3281505.3281590. [CC: 6]. 2018.PDF.

  • Galvan, A., Ortega, F., and Rishe, N., Procedural Celestial Rendering for 3D Navigation. In 2017 IEEE Symposium on 3D User Interfaces (3DUI), Los Angeles, CA. 2017. pp. 211–212 PDF.

  • Calella, J., Ortega, F., Rishe, N., Barreto, A., and Bernal, J., HandMagic: Towards User Interaction with Inertial Measuring Units. In 2016 IEEE SENSORS. Orlando, FL. 2016, pp. 1-3. [AR:58%, CC: 4]. PDF.

  • Vassigh, S., Elias, A., Ortega, F., Davis, D., Gallardo, G., Alhaffar, H., Borges, L., Bernal, J., and Rishe, N., Integrating Building Information Modeling with Augmented Reality for Interdisciplinary Learning.\” In 2016 IEEE International Symposium Mixed and Augmented Reality (ISMAR-Adjunct), pp. 260–261, IEEE, 2016. [CC: 28]. PDF.

  • Ortega, F., Rishe, N., and Barreto, A., TAMGeF: Touch-midAir-Motion Framework for Spatial Input. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI ’15). ACM, New York, NY, USA, pp. 136, 2015. PDF.

  • Ortega, F., Barreto, A., Rishe, N., Adjouadi, M., and Liu, S., Exploring Modeling Language for Multi-Touch Systems Using Petri Nets. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS ’13), ACM, New York, NY, USA. pp. 361–364. 2013. [CC: 8]. PDF.

  • Ortega, F., Barreto, A., and Rishe, N., Augmenting Multi-Touch with Commodity Devices. In Proceedings of the 1st Symposium on Spatial User Interaction (SUI ’13). ACM, New York, NY, USA, p. 95. 2013. PDF.

  • Ortega, F., Barreto, A., Rishe, N. and Adjouadi, M., and Abyarjoo, F., Poster: Real-Time Gesture Detection for Multi-Touch Devices. In IEEE 8th Symposium on 3D User Interfaces (3DUI ’13), Orlando, FL, pp. 167-168. 2013. PDF.

Refereed Demo Papers

  • Raikwar, A., Plabst, L., and Ortega, F.R.. ARtisan Bistro: A Cooking Task Environment to Conduct Studies in Augmented Reality. In The 21st IEEE International Symposium on Mixed and Augmented Reality (ISMAR). October 17 – 21, 2022, Singapore, Singapore. IEEE, pp. 909–910. DOI: 10.1109/ISMAR-Adjunct57072.2022.00200. 2022.

  • Pustejovsky, J., Krishnaswamy, N., Beveridge, R., Patil, D.†, McNeely-White, D.G.†,Wang, H.†, and Ortega, F.R.. Situational Awareness in Human Computer Interaction: Diana’sWorld. In International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments (ICAT-EGVE): Demos. December 2 – 4, 2020. ACM/Eurographics. Best DemoAward. DOI: https://doi.org/10.2312/egve.20201282. 2020.

  • Raikwar, A., Stephens, J., Ortega, F., Demo: Assessing Sports Related Concussion in Soccer Players Using Immersive VR Soccer, in in IEEE VR and 3DUI 2020, pp. 1–2. Atlanta, GA, USA. 2020. In press. PDF.

  • Balcazar, R., Ortega, F., Tarre, K., Barreto, A., Weiss, M., Rishe, N., [DEMO] CircGR: Interactive Multi-Touch Gesture Recognition using Circular Measurements, in Proceedings of the 2017 ACM on Interactive Surfaces and Spaces (ISS ’17). Brighton, England.

Scientific/Trade Magazine Articles

  • Williams, A.S. and Ortega, F.R.. 2020. Evolutionary gestures: when a gesture is not quite legacy biased. In Intractions 27, 5 (September – October 2020), 50–53, https://doi.org/10.1145/3412499. 2020.

  • Steed, A., Ortega, F.R., Williams, A. S., Kruijff, E., Stuerzlinger, W., Batmaz, A. U., Won, A.S., Rosenberg, E.S., Simeone, A.L., and Hayes, A. 2020. Evaluating immersive experiences during Covid-19 and beyond. In Intractions 27, 4 (July – August 2020), 62–67, https://doi.org/10.1145/3406098. [CC: 45]. 2020.

Ph.D. Student Refereed Doctoral Consortium

  • Borhani, Z. (2022, March). [DC] Annotation in Asynchronous Collaborative Immersive Analytic Environments using Augmented Reality. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 950-951). IEEE. https://ieeexplore.ieee.org/abstract/document/9757653. 2022.

  • Willams, Adam S., and Ortega, F., [DC] Multimodal User-Defined inputs for Optical See Through Augmented Reality Environments. in in IEEE VR and 3DUI 2020, pp. 1–2. Atlanta, GA, USA. 2020. In press. PDF.

Other Refereed Papers

  • Aazhang, B., Abler, R. T., Allebach, J. P., Bost, L. F., Cavallaro, J. R., Chong, E. K. P., Coyle, E. J., Cullers, J. B. S., Dennis, S. M., Dong, Y., Enjeti, P. N., Filippas, A. V., Froyd, J. E., Garmire, D., George, J., Gilchrist, B. E., Hohner, G. S., Hughes, W. L., Johnson, A., Kim, C., Kim, H., Klenke, R. H., Lagoudas, M. Z., Llewellyn, D. C., Lu, Y., Lybarger, K. J., Marshall, S., Muralidharan, S., Ohta, A. T., Ortega, F. R., Riskin, E. A., Rizzo, D. M., Ryder, C. R., Shiroma, W. A., Siller, T. J., Sonnenberg-Klein, J., Sadjadi, S. M., Strachan, S. M., Taheri, M., Woods, G. L., Zoltowski, C. B., Fabien, B. C., Johnson, P., Collins, R., and Murray, P. Vertically Integrated Projects (VIP) Programs: Multidisciplinary Projects with Homes in Any Discipline In 2017 ASEE Annual Conference & Exposition, Columbus, Ohio. June, 2017. https://peer.asee.org/29103.

Invited Papers

  • Bolivar, S., Perez, D., Carrasquillo, A., Willams, AdamS., Rishe, N., and Ortega, F., 3D Interaction for Computer Science Educational VR Game. In Universal Access in Human-Computer Interaction. Virtual, Augmented, and Intelligent Environments. UAHCI 2019. Orlando, FL. 2019. In press.

  • O-larnnithipong, N. Barreto, A., Ratchatanantakit, N., Tangnimitchok, S., and Ortega, F., Real-Time Implementation of Orientation Correction Algorithm for 3D Hand Motion Tracking Interface. In Universal Access in Human-Computer Interaction. Methods, Technologies, and Users. UAHCI 2018. Lecture Notes in Computer Science, Springer, vol 10907, pp. 228–242. Invited session: Spatial User Interaction Beyond the Mouse, Las Vegas, NV, 2018.

  • Bolivar, S., Ortega, F., Zock-Obregon, M., and Rishe, N., 3D Spatial Gaming Interaction to Broad CS Participation. In Universal Access in Human-Computer Interaction. Virtual, Augmented, and Intelligent Environments. UAHCI 2018. Lecture Notes in Computer Science, Springer, vol 10908, pp. 39–47. Invited session: Spatial User Interaction Beyond the Mouse, Las Vegas, NV, 2018.

  • Torres, N., Ortega, F., Bernal, J., Barreto, A., and Rishe, N., Towards Multi-Modal Interaction with Interactive Paint. In Universal Access in Human-Computer Interaction. Virtual, Augmented, and Intelligent Environments. UAHCI 2018. Lecture Notes in Computer Science, Springer, vol 10907, pp. 299–308. Invited session: Spatial User Interaction Beyond the Mouse, Las Vegas, NV, 2018.

  • Vassigh, S., Ortega, F., Barreto, A., Tarre, K., and Maldonado, J., Use of 3D Human-Computer Interaction for Teaching in the Architectural Engineering and Construction Fields. In Universal Access in Human-Computer Interaction. Virtual, Augmented, and Intelligent Environments. UAHCI 2018. Lecture Notes in Computer Science, Springer, vol 10908, pp. 149–159. Invited session: Spatial User Interaction Beyond the Mouse, Las Vegas, NV, 2018.

Non-Refereed Articles

  • Ortega, F., Barreto, A., Rishe, N., and Adjouadi, M., Towards 3D Data Environments Using Multi-Touch Screens. In ACHI 2012: The Fifth International Conference on Advances in Computer-Human Interactions, pp. 118–121, 2012.

  • Ortega, F., Barreto, A., Rishe, N., Adjoudi, M., and Abyarjoo, F., GyroTouch: Complementing the Multi-Touch Display. In ACM Richard Tapia Celebration of Diversity in Computing, 2014.

  • Cofino, J., Barreto, A., Abyarjoo, F., and Ortega, F., B.A.S.S. Blind-Assistive Spatialized Screen-reading. In ACM Richard Tapia Celebration of Diversity in Computing, 2014.

Patents

  • Francisco Ortega, Jules Calella, Naphtali Rishe, S.S. Iyengar. ree Dimensional Touch Conductive Fabric. Publication No. US20190391683A1. Application No. 16015801. Filed: June 22, 2018. Publication Date: December 26, 2019. FIU-IP-1744.

  • Ortega, F., Rishe, N., and Barreto, A., Gesture Discernment and Processing System.Patent No.: US 9,886,190 B2. Date of Patent: Feb. 6, 2018. US Utility Patent led November 28th, 2014, USPS Application Number 20160091977, publication date March 31st, 2016.

  • Barreto, A., Rishe, N., Ortega, F., O-Larnnithipong, N., VRT: Virtual Round Table. Patent No.: US 9,900,555 B1, Date of Patent: Feb. 20, 2018. Disclosed to FIU, January, 2017