Knowledge Commons of Institute of Automation,CAS
VirtualClassroom: A Lecturer-Centered Consumer-Grade Immersive Teaching System in Cyber-Physical-Social Space | |
Shen, Tianyu1; Huang, Shi-Sheng1; Li, Deqi1; Lu, Zhiyuan1; Wang, Fei-Yue2; Huang, Hua1 | |
发表期刊 | IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS |
ISSN | 2168-2216 |
2022-12-20 | |
页码 | 13 |
通讯作者 | Huang, Hua(huahuang@bnu.edu.cn) |
摘要 | Lecturers, as the guidance of the classroom, play a significant role in the teaching process. However, the lecturers' sense of space immersion has been ignored in current virtual teaching systems. In this article, we explore the cyber-physical-social intelligence for Edu-Metaverse in cyber-physical-social space and specially design a lecturer-centered immersive teaching system, taking the social and lecturers' factors into consideration. We call this system VirtualClassroom (V-Classroom). Specifically, we first introduce the cyber-physical-social system (CPSS) paradigm of V-Classroom so that the workflow is standardized and significantly simplified, and the systems can be constructed with off-the-shelf hardware. The key component of V-Classroom is a cyber-world representation of a physical-world classroom instrumented with sparse consumer-grade RGBD cameras for capturing the 3-D geometry and texture of the classrooms. We provide each V-Classroom lecturer with a physical device for sending 6DoF view-change messages and showing view-dependent content of the remote classroom. Following the above paradigm, we develop the V-Classroom algorithms, including V-Classroom depth algorithm (V-DA) and V-Classroom view algorithm (V-VA), to achieve the real-time rendering of remote classrooms. V-DA is dedicated to recovering accurate depth information of the classrooms while V-VA is devoted to real-time novel view synthesis. Finally, we illustrate our implemented CPSS-driven V-Classroom prototype, based on real-world classroom scenarios we collected, and discuss the main challenges and future direction. |
关键词 | 6DoF video cyber-physical-social systems (CPSSs) educational metaverse immersive teaching |
DOI | 10.1109/TSMC.2022.3228270 |
关键词[WOS] | DIGITAL TWINS ; INDUSTRY 4.0 ; STEREO ; EDUCATION ; CPS |
收录类别 | SCI |
语种 | 英语 |
资助项目 | National Natural Science Foundation ofChina[61533019] |
项目资助者 | National Natural Science Foundation ofChina |
WOS研究方向 | Automation & Control Systems ; Computer Science |
WOS类目 | Automation & Control Systems ; Computer Science, Cybernetics |
WOS记录号 | WOS:000903378100001 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/50986 |
专题 | 多模态人工智能系统全国重点实验室_平行智能技术与系统团队 |
通讯作者 | Huang, Hua |
作者单位 | 1.Beijing Normal Univ, Sch Artificial Intelligence, Beijing 100875, Peoples R China 2.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China |
推荐引用方式 GB/T 7714 | Shen, Tianyu,Huang, Shi-Sheng,Li, Deqi,et al. VirtualClassroom: A Lecturer-Centered Consumer-Grade Immersive Teaching System in Cyber-Physical-Social Space[J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS,2022:13. |
APA | Shen, Tianyu,Huang, Shi-Sheng,Li, Deqi,Lu, Zhiyuan,Wang, Fei-Yue,&Huang, Hua.(2022).VirtualClassroom: A Lecturer-Centered Consumer-Grade Immersive Teaching System in Cyber-Physical-Social Space.IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS,13. |
MLA | Shen, Tianyu,et al."VirtualClassroom: A Lecturer-Centered Consumer-Grade Immersive Teaching System in Cyber-Physical-Social Space".IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2022):13. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论