CN112073668A - Remote classroom interaction method, system, device and storage medium - Google Patents
Remote classroom interaction method, system, device and storage medium Download PDFInfo
- Publication number
- CN112073668A CN112073668A CN202010861357.4A CN202010861357A CN112073668A CN 112073668 A CN112073668 A CN 112073668A CN 202010861357 A CN202010861357 A CN 202010861357A CN 112073668 A CN112073668 A CN 112073668A
- Authority
- CN
- China
- Prior art keywords
- target
- information
- classroom
- voice information
- remote
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 45
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000004891 communication Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 8
- 238000000605 extraction Methods 0.000 claims description 4
- 230000001815 facial effect Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 241001310793 Podium Species 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- User Interface Of Digital Computer (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses a remote classroom interaction method, a system, a device and a storage medium, wherein the method comprises the following steps: collecting image information; extracting face information of a target from the image information; acquiring a sight focus of a target according to the face information; determining that the sight focus is positioned on a display screen, and calculating the fixation time of the target; determining that the watching time is greater than a first threshold value, and collecting voice information of the target; and switching on the classroom in which the target is positioned and the corresponding remote classroom according to the voice information. According to the embodiment of the invention, the sight focus of the teaching teacher is collected, and after the sight focus of the teaching teacher stays on the display screen for a period of time, the voice information of the teaching teacher is collected to realize voice connection control on a remote classroom. Compared with the existing control method, the convenience of the teacher in operating the remote classroom interaction system is greatly improved through the sight focus and the voice control. The invention can be widely applied to the technical field of remote teaching.
Description
Technical Field
The invention relates to the technical field of remote teaching, in particular to a remote classroom interaction method, a remote classroom interaction system, a remote classroom interaction device and a storage medium.
Background
With the application of video communication technology in classrooms of schools, teachers can give lessons to local and remote classes at the same time, and the classes are located in different geographical positions and different noise environments. In order to improve the teaching experience, when the voice communication between the lecture hall and the remote classroom is not needed, the voice of the remote classroom is not transmitted to the lecture hall and other remote classrooms. Only when the teacher in the lecture classroom needs to communicate with the remote classroom, a remote classroom is assigned to have a voice conversation with the teacher in the lecture classroom.
In the current remote classroom interaction system, when performing video interaction with remote classroom students, a teacher needs to use a remote controller or control software to operate. Because a teacher needs to hold books, teaching tools or chalks in a class and cannot hold a system remote controller or operate control software, the teacher needs to walk to the remote controller or the control software for operation every time the teacher wants to communicate with a remote classroom, and the operation process is complicated.
Disclosure of Invention
In view of the above, the present invention provides a remote classroom interaction method, system, device and storage medium to improve the convenience of teachers in class.
The first technical scheme adopted by the invention is as follows:
a remote classroom interaction method, comprising:
collecting image information of a preset position;
extracting face information of a target from the image information;
acquiring a sight focus of the target according to the face information;
determining that the sight focus is positioned on a display screen, and calculating the fixation time of the target;
determining that the watching time is greater than a first threshold value, and collecting voice information of the target;
and switching on the classroom in which the target is positioned and the corresponding remote classroom according to the voice information.
Further, the method for extracting the face information comprises the following steps:
acquiring account information according to input;
and acquiring the face features corresponding to the account information, and extracting the face information of the target from the image information according to the face features.
Further, the acquiring the voice information of the target includes:
and displaying a voice command prompt on the display screen, and acquiring the voice information of the target.
Further, still include:
and determining that the voice information of the target is invalid voice information, and re-collecting the voice information of the target.
Further, the switching on the classroom in which the target is located and the corresponding remote classroom according to the voice information includes:
and determining that the voice information comprises a trigger word, identifying the voice information, and connecting the classroom in which the target is located and the corresponding remote classroom.
Further, the recognizing the voice information and connecting the classroom in which the target is located and the corresponding remote classroom includes:
and acquiring the object name after the trigger word, and connecting the classroom in which the object is located and a remote classroom corresponding to the object name.
Further, still include:
determining that the sight line focus is positioned outside the display screen, and calculating the far time of the sight line focus;
and determining that the distance time is greater than a second threshold value, and stopping collecting the voice information of the target.
The second technical scheme adopted by the invention is as follows:
a remote classroom interaction system comprising:
the image acquisition module is used for acquiring image information of a preset position;
the face extraction module is used for extracting the face information of the target from the image information;
the sight line identification module is used for acquiring a sight line focus of the target according to the face information;
the gaze timing module is used for determining that the sight focus is positioned on a display screen and calculating the gaze time of the target;
the voice acquisition module is used for determining that the watching time is greater than a first threshold value and acquiring the voice information of the target;
and the remote communication module is used for connecting the classroom in which the target is positioned and the corresponding remote classroom according to the voice information.
The third technical scheme adopted by the invention is as follows:
a remote classroom interaction device comprising:
the camera is used for acquiring image information of a preset position;
the host is used for extracting the face information of a target from the image information, acquiring a sight focus of the target according to the face information, determining that the sight focus is positioned on a display screen, and calculating the fixation time of the target; switching on the classroom in which the target is positioned and the corresponding remote classroom according to the voice information;
the first microphone is used for determining that the watching time is greater than a first threshold value and acquiring voice information of the target; collecting voice information of a classroom in which the target is located;
and the second microphone is used for acquiring the voice information of the remote classroom.
The fourth technical scheme adopted by the invention is as follows:
a computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, implements a remote classroom interaction method as described.
According to the embodiment of the invention, by collecting the sight focus of the teaching teacher, after the sight focus of the teaching teacher stays on the display screen for a period of time, the voice information of the teaching teacher is collected, and the control on the voice connection of the remote classroom is realized through the collected voice information. Compared with the existing control method, the convenience of the teacher in operating the remote classroom interaction system is greatly improved through the sight focus and the voice control.
Drawings
FIG. 1 is a first flowchart of a remote classroom interaction method in accordance with an embodiment of the present invention;
FIG. 2 is a second flowchart of a remote classroom interaction method in accordance with an embodiment of the present invention;
fig. 3 is a block diagram of a remote classroom interaction device according to an embodiment of the invention.
Detailed Description
The conception, the specific structure and the technical effects of the present invention will be clearly and completely described in conjunction with the embodiments and the accompanying drawings to fully understand the objects, the schemes and the effects of the present invention.
An embodiment of the present invention provides a remote classroom interaction method, with reference to fig. 1 and 2, including:
s100, collecting image information of a preset position;
s200, extracting the face information of the target from the image information;
s300, acquiring a sight focus of the target according to the face information;
s400, determining that the sight focus is positioned on a display screen, and calculating the fixation time of the target;
s500, determining that the watching time is greater than a first threshold value, and collecting voice information of the target;
s600, switching on the classroom where the target is located and the corresponding remote classroom according to the voice information.
Specifically, in the course of a remote classroom lecture, a camera can shoot an image of a target in real time and transmit the shot image to a computer for processing; after the target is judged to be continuously watching the display screen for a period of time, the intention of the target to interact with the remote classroom is confirmed, the input of the voice command of the target is received, and the classroom where the target is located and the designated remote classroom are connected according to the received voice command input.
The preset position is the position of the target, the camera can be fixed behind the lecture room, and the area where the shot target is located is the preset position.
The image information is the picture information shot by the camera, and the image information is collected by the camera and matched with the face recognition function of the host computer, so that whether the target is positioned in the shooting range of the camera or not can be judged in real time.
The target is the object for remote classroom interactive control, typically referred to as a teacher.
The face information is the face image information of the target extracted from the image information, and the influence of other targets or environments on subsequent sight line recognition is greatly reduced by extracting the face information of the target from the image information.
The sight line focus refers to the intersection point of the sight lines of the two eyes, and the sight line focus of the target can be identified through an AI sight line identification technology so as to judge the attention object of the target. The method for acquiring the target sight line focus can be as follows: the method comprises the steps of obtaining the length, the width and the height of a lecture room in advance, and constructing a three-dimensional coordinate system of the lecture room; acquiring the position, the direction and the focal length of a camera in a three-dimensional coordinate system of a lecture classroom; the area of the display screen in the three-dimensional coordinate system of the lecture classroom is obtained. And performing image restoration adjustment by combining face information and distortion parameters of a camera, and performing 3D modeling on the face by using an average face model and an AI face sight recognition module. And analyzing the binocular vision line focus of the face by the length, the width and the height of the lecture classroom and combining the position and the parameters of the camera and the position of the face, and judging whether the sight focus of the target is on the display screen.
The AI sight line recognition technology is to recognize the direction and focus of the sight line of a person in a face image by analyzing the image of the face and performing 3D transformation on the image.
The AI face sight line recognition module corresponds to an AI sight line recognition technology and is a module used for recognizing the face sight line in the image in a remote classroom interaction system. The AI face gaze recognition module may recognize a face eye gaze location in an image captured by a designated camera in a designated classroom, which may be used to determine a person's gaze location.
The watching time refers to the staying time of the sight focus of the target on the display screen, and when the time that the target watches the display screen exceeds a first threshold value, the target is confirmed to have the interaction intention with the display screen. The gaze time may be calculated by the number of consecutive images of the target gaze display, for example: the frequency of images captured by the camera is 1 image per 100 milliseconds, and when a target is watching the display screen for 5 consecutive images, i.e., the target is watching the display screen for 500 milliseconds, it is determined that the target may wish to communicate with a remote classroom.
Voice information can be collected through the microphone, and the target can be controlled the host computer through voice information, has improved the convenience that the teacher took lessons greatly.
In some embodiments, the face information extraction method includes:
acquiring account information according to input;
and acquiring the face features corresponding to the account information, and extracting the face information of the target from the image information according to the face features.
Specifically, an account is logged in before a lecture, and the face features of a target pre-stored in the cloud are acquired according to the logged account, so that the face information of the target in an image can be extracted after the image is shot by a camera.
The account information is used for extracting target face information in the teaching process, a teacher needs to log in with an account before starting teaching, the system confirms a teacher who gives the teaching according to the account, and the face features of the teacher, namely the face features of the target, are extracted from the cloud. After the face features of the target are obtained, the face information of the target in the image can be extracted through an AI face recognition technology.
The AI face recognition technology is a technology for recognizing a specified person from an image by analyzing the image through an artificial intelligence technology.
The AI face recognition module corresponds to an AI face recognition technology and is a module for recognizing faces in images in a remote classroom interaction system. An image is input to the AI face recognition module, which may return the location of the face in the image.
In the process of face recognition, the frequency of images collected by a camera can be set to be 1 piece per 100 milliseconds, the collected images are input into an AI face recognition module, the AI face recognition module completes the analysis of the images within 100 milliseconds to determine whether the images contain the face of a target, and if the AI face recognition system recognizes the face image of the target, the face image of the target is intercepted and output to the AI face sight line recognition module.
In some embodiments, the collecting voice information of the target includes:
and displaying a voice command prompt on the display screen, and acquiring the voice information of the target.
Specifically, after the target and the display screen are judged to have the interaction intention, a corresponding voice command prompt is displayed on the display screen to assist the target in performing voice control. The voice command prompt may include a trigger word for triggering recognition and an object name, which is the control object following the trigger word.
In some embodiments, further comprising:
and determining that the voice information of the target is invalid voice information, and re-collecting the voice information of the target.
Specifically, when the voice information of the target is invalid information, it indicates that the target may be operated by mistake, and the voice command prompt needs to be displayed again and the voice information of the target needs to be collected again.
In some embodiments, said switching on the classroom in which the object is located and the corresponding remote classroom according to the voice information includes:
and determining that the voice information comprises a trigger word, identifying the voice information, and connecting the classroom in which the target is located and the corresponding remote classroom.
Specifically, after receiving the voice information of the target, the AI voice module performs AI voice recognition, and continues to recognize subsequent voices only when a trigger word is recognized.
The AI voice recognition module is a module used for recognizing sound data collected by a microphone in a remote classroom interaction system, and can recognize character information in voice information.
In some embodiments, the recognizing the voice information and switching on the classroom in which the object is located and the corresponding remote classroom includes:
and acquiring the object name after the trigger word, and connecting the classroom in which the object is located and a remote classroom corresponding to the object name.
Specifically, after the trigger word is recognized, the subsequent speech is continuously recognized. If the object name is included in the subsequent speech which is continuously recognized, the object name is returned.
The object name refers to an object to be operated by the target, and may be, for example, a class name, and the system is connected to a corresponding remote classroom according to the object name.
In some embodiments, further comprising:
determining that the sight line focus is positioned outside the display screen, and calculating the far time of the sight line focus;
and determining that the distance time is greater than a second threshold value, and stopping collecting the voice information of the target.
Specifically, after the target no longer gazes at the display screen for a certain time, the voice prompt disappears and the eye gaze of the target is re-detected. By stopping collecting the voice information of the target in time, other voices of the target are prevented from becoming voice commands, and misoperation of the system is prevented.
The embodiment of the invention also provides a remote classroom interaction system, which comprises:
the image acquisition module is used for acquiring image information of a preset position;
the face extraction module is used for extracting the face information of the target from the image information;
the sight line identification module is used for acquiring a sight line focus of the target according to the face information;
the gaze timing module is used for determining that the sight focus is positioned on a display screen and calculating the gaze time of the target;
the voice acquisition module is used for determining that the watching time is greater than a first threshold value and acquiring the voice information of the target;
and the remote communication module is used for connecting the classroom in which the target is positioned and the corresponding remote classroom according to the voice information.
Specifically, the contents in the above method embodiments are all applicable to the present system embodiment, the functions specifically implemented by the present system embodiment are the same as those in the above method embodiment, and the beneficial effects achieved by the present system embodiment are also the same as those achieved by the above method embodiment.
The layers, modules, units, platforms, and/or the like included in the system may be implemented or embodied by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer readable memory. The methods may be implemented in a computer program using standard programming techniques, including a non-transitory computer-readable storage medium configured with the computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner, according to the methods and figures described in the detailed description. Each program may be implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.
The data processing flows performed by the layers, modules, units, and/or platforms included in the system may be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The data processing flows correspondingly performed by the layers, modules, units and/or platforms included in the system of embodiments of the invention may be performed under the control of one or more computer systems configured with executable instructions, and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications) collectively executed on one or more processors, by hardware, or a combination thereof. The computer program includes a plurality of instructions executable by one or more processors.
The system may be implemented in any type of computing platform operatively connected to a suitable connection, including but not limited to a personal computer, mini computer, mainframe, workstation, networked or distributed computing environment, separate or integrated computer platform, or in communication with a charged particle tool or other imaging device, and the like. The data processing flows correspondingly executed by the layers, modules, units and/or platforms included in the inventive system may be implemented in machine readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, an optical read and/or write storage medium, a RAM, a ROM, etc., such that it may be read by a programmable computer, and when the storage medium or device is read by the computer, may be used to configure and operate the computer to perform the procedures described herein. Further, the machine-readable code, or portions thereof, may be transmitted over a wired or wireless network. The invention described herein includes these and other different types of non-transitory computer-readable storage media when such media include instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor. The invention also includes the computer itself when programmed according to the methods and techniques described herein.
An embodiment of the present invention further provides a remote classroom interaction apparatus, referring to fig. 3, including:
the camera is used for acquiring image information of a preset position;
the host is used for extracting the face information of a target from the image information, acquiring a sight focus of the target according to the face information, determining that the sight focus is positioned on a display screen, and calculating the fixation time of the target; switching on the classroom in which the target is positioned and the corresponding remote classroom according to the voice information;
the first microphone is used for determining that the watching time is greater than a first threshold value and acquiring voice information of the target; collecting voice information of a classroom in which the target is located;
and the second microphone is used for acquiring the voice information of the remote classroom.
Specifically, the remote classroom interaction system is a software and hardware system that enables a lecture classroom to provide a plurality of remote classrooms with synchronous lessons in a remote video communication mode. The display screen is connected with the host through a cable or a wireless signal and is used for displaying pictures of a remote classroom; the lecture home classroom refers to a classroom in which a teacher gives lessons, and the remote classroom refers to a classroom in which no teacher gives lessons and only students listen to the lecture home classroom remotely; the host is a computer used for general control in the remote classroom interaction system, and terminal software of the remote classroom interaction system is operated on the host; the camera is connected with the remote classroom interaction system through a cable or a wireless signal, is arranged opposite to the blackboard, and has a lens facing the blackboard and the podium and used for shooting pictures of teachers; the remote camera is connected with a remote classroom interaction system through a cable or a wireless signal, and is usually arranged on a blackboard, and the lens of the remote camera faces a student desk and is used for shooting pictures of students; the microphone is connected with the host through a wireless signal, is mainly used for collecting the voice of the teacher, and can be a microphone worn on the head, a handheld microphone or a microphone clamped on a neck clip.
The remote classroom interaction system is also provided with a student microphone which is connected with the host through a cable or a wireless signal and is mainly used for collecting the speaking voice of students, and the student microphone can be installed in a sitting area of the students or can be a suspended microphone installed on a ceiling of a classroom. The remote classroom interaction system is also provided with a classroom sound box, wherein the classroom sound box is connected with the host through cables or wireless signals, can be arranged on the two side walls of the blackboard, faces the student desk and is used for playing the sound of other remote classrooms.
The remote classroom interaction system is formed by connecting a lecture hall and a plurality of remote classrooms through a network and transmitting information by using an audio and video communication technology. The remote classroom interaction system comprises a main classroom, a remote classroom interaction system, a hardware device, a main hardware device host, peripheral devices, a remote camera and a display screen, wherein the main classroom is internally provided with the hardware device of the remote classroom interaction system; all peripheral devices are connected to the host computer by wire or wirelessly.
The sound of the teacher speaking in the lecture room is mainly collected through a microphone, the sound of the students is collected through a microphone of the students, and the sound is mixed at the host and then sent to the remote classroom host. After receiving the sound information of the lecture hall, the remote classroom host computer plays the sound information through the remote classroom loudspeaker box, so that students in the remote classroom can hear the sound of the lecture hall.
The platform picture in the main lecture room is mainly shot through a camera, the picture of the student under the platform is shot through a remote camera, and the picture is mixed at the host and then sent to the remote classroom host. After receiving the picture of the main lecture room, the remote classroom host machine plays the picture through the remote classroom all-in-one machine, so that the students in the remote classroom can see the picture in class.
The speaking sound of the students in the remote classroom is mainly collected by the microphones of the students and is sent to the main machine of the main lecture room by the main machine. After receiving the sound of the remote classroom, the host computer of the main lecture room broadcasts the sound through the loudspeaker box of the main lecture room, so that teachers and students in the main lecture room can hear the sound of the students in the remote classroom answering the questions.
The learning pictures of students in the remote classroom are mainly shot by a remote camera and are sent to the main machine of the lecture classroom by the main machine of the remote classroom. After receiving the remote classroom picture, the main machine of the lecture room plays the picture through the display screen, so that a teacher in the lecture room can see the learning condition of students in the remote classroom.
The contents in the above method embodiments are all applicable to the present apparatus embodiment, the functions specifically implemented by the present apparatus embodiment are the same as those in the above method embodiments, and the advantageous effects achieved by the present apparatus embodiment are also the same as those achieved by the above method embodiments.
Embodiments of the present invention also provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the remote classroom interaction method is implemented.
In particular, the storage medium stores processor-executable instructions, which when executed by the processor, are configured to perform the steps of the method for processing mutual information according to any one of the above-mentioned method embodiments. For the storage medium, it may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. It can be seen that the contents in the foregoing method embodiments are all applicable to this storage medium embodiment, the functions specifically implemented by this storage medium embodiment are the same as those in the foregoing method embodiments, and the advantageous effects achieved by this storage medium embodiment are also the same as those achieved by the foregoing method embodiments.
It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element of the same type from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure. The use of any and all examples, or exemplary language ("e.g.," such as "or the like") provided herein, is intended merely to better illuminate embodiments of the invention and does not pose a limitation on the scope of the invention unless otherwise claimed.
The above description is only a preferred embodiment of the present invention, and the present invention is not limited to the above embodiment, and any modifications, equivalent substitutions, improvements, etc. within the spirit and principle of the present invention should be included in the protection scope of the present invention as long as the technical effects of the present invention are achieved by the same means. The invention is capable of other modifications and variations in its technical solution and/or its implementation, within the scope of protection of the invention.
Claims (10)
1. A remote classroom interaction method, comprising:
collecting image information of a preset position;
extracting face information of a target from the image information;
acquiring a sight focus of the target according to the face information;
determining that the sight focus is positioned on a display screen, and calculating the fixation time of the target;
determining that the watching time is greater than a first threshold value, and collecting voice information of the target;
and switching on the classroom in which the target is positioned and the corresponding remote classroom according to the voice information.
2. The remote classroom interaction method as described in claim 1, wherein said facial information is extracted by:
acquiring account information according to input;
and acquiring the face features corresponding to the account information, and extracting the face information of the target from the image information according to the face features.
3. The method as claimed in claim 1, wherein said collecting voice information of said object comprises:
and displaying a voice command prompt on the display screen, and acquiring the voice information of the target.
4. A remote classroom interaction method as described in claim 3, further comprising:
and determining that the voice information of the target is invalid voice information, and re-collecting the voice information of the target.
5. The method as claimed in claim 1, wherein said switching on the classroom in which the object is located and the corresponding remote classroom according to the voice information comprises:
and determining that the voice information comprises a trigger word, identifying the voice information, and connecting the classroom in which the target is located and the corresponding remote classroom.
6. The method as claimed in claim 5, wherein the recognizing the voice information to connect the classroom in which the object is located and the corresponding remote classroom comprises:
and acquiring the object name after the trigger word, and connecting the classroom in which the object is located and a remote classroom corresponding to the object name.
7. A remote classroom interaction method as described in claim 1, further comprising:
determining that the sight line focus is positioned outside the display screen, and calculating the far time of the sight line focus;
and determining that the distance time is greater than a second threshold value, and stopping collecting the voice information of the target.
8. A remote classroom interaction system, comprising:
the image acquisition module is used for acquiring image information of a preset position;
the face extraction module is used for extracting the face information of the target from the image information;
the sight line identification module is used for acquiring a sight line focus of the target according to the face information;
the gaze timing module is used for determining that the sight focus is positioned on a display screen and calculating the gaze time of the target;
the voice acquisition module is used for determining that the watching time is greater than a first threshold value and acquiring the voice information of the target;
and the remote communication module is used for connecting the classroom in which the target is positioned and the corresponding remote classroom according to the voice information.
9. A remote classroom interaction device, comprising:
the camera is used for acquiring image information of a preset position;
the host is used for extracting the face information of a target from the image information, acquiring a sight focus of the target according to the face information, determining that the sight focus is positioned on a display screen, and calculating the fixation time of the target; switching on the classroom in which the target is positioned and the corresponding remote classroom according to the voice information;
the first microphone is used for determining that the watching time is greater than a first threshold value and acquiring voice information of the target; collecting voice information of a classroom in which the target is located;
and the second microphone is used for acquiring the voice information of the remote classroom.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a remote classroom interaction method as defined in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010861357.4A CN112073668B (en) | 2020-08-25 | 2020-08-25 | Remote classroom interaction method, system, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010861357.4A CN112073668B (en) | 2020-08-25 | 2020-08-25 | Remote classroom interaction method, system, device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112073668A true CN112073668A (en) | 2020-12-11 |
| CN112073668B CN112073668B (en) | 2023-10-31 |
Family
ID=73658894
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010861357.4A Active CN112073668B (en) | 2020-08-25 | 2020-08-25 | Remote classroom interaction method, system, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112073668B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112687133A (en) * | 2020-12-30 | 2021-04-20 | 湖北盟道信息科技有限公司 | Audio adjusting method and system for online classroom |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103188541A (en) * | 2011-12-30 | 2013-07-03 | 三星电子株式会社 | Electronic apparatus and method for controlling the same |
| CN103632664A (en) * | 2012-08-20 | 2014-03-12 | 联想(北京)有限公司 | A method for speech recognition and an electronic device |
| CN103634455A (en) * | 2012-08-22 | 2014-03-12 | 百度在线网络技术（北京）有限公司 | Annotation-based voice command prompting method and mobile terminal |
| CN108961880A (en) * | 2018-08-03 | 2018-12-07 | 青岛华师京城网络科技有限公司 | A kind of implementation method contacting classroom |
| CN109191964A (en) * | 2018-10-12 | 2019-01-11 | 北京凌宇智控科技有限公司 | A kind of teaching interaction system based on virtual reality |
| CN109218666A (en) * | 2018-09-03 | 2019-01-15 | 广州市保伦电子有限公司 | A kind of long-distance interactive recording and broadcasting system and exchange method, storage medium |
| CN110211586A (en) * | 2019-06-19 | 2019-09-06 | 广州小鹏汽车科技有限公司 | Voice interactive method, device, vehicle and machine readable media |
| CN110287947A (en) * | 2019-07-24 | 2019-09-27 | 阔地教育科技有限公司 | Interaction classroom in interaction classroom determines method and device |
| CN110349456A (en) * | 2019-07-12 | 2019-10-18 | 阔地教育科技有限公司 | Intelligence control system, remote control terminal and the classroom terminal of interaction classroom |
| CN111240477A (en) * | 2020-01-07 | 2020-06-05 | 北京汽车研究总院有限公司 | Vehicle-mounted human-computer interaction method and system and vehicle with system |
| CN111492426A (en) * | 2017-12-22 | 2020-08-04 | 瑞典爱立信有限公司 | Voice control of gaze initiation |
-
2020
- 2020-08-25 CN CN202010861357.4A patent/CN112073668B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103188541A (en) * | 2011-12-30 | 2013-07-03 | 三星电子株式会社 | Electronic apparatus and method for controlling the same |
| CN103632664A (en) * | 2012-08-20 | 2014-03-12 | 联想(北京)有限公司 | A method for speech recognition and an electronic device |
| CN103634455A (en) * | 2012-08-22 | 2014-03-12 | 百度在线网络技术（北京）有限公司 | Annotation-based voice command prompting method and mobile terminal |
| CN111492426A (en) * | 2017-12-22 | 2020-08-04 | 瑞典爱立信有限公司 | Voice control of gaze initiation |
| CN108961880A (en) * | 2018-08-03 | 2018-12-07 | 青岛华师京城网络科技有限公司 | A kind of implementation method contacting classroom |
| CN109218666A (en) * | 2018-09-03 | 2019-01-15 | 广州市保伦电子有限公司 | A kind of long-distance interactive recording and broadcasting system and exchange method, storage medium |
| CN109191964A (en) * | 2018-10-12 | 2019-01-11 | 北京凌宇智控科技有限公司 | A kind of teaching interaction system based on virtual reality |
| CN110211586A (en) * | 2019-06-19 | 2019-09-06 | 广州小鹏汽车科技有限公司 | Voice interactive method, device, vehicle and machine readable media |
| CN110349456A (en) * | 2019-07-12 | 2019-10-18 | 阔地教育科技有限公司 | Intelligence control system, remote control terminal and the classroom terminal of interaction classroom |
| CN110287947A (en) * | 2019-07-24 | 2019-09-27 | 阔地教育科技有限公司 | Interaction classroom in interaction classroom determines method and device |
| CN111240477A (en) * | 2020-01-07 | 2020-06-05 | 北京汽车研究总院有限公司 | Vehicle-mounted human-computer interaction method and system and vehicle with system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112687133A (en) * | 2020-12-30 | 2021-04-20 | 湖北盟道信息科技有限公司 | Audio adjusting method and system for online classroom |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112073668B (en) | 2023-10-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017215295A1 (en) | Camera parameter adjusting method, robotic camera, and system | |
| US9223786B1 (en) | Communication in a sensory immersive motion capture simulation environment | |
| US20080180519A1 (en) | Presentation control system | |
| US9076345B2 (en) | Apparatus and method for tutoring in convergence space of real and virtual environment | |
| KR101775974B1 (en) | Analysis system and method for class attitude | |
| CN111027486A (en) | Auxiliary analysis and evaluation system and method for big data of teaching effect of primary and secondary school classroom | |
| US11595615B2 (en) | Conference device, method of controlling conference device, and computer storage medium | |
| CN210469530U (en) | Audio and image tracking system for speaking person | |
| CN112307800A (en) | Method and device for displaying electronic nameplate in video conference | |
| CN110085072A (en) | A kind of implementation method and device of the asymmetric display in multimachine position | |
| JP2007158680A (en) | Tracking imaging apparatus and tracking imaging system utilizing it | |
| CN112073668B (en) | Remote classroom interaction method, system, device and storage medium | |
| US7986336B2 (en) | Image capture apparatus with indicator | |
| CN113301367B (en) | Audio and video processing method, device, system and storage medium | |
| CN112507829B (en) | Multi-person video sign language translation method and system | |
| WO2021033592A1 (en) | Information processing apparatus, information processing method, and program | |
| KR102341294B1 (en) | Method and apparatus for providing interactive content | |
| KR20160122869A (en) | Apparatus for being possible language converting using robot arm | |
| CN110730378A (en) | Information processing method and system | |
| Ido et al. | Robotic receptionist ASKA: a research platform for human-robot interaction | |
| KR20150145303A (en) | Multiview telepresence service providing method and apparaus thereof | |
| EP4156147A1 (en) | System, device, and method for improving visual and/or auditory tracking of a presentation given by a presenter | |
| CN113794824B (en) | Indoor visual document intelligent interactive acquisition method, device, system and medium | |
| KR102623534B1 (en) | Remote lecture system that enables active class participation | |
| KR102289448B1 (en) | Apparatus for providing interactive content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |