CN112565669B - Method for measuring attention of participants in network video conference - Google Patents
Method for measuring attention of participants in network video conference Download PDFInfo
- Publication number
- CN112565669B CN112565669B CN202110187053.9A CN202110187053A CN112565669B CN 112565669 B CN112565669 B CN 112565669B CN 202110187053 A CN202110187053 A CN 202110187053A CN 112565669 B CN112565669 B CN 112565669B
- Authority
- CN
- China
- Prior art keywords
- participant
- attention
- display
- speaker
- desktop
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a method for measuring attention of participants in a network video conference. According to the method, the area of the shared desktop of the speaker in the participant display screen is obtained and compared with the obtained area of the participant display screen, so that the attention of the participant in the conference is judged, and the attention of the participant is displayed on an interface of the conference Host in a grading mode. The method does not need additional confirmation operation of the participants in the process of participating in the conference, does not need to add special staff for manual judgment, improves the efficiency and saves the hardware cost and the labor cost compared with the existing measurement method.
Description
Technical Field
The invention relates to the technical field of network video conferences, in particular to a method for measuring attention of participants in a network video conference.
Background
A video conference system, also called network video conference system, refers to a system device that transmits audio, video and document data to each other through communication network and multimedia devices, so as to realize real-time and interactive communication and achieve the purpose of conference. Because the cost of the network is high and the application range is small, the requirements for response speed and instant conversation are difficult to meet, the bandwidth of the network is rapidly improved along with the development of network technology and information technology, and the cost is obviously reduced. Due to the influence of global trend, the region range spanned by social and economic activities of people is wider and wider, the network video conference is not limited by regions, time and labor cost can be well saved, and the working efficiency is improved, so that the network video conference is taken as a necessary communication tool in world organizations, government agencies, education institutions, enterprises and other disputes.
Although the network video conference has its own technical advantages, there are some disadvantages, for example, the participants are not in the conference place, the scene atmosphere is not obvious, the attention of the participants may be affected by the place, which results in the reduction of conference transmission efficiency, which is disadvantageous for the transmission of some important information. In order to facilitate a speaker to grasp the participant status of a participant and adjust the lecture mode in a targeted manner, the prior art provides some auxiliary methods for judging the attention of the participant. For example, there are conference systems in which point-to-function is set: click to button appears on the participant screen, the participant clicks to confirm to show that he is participating, a full-time person is set up in some education courses, and whether the participant is listening or speaking is confirmed by viewing the video image of the participant. The point-to-button approach solves the above problems to some extent, but the point-to-point operation itself tends to distract the participants. And the labor cost is improved and the efficiency of the network video conference is reduced by setting the mode of looking over by full-time personnel. Based on the above situation, the invention provides a method for measuring attention of participants.
Disclosure of Invention
The invention aims to solve the defects in the prior art and provides a method for measuring attention of participants. The method comprises the following steps:
a method for measuring attention of participants in a network video conference specifically comprises the following steps:
step 100), acquiring a video data stream of a shared desktop of a speaker and a shared desktop display parameter of the speaker through an image acquisition module, and processing the acquired video data stream to obtain an image data signal;
step 200), sending the obtained image data signal to participant terminal equipment, converting the image data signal into a digital signal through an image processing module, extracting display parameters of shared desktop data of a speaker and a shared desktop of the speaker from the digital signal, and displaying the shared desktop of the speaker in a display area of video conference software to the maximum extent according to the display parameters;
step 300), obtaining the area of the shared desktop of the speaker in the participant display screen S1;
step 400), obtaining area of participant display screen S2, determining participant screen display normalization parameter P according to areas S1 and S2 obtained in step 300), wherein P = S2/S1;
step 500), acquiring the area of the shared desktop of the speaker in the participant display screen in real time S1';
step 600), determining the attention of the participant according to the area S1' of the speaker sharing desktop in the real-time participant display screen obtained in the step 500) and the area S2 of the participant display screen and the participant screen display normalization parameters;
step 700), sending the attention information of the multiple participants to a server, and sending the attention information to a conference Host by the server and displaying the attention levels of the multiple participants on an interface;
step 800), repeatedly performing steps 500) to 700) at predetermined intervals.
Further, the specific manner of determining the attention of the participant in step 600) is as follows: participant focus = P × S1'/S2 x 100%.
Further, the desktop display parameter is specifically the length-width ratio of the presenter display.
Further, wherein the attention level in step 700) is determined by the value range of the attention of the participant.
Further, wherein in step 600) the attention levels of the participants are displayed in different colors.
Further, wherein the step 500) of obtaining the area of the speaker sharing desktop in the participant display screen S1' includes removing a portion of the area covered by the other display windows.
Further, the display is displayed in green, yellow and red in the order of the attention level from high to low, respectively.
The invention provides a quick and convenient processing method aiming at the problems in the method for judging the attention of participants in the network video conference. According to the method, extra confirmation operation of the participants in the conference process is not needed, and the full-time staff is not needed to be added for manual judgment, the attention of the participants can be measured only by calculating the display window on the participant display terminal, and the measurement result can be displayed on the conference Host in a grading mode.
Drawings
FIG. 1 is a schematic diagram of a presenter sharing a desktop in an embodiment of the present invention;
FIG. 2 is a schematic diagram of a display of a presenter sharing desktop on a participant desktop according to an embodiment of the present invention;
FIG. 3 is a schematic illustration of a possible presence of a participant desktop in an embodiment of the present invention;
FIG. 4 is a schematic diagram of an actual display area of a presenter sharing desktop on a participant desktop according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of attention capture and display among participants in an embodiment of the invention.
Detailed Description
Example 1
In the embodiment of the invention, the key steps of the method for measuring attention of participants in the network video conference are explained.
Referring to fig. 1 to 5, the method for measuring attention of participants in a network video conference provided by the present invention includes the following steps:
step 100), acquiring a video data stream of a shared desktop of a speaker and a shared desktop display parameter of the speaker through an image acquisition module, and processing the acquired video data stream to obtain an image data signal;
step 200), sending the obtained image data signal to participant terminal equipment, converting the image data signal into a digital signal through an image processing module, extracting display parameters of shared desktop data of a speaker and a shared desktop of the speaker from the digital signal, and displaying the shared desktop of the speaker in a display area of video conference software to the maximum extent according to the display parameters;
step 300), obtaining the area of the shared desktop of the speaker in the participant display screen S1;
step 400), obtaining area of participant display screen S2, determining participant screen display normalization parameter P according to areas S1 and S2 obtained in step 300), wherein P = S2/S1;
step 500), acquiring the area of the shared desktop of the speaker in the participant display screen in real time S1';
step 600), determining the attention of the participant according to the area S1' of the speaker sharing desktop in the real-time participant display screen obtained in the step 500) and the area S2 of the participant display screen and the participant screen display normalization parameters;
step 700), sending the attention information of the multiple participants to a server, and sending the attention information to a conference Host by the server and displaying the attention levels of the multiple participants on an interface;
step 800), repeatedly performing steps 500) to 700) at predetermined intervals.
In the network video conference, in order to clearly explain technical contents related to the conference, a speaker shares a personal desktop to participants, conference software is used for obtaining video data streams of the speaker shared desktop and shared desktop display parameters of the speaker through an image acquisition module, and the obtained video data streams are processed to obtain image data signals. Fig. 1 is a schematic diagram of a shared desktop of a speaker in an embodiment of the present invention, where fig. 1 corresponds to a view of the shared desktop at a certain time, and in essence, information on a display desktop of the speaker in a conference is acquired in a video data stream manner, the image acquisition module also acquires display parameters of the shared desktop of the speaker, that is, a length-width ratio of a display screen, and the image acquisition module processes the acquired video data stream and the acquired display parameters and converts the video data stream and the display parameters into image data signals for subsequent participant terminal devices to receive.
FIG. 2 is a schematic diagram of a display of a presenter sharing desktop on a participant desktop according to an embodiment of the present invention; in the conference process, after the obtained image data signals are sent to the participant terminal equipment, the image data signals are converted into digital signals through an image processing module, display parameters of a shared desktop of a speaker are extracted from the digital signals according to the shared desktop of the speaker, the display parameters are displayed on the participant terminal equipment in a display area of video conference software in a maximized mode according to the display parameters, and audio information is played synchronously. "participant shared desktop picture" refers to a window of the network video conference system displaying interaction on the participant's desktop, and not only includes the desktop shared by the speaker (if the desktop is being shared). For shared desktop displays, because the ratio of the presenter display is different from the ratio of the participant displays, a common approach used in the industry is: the content of the desktop of the speaker occupies the window as much as possible according to the length-width ratio of the display (display desktop) of the speaker, other vacant parts are filled with default colors, and meanwhile, the window can display other module components such as videos, participants and the like. The speaker's shared desktop in fig. 2 is displayed in a maximized manner according to the speaker's display desktop aspect ratio.
Based on the area S1 of the lecturer sharing desktop in the participant display screen and the area S2 of the participant display screen obtained in the state where the lecturer sharing desktop is maximally displayed as shown in fig. 2, a participant screen normalization parameter P is determined according to the obtained areas S1 and S2, where P = S2/S1. The purpose of implementing the above steps is to provide a standard executable parameter for the difference of the displays of different participants, so that the area of the shared desktop of the speaker in the display screen of the participants, which is measured in real time in the subsequent process, can be used for measuring the conference attention of the participants.
During the conference, the participants may perform operations on the display screen, which include: the size of the conference software display window is changed, other programs are operated, and the like, at the moment, the size change of the conference software display window or the opening of other program windows influences the size of the shared table area of the speaker displayed in the conference software display window, for example, the size of the conference software display window is respectively reduced by half according to the length and the width, and the shared table area of the speaker displayed in the conference software display window is reduced to be one fourth of the original size. If the new program window that the participant is running on is located above the shared desktop of the presenter displayed in the conferencing software display window, it may be partially or fully obscured and the attention of the participant is correspondingly diminished. The invention reflects the attention change of the participants through the change of the sharing desktop area of the speaker displayed in the display window of the network video conference software. To dynamically show the attention of the participants, steps 500) to 700) need to be repeatedly executed at predetermined intervals, which may be determined according to actual needs, such as 5 seconds, 10 seconds, 30 seconds … …, and the like.
In the process of specifically calculating the attention, the attention of the participant is determined according to the area S2 of the display screen of the participant, the area S1' of the shared desktop of the speaker in the real-time display screen of the participant and the normalization parameters of the screen of the participant, and the specific calculation formula is as follows: participant focus = P × S1'/S2 x 100%. Therefore, the attention of the participants can be objectively reflected by the proportion of the size of the content display window.
As mentioned above, the area S1 'of the participant' S display screen where the speaker shares the desktop may be manually adjusted or may be masked and then changed in size, and the manual change may be calculated by the network video conference software based on the actual display size. For the masked case, separate calculations are needed. As shown in fig. 3 and 4, on the display desktop of the participants, the speaker sharing desktop in the participant network video conference window (i.e. the speaker sharing desktop in the participant display screen) is partially covered by other windows, and then the area actually displayed by the participant network video conference window is calculated through the following steps:
step 501), acquiring other windows displayed on a shared desktop of a speaker in a display screen of a current participant to be judged;
step 502), acquiring the rectangular information of the other windows;
step 503), calculating the intersecting area of the shared desktop of the speaker in the other windows and the display screen of the current participant;
and step 504), subtracting the intersected area from the current network video conference window to obtain the area of the shared desktop of the speaker in the participant display screen.
Through the steps, the intersecting area of the shared desktop of the speaker in the display screen of the front participant when other windows are covered can be obtained.
For the situation of participation of multiple persons, in order to quickly and intuitively browse the attention degree situation of the participants, the attention degree can be divided into various levels. The attention degree grades are determined by the numerical range of attention degrees of the participants, and the division rules of the grades can be selected according to actual conditions, which is not described herein again. Besides, the colors can be set to represent different attention degrees, such as green, yellow, and red, which respectively correspond to different attention degree range values. Detailed attention values may be set, or various types of shapes may be provided that indicate different attention levels. The participants may also be sorted by the size of the attention. FIG. 5 is a schematic diagram of attention capture and display among participants in an embodiment of the invention. The participants update their attention to the server in real time, the server sends the attention to the conference Host, and finally the attention of each participant is displayed on the interface.
Example 2
In embodiment 1, a specific implementation of obtaining and presenting attention of a participant in real time in a network video conference is described, where the attention is used for measuring the real-time attention of the participant. In practical application, other use situations exist, such as measuring the whole attention of the participants in the whole process of the network video conference. In this embodiment, based on the needs of such a situation, a method for measuring attention of a participant is provided based on embodiment 1, and the specific steps are as follows:
step 100), acquiring a video data stream of a shared desktop of a speaker and a shared desktop display parameter of the speaker through an image acquisition module, and processing the acquired video data stream to obtain an image data signal;
step 200), sending the obtained image data signal to participant terminal equipment, converting the image data signal into a digital signal through an image processing module, extracting display parameters of shared desktop data of a speaker and a shared desktop of the speaker from the digital signal, and displaying the shared desktop of the speaker in a display area of video conference software to the maximum extent according to the display parameters;
step 300), obtaining the area of the shared desktop of the speaker in the participant display screen S1;
step 400), obtaining area of participant display screen S2, determining participant screen display normalization parameter P according to areas S1 and S2 obtained in step 300), wherein P = S2/S1;
step 500), acquiring the area of the shared desktop of the speaker in the participant display screen in real time S1';
step 600), determining the attention of the participant according to the area S1' of the speaker sharing desktop in the real-time participant display screen obtained in the step 500) and the area S2 of the participant display screen and the participant screen display normalization parameters;
step 601), accumulating the attention degrees obtained in the step 600) and recording the accumulation times;
step 700), carrying out accumulated value and recorded accumulated times according to the attention to obtain an average value, sending the average value to a server as the attention information of a plurality of participants, sending the average value to a conference Host by the server, and displaying the attention levels of the participants on an interface;
step 800), repeatedly performing step 500) -step 700) at predetermined intervals.
In this embodiment, steps 100 to 600) are the same as embodiment 1, and on the basis of obtaining the attention value in step 600), the attention value obtained each time is accumulated and averaged, so that the obtained attention average value reflects the average state of attention of the participants in the whole network video conference process, is an index parameter for the judgment process, and is very effective for judging the learning state of the students in the network video conference in some training or education institutions. Likewise, the attention obtained in the present embodiment may also be shown by ranking, in different colors, or in a sorted manner as in embodiment 1.
The above disclosure is only an embodiment of the present invention, but the present invention is not limited thereto, and those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. It is to be understood that such changes and modifications are intended to be included within the scope of the appended claims. Furthermore, although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
Claims (7)
1. A method for measuring attention of participants in a network video conference, the method comprising:
step 100), acquiring a video data stream of a shared desktop of a speaker and a shared desktop display parameter of the speaker through an image acquisition module, and processing the acquired video data stream to obtain an image data signal;
step 200), sending the obtained image data signal to participant terminal equipment, converting the image data signal into a digital signal through an image processing module, extracting sharing desktop data of a speaker and sharing desktop display parameters of the speaker from the digital signal, and displaying the sharing desktop of the speaker in a display area of video conference software to the maximum extent according to the display parameters;
step 300), obtaining the area of the shared desktop of the speaker in the participant display screen S1;
step 400), obtaining area of participant display screen S2, determining participant screen display normalization parameter P according to areas S1 and S2 obtained in step 300), wherein P = S2/S1;
step 500), acquiring the area of the shared desktop of the speaker in the participant display screen in real time S1';
step 600), determining the attention of the participant according to the area S1' of the speaker sharing desktop in the real-time participant display screen obtained in the step 500) and the area S2 of the participant display screen and the participant screen display normalization parameters;
step 700), sending the attention information of the multiple participants to a server, and sending the attention information to a conference Host by the server and displaying the attention levels of the multiple participants on an interface;
step 800), repeatedly performing steps 500) to 700) at predetermined intervals.
2. The method as claimed in claim 1, wherein the specific manner of determining the attention of the participant in step 600) is: participant focus = P × S1'/S2 x 100%.
3. The method of measuring attention of a participant according to claim 1, wherein said desktop display parameter is specifically the length to width ratio of the presenter display.
4. A method for measuring attention of a participant according to any one of claims 1-3, wherein the level of attention in step 700) is determined by the range of values of attention of the participant.
5. A method as defined in claim 4, wherein the attention levels of the participants in step 700) are displayed in different colors.
6. The method for measuring attention of a participant according to claim 4 wherein said step 500) of obtaining an area of the participant 'S shared desktop on the display screen of the participant S1' includes removing portions of the area covered by other display windows.
7. The method for measuring attention of a participant according to claim 5, wherein said levels of attention are displayed in the order of green, yellow and red, respectively, from high to low.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110187053.9A CN112565669B (en) | 2021-02-18 | 2021-02-18 | Method for measuring attention of participants in network video conference |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110187053.9A CN112565669B (en) | 2021-02-18 | 2021-02-18 | Method for measuring attention of participants in network video conference |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112565669A CN112565669A (en) | 2021-03-26 |
| CN112565669B true CN112565669B (en) | 2021-05-11 |
Family
ID=75035930
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110187053.9A Active CN112565669B (en) | 2021-02-18 | 2021-02-18 | Method for measuring attention of participants in network video conference |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112565669B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113783709B (en) * | 2021-08-31 | 2024-03-19 | 重庆市易平方科技有限公司 | Conference participant monitoring and processing method and device based on conference system and intelligent terminal |
| CN114816308B (en) * | 2022-06-28 | 2022-09-20 | 深圳乐播科技有限公司 | Information partition display method and related equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102883134A (en) * | 2012-11-01 | 2013-01-16 | 成都飞视美视频技术有限公司 | Screen sharing and controlling method for video conference system |
| CN105072189A (en) * | 2015-08-18 | 2015-11-18 | 广东威创视讯科技股份有限公司 | Desktop area sharing method and system |
| CN105340264A (en) * | 2013-06-27 | 2016-02-17 | 思科技术公司 | Generating video pane layout |
| CN107071331A (en) * | 2017-03-08 | 2017-08-18 | 苏睿 | Method for displaying image, device and system, storage medium and processor |
| CN107509052A (en) * | 2017-09-08 | 2017-12-22 | 广州视源电子科技股份有限公司 | Double-current video conference method, device, electronic equipment and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4500026B2 (en) * | 2003-09-10 | 2010-07-14 | パイオニア株式会社 | Communication device |
-
2021
- 2021-02-18 CN CN202110187053.9A patent/CN112565669B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102883134A (en) * | 2012-11-01 | 2013-01-16 | 成都飞视美视频技术有限公司 | Screen sharing and controlling method for video conference system |
| CN105340264A (en) * | 2013-06-27 | 2016-02-17 | 思科技术公司 | Generating video pane layout |
| CN105072189A (en) * | 2015-08-18 | 2015-11-18 | 广东威创视讯科技股份有限公司 | Desktop area sharing method and system |
| CN107071331A (en) * | 2017-03-08 | 2017-08-18 | 苏睿 | Method for displaying image, device and system, storage medium and processor |
| CN107509052A (en) * | 2017-09-08 | 2017-12-22 | 广州视源电子科技股份有限公司 | Double-current video conference method, device, electronic equipment and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112565669A (en) | 2021-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3298509B1 (en) | Prioritized display of visual content in computer presentations | |
| CN112565669B (en) | Method for measuring attention of participants in network video conference | |
| US6646673B2 (en) | Communication method and terminal | |
| US10235574B2 (en) | Image-capturing device, recording device, and video output control device | |
| US20160173818A1 (en) | Method, device, and display device for switching video source | |
| CN101394479B (en) | Teacher movement tracing method based on movement detection combining multi-channel fusion | |
| KR20160125972A (en) | Displaying a presenter during a video conference | |
| US6608644B1 (en) | Communication system | |
| EP2961158A1 (en) | Method and device for displaying conference material in video conference | |
| CN104135641A (en) | Tool of mobile terminal and server for intelligently integrating audio and video | |
| CN108712627A (en) | Video conference content and quality detection apparatus and detection method | |
| EP1186128B1 (en) | Method and device for detecting data concerning the viewing of video information and the relaying of this information to a central data processing installation | |
| CN104601929A (en) | Remote teaching video interaction system | |
| Leszczuk et al. | Determining image quality requirements for recognition tasks in generalized public safety video applications: Definitions, testing, standardization, and current trends | |
| CN111163280B (en) | Asymmetric video conference system and method thereof | |
| WO2021115255A1 (en) | Method, apparatus, and system for evaluating sensation of vr experience | |
| KR101939130B1 (en) | Methods for broadcasting media contents, methods for providing media contents and apparatus using the same | |
| CN111093028A (en) | Information processing method and electronic equipment | |
| CN209748700U (en) | Remote video conference system | |
| DE112019005601T5 (en) | INFORMATION PROCESSING DEVICE AND METHOD AND PROGRAM | |
| KR102291542B1 (en) | Method and apparatus for synchronizing user feedback information of content streaming service | |
| CN116795464A (en) | Method for realizing remote assistance and related equipment | |
| WO2021245759A1 (en) | Voice conference device, voice conference system, and voice conference method | |
| CN106301815B (en) | Dynamic background sharing method and system based on voice chat room | |
| KR102034277B1 (en) | The system of conference live streaming broadcasting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |