CN111147792A - Method and equipment for completing video conference record - Google Patents
Method and equipment for completing video conference record Download PDFInfo
- Publication number
- CN111147792A CN111147792A CN201911235065.3A CN201911235065A CN111147792A CN 111147792 A CN111147792 A CN 111147792A CN 201911235065 A CN201911235065 A CN 201911235065A CN 111147792 A CN111147792 A CN 111147792A
- Authority
- CN
- China
- Prior art keywords
- conference
- video
- participant
- audio
- abnormal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method and a device for completing video conference records, wherein the method comprises the following steps: monitoring the audio and video states of the participants in the current ongoing video conference in real time; according to the monitored audio and video states, when the conference state of the participant is identified to be abnormal, the participant with abnormal conference and an abnormal time node are marked; starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying; the problem of missing conference content when the conference is abnormal due to various active or passive reasons of participants in the video conference process is solved, the conference content which is possibly missing is effectively supplemented, and the quality and the conference efficiency of the video conference are improved; for the user side, the user experience is improved.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a method and equipment for completing video conference records.
Background
A video conference can be simply understood as: the individuals or groups in two or more different places transmit the sound, the image and the file data to each other through the transmission line and the multimedia equipment, so as to realize the real-time interactive teleconference.
At present, with the high-speed development of internet technology, demands of office globalization and office high efficiency enable more and more users using network video conference products, the market scale of video conference systems is continuously enlarged, and the use of video conference systems gradually enters various industries. In the process of video conference, the participants of the video conference inevitably have the following situations: for active or passive reasons, the participants at other places of the video conference cannot hear the sound of the participant who pronounces at the place A, or the video conference system detects that the participant at the place A is not in front of the conference screen and the participants at other places speak; how to avoid the above situation, the a-site participant will not miss the meeting content of the ongoing video conference, which is one of the problems to be solved at present.
Disclosure of Invention
The invention provides a method and equipment for complementing video conference records, and aims to solve the problem of missing conference contents when a conference is abnormal due to various active or passive reasons of participants in a video conference process.
In order to achieve the above object, the present invention provides a method for completing a video conference recording, the method comprising:
monitoring the audio and video states of the participants in the current ongoing video conference in real time;
according to the monitored audio and video states, when the conference state of the participant is identified to be abnormal, the participant with abnormal conference and an abnormal time node are marked;
starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying.
Further, the method for completing the video conference record further comprises:
and when the conference state of the participants is monitored to be recovered to be normal, finishing the information conversion task, and simultaneously continuing to monitor the state corresponding to the video conference.
Further, the method for completing the video conference record further comprises:
pre-configuring and storing participant characteristic information and participant attribute information for participating in the video conference;
wherein the participant characteristic information includes: the biological characteristic information of the participants can be uniquely determined; the conference attribute information includes: meeting address, meeting starting and ending time, number of participants, participant characteristic information respectively matched with different meeting addresses, participant position information, importance degree information matched with the contents of the video meeting of the participants and the video meeting of the time, and association degree information of the participants and the video meeting of the time.
Further, the real-time monitoring of the audio and video states of the participants in the currently ongoing video conference includes:
and monitoring the audio and video state of each participant corresponding to each conference address respectively in real time by using an audio and video sensor and taking the conference address corresponding to the parameter attribute information as a unit and referring to the pre-configured characteristic information of the participants.
Further, the identifying that the conference state of the participant is abnormal according to the audio and video state includes:
according to the audio and video state, recognizing that the time that the distance between the participant and the conference screen exceeds the preset range is longer than the preset time, or recognizing that the conference state of the participant is abnormal when the conference state of the participant who is speaking is a mute state.
Further, the identifying that the conference state of the participant is abnormal according to the monitored audio and video state comprises:
let the number of occurrences of the J-type condition in the ith conference be Kij, and the feature of the audio in the unit time when the J-type condition occurs in the mth conference be Vijm, where i is 1,2,3, …, n, J is 1,2,3, …, J, M is 1,2,3, …, M, and the probability of the J-type condition occurring in the nth +1 conference be P(n+1)jComprises the following steps:
wherein, αjFor a normalized coefficient, the calculation formula is as follows:
when the characteristic of the audio in the (n + 1) th conference unit time is V, the probability of the audio being in the j-type condition is PjComprises the following steps:
according to PjThe abnormal meeting state of the participants can be identified by the value of (1);
wherein, PjThe most likely situation of the current conference is the situation category corresponding to the maximum value.
Further, the audio and video information corresponding to the video conference is converted into text information, and the text information is pushed to a conference screen of a participant to be displayed, and the method comprises the following steps:
after corresponding audio and video information in the video conference is converted into text information, according to different types of abnormal states, a pushing scheme matched with the abnormal states is adopted, and the text information is pushed to a corresponding conference screen to be displayed.
In order to achieve the above object, the present invention further provides an apparatus for completing a video conference recording, the apparatus including a memory and a processor, the memory storing thereon a recording completion program operable on the processor for completing the video conference recording, the recording completion program when executed by the processor implementing the steps of:
monitoring the audio and video states of the participants in the current ongoing video conference in real time;
according to the audio and video state, when the conference state of the participants is identified to be abnormal, the participants with abnormal conference and abnormal time nodes are marked;
starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying.
Further, the record completion program may be further executable by the processor to perform the steps of:
and when the conference state of the participants is monitored to be recovered to be normal, finishing the information conversion task, and simultaneously continuing to monitor the state corresponding to the video conference.
Further, the recording completion program may be further executed by the processor to identify that the conference state of the participant is abnormal according to the monitored audio/video state, and the identifying includes:
let the number of occurrences of the J-type condition in the ith conference be Kij, and the feature of the audio in the unit time when the J-type condition occurs in the mth conference be Vijm, where i is 1,2,3, …, n, J is 1,2,3, …, J, M is 1,2,3, …, M, and the probability of the J-type condition occurring in the nth +1 conference be P(n+1)jComprises the following steps:
wherein, αjFor a normalized coefficient, the calculation formula is as follows:
when the characteristic of the audio in the (n + 1) th conference unit time is V, the probability of the audio being in the j-type condition is PjComprises the following steps:
according to PjThe abnormal meeting state of the participants can be identified by the value of (1);
wherein, PjThe most likely situation of the current conference is the situation category corresponding to the maximum value.
Further, the record completion program may be further executable by the processor to perform the steps of:
pre-configuring and storing participant characteristic information and participant attribute information for participating in the video conference;
wherein the participant characteristic information includes: the biological characteristic information of the participants can be uniquely determined; the conference attribute information includes: meeting address, meeting starting and ending time, number of participants, participant characteristic information respectively matched with different meeting addresses, participant position information and importance degree information matched with the contents of the video meeting of the participants.
Further, the record completion program may be further executable by the processor to perform the steps of:
by utilizing an audio/video sensor, taking a conference address corresponding to the parameter attribute information as a unit, referring to the pre-configured characteristic information of the participants, and monitoring the audio/video state of each participant corresponding to each conference address in real time;
according to the audio and video state, recognizing that the time that the distance between a participant and the conference screen exceeds a preset range is longer than a preset time, or recognizing that the conference state of the participant is abnormal when the conference state of the participant who is speaking is a mute state;
when the meeting state of the participants is identified to be abnormal, the participants with abnormal meeting and abnormal time nodes are marked;
starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a corresponding conference screen for displaying by adopting a pushing scheme matched with the abnormal state according to different types of the abnormal state.
The method and the equipment for completing the video conference record can achieve the following beneficial effects:
monitoring the audio and video states of the participants in the current ongoing video conference in real time; according to the monitored audio and video states, when the conference state of the participant is identified to be abnormal, the participant with abnormal conference and an abnormal time node are marked; starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying; the problem of missing conference content when the conference is abnormal due to various active or passive reasons of participants in the video conference process is solved, the conference content which is possibly missing is effectively supplemented, and the quality and the conference efficiency of the video conference are improved; for the user side, the user experience is improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described below by means of the accompanying drawings and examples.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic flow chart diagram illustrating one embodiment of a method for completing a videoconference recording of the present invention;
fig. 2 is a schematic internal structure diagram of an embodiment of the apparatus for completing a videoconference recording according to the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
The invention provides a method and equipment for completing video conference records, which are used for automatically completing the video conference records under the condition that abnormity possibly occurs in the video conference process (for example, a participant who pronounces is in a mute state, or the participant is not in front of a conference screen for a certain time, and the like) in order to avoid the condition that the participant possibly lacks conference contents.
As shown in fig. 1, fig. 1 is a schematic flow chart of an embodiment of a method for completing a video conference recording according to the present invention; the method of complementing video conference recordings of the present invention may be implemented as steps S10-S30 described as follows:
step S10, monitoring the audio and video state of the participants in the current video conference in real time;
in the embodiment of the invention, in the whole process of the video conference, the system monitors the audio and video states of all participants participating in the video conference in real time by utilizing various sensors which are pre-configured in a conference room corresponding to the video conference.
The sensors described in the embodiments of the present invention may be configured according to a specific application scenario, and the embodiments of the present invention do not limit the type and number of the sensors that need to be configured for a video conference. In one particular application scenario, the types of sensors used in the method of completing a video conference recording include, but are not limited to: a camera and an audio pickup;
further, in one embodiment, in order to more comprehensively monitor the audio and video states of the participants in the current ongoing video conference, the feature information and the attribute information of the participants participating in the current video conference are configured and stored in advance;
wherein the participant characteristic information includes: the biological characteristic information of the participants can be uniquely determined, such as various types of biological characteristic information required by face recognition and/or iris recognition technology; the conference attribute information includes: meeting address, meeting starting and ending time, number of participants, participant characteristic information respectively matched with different meeting addresses, participant position information, importance degree information matched with the contents of the video meeting of the participants, association degree information of the participants and the video meeting theme of the time and the like.
Based on the configured participant characteristic information and participant attribute information of the current video conference, when monitoring the audio and video states of the participants in the current video conference in real time, the method can be implemented as follows:
and monitoring the audio and video state of each participant corresponding to each conference address respectively in real time by using an audio and video sensor and taking the conference address corresponding to the parameter attribute information as a unit and referring to the pre-configured characteristic information of the participants. For example, for several different conference addresses participating in the video conference, the audio and video states of the participants corresponding to the conference addresses are integrated to perform integrated identification and judgment.
Step S20, according to the monitored audio and video state, when the meeting state of the participants is identified to be abnormal, the participants with abnormal meeting and abnormal time nodes are marked;
and step S30, starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for display.
In the embodiment of the invention, after the audio and video states corresponding to all the participants are monitored by using various configured sensors for monitoring the audio and video states, whether the current conference states of all the participants are abnormal or not is identified and judged according to the audio and video states of all the participants.
When the conference state of the participants is identified and judged to be abnormal, specific analysis and judgment need to be performed according to different participants of different conference addresses in a specific application scene. For example, the conference address for participating in the video conference includes three locations, namely location a, location B and location C. And at the same time, regarding the participants at the site B and/or the site C, the participant m at the site A is in a mute state at the moment, and the conference state of the participant m at the site A is recognized to be abnormal at the moment.
For another example, in the same application scenario, a participant m at the current location a speaks to identify a participant n at the location B, and the time that the distance between the participant m and the conference screen exceeds the preset range is longer than the preset time duration, for example, the time that the participant n at the location B is not in front of the conference screen exceeds three minutes, then it is identified that the conference state of the participant n at the location B is abnormal.
In addition, the judgment rule for whether the conference state is abnormal or not may also be judged according to the participant attribute information corresponding to the participants in different application scenarios, for example: the method and the device are configured according to position information of the participants, and/or importance degree information matched with the contents of the video conference, and/or association degree information of the participants and the video conference theme, and the like.
Aiming at the condition that the meeting state of the participants is abnormal due to the fact that the time that the distance between the participants and the meeting screen exceeds the preset range is longer than the preset time, the condition that the participants leave midway and finish participating in the video meeting in advance needs to be eliminated. The mode of eliminating the abnormal condition can be realized by manually triggering an instruction by a user or by judging by the system according to a configured identification rule. The embodiment of the present invention does not limit this.
When the conference state of the participants who participate in the video conference is identified to be abnormal, the system marks the participants with abnormal conference and abnormal time nodes; starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying. When the operation of converting the audio and video information into the text information is executed, data processing and data conversion between the information can be carried out according to the configuration of the system corresponding to the video conference. The embodiment of the invention does not limit the specific conversion mode for converting the audio/video information into the text information.
Further, in order to improve the accuracy of text pushing, after corresponding audio and video information in a video conference is converted into text information, a pushing scheme matched with abnormal states can be adopted according to different types of the abnormal states corresponding to participants, and the text information is pushed to a corresponding conference screen to be displayed.
Further, in an embodiment of the present invention, in order to ensure the quality of the video conference, a real-time monitoring operation is performed in the entire video conference process, so that when it is monitored that the conference state of the participant returns to normal, the information conversion task is ended, and meanwhile, the state monitoring corresponding to the video conference is continued, and the above process is repeatedly performed.
Further, in an embodiment of the present invention, in an actual application scenario, various conditions may occur during a conference, such as device damage, device failure, exceeding of an audio/video collection range, abnormal state of a participant, and the like, and the abnormal conditions are identified in time and accurately through information such as audio/video and the like, and relevant processing is performed according to the abnormal conditions, which is particularly important for the conference, such as timely identifying device failure, performing complete processing on conference information, simultaneously informing the participant of a failure reason, or timely alarming or making an emergency call, so that the safety of the participants can be effectively guaranteed. For the identification of these pieces of information, this is done as follows:
let the number of occurrences of the J-type condition in the ith conference be Kij, and the feature of the audio in the unit time when the J-type condition occurs in the mth conference be Vijm, where i is 1,2,3, …, n, J is 1,2,3, …, J, M is 1,2,3, …, M, and the probability of the J-type condition occurring in the nth +1 conference be P(n+1)jComprises the following steps:
wherein, αjFor a normalized coefficient, the calculation formula is as follows:
when the characteristic of the audio in the (n + 1) th conference unit time is V, the probability of the audio being in the j-type condition is PjComprises the following steps:
according to PjThe abnormal meeting state of the participants can be identified by the value of (1);
wherein, PjThe situation type corresponding to the maximum value is the most likely situation of the current conference, and corresponding countermeasures can be taken according to the situation.
The method for complementing the video conference record monitors the audio and video states of the participants in the current ongoing video conference in real time; according to the monitored audio and video states, when the conference state of the participant is identified to be abnormal, the participant with abnormal conference and an abnormal time node are marked; starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying; the problem of missing conference content when the conference is abnormal due to various active or passive reasons of participants in the video conference process is solved, the conference content which is possibly missing is effectively supplemented, and the quality and the conference efficiency of the video conference are improved; for the user side, the user experience is improved.
Based on the description of the embodiment of fig. 1, the invention further provides a device for completing the video conference record; the device for completing the video conference recording can implement the method for completing the video conference recording described in the embodiment of fig. 1, thereby solving the problem of missing conference contents when a conference is abnormal due to various active or passive reasons of participants in the video conference process, and automatically completing the video conference recording.
Fig. 2 is a schematic diagram of the internal structure of an embodiment of the apparatus for completing a video conference recording according to the present invention, as shown in fig. 2. In the embodiment shown in fig. 2, the device 1 for complementing video conference records (hereinafter referred to as "recording complementing device") may be a PC (Personal Computer), or may be a terminal device such as a smart phone, a tablet Computer, or a portable Computer. The record complementing device 1 comprises at least a memory 11, a processor 12, a communication bus 13, and a network interface 14.
The memory 11 includes at least one type of readable storage medium, which includes a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, and the like. The memory 11 may in some embodiments be an internal storage unit of the record complementing device 1, e.g. a hard disk of the record complementing device 1. The memory 11 may also be an external storage device of the recording and complementing device 1 in other embodiments, such as a plug-in hard disk provided on the recording and complementing device 1, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like. Further, the memory 11 may also include both an internal storage unit of the record complementing device 1 and an external storage device. The memory 11 may be used not only to store application software installed in the record complementing device 1 and various types of data, such as a code of the record complementing program 01, but also to temporarily store data that has been output or is to be output.
The processor 12 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor or other data Processing chip in some embodiments, and is used for executing program codes stored in the memory 11 or Processing data, such as executing the record completion program 01.
The communication bus 13 is used to realize connection communication between these components.
The network interface 14 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), typically used to establish a communication link between the apparatus 1 and other electronic devices.
Optionally, the apparatus 1 may further comprise a user interface, which may comprise a Display (Display), an input unit such as a Keyboard (Keyboard), and optionally a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, or the like. The display, which may also be referred to as a display screen or display unit, is suitable for displaying information processed in the recording and replenishment apparatus 1 and for displaying a visual user interface.
Fig. 2 shows only the recording and complementing device 1 with the components 11-14 and the recording and complementing program 01, and it will be understood by those skilled in the art that the structure shown in fig. 2 does not constitute a limitation of the recording and complementing device 1, and may comprise fewer or more components than those shown, or some components may be combined, or a different arrangement of components.
In the embodiment of the apparatus 1 shown in fig. 2, a recording completion program 01 is stored in the memory 11; the record completion program 01 stored in the memory 11 is executable on the processor 12, and when the access program 01 is executed by the processor 12, the following steps are implemented:
monitoring the audio and video states of the participants in the current ongoing video conference in real time;
according to the audio and video state, when the conference state of the participants is identified to be abnormal, the participants with abnormal conference and abnormal time nodes are marked;
starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying.
In one embodiment, the recording completion program may be further executed by the processor to identify that the conference state of the participant is abnormal according to the monitored audio/video state, and the identifying includes:
let the number of occurrences of the J-type condition in the ith conference be Kij, and the feature of the audio in the unit time when the J-type condition occurs in the mth conference be Vijm, where i is 1,2,3, …, n, J is 1,2,3, …, J, M is 1,2,3, …, M, and the probability of the J-type condition occurring in the nth +1 conference be P(n+1)jComprises the following steps:
wherein, αjFor a normalized coefficient, the calculation formula is as follows:
when the characteristic of the audio in the (n + 1) th conference unit time is V, the probability of the audio being in the j-type condition is PjComprises the following steps:
according to PjThe abnormal meeting state of the participants can be identified by the value of (1);
wherein, PjThe most likely situation of the current conference is the situation category corresponding to the maximum value.
In one embodiment, the record completion program is further executable by the processor to perform the steps of:
and when the conference state of the participants is monitored to be recovered to be normal, finishing the information conversion task, and simultaneously continuing to monitor the state corresponding to the video conference.
In one embodiment, the record completion program is further executable by the processor to perform the steps of:
pre-configuring and storing participant characteristic information and participant attribute information for participating in the video conference;
wherein the participant characteristic information includes: the biological characteristic information of the participants can be uniquely determined; the conference attribute information includes: meeting address, meeting starting and ending time, number of participants, participant characteristic information respectively matched with different meeting addresses, participant position information and importance degree information matched with the contents of the video meeting of the participants.
In one embodiment, the record completion program is further executable by the processor to perform the steps of:
by utilizing an audio/video sensor, taking a conference address corresponding to the parameter attribute information as a unit, referring to the pre-configured characteristic information of the participants, and monitoring the audio/video state of each participant corresponding to each conference address in real time;
according to the audio and video state, recognizing that the time that the distance between a participant and the conference screen exceeds a preset range is longer than a preset time, or recognizing that the conference state of the participant is abnormal when the conference state of the participant who is speaking is a mute state;
when the meeting state of the participants is identified to be abnormal, the participants with abnormal meeting and abnormal time nodes are marked;
starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a corresponding conference screen for displaying by adopting a pushing scheme matched with the abnormal state according to different types of the abnormal state.
In the embodiment of the present invention, the working principle of the recording completion device is substantially the same as the working principle of the method for completing video conference recording described in the embodiment of fig. 1, and details are not repeated again in the embodiment of the present invention.
The invention supplements the video conference recording equipment, and monitors the audio and video states of the participants in the current ongoing video conference in real time; according to the monitored audio and video states, when the conference state of the participant is identified to be abnormal, the participant with abnormal conference and an abnormal time node are marked; starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying; the problem of missing conference content when the conference is abnormal due to various active or passive reasons of participants in the video conference process is solved, the conference content which is possibly missing is effectively supplemented, and the quality and the conference efficiency of the video conference are improved; for the user side, the user experience is improved.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A method of completing a video conference recording, the method comprising:
monitoring the audio and video states of the participants in the current ongoing video conference in real time;
according to the monitored audio and video states, when the conference state of the participant is identified to be abnormal, the participant with abnormal conference and an abnormal time node are marked;
starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying.
2. The method of completing a videoconference recording of claim 1, further comprising:
and when the conference state of the participants is monitored to be recovered to be normal, finishing the information conversion task, and simultaneously continuing to monitor the state corresponding to the video conference.
3. A method of completing a videoconference record according to claim 1 or 2, further comprising:
pre-configuring and storing participant characteristic information and participant attribute information for participating in the video conference;
wherein the participant characteristic information includes: the biological characteristic information of the participants can be uniquely determined; the conference attribute information includes: meeting address, meeting starting and ending time, number of participants, participant characteristic information respectively matched with different meeting addresses, participant position information, importance degree information matched with the contents of the video meeting of the participants and the video meeting of the time, and association degree information of the participants and the video meeting of the time.
4. A method of completing a videoconference record as claimed in claim 3, wherein said monitoring in real time the audio-visual status of the participants in the currently ongoing videoconference comprises:
and monitoring the audio and video state of each participant corresponding to each conference address respectively in real time by using an audio and video sensor and taking the conference address corresponding to the parameter attribute information as a unit and referring to the pre-configured characteristic information of the participants.
5. The method of completing a videoconference record according to claim 1 or claim 2, wherein said identifying that the conference state of the participant is abnormal based on the monitored audio-visual state comprises:
let the number of occurrences of the J-type condition in the ith conference be Kij, and the feature of the audio in the unit time when the J-type condition occurs in the mth conference be Vijm, where i is 1,2,3, …, n, J is 1,2,3, …, J, M is 1,2,3, …, M, and the probability of the J-type condition occurring in the nth +1 conference be P(n+1)jComprises the following steps:
wherein, αjFor a normalized coefficient, the calculation formula is as follows:
when the characteristic of the audio in the (n + 1) th conference unit time is V, the probability of the audio being in the j-type condition is PjComprises the following steps:
according to PjThe abnormal meeting state of the participants can be identified by the value of (1);
wherein, PjThe most likely situation of the current conference is the situation category corresponding to the maximum value.
6. The method for completing a video conference record according to claim 1 or 2, wherein the converting the corresponding audio and video information in the video conference into text information and pushing the text information to a conference screen of a participant for display comprises:
after corresponding audio and video information in the video conference is converted into text information, according to different types of abnormal states, a pushing scheme matched with the abnormal states is adopted, and the text information is pushed to a corresponding conference screen to be displayed.
7. An apparatus for completing a videoconference recording, the apparatus comprising a memory and a processor, the memory having stored thereon a recording completion program operable on the processor for completing a videoconference recording, the recording completion program when executed by the processor performing the steps of:
monitoring the audio and video states of the participants in the current ongoing video conference in real time;
according to the audio and video state, when the conference state of the participants is identified to be abnormal, the participants with abnormal conference and abnormal time nodes are marked;
starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a conference screen of a participant for displaying.
8. The apparatus for completing a videoconference record according to claim 7, wherein said record completion routine is further executable by said processor to identify an abnormality in the conference state of said participant based on said monitored audio-visual state, comprising:
let the number of occurrences of the J-type condition in the ith conference be Kij, and the feature of the audio in the unit time when the J-type condition occurs in the mth conference be Vijm, where i is 1,2,3, …, n, J is 1,2,3, …, J, M is 1,2,3, …, M, and the probability of the J-type condition occurring in the nth +1 conference be P(n+1)jComprises the following steps:
wherein, αjFor a normalized coefficient, the calculation formula is as follows:
when the characteristic of the audio in the (n + 1) th conference unit time is V, the probability of the audio being in the j-type condition is PjComprises the following steps:
according to PjThe abnormal meeting state of the participants can be identified by the value of (1);
wherein, PjThe most likely situation of the current conference is the situation category corresponding to the maximum value.
9. An apparatus for completing a videoconference recording according to claim 7 or 8, wherein said recording completion routine is further executable by said processor to perform the steps of:
pre-configuring and storing participant characteristic information and participant attribute information for participating in the video conference;
wherein the participant characteristic information includes: the biological characteristic information of the participants can be uniquely determined; the conference attribute information includes: meeting address, meeting starting and ending time, number of participants, participant characteristic information respectively matched with different meeting addresses, participant position information and importance degree information matched with the contents of the video meeting of the participants.
10. The apparatus for completing a videoconference recording of claim 9, wherein said recording completion routine is further executable by said processor to perform the steps of:
by utilizing an audio/video sensor, taking a conference address corresponding to the parameter attribute information as a unit, referring to the pre-configured characteristic information of the participants, and monitoring the audio/video state of each participant corresponding to each conference address in real time;
according to the audio and video state, recognizing that the time that the distance between a participant and the conference screen exceeds a preset range is longer than a preset time, or recognizing that the conference state of the participant is abnormal when the conference state of the participant who is speaking is a mute state;
when the meeting state of the participants is identified to be abnormal, the participants with abnormal meeting and abnormal time nodes are marked;
starting from the marked abnormal time node, starting an information conversion task, converting corresponding audio and video information in the video conference into text information, and pushing the text information to a corresponding conference screen for displaying by adopting a pushing scheme matched with the abnormal state according to different types of the abnormal state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911235065.3A CN111147792A (en) | 2019-12-05 | 2019-12-05 | Method and equipment for completing video conference record |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911235065.3A CN111147792A (en) | 2019-12-05 | 2019-12-05 | Method and equipment for completing video conference record |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111147792A true CN111147792A (en) | 2020-05-12 |
Family
ID=70517715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911235065.3A Pending CN111147792A (en) | 2019-12-05 | 2019-12-05 | Method and equipment for completing video conference record |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111147792A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110087014A (en) * | 2019-04-29 | 2019-08-02 | 努比亚技术有限公司 | Video complementing method, terminal and computer readable storage medium |
| CN111556279A (en) * | 2020-05-22 | 2020-08-18 | 腾讯科技（深圳）有限公司 | Monitoring method and communication method of instant session |
| CN111818389A (en) * | 2020-07-27 | 2020-10-23 | 联想(北京)有限公司 | Data processing method and device and computer readable storage medium |
| CN112261347A (en) * | 2020-10-14 | 2021-01-22 | 浙江大华技术股份有限公司 | Method and device for adjusting participation right, storage medium and electronic device |
| CN112307354A (en) * | 2020-12-31 | 2021-02-02 | 全时云商务服务股份有限公司 | Marketing information pushing method |
| CN113727055A (en) * | 2021-08-23 | 2021-11-30 | 董玉兰 | Video conference system and terminal equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012161089A1 (en) * | 2011-05-26 | 2012-11-29 | シャープ株式会社 | Teleconference device |
| CN106209725A (en) * | 2015-04-30 | 2016-12-07 | 中国电信股份有限公司 | Method, video conference central server and system for video conference certification |
| CN110139062A (en) * | 2019-05-09 | 2019-08-16 | 平安科技（深圳）有限公司 | A kind of creation method, device and the terminal device of video conference record |
-
2019
- 2019-12-05 CN CN201911235065.3A patent/CN111147792A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012161089A1 (en) * | 2011-05-26 | 2012-11-29 | シャープ株式会社 | Teleconference device |
| CN106209725A (en) * | 2015-04-30 | 2016-12-07 | 中国电信股份有限公司 | Method, video conference central server and system for video conference certification |
| CN110139062A (en) * | 2019-05-09 | 2019-08-16 | 平安科技（深圳）有限公司 | A kind of creation method, device and the terminal device of video conference record |
Non-Patent Citations (1)
| Title |
|---|
| 周厚奎: "概率主题模型的研究及其在多媒体主题发现和演化中的应用", 《中国博士学位论文全文数据库 信息科技辑》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110087014A (en) * | 2019-04-29 | 2019-08-02 | 努比亚技术有限公司 | Video complementing method, terminal and computer readable storage medium |
| CN110087014B (en) * | 2019-04-29 | 2022-04-19 | 努比亚技术有限公司 | Video completion method, terminal and computer-readable storage medium |
| CN111556279A (en) * | 2020-05-22 | 2020-08-18 | 腾讯科技（深圳）有限公司 | Monitoring method and communication method of instant session |
| CN111818389A (en) * | 2020-07-27 | 2020-10-23 | 联想(北京)有限公司 | Data processing method and device and computer readable storage medium |
| CN112261347A (en) * | 2020-10-14 | 2021-01-22 | 浙江大华技术股份有限公司 | Method and device for adjusting participation right, storage medium and electronic device |
| CN112307354A (en) * | 2020-12-31 | 2021-02-02 | 全时云商务服务股份有限公司 | Marketing information pushing method |
| CN113727055A (en) * | 2021-08-23 | 2021-11-30 | 董玉兰 | Video conference system and terminal equipment |
| CN113727055B (en) * | 2021-08-23 | 2024-03-01 | 董玉兰 | Video conference system and terminal equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111147792A (en) | Method and equipment for completing video conference record | |
| US8560315B2 (en) | Conference support device, conference support method, and computer-readable medium storing conference support program | |
| CN110659397B (en) | Behavior detection method and device, electronic equipment and storage medium | |
| US20190244034A1 (en) | Methods and apparatuses for processing video data | |
| US10148712B2 (en) | Automated social network introductions for e-meetings | |
| CN107078917A (en) | Trustship videoconference | |
| WO2021169616A1 (en) | Method and apparatus for detecting face of non-living body, and computer device and storage medium | |
| US20200019788A1 (en) | Computer system, resource arrangement method thereof and image recognition method thereof | |
| CN113163153A (en) | Method, device, medium and electronic equipment for processing violation information in video conference | |
| CN111144351A (en) | Image acquisition and analysis system and method for engineering progress | |
| CN110852196B (en) | Face recognition information display method and device | |
| CN110674728B (en) | Method, device, server and storage medium for playing mobile phone based on video image identification | |
| US20220141396A1 (en) | Video conferencing system and method of removing interruption thereof | |
| CN108763017B (en) | Application software data processing method, server side and storage medium for financial business | |
| US20160261828A1 (en) | Method, Device, and System for Multipoint Video Communication | |
| CN111191995A (en) | Method for realizing store intelligent monitoring and member-to-store intelligent reminding based on Internet platform | |
| US20230009336A1 (en) | Live video interaction method and apparatus, and computer device | |
| CN111695445A (en) | Face recognition method, device, equipment and computer readable storage medium | |
| CN111369703A (en) | Online time determination method, device, server and medium | |
| CN111192141A (en) | Risk assessment method and device based on remote photoplethysmography and storage medium | |
| CN115756256A (en) | Information labeling method, system, electronic equipment and storage medium | |
| CN115762523A (en) | Fault record acquisition method and device, electronic equipment and readable storage medium | |
| CN115205761A (en) | Accident reason off-line intelligent diagnosis system | |
| US11036971B2 (en) | Face recognition method and electronic device employing the method | |
| CN114945079A (en) | Video recording and invigilating method for online pen test, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200512 |