CN107357585B - Video acquisition method and device, video equipment and storage medium - Google Patents
Video acquisition method and device, video equipment and storage medium Download PDFInfo
- Publication number
- CN107357585B CN107357585B CN201710570118.1A CN201710570118A CN107357585B CN 107357585 B CN107357585 B CN 107357585B CN 201710570118 A CN201710570118 A CN 201710570118A CN 107357585 B CN107357585 B CN 107357585B
- Authority
- CN
- China
- Prior art keywords
- video
- data
- equipment
- local
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 230000005540 biological transmission Effects 0.000 claims description 42
- 238000006243 chemical reaction Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 20
- 238000012545 processing Methods 0.000 abstract description 9
- 230000002452 interceptive effect Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a video acquisition method, a video acquisition device, video equipment and a storage medium, wherein the method comprises the following steps: establishing a video conference connection between a local video device and at least one remote video device; converting screen data of a preset desktop acquired by local video equipment into video output data of a camera in video conference connection, wherein the screen data of the preset desktop is obtained by capturing a display picture of the preset desktop; and sending the video output data to the remote video equipment so that the remote video equipment displays the video output data in real time. By adopting the method, the technical problem that the processing process of displaying the shared data in real time by the remote video equipment is too complicated in the existing video conference process can be solved.
Description
Technical Field
The present invention relates to the field of multimedia technologies, and in particular, to a video acquisition method and apparatus, a video device, and a storage medium.
Background
With the development of multimedia technology, video conferencing has become the primary form of conferencing for cross-regional companies. Generally speaking, participants in different areas can make video connection through local video equipment to realize video conference.
For example, if a local participant wants to describe data such as a document, a video, a slide show, or a picture in a video conference, the data needs to be sent to a remote participant by mail or the like in advance. In the video conference process, the local conference participant and the remote conference participant respectively open the data, and the local conference participant informs the data display position of the remote conference participant so that the remote conference participant manually adjusts the data display position, and the data is displayed in real time in the remote video equipment. Or, performing secondary development on video conference software installed in the video device in advance, so that the video conference software can perform video coding on the displayed data in real time, and further send the video coded data to the remote video device, so as to realize real-time display of the data on the remote video device. The above scheme cannot be implemented without pre-developing the video conference software secondarily.
Disclosure of Invention
In view of this, embodiments of the present invention provide a video acquisition method, an apparatus, a video device, and a storage medium, so as to solve the technical problem that a processing process of displaying shared data in real time by a remote video device is too complicated in an existing video conference process.
In a first aspect, an embodiment of the present invention provides a video acquisition method, including:
establishing a video conference connection between a local video device and at least one remote video device;
converting screen data of a preset desktop acquired by the local video equipment into video output data of a camera in video conference connection, wherein the screen data of the preset desktop is obtained by capturing a display picture of the preset desktop;
and sending the video output data to the remote video equipment so that the remote video equipment displays the video output data in real time.
In a second aspect, an embodiment of the present invention further provides a video obtaining apparatus, including:
the connection establishing module is used for establishing video conference connection between the local video equipment and at least one remote video equipment;
the data conversion module is used for converting screen data of a preset desktop acquired by the local video equipment into video output data of a camera in video conference connection, wherein the screen data of the preset desktop is obtained by capturing a display picture of the preset desktop;
and the data sending module is used for sending the video output data to the remote video equipment so as to enable the remote video equipment to display the video output data in real time.
In a third aspect, an embodiment of the present invention further provides a video device, including:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the video acquisition method according to the embodiment of the present invention.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the video acquiring method according to the embodiment of the present invention.
According to the video acquisition method, the video acquisition device, the video equipment and the storage medium, after the video conference connection is established between the local video equipment and at least one remote video equipment, converting the screen data of the preset desktop acquired by the local video equipment into the video output data of the current camera, wherein the screen data of the preset desktop is obtained by capturing the display picture of the preset desktop and transmitting the video output data to the remote video equipment, the technical scheme for displaying the video output data in real time in the remote video equipment realizes that when a video conference is carried out, the screen data of the preset desktop of the video data of the non-local participants can be displayed in the remote video equipment in real time without changing or developing the video conference software in the local video equipment and the remote video equipment. Meanwhile, text data, video data, slide data, picture data and the like which need to be displayed by the local conference participants do not need to be sent to the remote conference participants in advance, and real-time display is achieved manually by the remote conference participants.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments made with reference to the following drawings:
fig. 1a is a flowchart of a video acquisition method according to an embodiment of the present invention;
FIG. 1b is a schematic diagram of a video conferencing system;
fig. 1c is a flowchart of a video acquisition method according to an embodiment of the present invention;
fig. 2a is a flowchart of a video acquisition method according to a second embodiment of the present invention;
FIG. 2b is a schematic diagram of an application scenario of a video conferencing system;
FIG. 2c is a data processing flow diagram of a video conferencing system;
fig. 3 is a flowchart of a video acquisition method according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a video capture device according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of a video apparatus according to a fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings.
Example one
Fig. 1a is a flowchart of a video acquisition method according to an embodiment of the present invention. The video acquisition method provided by the embodiment is suitable for the situation of carrying out a video conference on at least two remote video devices. The video acquisition method provided by this embodiment may be executed by a video conference apparatus, and the video conference apparatus may be implemented by software and/or hardware and integrated in a local video device.
Referring to fig. 1a, the video acquisition method provided in this embodiment specifically includes:
and S110, establishing a video conference connection between the local video equipment and at least one remote video equipment.
In this embodiment, the video conference is that at least two video devices that are not in the same location interact through the internet and perform video connection, so as to ensure that at least two participants that are not in the same location can perform normal conference communication through the video devices. Optionally, the video devices are all installed with video conference software based on Windows or android and other open platforms. Specifically, the video device used by the currently-hosted or hosted participant is a local video device, and the other video devices connected to the current local video device are remote video devices. Specifically, the local video device is provided with at least one actual camera. The remote video device may be the same video device as the local video device or a different video device.
Further, the establishment of the video conference connection between the local video device and the remote video device means that the video conference software in the local video device establishes a connection with the video conference software in the remote video device. The specific manner of establishing the connection is not limited in this embodiment.
Specifically, after the video conference connection is established, the local video device may perform video data transmission with the remote video device, where the video data are data conforming to a video protocol and a video format.
And S120, converting the screen data of the preset desktop acquired by the local video equipment into video output data of a camera in video conference connection.
Generally, the screen data of the preset desktop is different from the actual video data acquired by the actual camera. The actual video data is the spatial video data of the current local participant shot by the actual camera. In contrast, the screen data of the preset desktop is data obtained by capturing the display image of the preset desktop. Optionally, the preset desktop may be a desktop of a local video device, or a desktop of an intelligent device operated by a local participant, where the intelligent device may be directly connected to the local video device, or may be associated with the local video device through an intermediate device, and a specific connection manner thereof is not limited in this embodiment. Optionally, the smart device may be a smart phone, a tablet phone, a notebook computer, a desktop computer, or the like. Further, capturing the display image means performing a capturing operation on each pixel point of the current display image to obtain data having the same display content as that of the current display image, where the data includes information of each pixel point, and when other devices obtain the data, the display image of the preset desktop can be determined according to the information of each pixel point. The specific format of the data is not limited in this embodiment. For example, the data may be in a picture format, that is, performing a capture operation on each pixel point of the display screen generates picture data having the same display content, which is similar to a screenshot process. The display content may be text, slides, pictures, videos, and the like. Typically, when performing the grabbing operation, the grabbing frequency may be set, and the screen data may be acquired according to the grabbing frequency, so as to ensure the accuracy and effectiveness of the screen data. The capturing process can be regarded as a process of shooting screen data of a preset desktop in a video conference scene. In this embodiment, the screen data of the preset desktop is defaulted to data obtained by capturing all display frames of the preset desktop. In practical application, the screen data of the preset desktop may also be data obtained by capturing a part of display pictures in the preset desktop.
Optionally, when the local video device uses the desktop of the local video device as the preset desktop, the local participant may perform operations such as turning pages and sliding the screen data by operating the local video device or a control device (e.g., a smart pen or a remote controller) associated with the local video device.
Optionally, when the local video device uses the desktop of the intelligent device associated with the local video device as a preset desktop, the local participant may implement operations such as page turning and sliding of the screen data by controlling the intelligent terminal. Furthermore, after the local video device acquires the screen data of the preset desktop, the local video device may display the screen data on its own display screen or may not display the screen data to be displayed. In this embodiment, a preset desktop is taken as a desktop of the smart terminal for exemplary description. In practical application, a local participant may need to switch among a plurality of intelligent devices, and then the local video device needs to switch an input source of screen data of a preset desktop among the plurality of intelligent devices, and at this time, in order to simplify a switching process, the screen data of the desktop of the intelligent terminal may be transmitted to the local video device through the intermediate device. Optionally, the intermediate device is preferably a screen-passing device. The screen transmission device is a device capable of transmitting screen data of the intelligent device to the local video device in real time. At the moment, the screen transmission equipment is in wired or wireless connection with at least one intelligent device, and captures a display picture of a desktop of the at least one intelligent device to serve as screen data of a preset desktop and sends the screen data to the local video equipment. When a local participant is switched among a plurality of intelligent devices, the connection between the intelligent devices and the screen transmission device only needs to be switched, and the local video device does not need to switch an input source and only needs to continuously acquire screen data of a preset desktop sent by the screen transmission device. Generally speaking, the switching process of the connection between the intelligent device and the screen transmission device is much simpler than that of the connection between the local video device and the intelligent device.
Specifically, format conversion is performed on screen data of a preset desktop, so that the converted data has the same format as data output by an actual camera, and the data in the format is an input source supported by video conference software. Further, the format-converted data is used as video output data. The video output data can be regarded as data output after being shot by a camera currently used in the video conference connection.
Optionally, a virtual camera is installed in the local video device in advance, and the virtual camera is used to perform format conversion on screen data of a preset desktop to obtain video output data. The virtual camera is a type of application software which can simulate a real camera. The virtual camera may be a Universal Serial Bus (USB) device, or a Source Filter based on DirectShow. The DirectShow is a development kit for streaming media processing based on Component Object Model (COM), and the Source Filter is a video capture method. In general, application software that can output any input source supported by video conferencing software may be referred to as a virtual camera. Optionally, the data format output by the virtual camera of the local video device is the same as that output by the actual camera, and the video conference software supports the data in the format.
Optionally, when the screen data of the preset desktop is used as the video output data, if a local participant wants to transmit the video of the participant shot by the actual camera, the camera can be directly switched, and at the moment, the local video device switches the actual video data shot by the actual camera into the video output data shot by the current camera and inputs the video output data into the video conference software. It should be noted that, in the switching process, the local video device is not required to perform any operation on the video conference software, that is, the video conference software is not required to perform any switching operation of the input source in the video conference process, and only needs to continuously receive the video output data of the current camera sent by the local video device.
And S130, sending the video output data to the remote video equipment so that the remote video equipment can display the video output data in real time.
For example, sending the video output data to the remote video device means that the local video conference software sends the video output data to the video conference software of the remote video device. When the video conference software of the remote video device receives the video output data, the video output data is transmitted to the processor so that the processor displays the video output data on the desktop of the remote video device, and then the remote participants can watch the video output data in real time. In the process, the video conference software does not need to be developed for any second time, and the video conference software based on an open platform such as Windows or android can realize the operation.
Further, when the local party and the conference party operate the content of the current desktop display data, the remote video device can synchronously display the operation.
Application scenario example applicable to the embodiment:
fig. 1b is a schematic diagram of a video conference system. The local video device 11 may obtain screen data of the desktop of the smart device 13 through the screen transmission device 12. Further, after the local video device 11 establishes a connection with a remote video device (not shown), if a local participant needs to share a certain text document, the text document only needs to be opened and displayed in the intelligent device 13. At this time, the screen transfer device 12 captures the data on which the text document is displayed and transmits the data to the local video device 11 as screen data of a preset desktop. After receiving the screen data of the preset desktop, the local video device 11 converts the screen data of the preset desktop into video output data output by a camera in the current video conference connection, and uses the video output data as an input source of video conference software, so that the video conference software sends the video output data to the remote video device, and the remote video device is ensured to display the screen data of the desktop of the intelligent device 13 in real time. Further, when a local participant operates on a text document on the intelligent device 13, the remote video device may synchronously display the operation. At this time, the video conference software in the local video device 11 only needs to continuously acquire the video output data of the current camera without any change. Meanwhile, video conference software in the remote video equipment does not need to be changed, and only needs to continuously receive video output data.
In summary, after the video conference connection is established between the local video device and at least one remote video device, the screen data of the preset desktop acquired by the local video device is converted into the video output data of the current camera, where the screen data of the preset desktop is obtained by capturing the display image of the preset desktop, and the video output data is transmitted to the remote video device, so as to implement the technical scheme that the remote video device displays the video output data in real time. Meanwhile, text data, video data, slide data, picture data and the like which need to be displayed by the local conference participants do not need to be sent to the remote conference participants in advance, and real-time display is achieved manually by the remote conference participants.
Further, consider a class of application scenarios: local participants need to send the screen data of the preset desktop acquired by the local video equipment and send the pictures of the participants shot by the actual camera, namely, the actual video data acquired by the actual camera and the screen data of the preset desktop are sent to the remote video equipment together. In order to meet the application scenario and still not need to perform any operation on local video application software, in this embodiment, a technical scheme is further provided in which actual video data acquired by an actual camera and screen data of a preset desktop acquired by local video equipment are used together as video output data of the camera in a video conference connection, which is specifically shown in fig. 1 c:
s101, establishing video conference connection between the local video equipment and at least one remote video equipment.
And S102, combining actual video data shot by an actual camera and screen data of a preset desktop acquired by local video equipment.
Illustratively, when screen data of a preset desktop in the local video device is acquired, actual video data shot by an actual camera is acquired synchronously. Further, merging the screen data of the preset desktop with the actual video data, wherein the merging process specifically comprises the following steps: and merging the screen data and the actual video data of the preset desktop at the same acquisition moment according to the display style. The display style can be selected as the display proportion of the screen data of the preset desktop and the actual video data in the same display picture. The mixed data includes both the screen data of the current preset desktop and the actually shot video data.
And S103, converting the combined mixed data into video output data of a camera in video conference connection.
At this time, the processing manner of the mixed data is the same as the processing manner of the screen data of the preset desktop in S120, and details are not described herein.
And S104, sending the video output data to the remote video equipment so that the remote video equipment can display the video output data in real time.
Specifically, the remote video device can display the actual shooting data and the screen data of the preset desktop in real time, and does not need to perform any operation on the video conference software in the local video device and the remote video device.
Example two
Fig. 2a is a flowchart of a video acquisition method according to a second embodiment of the present invention. The present embodiment is embodied on the basis of the above-described embodiments. Specifically, referring to fig. 2a, the video acquiring method provided in this embodiment specifically includes:
s210, establishing video conference connection between the local video equipment and at least one remote video equipment.
And S220, acquiring screen data of a preset desktop.
In this embodiment, the acquiring of the screen data of the preset desktop specifically includes the following scheme:
according to the first scheme, screen data of a preset desktop sent by a screen transmission device are obtained.
Specifically, the screen transmission device is respectively connected with the local video device and the at least one intelligent device, where the connection mode may be wired connection or wireless connection, for example, the screen transmission device is wirelessly connected with the local video device and wired connected with the at least one intelligent device. Further, the preset desktop is the desktop of at least one intelligent device connected with the screen transmission device. When the screen transmission device is connected with the intelligent device, the screen transmission device can acquire the screen data of the desktop of the intelligent device in real time and send the screen data to the local video conference. Optionally, when the screen data is in a picture format, the screen transmission device acquires picture data of one frame, and sends the picture data of one frame to the local video device. Generally, the screen transmission device can only obtain the screen data of the desktop of one intelligent device at the same time. When the screen transmission equipment is connected with the intelligent equipment, the intelligent terminal for transmitting the screen data can be determined by local participants, and the intelligent terminal is operated, so that the screen transmission equipment acquires the screen data of the intelligent terminal.
Furthermore, when the connection between the screen transmission device and the local video device is established, receiving software of the screen transmission device is installed in the local video device, so that screen data sent by the screen transmission device can be received.
The screen transmission device has the advantage that when the local conference participants switch the intelligent device for use, no operation needs to be performed on the local video device or video conference software. Meanwhile, data needing to be shared in the intelligent device does not need to be copied to the local video device, and particularly when the local video device is a public device, data security is guaranteed.
Optionally, after receiving the screen data, the local video device may selectively display the screen data on the local display surface according to actual needs. When the screen data is displayed, the screen data can be displayed in a full screen mode, and other contents can be displayed simultaneously when the screen data is displayed.
Optionally, the wireless connection involved in the foregoing process may be: wireless connection modes such as wireless local area network, Bluetooth or infrared and the like. The wired connection may be: a USB socket connection or an IEEE 1394 socket connection.
And secondly, acquiring screen data of a desktop of the intelligent device, which is sent by at least one intelligent device connected with the local video device, as screen data of a preset desktop.
Specifically, the intelligent device is set with a function of capturing display content of a current desktop as screen data of a preset desktop, and sending the screen data to the local video device. During the connection of the video conference, the intelligent device can capture the display content of the current desktop in real time and encode the display content to obtain screen data, and then the screen data is sent to the local video device. And the local video equipment decodes the received screen data, and the decoded data is used as the screen data of the preset desktop. The local video device can be physically connected with the at least one intelligent device and acquires screen data of the at least one intelligent device. When the screen data of the plurality of intelligent devices are acquired, the plurality of screen data can be combined according to a preset display rule to obtain the screen data of the preset desktop. The display rule may be a display position or a display scale of the plurality of screen data in the current desktop, or the like.
It should be noted that the local video device may also directly obtain the screen data of its desktop as the display data to be sent. Such a scheme is applicable to a scenario where data that a local participant needs to share is stored in a local video device. At this point, the data can be opened and displayed directly in the local video device. Such schemes are also applicable to scenarios where a local participant shares data with a remote participant, and the data needs to be presented to other local participants. At this time, after the screen data sent by the screen transmission device is acquired, the data may be displayed in the local device, and the screen data of the desktop of the device itself may be acquired as the screen data of the preset desktop.
It should be noted that S220 may also be executed before S210, that is, screen data of a preset desktop in the local video device is obtained first, and then a video conference connection between the local video device and the remote video device is established.
And S230, writing the screen data of the preset desktop acquired by the local video equipment into the virtual camera through a preset data interface.
Specifically, a data interface for writing data into the virtual camera is preset, where a specific rule of the data interface is not limited in this embodiment, for example, the rule may be a memory sharing manner.
For example, when the local video device is wirelessly connected to the screen transmission device, data may be exchanged between the receiving software of the screen transmission device and the virtual camera through a preset data interface. Furthermore, after the screen data of the desktop of the intelligent terminal is acquired, the screen transmission device encodes the screen data and sends the encoded data to the local video device through the wireless sending port. The specific encoding method is not limited in this embodiment, and only the wireless communication protocol needs to be satisfied. Furthermore, the screen transmission equipment of the local video equipment receives the data received by the software, decodes the data to obtain the screen data of the preset desktop, and writes the screen data of the preset desktop into the virtual camera in a memory sharing mode according to the convention rule of the data interface.
And S240, converting screen data of the preset desktop by using the virtual camera to obtain video output data of the camera in video conference connection.
Further, the screen data of the preset desktop is converted into video output data through the virtual camera, wherein the video output data can be regarded as data "shot" by the virtual camera. When the video conference is connected, the virtual camera is used as a camera for shooting the video at present, and the video output data is used as the output data of the current camera.
Specifically, format conversion processing is performed on screen data of a preset desktop. Namely, on the premise of not changing the display content, writing the screen of the preset desktop into the virtual camera, so that the virtual camera converts the screen data of the preset desktop into the output format of the virtual camera, thereby realizing the shooting of the screen data of the preset desktop by the virtual camera. And in the video conference connection process, calling data in the virtual camera as video output data shot by the current camera and inputting the video output data into video conference software.
It should be noted that, format conversion may also be directly performed on screen data of a preset desktop to obtain data conforming to the output format of the virtual camera, and the data is directly written into the virtual camera, at this time, the virtual camera does not need to perform the operation of format conversion, and in the video conference process, the written data may be directly output as video output data.
And S250, sending the video output data to the remote video equipment so that the remote video equipment can display the video output data in real time.
Application scenario example applicable to the embodiment:
referring to fig. 2b, it is assumed that the local video device is an interactive conference tablet 21 configured with a Windows host system and installed with at least one camera. Further, the interactive conference tablet 21 is a touch-sensitive tablet and is larger than 50 inches. In general, the interactive conference tablet 21 may be placed in a conference room as a public device. Specifically, the interactive conference tablet 21 is installed with receiving software of a screen transmission device, a virtual camera, and video conference software of a third party.
Further, the interactive conference tablet 21 is wirelessly connected with the screen transmission device 22, and the screen transmission device 22 is connected with the notebook computer 23 by wire. The notebook computer 23 is a holding device for local participants. The screen data of the current desktop of the notebook computer 23 captured by the screen transmitting device 22 is picture data.
When a local participant wants to share a text document after the interactive conference tablet 21 establishes a video conference connection with at least one remote video device 24 via the internet, the local participant only needs to open the text document in the notebook computer 23. Referring to fig. 2c, it is a data processing flow diagram of the video conference system. Specifically, the screen transfer device 22 acquires screen data on which the text document is displayed to obtain picture data. Further, the picture data is video-encoded and sent to the interactive conference tablet 21. After receiving the data through the receiving software of the screen transmission device, the interactive conference tablet 21 decodes the data to obtain the screen data of the preset desktop, and writes the screen data of the preset desktop into the virtual camera according to the preset data interface, so that the virtual camera performs format conversion on the display data to be transmitted. Further, the data after the format conversion in the virtual camera is called as the video output data of the current camera and sent to the third-party video conference software, so that the third-party video conference software sends the video output data to the video conference software of the remote video device 24. At this time, the desktop display contents of the notebook computer 23 and the at least one remote video device 24 are the same and are the desktop display data of the text document, and the interactive conference tablet 21 selectively displays the desktop display data according to the actual requirement. Meanwhile, the text document is not stored in both the interactive conference tablet 21 and the at least one remote video device 24, and when the video conference is finished, the text document is not stored in both the interactive conference tablet 21 and the at least one remote video device 24, so that the security of the text document is further ensured. Further, if the displayed text document needs to be turned, displayed in a sliding manner, or marked, the local participant only needs to execute the corresponding operation at the notebook computer 23.
In summary, after the video conference connection between the local video device and the at least one remote video device is established, the screen data of the preset desktop is obtained, and the screen data of the preset desktop is written into the virtual camera through the data interface, so that the virtual camera converts the screen data of the preset desktop into video output data of the current camera connected to the video conference and sends the video output data to the remote video device, so that the remote video device displays corresponding display data in real time in the video conference process, text data, video data, slide data, picture data and the like which need to be displayed by a local participant are not required to be sent to a remote participant in advance, and the remote participant manually realizes real-time display. Meanwhile, video conference software in the local video equipment and the remote video equipment does not need to be changed or developed for the second time.
EXAMPLE III
Fig. 3 is a flowchart of a video acquisition method according to a third embodiment of the present invention. The present embodiment is embodied on the basis of the above-described embodiments. Specifically, referring to fig. 3, the video acquiring method provided in this embodiment includes:
s310, screen data of a preset desktop are obtained.
And S320, establishing the video conference connection between the local video equipment and at least one remote video equipment.
S330, converting the screen data of the preset desktop acquired by the local video equipment into video output data of a camera in video conference connection.
S340, confirming whether a video switching instruction is received. If yes, go to step S350. Otherwise, S360 is performed.
Specifically, the video switching instruction is an instruction for switching an input source of the video conference software, and may be sent by a local participant through a local video device or a control device associated with the local video device, and a specific sending form is not limited in this embodiment.
At present, the acquired screen data of the preset desktop is defaulted to data obtained by preferentially shooting in the video conference process. And if a video switching instruction is received, determining that the camera which is currently used for shooting needs to be switched, namely, taking the data which is shot in the other camera as video output data. In this embodiment, the setting of the video switching instruction may be to switch the data obtained by "shooting" by the current camera from the screen data of the preset desktop to the actual shooting data by default.
Optionally, when a virtual camera is set in the local video device, at least one virtual camera may be set, and each virtual camera has corresponding data, and correspondingly, the video switching instruction may also be an instruction for switching between virtual cameras, at this time, numbers may be provided for each virtual camera and the actual camera, and a number to be switched to the current camera is added to the video switching instruction, so as to implement switching of the cameras.
And S350, when the video switching instruction is confirmed to be received, acquiring actual video data shot by an actual camera of the local video equipment, and taking the actual video data as video output data of the camera in the video conference connection. S360 is performed.
Illustratively, an actual camera is taken as a camera currently performing shooting, actual video data shot by the actual camera is taken as video output data, and the video output data is sent to video conference software. The local video equipment automatically replaces the current camera without any operation on the video conference software, namely the video conference software only needs to continuously receive video output data of the current camera.
It should be noted that the number of the actual cameras may be at least one, and accordingly, the actual video data may be, by default, synthesized data captured by all the actual cameras. Optionally, only the shooting data of a single actual camera may be acquired, at this time, each actual camera may be numbered, and a corresponding number is added to the video switching instruction, or after the video switching instruction is received, it is prompted that a plurality of actual cameras exist at present, and a local participant selects to acquire the shooting data of one of the actual cameras, or acquires the shooting data of at least two actual cameras.
And S360, sending the video output data to the remote video equipment so that the remote video equipment can display the video output data in real time.
Optionally, S360 may be directly executed after S330, and S340 may be simultaneously executed during the process of executing S360 until the video conference is finished.
It should be noted that, in this embodiment, after the video conference connection is established by default, the screen data of the preset desktop is used as the video output data obtained by "shooting" by the current camera. In practical application, actual video data shot by an actual camera can be defaulted as video output data, and when a switching instruction is received, screen data of a preset desktop is switched to the video output data. Meanwhile, in the embodiment, the switching operation can be executed between the screen data of the preset desktop and the actual video data for many times according to the actual requirements of the local conference participants, and any operation on the video conference software is not required to be executed every time.
In summary, by obtaining the screen data of the preset desktop, and performing format conversion on the screen data of the preset desktop after establishing the video conference connection between the local video device and the remote video device, if a video switching instruction is not received, the converted screen data of the preset desktop is used as video output data, and if a video switching instruction is received, the actual video data shot by the actual camera is used as video output data, and the video output data is sent to the remote video device, switching between the screen data of the preset desktop and the actual video data is realized, and no operation is required to be performed on the video conference software. Meanwhile, text data, video data, slide data, picture data and the like which need to be displayed by the local conference participants do not need to be sent to the remote conference participants in advance, and real-time display is achieved manually by the remote conference participants.
Example four
Fig. 4 is a schematic structural diagram of a video capture device according to a fourth embodiment of the present invention. Referring to fig. 4, the video capture apparatus of the present embodiment includes: a connection establishing module 401, a data converting module 402 and a data transmitting module 403.
The connection establishing module 401 is configured to establish a video conference connection between a local video device and at least one remote video device; the data conversion module 402 is configured to convert screen data of a preset desktop acquired by a local video device into video output data of a camera in a video conference connection, where the screen data of the preset desktop is obtained by capturing a display image of the preset desktop; and a data sending module 403, configured to send the video output data to a remote video device, so that the remote video device displays the video output data in real time.
In summary, after a video conference connection is established between a local video device and at least one remote video device, screen data of a preset desktop acquired by the local video device is converted into video output data of a current camera, wherein the screen data of the preset desktop is data obtained by capturing a display picture of the preset desktop, and the video output data is transmitted to the remote video device, so as to realize real-time display of the video output data in the remote video device. Meanwhile, text data, video data, slide data, picture data and the like which need to be displayed by the local conference participants do not need to be sent to the remote conference participants in advance, and real-time display is achieved manually by the remote conference participants.
On the basis of the above embodiment, the method further includes: the data acquisition module is used for acquiring screen data of a preset desktop sent by the screen transmission equipment before or after the video conference connection between the local video equipment and at least one remote video equipment is established, wherein the preset desktop is the desktop of at least one intelligent device connected with the screen transmission equipment; or before or after the video conference connection between the local video equipment and the at least one remote video equipment is established, acquiring the screen data of the desktop of the intelligent equipment, which is sent by the at least one intelligent equipment connected with the local video equipment, as the screen data of the preset desktop.
On the basis of the above embodiment, the data conversion module 402 includes: the writing unit is used for writing the screen data of the preset desktop acquired by the local video equipment into the virtual camera through a preset data interface; and the conversion unit is used for converting the screen data of the preset desktop by using the virtual camera so as to obtain the video output data of the camera in the video conference connection.
On the basis of the above embodiment, the method further includes: and the data switching module is used for converting the screen data of the preset desktop acquired by the local video equipment into video output data of the camera in the video conference connection, acquiring actual video data shot by the actual camera of the local video equipment when a video switching instruction is confirmed to be received, and taking the actual video data as the video output data of the camera in the video conference connection.
On the basis of the above embodiment, the data conversion module 402 includes: the data merging unit is used for merging actual video data shot by an actual camera and screen data of a preset desktop acquired by local video equipment; and the mixed data conversion unit is used for converting the combined mixed data into video output data of a camera in video conference connection.
The video acquisition device provided by the embodiment of the invention can be used for executing the video acquisition method provided by any embodiment, and has corresponding functions and beneficial effects.
EXAMPLE five
Fig. 5 is a schematic structural diagram of a video apparatus according to a fifth embodiment of the present invention. As shown in fig. 5, the video apparatus includes a processor 50, a memory 51, a camera 52, a communication device 53, an input device 54, and an output device 55; the number of processors 50 in the video device may be one or more, and one processor 50 is taken as an example in fig. 5; the number of the cameras 52 in the video device may be one or more, and one camera 52 is taken as an example in fig. 5; the processor 50, the memory 51, the camera 52, the communication device 53, the input device 54 and the output device 55 in the video apparatus may be connected by a bus or other means, and the bus connection is exemplified in fig. 5.
The memory 51, which is a computer-readable storage medium, may be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the video acquisition method in the embodiment of the present invention (for example, the connection establishing module 401, the data converting module 402, and the data transmitting module 403 in the video acquisition apparatus). The processor 50 executes various functional applications and data processing of the video device by executing software programs, instructions and modules stored in the memory 51, that is, implements the video acquisition method described above.
The memory 51 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 51 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 51 may further include memory located remotely from processor 50, which may be connected to a video device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The camera 52 is an actual camera, and is configured to capture images of participants during a video conference and output actual video data.
The communication means 53 may be adapted to connect with at least one remote video apparatus and to transmit video output data to the at least one remote video apparatus; and the desktop management system is also used for connecting with the screen transmission equipment and acquiring the screen data of the preset desktop sent by the screen transmission equipment.
The input device 54 may be used to receive input numeric or character information and generate key signal inputs relating to user settings and function controls of the video apparatus. The output device 55 may include a display device such as a display screen.
The video device provided by the embodiment of the invention can execute the video acquisition method provided by any embodiment, and has corresponding functions and beneficial effects.
EXAMPLE six
An embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, perform a video acquisition method, where the video acquisition method includes:
establishing a video conference connection between a local video device and at least one remote video device;
converting screen data of a preset desktop acquired by local video equipment into video output data of a camera in video conference connection, wherein the screen data of the preset desktop is obtained by capturing a display picture of the preset desktop;
and sending the video output data to the remote video equipment so that the remote video equipment displays the video output data in real time.
Of course, the storage medium provided by the embodiment of the present invention includes computer-executable instructions, and the computer-executable instructions are not limited to the operations of the video obtaining method described above, and may also perform related operations in the video obtaining method provided by any embodiment of the present invention, and have corresponding functions and advantages.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, and the computer software product may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) to execute the video acquiring method according to the embodiments of the present invention.
It should be noted that, in the embodiment of the video obtaining apparatus, the included units and modules are only divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (6)
1. A video acquisition method, comprising:
establishing a video conference connection between a local video device and at least one remote video device;
converting screen data of a preset desktop acquired by the local video equipment into video output data of a camera in video conference connection, wherein the screen data of the preset desktop is obtained by capturing a display picture of the preset desktop;
sending the video output data to the remote video equipment so that the remote video equipment displays the video output data in real time;
before or after the video conference connection between the local video device and the at least one remote video device is established, the method further comprises the following steps:
acquiring screen data of a preset desktop sent by a screen transmission device, wherein the preset desktop is the desktop of at least one intelligent device connected with the screen transmission device, and the screen data of the preset desktop sent by the screen transmission device is the same as the screen data of the desktop of the intelligent device;
the screen transmission equipment is also connected with the local video equipment;
converting the screen data of the preset desktop acquired by the local video equipment into video output data of a camera in video conference connection comprises:
writing the screen data of the preset desktop acquired by the local video equipment into a virtual camera through a preset data interface;
and converting the screen data of the preset desktop by using the virtual camera to obtain the video output data of the camera in the video conference connection.
2. The video obtaining method according to claim 1, wherein after converting the screen data of the preset desktop obtained by the local video device into the video output data of the camera in the video conference connection, the method further comprises:
and when the video switching instruction is confirmed to be received, acquiring actual video data shot by an actual camera of the local video equipment, and taking the actual video data as video output data of the camera in video conference connection.
3. The video obtaining method according to claim 1, wherein the converting the screen data of the preset desktop obtained by the local video device into the video output data of the camera in the video conference connection comprises:
combining actual video data shot by an actual camera and screen data of a preset desktop acquired by the local video equipment;
and converting the combined mixed data into video output data of a camera in video conference connection.
4. A video acquisition apparatus, comprising:
the connection establishing module is used for establishing video conference connection between the local video equipment and at least one remote video equipment;
the data conversion module is used for converting screen data of a preset desktop acquired by the local video equipment into video output data of a camera in video conference connection, wherein the screen data of the preset desktop is obtained by capturing a display picture of the preset desktop;
the data sending module is used for sending the video output data to the remote video equipment so as to enable the remote video equipment to display the video output data in real time;
the data acquisition module is used for acquiring screen data of a preset desktop sent by the screen transmission equipment before or after a video conference connection between the local video equipment and at least one remote video equipment is established, wherein the preset desktop is the desktop of at least one intelligent equipment connected with the screen transmission equipment, and the screen data of the preset desktop sent by the screen transmission equipment is the same as the screen data of the desktop of the intelligent equipment;
the screen transmission equipment is also connected with the local video equipment;
the data conversion module includes:
the writing unit is used for writing the screen data of the preset desktop acquired by the local video equipment into the virtual camera through a preset data interface;
and the conversion unit is used for converting the screen data of the preset desktop by using the virtual camera so as to obtain the video output data of the camera in video conference connection.
5. A video apparatus, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the video acquisition method of any of claims 1-3.
6. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the video acquisition method according to any one of claims 1 to 3.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710570118.1A CN107357585B (en) | 2017-07-13 | 2017-07-13 | Video acquisition method and device, video equipment and storage medium |
| PCT/CN2017/103245 WO2019010827A1 (en) | 2017-07-13 | 2017-09-25 | Video acquisition method and apparatus, video device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710570118.1A CN107357585B (en) | 2017-07-13 | 2017-07-13 | Video acquisition method and device, video equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107357585A CN107357585A (en) | 2017-11-17 |
| CN107357585B true CN107357585B (en) | 2020-11-06 |
Family
ID=60292601
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710570118.1A Active CN107357585B (en) | 2017-07-13 | 2017-07-13 | Video acquisition method and device, video equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107357585B (en) |
| WO (1) | WO2019010827A1 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108156412A (en) * | 2017-12-19 | 2018-06-12 | 威创集团股份有限公司 | Data transmission method, device, user terminal and storage medium |
| CN111538468A (en) * | 2020-04-27 | 2020-08-14 | 威创集团股份有限公司 | Visual interface control method and system |
| CN111935540B (en) * | 2020-08-07 | 2022-06-28 | 北京飞讯数码科技有限公司 | Desktop sharing method and system between commanding and scheduling terminals |
| CN112422882A (en) * | 2020-12-02 | 2021-02-26 | 深圳市前海手绘科技文化有限公司 | Method and device for providing video source for video conference system |
| CN112804473A (en) * | 2020-12-18 | 2021-05-14 | 北京字跳网络技术有限公司 | Video conference presenting method and device, terminal equipment and storage medium |
| TWI807513B (en) * | 2021-12-03 | 2023-07-01 | 弘真科技股份有限公司 | Virtual video meeting system and meeting method |
| CN116347015B (en) * | 2023-05-26 | 2023-10-20 | 深圳市拔超科技股份有限公司 | System and method for smooth switching based on multiple USB cameras |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101674110A (en) * | 2009-10-21 | 2010-03-17 | 中兴通讯股份有限公司 | Method for implementing desktop sharing and control of mobile terminals and mobile terminal |
| CN101888519A (en) * | 2009-05-14 | 2010-11-17 | 华为技术有限公司 | Method for sharing desktop contents and intelligent equipment |
| CN102572578A (en) * | 2011-12-30 | 2012-07-11 | Tcl王牌电器(惠州)有限公司 | Method for displaying pictures of mobile terminal on television screen and screen-transmitting system |
| CN102883134A (en) * | 2012-11-01 | 2013-01-16 | 成都飞视美视频技术有限公司 | Screen sharing and controlling method for video conference system |
| CN103501310A (en) * | 2013-07-11 | 2014-01-08 | 广东工业大学 | Method for controlling computer desktop sharing based on video phone |
| CN104038722A (en) * | 2013-03-06 | 2014-09-10 | 中兴通讯股份有限公司 | Content interaction method and content interaction system for video conference |
| CN104427295A (en) * | 2013-08-29 | 2015-03-18 | 中兴通讯股份有限公司 | Method for processing video in video conference and terminal |
| CN104601930A (en) * | 2015-01-09 | 2015-05-06 | 西安融成科技有限公司 | System and method for automatically switching and displaying video image and desktop image |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101494547A (en) * | 2009-03-05 | 2009-07-29 | 广东威创视讯科技股份有限公司 | Method and system for implementing conference combining local conference and network conference equipment |
| CN101764989A (en) * | 2009-11-05 | 2010-06-30 | 广东威创视讯科技股份有限公司 | Device for remotely displaying local computer desktop images through video conference system |
| CA2722460A1 (en) * | 2010-11-26 | 2012-05-26 | Centre De Recherche Informatique De Montreal | Screen sharing and video conferencing system and method |
| CN103595944A (en) * | 2013-11-22 | 2014-02-19 | 惠州华阳通用电子有限公司 | Wi-Fi display switching device and method among terminals |
| CN105553943B (en) * | 2015-12-07 | 2019-05-28 | 广州视睿电子科技有限公司 | Transmission method, screen transmission method and device for screen transmission software and data transmission system |
-
2017
- 2017-07-13 CN CN201710570118.1A patent/CN107357585B/en active Active
- 2017-09-25 WO PCT/CN2017/103245 patent/WO2019010827A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101888519A (en) * | 2009-05-14 | 2010-11-17 | 华为技术有限公司 | Method for sharing desktop contents and intelligent equipment |
| CN101674110A (en) * | 2009-10-21 | 2010-03-17 | 中兴通讯股份有限公司 | Method for implementing desktop sharing and control of mobile terminals and mobile terminal |
| CN102572578A (en) * | 2011-12-30 | 2012-07-11 | Tcl王牌电器(惠州)有限公司 | Method for displaying pictures of mobile terminal on television screen and screen-transmitting system |
| CN102883134A (en) * | 2012-11-01 | 2013-01-16 | 成都飞视美视频技术有限公司 | Screen sharing and controlling method for video conference system |
| CN104038722A (en) * | 2013-03-06 | 2014-09-10 | 中兴通讯股份有限公司 | Content interaction method and content interaction system for video conference |
| CN103501310A (en) * | 2013-07-11 | 2014-01-08 | 广东工业大学 | Method for controlling computer desktop sharing based on video phone |
| CN104427295A (en) * | 2013-08-29 | 2015-03-18 | 中兴通讯股份有限公司 | Method for processing video in video conference and terminal |
| CN104601930A (en) * | 2015-01-09 | 2015-05-06 | 西安融成科技有限公司 | System and method for automatically switching and displaying video image and desktop image |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019010827A1 (en) | 2019-01-17 |
| CN107357585A (en) | 2017-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107357585B (en) | Video acquisition method and device, video equipment and storage medium | |
| CN111937375B (en) | Modifying video streams with supplemental content for video conferencing | |
| EP2839604B1 (en) | Electronic tool and methods for meetings | |
| US8803991B2 (en) | Snapshot capture in video stream | |
| KR101842559B1 (en) | Terminal, server, and terminal control method | |
| JP5734525B2 (en) | Medical support system and method | |
| CN104219474B (en) | Image processing equipment and its control method | |
| WO2018024231A1 (en) | Method and apparatus for interconnecting spliced wall and mobile intelligent terminal | |
| CN103597468A (en) | Systems and methods for improved interactive content sharing in video communication systems | |
| JP6182911B2 (en) | Transmission terminal, transmission system, program | |
| CN104023191A (en) | Android-based camera projection system and implementation method | |
| JP6535431B2 (en) | Conference system, display method for shared display device, and switching device | |
| US20230138804A1 (en) | Enhanced video call method and system, and electronic device | |
| TW201539312A (en) | Display device and method for displaying images | |
| CN113438442A (en) | Conference data sharing method and device | |
| CN113596571B (en) | Screen sharing method, device, system, storage medium and computer equipment | |
| US10244207B2 (en) | Videoconference communication device | |
| JP2018525744A (en) | Method for mutual sharing of applications and data between touch screen computers and computer program for implementing this method | |
| TWI740208B (en) | Image transmission device, image display system with remote screen capture function, and remote screen capture method | |
| KR20120079636A (en) | Method for sharing document work in multilateral conference | |
| CN113556500B (en) | Video overlapping method, device and system | |
| CN209980227U (en) | Intelligent display system and device | |
| CN107241199B (en) | Image processing method and device for conference terminal | |
| CN107480437B (en) | Data transmission method and device | |
| WO2024139400A1 (en) | Method for enabling whiteboard drawing, and related apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |