CN109587451A - A kind of video capture device and its control method showing equipment for virtual reality - Google Patents
A kind of video capture device and its control method showing equipment for virtual reality Download PDFInfo
- Publication number
- CN109587451A CN109587451A CN201811594697.4A CN201811594697A CN109587451A CN 109587451 A CN109587451 A CN 109587451A CN 201811594697 A CN201811594697 A CN 201811594697A CN 109587451 A CN109587451 A CN 109587451A
- Authority
- CN
- China
- Prior art keywords
- video
- capture device
- virtual reality
- processor
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 45
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 25
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 25
- 238000004891 communication Methods 0.000 claims description 18
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000007726 management method Methods 0.000 description 11
- 238000005259 measurement Methods 0.000 description 8
- 101150001149 CSI1 gene Proteins 0.000 description 4
- 101150071456 CSI2 gene Proteins 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000000746 body region Anatomy 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 208000002173 dizziness Diseases 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a kind of video capture devices and its control method that equipment is shown for virtual reality, the video capture device includes processor, at least two colour imagery shot mould groups and the video output interface that equipment is shown for connecting virtual reality, and at least two colour imagery shot mould groups and video output interface are connect with processor；Processor is arranged to carrying out the video image that at least two colour imagery shot mould groups are shot into synthesis processing, and the video image after synthesis is transmitted to virtual reality by video output interface and shows equipment.The virtual reality that the video image of shooting is sent to connection can be shown that equipment is shown in real time by video capture device through the invention, user-friendly, promote user experience.
Description
Technical field
The present invention relates to the shooting field of display technology of virtual reality, aobvious for virtual reality more particularly, to one kind
Show the video capture device and its control method of equipment.
Background technique
It is aobvious to generally include isolated video capture device and virtual reality for existing virtual reality video capture display system
Show equipment.In the storage card of the video image storage of video capture device shooting inside it.If user wants to watch the view
The video image of frequency filming apparatus shooting needs that storage card is placed in virtual reality display equipment again, controls virtual reality
Display equipment reads store video images in storage card and shows.
Therefore, by existing video capture device, user can not show viewing shooting in real time in equipment in virtual reality
Video image.And need to show in video capture device and virtual reality and be respectively provided with processor in equipment, this allows for whole
The higher cost of a virtual reality video capture display system.
Summary of the invention
The video image of shooting virtual reality can be sent in real time it is an object of the present invention to provide one kind to show
The video capture device that equipment is shown.
According to the first aspect of the invention, a kind of video capture device that equipment is shown for virtual reality, packet are provided
Processor, at least two colour imagery shot mould groups and the video output interface that equipment is shown for connecting virtual reality are included, it is described
At least two colour imagery shot mould groups and the video output interface are connected to the processor；The processor is arranged to
The video image that at least two colour imagery shots mould group is shot is subjected to synthesis processing, and the video image after synthesis is led to
It crosses the video output interface and is transmitted to the virtual reality display equipment.
Optionally, the processor is also configured to obtain the refresh rate that the virtual reality shows equipment, according to described
Refresh rate adjusts the frame per second of the video image after the synthesis, and video image adjusted is passed through the video output interface
It is transmitted to the virtual reality and shows equipment.
Optionally, the video capture device further includes main circuit board and corresponding with each colour imagery shot mould group
Pinboard, the first connector for connecting with corresponding camera module is provided on each pinboard；The video
Output interface and the processor are arranged on the main circuit board, be additionally provided on the main circuit board for each the
The second connector that a connector is correspondingly connected with, second connector are correspondingly connected with the processor.
Optionally, the video output interface is HDMI interface, DP interface or Type-C interface.
Optionally, the video capture device further includes the communication unit for being communicated with server, the communication
Unit is connected to the processor；The communication unit is arranged to receive the image processing algorithm that the server is sent, institute
Processor is stated to be also configured to handle the video image after the synthesis according to described image Processing Algorithm.
Optionally, the video capture device further includes storage unit, and the storage unit is connected to the processor, institute
It states processor and is also configured to the video image after the synthesis being sent to the storage unit and store.
Optionally, the video capture device further includes that the data for showing that equipment is connect with the virtual reality connect
Mouthful, the data-interface is connected to the processor；The data-interface shows that equipment is sent for receiving the virtual reality
Attitude data, the processor be also configured to be controlled according to the attitude data video capture device execute it is corresponding
Feature operation.
According to the second aspect of the invention, a kind of control method of video capture device is provided, comprising:
Determine the camera module that the video capture device is called under present filming scene；
Corresponding image processing algorithm is determined according to the type of the camera module of the calling；
It is handled according to video image of the described image Processing Algorithm to the camera shooting of the calling；
By treated, video image is sent to the virtual reality display equipment connecting with the video capture device.
Optionally, the control method further include:
It receives the virtual reality and shows the refresh rate that equipment is sent；
According to the frame per second of refresh rate adjustment treated the video image, so that the frame of video image adjusted
Rate shows that the refresh rate of equipment matches with the virtual reality；
Video image adjusted is sent to the virtual reality and shows equipment.
Optionally, the control method further include:
The video image is sent to server；
Receive the iterative processing algorithm that the server is sent, wherein the iterative processing algorithm is the server pair
Described image Processing Algorithm is trained to obtain according to the video image；
Described image Processing Algorithm is updated according to the iterative processing algorithm, according to updated image processing algorithm pair
The video image is handled.
According to the third aspect of the invention we, a kind of video capture device that equipment is shown for virtual reality, packet are provided
It includes processor, depth camera mould group, high frame per second global shutter colour imagery shot mould group and is shown for connecting virtual reality
The video output interface of equipment；The depth camera mould group and the high frame per second global shutter colour imagery shot mould group with it is described
Processor connection；The processor is arranged to the deep video image and the height for acquiring the depth camera mould group
The color video frequency image of frame per second global shutter colour imagery shot mould group acquisition carries out synthesis processing, and will treated video image
The virtual reality, which is transmitted to, by the video output interface shows equipment.
A beneficial effect of the invention is that video capture device through the invention can be in real time by the view of shooting
The virtual reality that frequency image is sent to connection shows that equipment is shown, user-friendly, promotes user experience.
By referring to the drawings to the detailed description of exemplary embodiment of the present invention, other feature of the invention and its
Advantage will become apparent.
Detailed description of the invention
The attached drawing for constituting part of specification describes the embodiment of the present invention, and together with the description for solving
Release the principle of the present invention.
Fig. 1 is the side that a kind of implementation structure of video capture device of equipment is shown provided by the present invention for virtual reality
Frame schematic diagram；
Fig. 2 is to show that the another of video capture device of equipment implements structure provided by the present invention for virtual reality
Structural schematic diagram；
Fig. 3 is another the implementation structure for the video capture device that equipment is shown provided by the present invention for virtual reality
Structural schematic diagram；
Fig. 4 is the process provided by the present invention for one of embodiment of the control method of video capture device
Figure；
Fig. 5 is the process provided by the present invention for one of embodiment of the control method of video capture device
Figure；
Fig. 6 is the process provided by the present invention for one of embodiment of the control method of video capture device
Figure.
Description of symbols:
U1: processor；U2-1, U2-2: colour imagery shot mould group；
U2-3:TOF camera module；U2-4: high frame per second global shutter colour imagery shot mould group；
J1: video output interface；J2: charging interface；
U3: battery；U4: power management chip；
U5: communication unit；U6: storage unit；
U7: memory；U8: Inertial Measurement Unit；
100: video capture device；200: virtual reality shows equipment；
110: main circuit board；120: pinboard；
111,121: connector.
Specific embodiment
Carry out the various exemplary embodiments of detailed description of the present invention now with reference to attached drawing.It should also be noted that unless in addition having
Body explanation, the unlimited system of component and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally
The range of invention.
Be to the description only actually of at least one exemplary embodiment below it is illustrative, never as to the present invention
And its application or any restrictions used.
Technology and equipment known to person of ordinary skill in the relevant may be not discussed in detail, but in appropriate situation
Under, the technology and equipment should be considered as part of specification.
It is shown here and discuss all examples in, any occurrence should be construed as merely illustratively, without
It is as limitation.Therefore, other examples of exemplary embodiment can have different values.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, then in subsequent attached drawing does not need that it is further discussed.
It can not show that equipment watches video capture in real time by virtual reality to solve user existing in the prior art
The problem of video image of device shooting, provide a kind of video capture device.
Fig. 1 is the side that a kind of implementation structure of video capture device of equipment is shown provided by the present invention for virtual reality
Frame schematic diagram.
As shown in Figure 1, this, which is used for virtual reality, shows that video capture device 100 of equipment may include processor U1, extremely
The few two colour imagery shot mould group U2-1 and U2-2 and video output interface J1 that equipment 200 is shown for connecting virtual reality.
At least two colour imagery shot mould group U2-1 and U2-2 and video output interface J1 are connect with processor U1.Processor U1 is set
It is set to and the video image of at least two colour imagery shot mould group U2-1 and U2-2 shooting is subjected to synthesis processing, and will be after synthesis
Video image is transmitted to virtual reality by video output interface and shows equipment 200.
Virtual reality in the present invention shows that equipment 200 is specially to establish connection with video capture device 100, can show
The virtual reality device of video image.Such as can be virtual implementing helmet, virtual reality glasses etc..
In an example of the invention, video output interface J1 at least can be HDMI interface (High Definition
Multimedia Interface, high-definition multimedia interface), (display port, high-definition digital is shown to be connect DP interface
Mouthful) or Type-C interface.
Specifically, the type sum number of the camera module for including of the video capture device 100 is arranged according to scene demand
Amount.For example, at least two colour imagery shot mould group U2-1 and U2-2 can adopt for high frame per second global shutter colour imagery shot mould group
With the imaging sensor of global shutter (Global Shutter)) and/or high-resolution colour imagery shot mould group.Specifically, at least
Two colour imagery shot mould group U2 can be at least two high frame per second global shutter colour imagery shot mould groups, be also possible at least two
A high-resolution colour imagery shot mould group can also be at least one high frame per second global shutter colour imagery shot mould group and at least one
A high-resolution colour imagery shot mould group.
CSI interface (Camera Serial Interface, the camera string of camera module U2-1 and U2-2 and processor
Line interface) connection.
In the case where the video capture device 100 includes two colour imagery shot mould group U2-1 and U2-2, camera mould
Group U2-1 and U2-2 can be to be connect with CSI1 interface on processor U1 and CSI2 interface respectively, as shown in Figure 1.
Video capture device 100 through the invention, colour imagery shot mould group U2-1 shoots the first video image, and passes through
CSI1 interface is sent to processor U1；Colour imagery shot mould group U2-2 shoots the second video image, is sent to by CSI2 interface
Processor U1.
Processor U1 can be by internal 3-D image composition algorithm by the first video image and the second video image
Synthesis processing is carried out, 3 d video images are obtained, which, which can store, is connecting with video capture device 100
It stores in equipment, the virtual reality that 3 d video images are sent to connection can also be shown that equipment 200 is shown in real time.
Processor U1 can also pass through internal panoramic picture composition algorithm splicing first image and the second figure
Picture generates full-view video image, wherein and colour imagery shot mould group U2-1 and U2-2 can be the camera module of big field angle,
The panoramic picture being finally synthesizing is 360 degree of panoramic pictures, which can store connect with video capture device 100
Storage equipment in, can also in real time by full-view video image be sent to connection virtual reality show equipment 200 show.
In this way, video capture device through the invention, can be sent to connection for the video image after synthesis in real time
Virtual reality shows that equipment is shown, user-friendly, promotes user experience.
Fig. 2 is to show that the another of video capture device of equipment implements structure provided by the present invention for virtual reality
Frame principle figure.
As shown in Fig. 2, this, which is used for virtual reality, shows that the video capture device 100 of equipment may include processor U1, view
Frequency output interface J1, depth camera mould group U2-3 and high frame per second global shutter colour imagery shot mould group U2-4.The depth camera
Head mould group U2-3 and high frame per second global shutter colour imagery shot mould group U2-4 is connect with processor U1.Processor U1 is arranged to
By the color video frequency image of depth camera mould group U2-3 acquisition and high frame per second global shutter colour imagery shot mould group U2-4 acquisition
Deep video image carry out synthesis processing, and the video image after synthesis is transmitted to by video output interface J1 virtual existing
Real display equipment 200.Wherein, which includes TOF (Time of flight, flight time) camera module and knot
Structure light video camera head mould group etc..
It include depth camera mould group U2-3 and high frame per second global shutter colour imagery shot mould in the video capture device 100
In the case where group U2-4, the image depth information that processor U1 can also be generated according to depth camera mould group U2-3, to solid
Determine the more preferable different background of scene of background, while carrying out Face datection, completes the beautification of face.
On this basis, TOF camera module U2-3 and high frame per second global shutter colour imagery shot mould group U2-4 can be
It is connect respectively with CSI1 interface on processor U1 and CSI2 interface, as shown in Figure 2.
In the identification field of human body (bone or face etc.), the available human body of TOF camera module U2-3
The deep video image at position, the colored view of the available the people's body region of high frame per second global shutter colour imagery shot mould group U2-4
The deep video image can be sent to processor U1, high frame per second by CSI1 interface by frequency image, TOF camera module U2-3
The color video frequency image can be sent to processor U1 by CSI2 interface by global shutter colour imagery shot mould group U2-4, located
It manages in device U1, compares the key point information of the human body of deep video image and color video frequency image, can determine human body portion
The spatial coordinated information of position realizes that identification and tracking of human body etc. are applied.
In this way, video capture device through the invention, can be sent to connection for the video image after synthesis in real time
Virtual reality shows that equipment is shown, user-friendly, promotes user experience.
In an example of the invention, in order to avoid video image shows the mistake shown in equipment in virtual reality
Occur Caton phenomenon in journey, avoids user from occurring during watching the video image that virtual reality display equipment is shown dizzy
Bad experience, the processor U1 in the video capture device 100, which may be also configured to obtain virtual reality, shows equipment
Refresh rate is exported according to the frame per second of the video image after refresh rate adjustment synthesis, and by video image adjusted by video
Interface J1 is transmitted to virtual reality and shows equipment 200.
Moreover, the refresh rate pairing of equipment 200 is shown according to virtual reality by the processor U1 of video capture device 100
The frame per second of video image after is adjusted, so that virtual reality shows that equipment 200 may not need to the video figure received
As being handled, therefore, virtual reality, which is shown in equipment 200, can be not provided with processor.In this way, virtual reality can also be reduced
Show the cost of equipment 200.
Since different model or difference may be provided in video capture device 100 in different application scenarios
The camera module of type, and the position of the pin of identical definition may be different in different camera modules.If will take the photograph
As head mould group and processor are arranged on same circuit board, then, then it needs to change video capture again according to application scenarios
The circuit board of device, this adds increased the hardware development costs of video capture device.
As shown in figure 3, the video capture device 100 may include main circuit board 110 and with each camera module pair
The pinboard 120 (including 120-1,120-2) answered, be provided on each pinboard 120 for corresponding camera module U2
First connector 121 (including 121-1,121-2) of connection；Video output interface J1 and processor U1, which can be, to be arranged in main electricity
On road plate 110, the second connector 111 for being correspondingly connected with every one first connector 121 is additionally provided on main circuit board 110
(including 111-1,111-2,111-3), the second connector 111 are correspondingly connected with processor U1.Specifically, the second connector 111
It is to be correspondingly connected with the CSI interface on processor U1.
In an example of the invention, if processor U1 can at most connect N number of camera module U2 simultaneously, that is, handle
Device U1 has N group CSI interface, then, N number of second connector 111 can be set on main circuit board 110, wherein N is positive
Integer.
In different application scenarios, camera module as needed changes pinboard, without to main circuit board
It is modified, so that it may reduce the hardware development cost of video capture device.
Further, main circuit board 110 and pinboard 120, which can be, is arranged in same housing.Due to different camera shootings
The size of head mould group may be different, and therefore, the size of different application scene lower case may also be different.If according to application scenarios
The shell of video capture device is changed, this also will increase the cost of video capture device.
Therefore, in an example of the invention, which further includes the bracket of corresponding each pinboard 120
(not shown), each pinboard 120 are fixed by the bracket on the shell of filming apparatus.
In this way, corresponding bracket is changed according to pinboard, without changing video capture device in different application scenarios
Shell, the cost of video capture device can also be reduced.
According to Fig.3, which can also include the communication unit for being communicated with other equipment
First U5, communication unit U5 are connect with processor U1.Communication unit U5, which can be, to be arranged on main circuit board 110.
Wherein, communication unit U5 can be through UART (Universal Asynchronous Receiver/
Transmitter, universal asynchronous receiving-transmitting transmitter) bus, the channel (Info/Query) IQ or SLIM bus (Serial
Low-power Inter-chip Media Bus, serial media bus between low-power chip) connection.
Communication unit U5 can be by the communications such as WiFi, 4G network, 3G network, GPRS or bluetooth with
Other equipment are communicated.
In an example of the invention, processor U1 can be sent the video image after synthesis by communication unit U5
Show that equipment 200 is shown to virtual reality.So, communication unit U5 and video output interface J1 can be by similar elements
It provides.Such as it can be, but not limited to be to provide communication unit U5 and video output interface J1 by WiFi antenna and WiFi chip.
In another example of the invention, processor U1 (can be wrapped the video image of shooting by communication unit U5
Include 3 d video images, full-view video image, and/or, color video frequency image and deep video image) it is sent to server, it takes
Business device video image can be trained Processing Algorithm based on the received, and the Processing Algorithm after training is sent to video and is clapped
Take the photograph device 100.Video capture device 100 receives the image processing algorithm after the training that server is sent by communication unit U5,
And transmit it to processor U1.The video figure that processor U1 shoots camera module according to the image processing algorithm after training
Piece is handled, and to optimize the shooting effect of the video capture device, promotes the shooting quality of the video capture device, can also be with
Promote user experience.
As shown in figure 3, the video capture device 100 can also include charging interface J2, battery U3 and power management chip
U4, charging interface J2 are connect with power management chip U4, and battery U3 is connected with power management chip U4, power management chip U4 quilt
It is set as control battery U3 to power to video capture device, and controls battery U3 and charged by charging interface J2.Charging
Mouth J2, battery U3 and power management chip U4, which can be, to be arranged on main circuit board 110.
Specifically, battery U3 is processor U1, the camera mould by power management chip U4 to video capture device 100
The functional chips power supply such as group U2.Meanwhile in the case where charging interface J2 is connect with external power supply, power management chip U4 can be with
Control battery U3 is charged by charging interface J2.
It is connect specifically, power management chip U4 can be with the power pins of charging interface J2 and grounding pin.Power supply
Managing chip U4 is the responsibility that transformation to electric energy, distribution, detection and other electric energy managements are shouldered in video capture device
Chip.Power management chip U4 is mainly responsible for the power supply amplitude of processor in identification video capture device, generates corresponding short
Square wave pushes late-class circuit to carry out power output.
Charging interface J2 for example can be mini-USB interface, micro-USB interface, USB A type interface, Type-C and connect
The USB interfaces such as mouth or lighting interface or round charging interface.It but is Type-C interface in video output interface J1
In the case where, which can also be used as charging interface J2.
In an example of the invention, charging interface J2 is USB interface.The data pin of USB interface can be with place
Device U1 connection is managed, the data of the transmission of equipment 200 are shown for receiving virtual reality.
For example, virtual reality, which is shown, can be set attitude transducer in equipment 200, virtual reality shows that equipment 200 can
Processor U1 is sent to by USB interface with the attitude data for acquiring attitude transducer, processor U1 can be in received appearance
In the case where state data fit preset condition, execution starts to shoot or stop the corresponding feature operations such as shooting.
As shown in figure 3, the video capture device 100 can also include storage unit U6, storage unit U6 can be with processing
Device U1 connection, processor U1 be also configured to by video image (including 3 d video images, full-view video image, and/or, it is color
Color video image and deep video image) it is sent to storage unit U6 and is stored.Storage unit U6, which can be, to be arranged in main electricity
On road plate 110.
Specifically, storage unit U6 for example may include memory either pluggable RAM card.
Further, which can also include memory U7 for storing instruction, memory U7 memory
The instruction of storage executes corresponding operation for control processor.The memory (is deposited at random for example including ROM (read-only memory), RAM
Access to memory), the nonvolatile memory of hard disk etc..Memory U7, which can be, to be arranged on main circuit board 110.
As shown in figure 3, the video capture device 100 can also include Inertial Measurement Unit U8.Inertial Measurement Unit U8 with
Processor U1 connection.Inertial Measurement Unit U8 can be through SPI (Serial Peripheral Interface, serial peripheral
Interface) bus connect with processor U1.Inertial Measurement Unit U8, which can be, to be arranged on main circuit board 110.
Specifically, Inertial Measurement Unit U8 may include 3-axis acceleration sensor, three-axis gyroscope and three axis magnetic sensing
Device.
In an example of the invention, Inertial Measurement Unit U8 can acquire the inertia number of the video capture device 100
According to processor U1 can control the video capture device 100 according to the inertial data that Inertial Measurement Unit U8 is acquired and execute phase
The feature operation answered.
For example, processor U1 can control the video capture device 100 and start to clap when inertial data meets first condition
It takes the photograph；Processor U1 can control the video capture device 100 and stop shooting when inertial data meets second condition；Processor
U1 can control the video capture device 100 shutdown when inertial data meets third condition.
The present invention also provides a kind of control methods for video capture device.Fig. 4 provides for the embodiment of the present invention
A kind of control method for video capture device.
According to Fig.4, which includes the following steps S410~S440:
Step S410 determines the camera module that video capture device is called under present filming scene.
In one embodiment, the camera module that video capture device is called under present filming scene can be two coloured silks
Color camera module is also possible to depth camera mould group and high frame per second global shutter colour imagery shot mould group.
Step S420 determines corresponding image processing algorithm according to the type of the camera module of calling.
The camera module that video capture device is called under present filming scene is the feelings of two colour imagery shot mould groups
Under condition, the first image processing algorithm corresponding to two colour imagery shot mould groups can be called.The video under present filming scene
The case where camera module that filming apparatus calls is depth camera mould group and high frame per second global shutter colour imagery shot mould group
Under, the second image procossing corresponding to depth camera mould group and high frame per second global shutter colour imagery shot mould group can be called to calculate
Method.
Step S430 is handled according to video image of the image processing algorithm to the camera shooting of calling.
Specifically, according to the first image processing algorithm can be to two colour imagery shot mould groups acquisition video image into
The three-dimensional synthesis of row either panorama composing process processing.It can be according to the second image processing algorithm and depth camera mould group adopted
The deep video image of collection and the color video frequency image of high frame per second global shutter colour imagery shot mould group acquisition carry out at synthesis
Reason, according to the depth information in deep video image, to replace background in color video frequency image, beautification face；It can also compare
The key point information of the human body of deep video image and color video frequency image, determines the spatial coordinated information of human body,
Realize the applications such as identification and the tracking of human body.
Treated transmission of video images is shown to the virtual reality connecting with video capture device and is set by step S440
It is standby.
Specifically, can be, by treated, transmission of video images to virtual reality shows that equipment carries out real-time display.
In one example, which can also include the steps that S510~S530 as shown in Figure 5:
Video image is sent to server by step S510.
Step S520 receives the iterative processing algorithm that server is sent.
Wherein, which is what server was trained image processing algorithm according to video image.
Step S530 updates image processing algorithm according to iterative processing algorithm, according to updated image processing algorithm
Video image is handled.
It, can be in this way, handled according to the video pictures that updated image processing algorithm shoots camera module
The shooting effect for optimizing the video capture device promotes the shooting quality of the video capture device, can also promote user experience.
In one example, which include thes steps that S610~S630 as shown in Figure 6:
Step S610, the virtual reality for receiving connection show the refresh rate that equipment is sent.
Step S620 adjusts the frame per second of video image according to the refresh rate.
Video image adjusted is transmitted to virtual reality through video output interface and shows equipment by step S630.
The difference of the various embodiments described above primary focus description and other embodiments, but those skilled in the art should be clear
Chu, the various embodiments described above can according to need exclusive use or are combined with each other.
Although some specific embodiments of the invention are described in detail by example, the skill of this field
Art personnel it should be understood that above example merely to being illustrated, the range being not intended to be limiting of the invention.The skill of this field
Art personnel are it should be understood that can without departing from the scope and spirit of the present invention modify to above embodiments.This hair
Bright range is defined by the following claims.
Claims (11)
1. a kind of video capture device for showing equipment for virtual reality, which is characterized in that including processor, at least two coloured silks
Color camera module and the video output interface that equipment is shown for connecting virtual reality, at least two colour imagery shot
Mould group and the video output interface are connected to the processor；The processor is arranged to colored by described at least two
The video image of camera module shooting carries out synthesis processing, and the video image after synthesis is passed through the video output interface
It is transmitted to the virtual reality and shows equipment.
2. video capture device according to claim 1, which is characterized in that the processor is also configured to described in acquisition
Virtual reality shows the refresh rate of equipment, the frame per second of the video image after the synthesis is adjusted according to the refresh rate, and will adjust
Video image after whole is transmitted to the virtual reality by the video output interface and shows equipment.
3. video capture device according to claim 1, which is characterized in that the video capture device further includes main circuit
Plate and pinboard corresponding with each colour imagery shot mould group are provided with for taking the photograph with corresponding on each pinboard
The first connector connected as head mould group；The video output interface and the processor are arranged on the main circuit board, institute
State the second connector being additionally provided on main circuit board for being correspondingly connected with each first connector, second connector
It is correspondingly connected with the processor.
4. video capture device according to claim 1, which is characterized in that the video output interface be HDMI interface,
DP interface or Type-C interface.
5. video capture device according to claim 1, which is characterized in that the video capture device further include for
The communication unit that server is communicated, the communication unit are connected to the processor；The communication unit is arranged to connect
The image processing algorithm that the server is sent is received, the processor is also configured to according to described image Processing Algorithm to described
Video image after synthesis is handled.
6. video capture device according to claim 1, which is characterized in that the video capture device further includes that storage is single
Member, the storage unit are connected to the processor, and the processor is also configured to pass the video image after the synthesis
It send to the storage unit and is stored.
7. video capture device according to claim 1, which is characterized in that the video capture device further include for
The virtual reality shows that the data-interface of equipment connection, the data-interface are connected to the processor；The data-interface
Show that the attitude data of equipment transmission, the processor are also configured to according to the posture number for receiving the virtual reality
Corresponding feature operation is executed according to the video capture device is controlled.
8. a kind of control method of video capture device characterized by comprising
Determine the camera module that the video capture device is called under present filming scene；
Corresponding image processing algorithm is determined according to the type of the camera module of the calling；
It is handled according to video image of the described image Processing Algorithm to the camera shooting of the calling；
By treated, video image is sent to the virtual reality display equipment connecting with the video capture device.
9. control method according to claim 8, which is characterized in that the control method further include:
It receives the virtual reality and shows the refresh rate that equipment is sent；
According to the frame per second of refresh rate adjustment treated the video image so that the frame per second of video image adjusted with
The virtual reality shows the refresh rate matching of equipment；
Video image adjusted is sent to the virtual reality and shows equipment.
10. control method according to claim 8, which is characterized in that the control method further include:
The video image is sent to server；
Receive the iterative processing algorithm that the server is sent, wherein the iterative processing algorithm is the server to basis
The video image is trained to obtain to described image Processing Algorithm；
According to the iterative processing algorithm update described image Processing Algorithm, with according to updated image processing algorithm to described
Video image is handled.
11. a kind of video capture device for showing equipment for virtual reality, which is characterized in that including processor, depth camera
Head mould group, high frame per second global shutter colour imagery shot mould group and the video output for connecting virtual reality display equipment connect
Mouthful；The depth camera mould group and the high frame per second global shutter colour imagery shot mould group are connected to the processor；It is described
Processor is arranged to the deep video image for acquiring the depth camera mould group and the high frame per second global shutter is colored
The color video frequency image of camera module acquisition carries out synthesis processing, and will treated video image by video output
Interface is transmitted to the virtual reality and shows equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811594697.4A CN109587451A (en) | 2018-12-25 | 2018-12-25 | A kind of video capture device and its control method showing equipment for virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811594697.4A CN109587451A (en) | 2018-12-25 | 2018-12-25 | A kind of video capture device and its control method showing equipment for virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109587451A true CN109587451A (en) | 2019-04-05 |
Family
ID=65931792
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811594697.4A Pending CN109587451A (en) | 2018-12-25 | 2018-12-25 | A kind of video capture device and its control method showing equipment for virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109587451A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110189239A (en) * | 2019-05-30 | 2019-08-30 | 北京金和网络股份有限公司 | Five fixed online testing method and system |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101541228A (en) * | 2006-11-16 | 2009-09-23 | 斯特赖克公司 | Wireless endoscopic camera |
| CN104679876A (en) * | 2015-03-11 | 2015-06-03 | 百度在线网络技术（北京）有限公司 | Photo shooting strategy recommendation device and method |
| CN204536724U (en) * | 2015-04-15 | 2015-08-05 | 南昌欧菲光电技术有限公司 | The measurement jig of camera module |
| CN204795285U (en) * | 2015-06-29 | 2015-11-18 | 维沃移动通信有限公司 | Camera module and terminal |
| CN106507092A (en) * | 2016-11-29 | 2017-03-15 | 歌尔科技有限公司 | Camera head and its image processing method, virtual reality device |
| CN106713890A (en) * | 2016-12-09 | 2017-05-24 | 宇龙计算机通信科技(深圳)有限公司 | Image processing method and device |
| CN107395960A (en) * | 2017-07-07 | 2017-11-24 | 珠海市魅族科技有限公司 | Photographic method and device, computer installation and computer-readable recording medium |
| CN207799326U (en) * | 2018-01-09 | 2018-08-31 | 长沙全度影像科技有限公司 | A kind of panorama shooting device of lens changeable module |
| CN108833880A (en) * | 2018-04-26 | 2018-11-16 | 北京大学 | Using across user behavior pattern carry out view prediction and realize that virtual reality video optimizes the method and apparatus transmitted |
| CN209402642U (en) * | 2018-12-25 | 2019-09-17 | 青岛小鸟看看科技有限公司 | A kind of video capture device showing equipment for virtual reality |
-
2018
- 2018-12-25 CN CN201811594697.4A patent/CN109587451A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101541228A (en) * | 2006-11-16 | 2009-09-23 | 斯特赖克公司 | Wireless endoscopic camera |
| CN104679876A (en) * | 2015-03-11 | 2015-06-03 | 百度在线网络技术（北京）有限公司 | Photo shooting strategy recommendation device and method |
| CN204536724U (en) * | 2015-04-15 | 2015-08-05 | 南昌欧菲光电技术有限公司 | The measurement jig of camera module |
| CN204795285U (en) * | 2015-06-29 | 2015-11-18 | 维沃移动通信有限公司 | Camera module and terminal |
| CN106507092A (en) * | 2016-11-29 | 2017-03-15 | 歌尔科技有限公司 | Camera head and its image processing method, virtual reality device |
| CN106713890A (en) * | 2016-12-09 | 2017-05-24 | 宇龙计算机通信科技(深圳)有限公司 | Image processing method and device |
| CN107395960A (en) * | 2017-07-07 | 2017-11-24 | 珠海市魅族科技有限公司 | Photographic method and device, computer installation and computer-readable recording medium |
| CN207799326U (en) * | 2018-01-09 | 2018-08-31 | 长沙全度影像科技有限公司 | A kind of panorama shooting device of lens changeable module |
| CN108833880A (en) * | 2018-04-26 | 2018-11-16 | 北京大学 | Using across user behavior pattern carry out view prediction and realize that virtual reality video optimizes the method and apparatus transmitted |
| CN209402642U (en) * | 2018-12-25 | 2019-09-17 | 青岛小鸟看看科技有限公司 | A kind of video capture device showing equipment for virtual reality |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110189239A (en) * | 2019-05-30 | 2019-08-30 | 北京金和网络股份有限公司 | Five fixed online testing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110221431B (en) | Portable computing box for eyeglass device | |
| US11523057B2 (en) | Modular image capture systems | |
| WO2020192458A1 (en) | Image processing method and head-mounted display device | |
| CN105453011B (en) | Virtual objects direction and visualization | |
| CN105359540B (en) | Head-mounted display apparatus and method for controlling such equipment | |
| CN104932698B (en) | A kind of hand-held interactive device device and its projection interactive method | |
| CN104350734B (en) | Image forming apparatus and image generating method | |
| CN105141331B (en) | A kind of spectacle type communication device, system and method | |
| CN104365081B (en) | Image forming apparatus and image generating method | |
| CN108476293B (en) | Multifunctional camera, control method thereof, wearable device, cradle head and aircraft | |
| US10165182B1 (en) | Panoramic imaging systems based on two laterally-offset and vertically-overlap camera modules | |
| CN110463195A (en) | Method and apparatus for rendering timing text and figure in virtual reality video | |
| CN104335569A (en) | Image capturing device, and image capturing method | |
| CN105452994A (en) | Concurrent optimal viewing of virtual objects | |
| TWM546639U (en) | Panorama image capture apparatus | |
| US20230336701A1 (en) | Cloud-based Rendering of Interactive Augmented/Virtual Reality Experiences | |
| CN209402642U (en) | A kind of video capture device showing equipment for virtual reality | |
| CN105744132B (en) | Optical lens accessory for panoramic image shooting | |
| CN108769755A (en) | High-resolution full view frequency live streaming camera system and method | |
| CN109587451A (en) | A kind of video capture device and its control method showing equipment for virtual reality | |
| KR20170107137A (en) | Head-mounted display apparatus using a plurality of data and system for transmitting and receiving the plurality of data | |
| CN110349527A (en) | Virtual reality display methods, apparatus and system, storage medium | |
| EP4088167B1 (en) | A virtual reality or augmented reality headset accessory for facilitating controlled viewing experiences in mobile environments | |
| CN212696130U (en) | Live device of two camera VR videos based on 5G remote control technique | |
| US20150264336A1 (en) | System And Method For Composite Three Dimensional Photography And Videography |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |