CN107426485A - Image acquisition and processing device, method and system - Google Patents
Image acquisition and processing device, method and system Download PDFInfo
- Publication number
- CN107426485A CN107426485A CN201710254440.3A CN201710254440A CN107426485A CN 107426485 A CN107426485 A CN 107426485A CN 201710254440 A CN201710254440 A CN 201710254440A CN 107426485 A CN107426485 A CN 107426485A
- Authority
- CN
- China
- Prior art keywords
- port
- described image
- image
- processor
- image acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The present invention relates to camcorder technology field, in particular to a kind of image acquisition and processing device, method and system.Image acquisition and processing device includes image acquisition device, image stitcher and processor, and image acquisition device is provided with two.Two image acquisition devices are connected with image stitcher respectively, and image stitcher is connected with the processor.The optical imagery that fish eye lens generates is converted to the first digital picture and sent to image stitcher by image acquisition device.The first digital picture that image stitcher is converted to two image acquisition devices received is spliced, form the second digital picture and send to processor, and the working condition of control described image collector, and the control instruction sent according to processor, control itself working condition.Processor carries out processing to the second digital picture received according to default processing routine and forms photographs.Described image acquisition processing device realizes the acquisition of big visual field photographic picture, meets the market demand.
Description
Technical field
The present invention relates to camcorder technology field, in particular to a kind of image acquisition and processing device, method and is
System.
Background technology
The general principle of the work of video camera:Optical image signal is changed into electric signal, in order to store or transmit.
When we shoot an object, the light reflected on this object is collected by camera lens, make its focus on picture pick-up device by
In smooth surface (such as target surface of pick-up tube), then light is changed into by picture pick-up device by electric energy, that is, obtained " vision signal ".Photoelectricity
Signal is very faint, need to be amplified by pre-arcing road, then is handled and adjusted by various circuits, the standard finally obtained
Signal can be sent on the recording mediums such as video recorder and record, or propagates or be sent on monitor by broadcasting system and show
Come.In order to obtain the relatively large photographic picture in the visual field, panorama camera arises at the historic moment.But inventor studies and found, existing skill
In art, still there is the drawbacks of field range is not open enough in the photographs captured by panorama camera, can not meet market need
Ask.
The content of the invention
In view of this, it is an object of the invention to provide a kind of image acquisition and processing device, method and system, with solution
State problem.
The embodiments of the invention provide a kind of image acquisition and processing device, including image acquisition device, image stitcher and place
Device is managed, described image collector is provided with two, and two described image collectors are connected with described image splicer respectively, described
Image stitcher is connected with the processor;
Described image collector, the optical imagery for fish eye lens to be generated are converted to the first digital picture and sent extremely
Described image splicer;
Described image splicer, first numeral being converted to for two described image collectors to receiving
Image is spliced, and is formed the second digital picture and is sent to the processor, and the work of control described image collector
State, and the control instruction sent according to the processor, control itself working condition;
The processor, for being handled according to default processing routine second digital picture received, shape
Into photographs.
Further, described image splicer includes the image mosaic controller and system controller being integrated in one, institute
Image mosaic controller is stated to be connected with described image collector and the processor respectively, the system controller respectively with it is described
Image acquisition device connects with the processor;
Described image splicing controller, described first be converted to for two described image collectors to receiving
Digital picture is spliced, and is formed the second digital picture and is sent to the processor;
The system controller, sent for controlling the working condition of described image collector, and according to the processor
Control instruction, control itself working condition.
Further, described image collector includes image capture controller, and described image acquisition controller includes first
Bus port, the first serial shooting control port, master clock port, frame synchronizing signal input port and the first difference output port
Group, the first difference output port group are provided with multigroup;
Described image splicing controller includes the second serial shooting control port, reference clock port, frame synchronizing signal end
Mouth, the first Differential Input port group and the second difference output port group, the first Differential Input port group are provided with multigroup, institute
State the second difference output port group be provided with it is multigroup;
The processor includes the second bus port and the second Differential Input port group, the second Differential Input port group
It is provided with multigroup;
First bus port is connected with second bus port, the described first serial shooting control port with it is described
Second serial shooting control port connection, the master clock port are connected with the reference clock port, the frame synchronizing signal
Input port is connected with the frame synchronizing signal port, multigroup first difference output port group and multigroup first difference
Input port group is connected and corresponded, multigroup second difference output port group and multigroup second Differential Input port
Group connection and one-to-one corresponding.
Further, described image acquisition controller also includes image acquisition device reseting port;
The system controller includes the 3rd serial shooting control port, image acquisition device reseting controling end mouth and system and answered
Bit port;
The processor also includes the 4th serial shooting control port and system reset control port;
Described image collector reseting port is connected with described image collector reseting controling end mouth, and the described 3rd serially takes the photograph
It is connected as control port serially images control port with the described 4th, the system reset port and the system reset control terminal
Mouth connection.
Further, the system controller includes the first communication bus port set, and described image splicer also includes depositing
Reservoir, the memory include the second communication bus port set;
The first communication bus port set is connected with the second communication bus port set.
Further, the processor includes image-signal processor and video encoder, described image signal processor
Connected with the video encoder;
Described image signal processor, for carrying out noise reduction, image enhaucament and colour correction to second digital picture,
Obtain image to be compressed and send to the video encoder;
The video encoder, for being compressed processing to the image to be compressed received, form taking the photograph for compression
Shadow image.
Further, described image acquisition processing device also includes communication device, the communication device and the processor
Connection.
Further, the communication device includes communication controler, antenna circuit and crystal oscillating circuit;
The communication controler includes radio frequency input/output port, crystal oscillator input port, crystal oscillator output port, WiFi communication
Port set and Bluetooth communication port set;
The processor includes WiFi communication control port group and Bluetooth communication control port group;
The antenna circuit is connected with the radio frequency input/output port, and the crystal oscillating circuit is connected to the crystal oscillator input
Between port and the crystal oscillator output port, the WiFi communication port set is connected with the WiFi communication control port group, institute
Bluetooth communication port set is stated to be connected with the Bluetooth communication control port group.
The embodiment of the present invention additionally provides a kind of image acquisition and processing method, applied to above-mentioned image acquisition and processing device,
Described image acquisition processing device includes image acquisition device, image stitcher and processor, and described image collector is provided with two
Individual, the input of the output ends of two described image collectors respectively with described image splicer is connected, described image splicer
Output end be connected with the processor, methods described includes;
The optical imagery that fish eye lens generates is converted to the first digital picture and sent to described by described image collector
Image stitcher;
First digital picture that described image splicer is converted to the two described image collectors received
Spliced, form the second digital picture and send to the processor, and the working condition of control described image collector,
And the control instruction sent according to the processor, control itself working condition;And
The processor is handled second digital picture received according to default processing routine, forms photography
Image.
The embodiment of the present invention is additionally provided at a kind of image collection processing system, including terminal device and above-mentioned IMAQ
Device is managed, described image acquisition processing device is connected with the terminal equipment in communication, the photographs is sent to described
Terminal device is handled and shown.
Image acquisition and processing device provided in an embodiment of the present invention, method and system, pass through image acquisition device IMAQ
The optical imagery that fish eye lens generates is converted to the first digital picture by device, and two image acquisition devices are turned by image stitcher
First digital picture got in return carries out being spliced to form the second digital picture, and sends to processor and handled, and is formed
Photographs, in terms of existing technologies, the acquisition of big visual field photographic picture is realized, meets the market demand.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, elaborates.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by embodiment it is required use it is attached
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, therefore be not construed as pair
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this
A little accompanying drawings obtain other related accompanying drawings.
Fig. 1 is a kind of schematic block diagram of image acquisition and processing device provided in an embodiment of the present invention.
Fig. 2 is the connection relationship diagram of image capture controller provided in an embodiment of the present invention.
Fig. 3 is the connection relationship diagram of another image capture controller provided in an embodiment of the present invention.
Fig. 4 is the connection relationship diagram of image mosaic controller provided in an embodiment of the present invention.
Fig. 5 is the connection relationship diagram of processor provided in an embodiment of the present invention.
Fig. 6 is the connection relationship diagram of system controller provided in an embodiment of the present invention.
Fig. 7 is the connection relationship diagram of memory provided in an embodiment of the present invention.
Fig. 8 is another schematic block diagram of image acquisition and processing device provided in an embodiment of the present invention.
Fig. 9 is another schematic block diagram of image acquisition and processing device provided in an embodiment of the present invention.
Figure 10 is the connection relationship diagram of communication device provided in an embodiment of the present invention.
Figure 11 is the connection relationship diagram of processor provided in an embodiment of the present invention.
Figure 12 is the connection relationship diagram of processor provided in an embodiment of the present invention.
Figure 13 is a kind of flow chart of image acquisition and processing method provided in an embodiment of the present invention.
Figure 14 is the sub-step flow chart of step S200 in Figure 13.
Figure 15 is the sub-step flow chart of step S300 in Figure 13.
Figure 16 is a kind of schematic block diagram of image collection processing system provided in an embodiment of the present invention.
Icon:10- image collection processing systems;100- image acquisition and processing devices;110- image acquisition devices;111- images
Acquisition controller;The bus ports of 1111- first;1112- first serially images control port;1113- master clocks port;1114-
Frame synchronizing signal input port;1115- the first difference output port groups;1116- power supply controlled ports;1117- image acquisition devices
Reseting port;120- image stitchers;121- image mosaic controllers;1211- second serially images control port;1212- joins
Examine clock port;1213- frame synchronizing signals port;The first Differential Inputs of 1214- port group;The difference output ports of 1215- second
Group;The first power supplies of 1216- port;1217- second source control ports;122- system controllers;1221- the 3rd serially takes the photograph
As control port;1222- external clock input ports;1223- image acquisition device reseting controling end mouths;The images of 12231- first are adopted
Storage reseting controling end mouth;12232- the second image acquisition device reseting controling end mouths;1224- system resets port;1225- first
Communication bus port set;123- memories;1231- the second communication bus port sets;130- processors;The bus ends of 131- second
Mouthful;The second Differential Inputs of 132- port group;133- the 4th serially images control port;134- external clock output ports;135-
System reset control port;136- image-signal processors;137- video encoders;138-WiFi communication control port groups;
139- Bluetooth communication control port groups;140- communication devices;141- communication controlers;1411- radio frequency input/output ports;
1412- crystal oscillator input ports;1413- crystal oscillator output ports;1414-WiFi COM1 groups;1415- Bluetooth communication port sets;
142- antenna circuits;143- crystal oscillating circuits;200- terminal devices.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment only
It is the part of the embodiment of the present invention, rather than whole embodiments.The present invention being generally described and illustrated herein in the accompanying drawings
The component of embodiment can be configured to arrange and design with a variety of.
In the description of the invention, unless otherwise clearly defined and limited, term " setting ", " connected ", " connection " are answered
It is interpreted broadly, for example, it may be being fixedly connected or being detachably connected, or is integrally connected;Can be that machinery connects
Connect or electrically connect;Can be joined directly together, can also be indirectly connected by intermediary, can be in two elements
The connection in portion.For the ordinary skill in the art, the tool of above-mentioned term in the present invention can be understood with concrete condition
Body implication.
Therefore, below the detailed description of the embodiments of the invention to providing in the accompanying drawings be not intended to limit it is claimed
The scope of the present invention, but be merely representative of the present invention selected embodiment.It is common based on the embodiment in the present invention, this area
The every other embodiment that technical staff is obtained under the premise of creative work is not made, belong to the model that the present invention protects
Enclose.
Referring to Fig. 1, it is a kind of schematic structure frame of image acquisition and processing device 100 provided in an embodiment of the present invention
Figure.Described image acquisition processing device 100 includes image acquisition device 110, image stitcher 120 and processor 130.Described image
Collector 110 is provided with two, and two described image collectors 110 are connected with described image splicer 120 respectively, described image
Splicer 120 is connected with the processor 130.
Wherein, described image collector 110 is used to the optical imagery of fish eye lens generation being converted to the first digital picture
And send to described image splicer 120.
In the present embodiment, described image collector 110 is integrated or is connected with for converting analog signals into data signal
Analog-digital converter.In the present embodiment, scenery generates optical imagery by the fish eye lens, projects described image collector
110 surface, electric signal is converted to, and data image signal is converted to eventually through the analog-digital converter.
It should be noted that in the present embodiment, the fish eye lens can be 210 ° of wide-angle lens.In hardware design mistake
Cheng Zhong, two fish-eye set locations can be that one in front and one in back, and camera lens positive direction is towards on the contrary, i.e. described in two
Fish eye lens can be bonded with the back side, to ensure the comprehensive of the visual field of the original image of acquisition.
It should also be noted that, in the present embodiment, the fish-eye angle can be other, for example, the flake
Camera lens can also be 180 °, 220 °, 230 ° of equal angular wide-angle lens.Further, it is to be appreciated that in the present embodiment, it is described
Fish-eye setting quantity equally can be other, for example, when the fish eye lens is 180 ° of wide-angle lens, to avoid
The photographic picture visual field of acquisition is not comprehensive enough, and the fish-eye setting quantity can also be 3.
Described image splicer 120 be used to being converted to two described image collectors 110 receiving described the
One digital picture is spliced, and is formed the second digital picture and is sent to the processor 130, and control described image collection
The working condition of device 110, and the control instruction sent according to the processor 130, control itself working condition.
Alternatively, described image splicer 120 includes the image mosaic controller 121 and system controller being integrated in one
122.It is understood that in the present embodiment, described image splicer 120 is picture processing chip, including two functional modules,
That is described image splicing controller 121 and the system controller 122.Wherein, described image splicing controller 121 respectively with institute
State image acquisition device 110 and the processor 130 connect, the system controller 122 respectively with described image collector 110 and
The processor 130 connects.Alternatively, in the present embodiment, described image splicer 120 is OV683 picture processing chips.Need
Illustrate, described image splicer 120 can also be other picture processing chips.
Wherein, described image splicing controller 121 is used to be converted to the two described image collectors 110 received
First digital picture spliced, form the second digital picture and simultaneously send to the processor 130.As can be seen here, originally
In embodiment, described image splicing controller 121 is used to two-way data image signal being spliced into data image signal all the way
And send to the processor 130.It is, therefore, to be understood that in the present embodiment, the amplitude of second digital picture is institute
State the first digital picture twice.
The system controller 122 is used for the working condition for controlling described image collector 110, and according to the processor
130 control instructions sent, control itself working condition.
The processor 130 is used to handle second digital picture received according to default processing routine,
Form photographs.
It should be noted that the processor 130 can be a kind of IC chip, there is signal handling capacity, institute
It can also be digital signal processor (DSP), application specific integrated circuit (ASIC), field programmable gate array to state processor 130
(FPGA) either other PLDs, discrete gate or transistor logic, discrete hardware components, it is possible to achieve or
Person performs the disclosed block diagram in example of the present invention.
In the present embodiment, described image collector 110 includes image capture controller 111.It is understood that the figure
Picture acquisition controller 111 is imaging sensor, and specifically, described image acquisition controller 111 can be COMS chips and CCD cores
The two kinds of imaging sensor of piece.In the present embodiment, described image acquisition controller 111 may be, but not limited to, COMS cores
Piece.Alternatively, in the present embodiment, described image acquisition controller 111 is imaging sensor OV4689.
Refer to Fig. 2 and Fig. 3, in the present embodiment, described image acquisition controller 111 include the first bus port 1111,
First serial shooting control port 1112, master clock port 1113, the difference output of frame synchronizing signal input port 1114 and first
Port set 1115.Wherein, the first difference output port group 1115 is provided with multigroup.It should be noted that shown in Fig. 2, Fig. 3
For the installation stand of described image acquisition controller 111, to represent the annexation of both hands image capture controller 111, and
Non- described image acquisition controller 111 itself.Incorporated by reference to Fig. 4, described image splicing controller 121 includes the second serial shooting control
Port 1211 processed, reference clock port 1212, frame synchronizing signal port 1213, the first Differential Input port group 1214 and second are poor
Divide output port group 1215.Wherein, the first Differential Input port group 1214 is provided with multigroup, second difference output end
Mouth group 1215 is provided with multigroup.Incorporated by reference to Fig. 5, the processor 130 includes the second bus port 131 and the second differential input end
Mouth group 132.Wherein, the second Differential Input port group 132 is provided with multigroup.
First bus port 1111 is connected with second bus port 131, to realize described image acquisition control
The bus communication of device 111 and the processor 130.Described first serial shooting control port 1112 and the described second serial shooting
Control port 1211 connects.Alternatively, in the present embodiment, the described first serial shooting control port 1112 and described second serial
Image control port 1211 by serial camera control bus (OmniVision serial camera control bus,
SCCB) connect.SCCB includes being used for the clock signal transmission line for transmitting clock signal and the data letter for transmitting data-signal
Number transmission line.The master clock port 1113 is connected with the reference clock port 1212, is controlled with being spliced by described image
Device 121 is that described image acquisition controller 111 provides reference clock signal, i.e., is the figure by described image splicer 120
As collector 110 provides reference clock signal.In order to prevent reverse impulse, alternatively, in the present embodiment, the master clock port
Anti-reverse pulse resistance is also associated between 1113 and the reference clock port 1212.In the present embodiment, the anti-reverse arteries and veins
It can be 0 Ω to rush resistance.The frame synchronizing signal input port 1114 is connected with the frame synchronizing signal port 1213, Duo Zusuo
State the first difference output port group 1115 to be connected and correspond with multigroup first Differential Input port group 1214, so as to real
Existing synchronous transfer data image signal.Multigroup second difference output port group 1215 and multigroup second differential input end
The connection of mouth group 132 and one-to-one corresponding, are sent out the data image signal after described image splicing controller 121 treats with realizing
Deliver to the processor 130.
In addition, from the foregoing, it will be observed that in the present embodiment, described image collector 110 is provided with two, each described image collection
Device 110 includes an image capture controller 111.Alternatively, in the present embodiment, the institute of each described image acquisition controller 111
State the first difference output port group 1115 and be provided with three groups, alternatively, the first difference output port group 1115 described in three groups is matched somebody with somebody
It is set to one group of first differential clock signal output port group and two group of first differential data signals output port group.Need what is illustrated
It is that the configuration quantity of the first differential data signals output port group is more, the transmission speed of described image acquisition controller 111
Degree is higher, so as to transmit the image of higher resolution.In the present embodiment, the first Differential Input port group 1214 is set
There are six groups, alternatively, the first Differential Input port group 1214 described in six groups is configured to two group of first differential clock signal input
Port set and four group of first differential data signals input port group.Equally, in the present embodiment, the second difference output port group
1215 are provided with six groups, alternatively, the second difference output port group 1215 described in six groups are configured into two group of second differential clocks
Signal output port group and four group of second differential data signals output port group.In the present embodiment, second differential input end
Mouth group 132 is provided with six groups, alternatively, by when the second Differential Input port group 132 is configured to two groups of second difference described in six groups
Clock signal input port group and four group of second differential data signals input port group.
Specifically, in the present embodiment, the first differential clock signal output port group is believed with first differential clocks
The connection of number input port group and correspond, the first differential data signals output port group is believed with first differential data
The connection of number input port group and correspond, the second differential clock signal output port group is believed with second differential clocks
The connection of number input port group and correspond, the second differential data signals output port group is believed with second differential data
The connection of number input port group and correspond.
It should be noted that in the present embodiment, it is positive difference that every group of differential signal port set also is configured into a polarity
Sub-signal port and a polarity are negative differential signal port.Put for example, the first differential clock signal output port is assembled
For a polarity be positive differential clock signal output port and a polarity is negative differential clock signal output port, other
The configuration of port set, same, here is omitted.It should be noted that in the present embodiment, two differential signals of connection
In port set, polarity identical differential signal port connection, for example, polarity in the first differential clock signal output port group
It is positive differential clocks letter for polarity in positive differential clock signal output port and the first differential clock signal input port group
The connection of number input port, polarity is negative differential clock signal output port in the first differential clock signal output port group
It is connected with polarity in the first differential clock signal input port group for negative differential clock signal input port, other port sets
Connection, same, here is omitted.
In the present embodiment, in order to control the power supply state of described image acquisition controller 111, described image acquisition controller
111 also include power supply controlled ports 1116, and described image splicing controller 121 also includes the first power supply port 1216 and the
Two power supply ports 1217.In the present embodiment, the power supply controlled ports of one of described image acquisition controller 111
1116 are connected with the first power supply port 1216, and the power supply of another described image acquisition controller 111 is controlled
Port 1116 is connected with the second source control port 1217.Thus, described image splicing controller 121 can be respectively or same
When control two described image acquisition controllers 111 power supply state.
Described image acquisition controller 111 also includes image acquisition device reseting port 1117.Incorporated by reference to Fig. 6, the system
Controller 122 includes the 3rd serial shooting control port 1221, external clock input port 1222, image acquisition device and resets control
Port 1223 and system reset port 1224.Wherein, described image collector reseting controling end mouth 1223 is adopted including the first image
Storage reseting controling end mouth 12231 and the second image acquisition device reseting controling end mouth 12232.In the present embodiment, the processor
130 also include the 4th serial shooting control port 133, external clock output port 134 and system reset control port 135.
In the present embodiment, described image collector reseting port 1117 and described image collector reseting controling end mouth 1223
Connection, so as to realize control of the system controller 122 to the working condition of described image acquisition controller 111.Specifically,
In the present embodiment, wherein, described first image collector reseting controling end mouth 12231 and a described image acquisition controller
111 described image collector reseting port 1117 connects, the second image acquisition device reseting controling end mouth 12232 with it is another
The described image collector reseting port 1117 of individual described image acquisition controller 111 connects.Thus, the system controller
122 separately or concurrently can reset to described image acquisition controller 111.Described 3rd serial shooting control port 1221
It is connected with the described 4th serial shooting control port 133, to realize the string of the system controller 122 and the processor 130
Row bus communicate.The external clock input port 1222 is connected with the external clock output port 134, to pass through the place
Reason device 130 is the system controller 122, i.e., is that described image splicer 120 provides external clock by the processor 130
Signal.The system reset port 1224 is connected with the system reset control port 135, so as to realize the processor 130
Control to the working condition of the system controller 122.
By above-mentioned setting, when described image splicing controller 121 is that described image acquisition controller 111 provides reference
Clock, also, after being resetted to described image acquisition controller 111, described image acquisition controller 111 is just started working,
Realize described image acquisition controller 111 and the synchronous transfer data image signal of described image splicing controller 121.
Alternatively, in the present embodiment, the system controller 122 also includes the first communication bus port set 1225.It please tie
Fig. 7 is closed, described image splicer 120 also includes the memory 123 for storage bottom application program, and the memory 123 wraps
Include the second communication bus port set 1231.The first communication bus port set 1225 and the second communication bus port set
1231 connections.
In the present embodiment, the first communication bus port set 1225 and the second communication bus port set 1231 are string
Row Peripheral Interface (Serial Peripheral Interface, SPI).The first communication bus port set 1225 with it is described
Second communication bus port set 1231 passes through SPI communication bus communication.Specifically, the first communication bus port set 1225 is wrapped
The first data-in port, the first data-out port, the first clock port and the first chip select terminal mouth are included, second communication is total
Line end mouth includes the second data-in port, the second data-out port, second clock port and the second chip select terminal mouth.Wherein,
First data-in port is connected with second data-out port, first data-out port and described second
Data-in port is connected, and first clock port is connected with the second clock port, the first chip select terminal mouth and institute
State the connection of the second chip select terminal mouth.
Referring to Fig. 8, in the present embodiment, the processor 130 includes image-signal processor 136 and video encoder
137, described image signal processor 136 and the video encoder 137 connect.It should be noted that alternatively, the present embodiment
In, described image signal processor 136 and video encoder 137 are to be integrated in two function moulds inside the processor 130
Block.
Wherein, described image signal processor 136 is used to carry out noise reduction, image enhaucament and color to second digital picture
Color correction, obtain the image to be compressed of high quality and send to the video encoder 137.The video encoder 137 is used for
Processing is compressed to the image to be compressed received, forms the photographs of compression.Alternatively, in the present embodiment, warp
Image after the compression of video encoder 137 processing is the photographs of H.264 form.
Referring to Fig. 9, in the present embodiment, described image acquisition processing device 100 also includes communication device 140, described logical
Letter device 140 is connected with the processor 130.The communication device 140 can be wireless communication devices, for example, WiFi devices,
Bluetooth transceiver.The communication device 140 can also be wire communication device, for example, USB receives connectivity port.The communication
Device 140 can also include the wireless communication devices and the wire communication device simultaneously.
Incorporated by reference to Figure 10, in the present embodiment, the communication device 140 includes communication controler 141, the and of antenna circuit 142
Crystal oscillating circuit 143.It is defeated that the communication controler 141 includes radio frequency input/output port 1411, crystal oscillator input port 1412, crystal oscillator
Exit port 1413, WiFi communication port set 1414 and Bluetooth communication port set 1415.Incorporated by reference to Figure 11 and Figure 12, the present embodiment
In, the processor 130 also includes WiFi communication control port group 138 and Bluetooth communication control port group 139.Wherein, it is described
Antenna circuit 142 is connected with the radio frequency input/output port 1411, and the crystal oscillating circuit 143 is connected to the crystal oscillator input
Between mouth 1412 and the crystal oscillator output port 1413, the WiFi communication port set 1414 and the WiFi communication control port
The connection of group 138, the Bluetooth communication port set 1415 are connected with the Bluetooth communication control port group 139.
Figure 13 is referred to, is a kind of flow chart of image acquisition and processing method provided in an embodiment of the present invention.Described image
Acquiring and processing method is applied to above-mentioned image acquisition and processing device 100.Above-mentioned image acquisition and processing device 100 includes IMAQ
Device 110, image stitcher 120 and processor 130, described image collector 110 are provided with two, two described image collectors
110 are connected with described image splicer 120 respectively, and described image splicer 120 is connected with the processor 130.Need to illustrate
, image acquisition and processing method provided by the invention is not using the particular order shown in Figure 13 and following either figure as limitation.
The specific steps shown in Figure 13 will be described in detail below.
The optical imagery that fish eye lens generates is converted to the first digital picture by step S100, described image collector 110
And send to described image splicer 120.
Step S200, the institute that described image splicer 120 is converted to the two described image collectors 110 received
State the first digital picture to be spliced, form the second digital picture and send to the processor 130, and control described image
The working condition of collector 110, and the control instruction sent according to the processor 130, control itself working condition.
Alternatively, in the present embodiment, described image splicer 120 includes the image mosaic controller 121 being integrated in one
With system controller 122, described image splicing controller 121 connects with described image collector 110 and the processor 130 respectively
Connect, the system controller 122 is connected with described image collector 110 and the processor 130 respectively.Figure 14 is referred to, can
Selection of land, in the present embodiment, the step S200 includes step S210 and the sub-steps of step S220 two.
Step S210, described image splicing controller 121 are converted to the two described image collectors 110 received
First digital picture spliced, form the second digital picture and simultaneously send to the processor 130.
Step S220, the system controller 122 control the working condition of described image collector 110, and according to described
The control instruction that processor 130 is sent, controls itself working condition.
Step S300, the processor 130 are carried out according to default processing routine to second digital picture received
Processing, form photographs.
Alternatively, in the present embodiment, the processor 130 includes image-signal processor 136 and video encoder 137,
Described image signal processor 136 and the video encoder 137 connect.Figure 15 is referred to, alternatively, in the present embodiment, institute
Stating step S300 includes step S310 and the sub-steps of step S320 two.
Step S310, described image signal processor 136 carry out noise reduction, image enhaucament and color to second digital picture
Color correction, obtain image to be compressed and send to the video encoder 137.
Step S320, the video encoder 137 are compressed processing to the image to be compressed received, form pressure
The photographs of contracting.
Figure 16 is referred to, is a kind of schematic structure frame of image collection processing system 10 provided in an embodiment of the present invention
Figure.Described image acquisition processing system 10 includes terminal device 200 and above-mentioned image acquisition and processing device 100.Described image is adopted
Collection processing unit 100 is communicated to connect with the terminal device 200, and the photographs is sent to the terminal device 200
Handle and show.
It should be noted that alternatively, in the present embodiment, described image acquisition processing device 100 passes through the communicator
Part 140 communicates to connect with the terminal device 200.In addition it is also necessary to illustrate, in the present embodiment, the terminal device 200
May be, but not limited to, mobile phone, tablet personal computer, computer, personal digital assistant (personal digital assistant,
The smart machine such as PDA).
It should be noted that in the present embodiment, the optics of the first digital picture is converted to by described image collector 110
Image is generated by fish eye lens, and in the present embodiment, the optics of the first digital picture is converted to by described image collector 110
Image is generated by 210 ° of wide-angle lens, so, splice through described image splicer 120, and handled through the processor 130
The photographs of formation lap be present.The terminal device 200 is used for the lap according to the photographs, looks for
Go out the characteristic point of the lap, handled by smooth equilibrium etc., form panoramic picture.
In the present embodiment, handling the photographs for the terminal device 200, the process of panoramic picture is formed
Specifically can be as follows.
First, the photographed images are read, and extract the SIFT feature of the photographed images, recycle K-d tree and
BBF algorithms carry out characteristic matching lookup, and carry out preliminary screening according to arest neighbors and time nearest neighbor distance ratio, then utilize
RANSAC algorithms screen match point and calculate transformation matrix, finally carry out image co-registration, i.e., carry out smooth equilibrium etc. to image
Reason, form a comprehensive 360 ° of panoramic picture that can be interacted.
In summary, image acquisition and processing device provided in an embodiment of the present invention, method and system, pass through image acquisition device
The optical imagery of fish eye lens generation is converted to the first digital picture by 110, by image stitcher 120 to two IMAQs
First digital picture that device 110 is converted to carries out being spliced to form the second digital picture, and sends to processor 130 and carry out
Processing, photographs is formed, in terms of existing technologies, realizes the acquisition of big visual field photographic picture, meeting market needs
Ask.
Obviously, those skilled in the art should be understood that the function of the above-mentioned embodiment of the present invention can use general meter
Device is calculated to realize, they can be concentrated on single computing device, or are distributed in the net that multiple computing devices are formed
On network, alternatively, they can be realized with the existing program code or algorithm that computing device can perform, it is thus possible to by it
Store and performed in the storage device by computing device, they are either fabricated to each integrated circuit device respectively or will
Multiple devices or step in them are fabricated to single integrated circuit device to realize.So, functions implementing the present invention are not restricted to
Any specific hardware and software combines.
It should be noted that:Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined, then it further need not be defined and explained in subsequent accompanying drawing in individual accompanying drawing.In description of the invention
In, term " first ", " second ", " the 3rd ", " the 4th " etc. are only used for distinguishing description, and it is not intended that being or implying relative
Importance.In addition, in the description of the invention, it is necessary to which the orientation of the instruction such as explanation, term " end " or position relationship are base
In orientation shown in the drawings or position relationship, or the invention product using when the orientation usually put or position relationship, only
It is to be described for the ease of description is of the invention with simplified, rather than the device or element of instruction or hint meaning must be with specifically
Orientation, with specific azimuth configuration and operation, therefore be not considered as limiting the invention.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should be included in the scope of the protection.
Claims (10)
1. a kind of image acquisition and processing device, it is characterised in that described including image acquisition device, image stitcher and processor
Image acquisition device is provided with two, and two described image collectors are connected with described image splicer respectively, described image splicing
Device is connected with the processor;
Described image collector, the optical imagery for fish eye lens to be generated are converted to the first digital picture and sent to described
Image stitcher;
Described image splicer, first digital picture being converted to for two described image collectors to receiving
Spliced, form the second digital picture and send to the processor, and the working condition of control described image collector,
And the control instruction sent according to the processor, control itself working condition;
The processor, for being handled according to default processing routine second digital picture received, formation is taken the photograph
Shadow image.
2. image acquisition and processing device according to claim 1, it is characterised in that described image splicer includes being integrated in
The image mosaic controller and system controller of one, described image splicing controller respectively with described image collector and described
Processor is connected, and the system controller is connected with described image collector and the processor respectively;
Described image splicing controller, first numeral being converted to for two described image collectors to receiving
Image is spliced, and is formed the second digital picture and is sent to the processor;
The system controller, for controlling the working condition of described image collector, and the control sent according to the processor
System instruction, controls itself working condition.
3. image acquisition and processing device according to claim 2, it is characterised in that described image collector is adopted including image
Collect controller, described image acquisition controller include the first bus port, the first serial shooting control port, master clock port,
Frame synchronizing signal input port and the first difference output port group, the first difference output port group are provided with multigroup;
Described image splicing controller includes the second serial shooting control port, reference clock port, frame synchronizing signal port, the
One Differential Input port group and the second difference output port group, the first Differential Input port group be provided with it is multigroup, described
Two difference output port groups are provided with multigroup;
The processor includes the second bus port and the second Differential Input port group, and the second Differential Input port group is set
Have multigroup;
First bus port is connected with second bus port, the described first serial shooting control port and described second
Serial shooting control port connection, the master clock port are connected with the reference clock port, the frame synchronizing signal input
Port is connected with the frame synchronizing signal port, multigroup first difference output port group and multigroup first Differential Input
Port set is connected and corresponded, and multigroup second difference output port group connects with multigroup second Differential Input port group
Connect and correspond.
4. image acquisition and processing device according to claim 3, it is characterised in that described image acquisition controller also includes
Image acquisition device reseting port;
The system controller includes the 3rd serial shooting control port, image acquisition device reseting controling end mouth and system reset end
Mouthful;
The processor also includes the 4th serial shooting control port and system reset control port;
Described image collector reseting port is connected with described image collector reseting controling end mouth, the described 3rd serial shooting control
Port processed is connected with the described 4th serial shooting control port, and the system reset port connects with the system reset control port
Connect.
5. image acquisition and processing device according to claim 2, it is characterised in that it is logical that the system controller includes first
Believe bus port group, described image splicer also includes memory, and the memory includes the second communication bus port set;
The first communication bus port set is connected with the second communication bus port set.
6. image acquisition and processing device according to claim 1, it is characterised in that the processor is included at picture signal
Reason device and video encoder, described image signal processor connect with the video encoder;
Described image signal processor, for carrying out noise reduction, image enhaucament and colour correction to second digital picture, obtain
Image to be compressed is simultaneously sent to the video encoder;
The video encoder, for being compressed processing to the image to be compressed received, form the graph of compression
Picture.
7. image acquisition and processing device according to claim 1, it is characterised in that described image acquisition processing device also wraps
Communication device is included, the communication device is connected with the processor.
8. image acquisition and processing device according to claim 7, it is characterised in that the communication device includes Control on Communication
Device, antenna circuit and crystal oscillating circuit;
The communication controler includes radio frequency input/output port, crystal oscillator input port, crystal oscillator output port, WiFi communication port
Group and Bluetooth communication port set;
The processor includes WiFi communication control port group and Bluetooth communication control port group;
The antenna circuit is connected with the radio frequency input/output port, and the crystal oscillating circuit is connected to the crystal oscillator input port
Between the crystal oscillator output port, the WiFi communication port set is connected with the WiFi communication control port group, the indigo plant
Tooth COM1 group is connected with the Bluetooth communication control port group.
9. a kind of image acquisition and processing method, it is characterised in that adopted applied to the image described in claim 1~8 any one
Collect processing unit, described image acquisition processing device includes image acquisition device, image stitcher and processor, described image collection
Device is provided with two, and the input of the output ends of two described image collectors respectively with described image splicer is connected, described
The output end of image stitcher is connected with the processor, and methods described includes;
The optical imagery that fish eye lens generates is converted to the first digital picture and sent to described image by described image collector
Splicer;
First digital picture that described image splicer is converted to the two described image collectors received is carried out
Splicing, form the second digital picture and send to the processor, and the working condition of control described image collector, and root
The control instruction sent according to the processor, controls itself working condition;And
The processor is handled second digital picture received according to default processing routine, forms graph
Picture.
10. a kind of image collection processing system, it is characterised in that including described in terminal device and claim 1~8 any one
Image acquisition and processing device, described image acquisition processing device is connected with the terminal equipment in communication, by the graph
Handle and show to the terminal device as sending.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710254440.3A CN107426485A (en) | 2017-04-18 | 2017-04-18 | Image acquisition and processing device, method and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710254440.3A CN107426485A (en) | 2017-04-18 | 2017-04-18 | Image acquisition and processing device, method and system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107426485A true CN107426485A (en) | 2017-12-01 |
Family
ID=60423301
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710254440.3A Pending CN107426485A (en) | 2017-04-18 | 2017-04-18 | Image acquisition and processing device, method and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107426485A (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101304515A (en) * | 2007-05-11 | 2008-11-12 | 徐世刚 | Panorama type reverse guidance system |
CN102638649A (en) * | 2012-03-06 | 2012-08-15 | 浙江大学 | USB3.0 high-speed high-definition industrial camera |
CN103809880A (en) * | 2014-02-24 | 2014-05-21 | 清华大学 | Man-machine interaction system and method |
CN104835118A (en) * | 2015-06-04 | 2015-08-12 | 浙江得图网络有限公司 | Method for acquiring panorama image by using two fish-eye camera lenses |
CN104994370A (en) * | 2015-06-30 | 2015-10-21 | 中国科学院自动化研究所 | 3D (three-dimensional) video image acquisition system |
CN105744137A (en) * | 2016-04-22 | 2016-07-06 | 王俊懿 | System for real-time correction and splicing of image formed by fish-eye lens through using hardware circuit |
CN206611496U (en) * | 2017-04-18 | 2017-11-03 | 深圳博电诚科国际贸易有限公司 | Image acquisition and processing apparatus and system |
-
2017
- 2017-04-18 CN CN201710254440.3A patent/CN107426485A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101304515A (en) * | 2007-05-11 | 2008-11-12 | 徐世刚 | Panorama type reverse guidance system |
CN102638649A (en) * | 2012-03-06 | 2012-08-15 | 浙江大学 | USB3.0 high-speed high-definition industrial camera |
CN103809880A (en) * | 2014-02-24 | 2014-05-21 | 清华大学 | Man-machine interaction system and method |
CN104835118A (en) * | 2015-06-04 | 2015-08-12 | 浙江得图网络有限公司 | Method for acquiring panorama image by using two fish-eye camera lenses |
CN104994370A (en) * | 2015-06-30 | 2015-10-21 | 中国科学院自动化研究所 | 3D (three-dimensional) video image acquisition system |
CN105744137A (en) * | 2016-04-22 | 2016-07-06 | 王俊懿 | System for real-time correction and splicing of image formed by fish-eye lens through using hardware circuit |
CN206611496U (en) * | 2017-04-18 | 2017-11-03 | 深圳博电诚科国际贸易有限公司 | Image acquisition and processing apparatus and system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN217849511U (en) | Image capturing apparatus, device and system and integrated sensor optical component assembly | |
CN102821238B (en) | Wide-field ultra-high-resolution imaging system | |
CN103780830B (en) | Linkage type photographing system and control method of multiple cameras thereof | |
CN202395858U (en) | Binocular photographic device | |
CN106357991A (en) | Image processing method, image processing apparatus, and display system | |
CN105516569A (en) | Method and device for obtaining omni-directional image | |
CN109672827A (en) | For combining the electronic device and its method of multiple images | |
CN110022431A (en) | Photographic device, image capture method, display device and display methods | |
CN112188093B (en) | Bimodal signal fusion system and method | |
CN205545526U (en) | Obtain panoramic picture's device | |
CN102724477A (en) | Device and method for carrying out real-time splicing on surveillance videos based on FPGA (field programmable gata array) | |
CN106303179A (en) | A kind of full shot for mobile terminal | |
CN108848354A (en) | A kind of VR content camera system and its working method | |
CN206807614U (en) | Pisces eye panoramic picture harvester | |
CN109600556B (en) | High-quality precise panoramic imaging system and method based on single lens reflex | |
CN114693569A (en) | Method for fusing videos of two cameras and electronic equipment | |
CN112822371B (en) | Image processing chip, application processing chip, data statistical system and method | |
CN104580895A (en) | Airborne imaging system with synchronous camera shooting and photographing capacity | |
CN206611496U (en) | Image acquisition and processing apparatus and system | |
CN105472226A (en) | Front and rear two-shot panorama sport camera | |
CN109089048A (en) | More camera lens full-view cooperative device and methods | |
CN106534650A (en) | System and method for photographing panoramic image | |
CN106950791A (en) | Panoramic photographing apparatus | |
CN107426485A (en) | Image acquisition and processing device, method and system | |
CN206594441U (en) | Panoramic photographing apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20200922 |
|
AD01 | Patent right deemed abandoned |