CN1738355A - Interactive device for integrating image processing circuit and image sensor in one substrate - Google Patents
Interactive device for integrating image processing circuit and image sensor in one substrate Download PDFInfo
- Publication number
- CN1738355A CN1738355A CNA2004100585613A CN200410058561A CN1738355A CN 1738355 A CN1738355 A CN 1738355A CN A2004100585613 A CNA2004100585613 A CN A2004100585613A CN 200410058561 A CN200410058561 A CN 200410058561A CN 1738355 A CN1738355 A CN 1738355A
- Authority
- CN
- China
- Prior art keywords
- image
- interactive apparatus
- substrate
- coffret
- image sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 43
- 238000012545 processing Methods 0.000 title claims abstract description 29
- 239000000758 substrate Substances 0.000 title claims description 25
- 230000005540 biological transmission Effects 0.000 claims abstract description 22
- 238000011156 evaluation Methods 0.000 claims abstract description 22
- 230000003068 static effect Effects 0.000 claims abstract description 17
- 230000003287 optical effect Effects 0.000 claims description 6
- 238000000034 method Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 6
- 238000013461 design Methods 0.000 description 4
- 238000012546 transfer Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 206010021703 Indifference Diseases 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000010205 computational analysis Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000008521 reorganization Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
- Image Input (AREA)
Abstract
Disclosed a interactive device for integrating the image processing circuit and the image sensor into one base, comprises a processing module and a control circuit. Wherein, the processing module comprises: a base, a image sensor for extracting the pixel signals relative to one image; a evaluation unit for judging the static image parameter of at least one image for forming said image according to said pixel signals; and a transmission interface for outputting static image parameter of at least one image produced by the evaluation unit by the method of serial transmission; the control circuit controls the operation of interactive device according to the static image parameter output by the transmission interface. In addition, the image sensor, the evaluation, and the transmission interface are all formed on said base.
Description
Technical field
The present invention relates to a kind of interactive apparatus, refer to a kind of interactive apparatus that image-processing circuit and image sensor is integrated in a substrate especially.
Background technology
Along with prevailing of audio-visual multimedia, image digitization becomes trend gradually.Known image sensor has become digital camera (Digital Video Camcorder) gradually, (Digital Still Camera DSC) waits digital device to absorb the usefulness of dynamic image to digital camera.Yet the higher image sensor of resolution can produce accurate digitized video quality, so be applied in mostly on image identification, the identification of fingerprint.But the image sensor that resolution is low then utilizes mostly on interacting toys, with the usefulness as simple action recognition.For instance, the present robot of releasing on the market is installed on " eyes " that the interior camera of robot can be used as interacting toys, induces user's action, then makes different instructions by the bist control circuit indication.
See also Fig. 1, Fig. 1 is the functional block diagram of known interactive apparatus 10.Interactive apparatus 10 comprises an image sensor 12, a microcontroller 14 and the defeated bus 16 of biographies in the lump.Image sensor 12 is to comprise a CMOS sensing array 22 and an analog-digital converter (analog to digital converter, ADC) 24.The data that 22 sensings of CMOS sensing array come out can be sent to analog-digital converter 24.Because CMOS sensing array 22 can sense most pixel informations.And each image is made up of most pixel informations.So if take a dynamic continuous image, the CMOS sensing array 22 of image sensor 12 just must constantly produce each pixel information.In order to transmit huge pixel information, be to see through the pixel information of the defeated bus 16 transmission institute sensings of biographies in the lump between image sensor 12 and the control circuit 12.Microcontroller 14 then can be according to the pixel information that obtains, the image of the object that reorganization is taken, or be used for judging the state of shot object, with the running of further control interactive apparatus 10.
Yet the data quantity of general 12 sensings of image sensor is very huge, still along with the fast development of serial transmission, uses the also transmission speed of too late serial transmission of the complicated transmitting speed arranged side by side of hardware structure.In addition, after microcontroller 14 utilizes coffret arranged side by side to receive the data of these sensings, also computational analysis goes out required data voluntarily, because the range of application of every kind of microcontroller 14 is also inconsistent, for instance, concerning the microcontroller 14 that is applied to mouse, microcontroller 14 does not need to obtain complete image, only needs to follow the trail of the relative position that imaged object moves.If use known image sensor 12 to produce pixel information thus, microcontroller 14 must all be received processing with all pixel informations, causes the burden in the processing.
In addition, image sensor 12 now is single-chips, and its function only is that the simple light with receiving converts the corresponding signal of telecommunication to.Under the circuit design trend of being particular about system combination, such single-chip image sensor 12 has improved necessity in fact.
Summary of the invention
The technical problem to be solved in the present invention provides a kind of interactive apparatus, its utilization is integrated in image-processing circuit and image sensor the chip of one substrate, be able to calculate earlier the specific image parameter that needs, transmit again and give control circuit and handle, with the complexity of the design of saving control circuit.
The invention provides and a kind of image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate, it comprises a processing module and a control circuit.Processing module comprises a substrate; One image sensor is used for and will captures the pairing majority of an image picture element signal; One evaluation unit is used for judging according to most picture element signals the static image parameter of each imaged object that forms images; And a coffret (transmission interface), be used for exporting the static image parameter that evaluation unit is produced in the mode of serial transmission.Control circuit (controller) is to be used for exporting the operation of static image parameter with the control interactive apparatus according to coffret.Image sensor, evaluation unit and coffret all are formed in this substrate.
According to the present invention, the static image parameter is an imaged object when being in static the demonstration, can be for the parameter that measures.For example the static image parameter of each imaged object is one of following parameter or its combination: the object number of endpoint of the directioin parameter of the coordinate of this imaged object, the area parameters of this imaged object, this imaged object, the color parameter of this imaged object, this imaged object, the object length-width ratio of this imaged object, and the boundary parameter of this imaged object.
Description of drawings
Below in conjunction with accompanying drawing the specific embodiment of the present invention is described in further detail
Fig. 1 is the functional block diagram of known interactive apparatus.
Fig. 2 is the functional block diagram of interactive apparatus of the present invention.
Fig. 3 is the schematic diagram of most image frames.
The primary clustering symbol description
10 interactive apparatus, 12 image sensors
14 microcontrollers, 16 transfer bus arranged side by side
22 CMOS sensing arrays, 24 analog-digital converters
41 substrates of 30 interactive apparatus
42 image sensors, 44 processing modules
45 evaluation units, 46 computing units
48,52 coffrets, 54 control circuits
100,150 imaged objects, 110,120 pictures
115,125,135 search areas, 130 pictures
Embodiment
See also Fig. 2, Fig. 2 is the functional block diagram of interactive apparatus 30 of the present invention.Interactive apparatus can be a mouse or an interacting toys (interactive toy).Interactive apparatus 30 comprises a processing module 44 and a control circuit 46.Processing module 44 is a chip.Processing module 44 comprises an image sensor 42, its can be a Charged Coupled Device (charge-coupled device, CCD) or a CMOS optical sensor, to be used for most digital pixel (pixel) signals of acquisition.Most pixel signals that produce are sent to processing module 44.Processing module 44 comprises a substrate 41, an evaluation unit 45, a computing unit 46 and coffret 48,52.Image sensor 42, evaluation unit 45, computing unit 46 and coffret 48,52 all are formed in the substrate 41.
See also Fig. 3, Fig. 3 is the schematic diagram of most image frames.Each picture (picture) can be combined by most picture element signals.For instance, concerning the picture of a 800*600 size, need 480,000 picture element signals to combine altogether.Image sensor 42 promptly is to be used for producing most picture element signals.And most picture element signals that produce are sent to after the evaluation unit 45, and evaluation unit 45 will be judged the various parameters of each image according to most picture element signals.With target picture 120 is example, the decision show state of destination object 100 on target picture 120 can determine by several image parameters, such as parameters such as coordinate, area (size), color parameter, directivity (orientation) and border (boundary), the object number of endpoint of destination object 100 on target picture 120, object length-width ratios.For instance, destination object 100 can be considered the set of the picture element signal with same hue parameter, and evaluation unit 45 can be judged the parameters such as size, directivity border and GTG value of destination object 100 in target picture 120 according to number with same pixel signal and coordinate.Parameters such as evaluation unit 45 all right decision objects number of endpoint and object length-width ratio.For instance, if destination object 100 is rectangles, then can also to determine the object number of endpoint be 4 to evaluation unit 45, and the length-width ratio of this rectangular object.In other words, when static image system of parameters destination object 100 is in static the demonstration, can be for the parameter that measures.
In addition, general so-called dynamic image is a succession of continuous image sequence in fact, yet because have a kind of existing picture of the persistence of vision on the human vision, so can produce the illusion of the image that links up.And in this kind dynamic image, because the time interval between picture is very little, so several indifferences between the picture that faces mutually are the change in location of picture material mostly.If when showing a dynamic image, most the picture element signals of must constantly recombinating in theory just can present continuous image.Yet, in general, on same image frame, have some common characteristics, perhaps be on the color, perhaps be on how much, or the further feature value obtain.Remove the mode of the redundant information on these spaces, will identify element important in the picture exactly, and remove repetition and do not have the element of demand.Please continue to consult Fig. 3, target picture 120 is to be distinguished into a plurality of objects, and each object can be any size.Each object in the middle of the target picture 120, be according to its with time shaft on difference between a object in the middle of the last picture 110, or and the central object of back one picture 130 between difference encode.With a destination object 100 carry out matching ratio to the time, can compare one by one to the object to be compared of all similar sizes in the search area 115 of last picture 110, or to a search area 135 of back one picture 130 in the object to be compared of all similar sizes compare one by one.In Fig. 3, after comparison, in the middle of all objects to be compared of last picture 110 and back one picture 130, find out is a references object 150 with destination object 100 difference minimums.The displacement difference that references object 150 and destination object are 100 is dynamic vector (motion vector).Computing unit 46 can see through above-mentioned mode and determine dynamic vector between each object.
After evaluation unit 45 and computing unit 46 obtain the relevant parameter of image, will respectively these image parameters be transmitted and give coffret 48,52.Coffret 48,52 can be an asynchronism transceiver (universal asynchronous receiver/transmitter, UART) interface.Compared to synchronous concatenation transmission (synchronons parallel transmission), it is little that asynchronous serial (asynchronous serial) transmission has a volume, advantages such as cheap and long transmission distance.For instance, UART Universal Asynchronous Receiver Transmitter is a kind of a kind of asynchronous serial/parallel data transducer that includes the transfer of data between the serial type device (serial device) that is used for controlling this interactive apparatus 30 (or a processor) and is connected with interactive apparatus 30.More particularly, the function series of interactive apparatus that UART provides 30 is similar in appearance to data termination equipment (the data terminal equipment such as RS-232, DTE) the data function of exchange that is provided, so that interactive apparatus 30 can see through as universal serial bus (universal serial bus, serial type bus USB) and the mutual swap date of serial type device.
Except mentioned before UART (RS232 is a kind of of UART), coffret 48,52 also can be I2C (inter-IC) and USB etc.I2C is a kind of agreement that sees through two two-way (send and receive) transmission line (serial data line SDA and serial clock pulse line SCL) with transfer of data.Because the principle system of conversion serial data such as I2C and USB and data side by side is similar in appearance to the UART conversion serial data and the principle of data side by side, and is all this field person and knows, so do not repeat them here.
In other words, at least a interface in first coffret 48 or the second coffret 52 serial transmission group that can be constituted for UART interface, I2C and USB.
At last, control circuit 54 is after receiving static parameters such as the dynamic vector (motion vector) that transmitted by coffret 48,52 or the coordinate of object 110, size (size), color parameter, directivity (orientation), border (boundary), object number of endpoint, object length-width ratio, can utilize the coding of each object in the last picture 110, the dynamic vector and the static parameter that cooperate each object in the target picture 120 are to reduce target picture 120.Or control circuit 54 is done further other processing according to these parameters, with the operation of control interactive apparatus 30.
Among another embodiment, first coffret 48 of the data that responsible transmission evaluation unit 45 is produced can be integrated into same interface with second coffret 52 of the dynamic vector that responsible transmission computing unit 46 is calculated.
For the interactive apparatus of optical mouse and so on,, pay much attention to for the shift position of cursor (can be considered an object) because optical mouse is a simple cursor (cursor) control device.So the parameter of the size of the imaged object that is determined for evaluation unit 45 and directivity and so on does not need especially, relatively payes attention to the dynamic vector that computing unit 46 is determined on the contrary.Therefore among the 3rd embodiment, processing module 44 can be at the device of optical mouse and so on, only design image sensor 42, computing unit 46 and second coffret 52 are formed in the same substrate 41, and do not need the evaluation unit 45 and first coffret 48 also together are formed in the same substrate 41.
Among the 4th embodiment, processing module 44 can only be formed at image sensor 42, evaluation unit 45 and first coffret 48 in the same substrate 41, and does not need the computing unit 46 and second coffret 52 also together are formed in the same substrate 41.
Compared to known technology, the processing module 44 that the present invention includes image sensor 42, evaluation unit 45, computing unit 46, coffret 48,52 can be integrated into the single-chip that is positioned at same substrate 41.Evaluation unit 45 can be judged the coordinate of most picture element signals, and determines the image parameters such as size, border, directivity and color parameter of imaged object according to pixel coordinate.And computing unit 46 can calculate dynamic vector via most the signal of video signal that image sensor 42 is transmitted in advance.Simultaneously coffret 48,52 is to utilize the UART interface or other any serial transmission interface transmits the image parameter that these calculate.So use the interactive apparatus 30 of the designed chip of the framework of processing module of the present invention, because this chip can calculate these image parameters in advance, utilize general serial transmission interface (as UART) that parameter is transmitted simultaneously and give control circuit 54, no longer need additionally to go to calculate these complicated parameter so be positioned at the control circuit 54 of rear end, also therefore reduce the complexity of Circuit Design, make that the use elasticity of control circuit 54 of interactive apparatus 30 is bigger, and shorten the time-histories of interactive apparatus exploitation.
The above only is preferred embodiment of the present invention, and all equalizations of being done according to the present patent application claim change and modify, and all should belong to the covering scope of patent of the present invention.
Claims (12)
1. one kind is integrated in the interactive apparatus of a substrate with image-processing circuit and image sensor, and it is characterized in that: it has a processing module, and this processing module comprises
One substrate;
One image sensor is formed in the substrate, is used for capturing the pairing majority of an image picture element signal;
One evaluation unit is formed in the substrate, is used for constituting according to the decision of this majority picture element signal the static image parameter of at least one imaged object of this image; And
One coffret is formed in the substrate, is used for exporting in the mode of serial transmission the static image parameter of this at least one imaged object; And
One control circuit is used for the static image parameter of the imaged object exported according to this coffret to control the operation of this interactive apparatus.
2. by the described interactive apparatus of claim 1, it is characterized in that: the static image parameter of imaged object is one of following parameter or its combination in this device: the object number of endpoint of the directioin parameter of the coordinate of this imaged object, the area parameters of this imaged object, this imaged object, the color parameter of this imaged object, this imaged object, the object length-width ratio of this imaged object, and the boundary parameter of this imaged object.
3. according to the described interactive apparatus of claim 1, it is characterized in that: the coffret of this device is an I
2C interface.
4. according to the described interactive apparatus of claim 1, it is characterized in that: the coffret of this device is a USB.
5. according to the described interactive apparatus of claim 1, it is characterized in that: the coffret of this device is a UART Universal Asynchronous Receiver Transmitter.
6. according to the described interactive apparatus of claim 1, it is characterized in that: this image sensor is a CMOS optical sensor.
7. according to the described interactive apparatus of claim 1, it is characterized in that: this image sensor is a Charged Coupled Device.
8. one kind is integrated in the interactive device of a substrate with image-processing circuit and image sensor, and it is characterized in that: it has a processing module, and this processing module comprises
One substrate;
One image sensor is formed in the substrate, is used for capturing most signal of video signal;
One computing unit is formed in this substrate, is used for calculating dynamic vector according to this majority signal of video signal; And
One coffret is formed in the substrate, is used for exporting this dynamic vector in the mode of serial transmission; And
One control circuit, this dynamic vector that is used for exporting according to this coffret is to control the operation of this interactive apparatus.
9. according to the described interactive apparatus of claim 8, it is characterized in that: this coffret is a UART Universal Asynchronous Receiver Transmitter.
10. according to the described interactive apparatus of claim 8, it is characterized in that: this coffret is an I
2C interface.
11. according to the described interactive apparatus of claim 8, it is characterized in that: this image sensor is a CMOS optical sensor.
12. according to the described interactive apparatus of claim 8, it is characterized in that: this image sensor is a Charged Coupled Device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100585613A CN100559334C (en) | 2004-08-18 | 2004-08-18 | Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100585613A CN100559334C (en) | 2004-08-18 | 2004-08-18 | Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1738355A true CN1738355A (en) | 2006-02-22 |
| CN100559334C CN100559334C (en) | 2009-11-11 |
Family
ID=36081000
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100585613A Ceased CN100559334C (en) | 2004-08-18 | 2004-08-18 | Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100559334C (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103177174A (en) * | 2011-12-26 | 2013-06-26 | 原相科技股份有限公司 | Interactive type electronic device |
| US8725208B2 (en) | 2008-11-05 | 2014-05-13 | Pixart Imaging Inc. | Serial transmission interface between an image sensor and a baseband circuit |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9024880B2 (en) | 2004-08-11 | 2015-05-05 | Pixart Imaging Inc. | Interactive system capable of improving image processing |
| TWI236289B (en) | 2004-08-11 | 2005-07-11 | Pixart Imaging Inc | Interactive device capable of improving image processing |
| TWI508543B (en) * | 2010-05-06 | 2015-11-11 | Pixart Imaging Inc | Interactive system capable of improving image processing |
-
2004
- 2004-08-18 CN CNB2004100585613A patent/CN100559334C/en not_active Ceased
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8725208B2 (en) | 2008-11-05 | 2014-05-13 | Pixart Imaging Inc. | Serial transmission interface between an image sensor and a baseband circuit |
| CN103177174A (en) * | 2011-12-26 | 2013-06-26 | 原相科技股份有限公司 | Interactive type electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100559334C (en) | 2009-11-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8760390B2 (en) | Interactive device capable of improving image processing | |
| US10805528B2 (en) | Image capturing apparatus, information processing system, information processing apparatus, and polarized-image processing method | |
| CN102202171B (en) | Embedded high-speed multi-channel image acquisition and storage system | |
| JP2010136413A (en) | High-speed vision sensor | |
| CN1263282C (en) | Apparatus for and method of interfacing between an image sensor and an image processor | |
| CN103430531A (en) | Video processing apparatus, video processing system, and video processing method | |
| CN115714855A (en) | Three-dimensional visual perception method and system based on stereoscopic vision and TOF fusion | |
| CN100559334C (en) | Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate | |
| CN101452349A (en) | Cursor controller on image display apparatus, method and image system | |
| US20040001074A1 (en) | Image display apparatus and method, transmitting apparatus and method, image display system, recording medium, and program | |
| US9024880B2 (en) | Interactive system capable of improving image processing | |
| CN2664064Y (en) | Pointer input device | |
| CN111696143A (en) | Event data registration method and system | |
| US8305460B2 (en) | Detection device and image capture system using the same | |
| CN102238358B (en) | Interactive system capable of improving image processing speed and method thereof | |
| KR20100028007A (en) | An image sensor, the operating method and usage thereof | |
| CN107635087A (en) | Solid state image sensor and image-sensing method | |
| CN1855004A (en) | Mouse with imaging function and its usage | |
| CN206133469U (en) | Stage interaction system based on 3D motion -sensing camera | |
| CN207321376U (en) | Solid state image sensor | |
| CN1960440A (en) | Camera system | |
| CN201457257U (en) | Vehicle-mounted safety monitoring device | |
| CN100535704C (en) | Method for controlling digit microscope output image by data-handling terminal | |
| CN211606671U (en) | AI800 ten thousand pixel camera mainboards | |
| Lee et al. | High-Speed CMOS Color Stereo Camera with Low Complexity VLSI Implementation for Real-Time 3D Vision Applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C35 | Partial or whole invalidation of patent or utility model | ||
| IP01 | Partial invalidation of patent right |
Commission number: 4W100538 Conclusion of examination: If the patent right is declared invalid, the patent right of invention No. 200410058561.3 shall be valid on the basis of the amendment of the claim submitted by the patent holder in November 19, 2010. Decision date of declaring invalidation: 20110418 Decision number of declaring invalidation: 16363 Denomination of invention: Interactive device for integrating image processing circuit and image sensor in one substrate Granted publication date: 20091111 Patentee: PixArt Imaging Inc. |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20210902 Address after: Hsinchu City, Taiwan, China Patentee after: Egis Technology Inc. Address before: Hsinchu City, Taiwan, China Patentee before: PixArt Imaging Inc. |
|
| TR01 | Transfer of patent right | ||
| IW01 | Full invalidation of patent right |
Decision date of declaring invalidation: 20220905 Decision number of declaring invalidation: 57993 Granted publication date: 20091111 |
|
| IW01 | Full invalidation of patent right |