CN111522455B - Image sensor comprising self-energy conversion pixels - Google Patents
Image sensor comprising self-energy conversion pixels Download PDFInfo
- Publication number
- CN111522455B CN111522455B CN202010294194.6A CN202010294194A CN111522455B CN 111522455 B CN111522455 B CN 111522455B CN 202010294194 A CN202010294194 A CN 202010294194A CN 111522455 B CN111522455 B CN 111522455B
- Authority
- CN
- China
- Prior art keywords
- pixels
- self
- image
- energy
- image sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000006243 chemical reaction Methods 0.000 title claims abstract description 57
- 238000004146 energy storage Methods 0.000 claims abstract description 44
- 230000003287 optical effect Effects 0.000 claims description 46
- 238000006073 displacement reaction Methods 0.000 claims description 34
- 230000008878 coupling Effects 0.000 claims 2
- 238000010168 coupling process Methods 0.000 claims 2
- 238000005859 coupling reaction Methods 0.000 claims 2
- 230000008859 change Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 9
- 238000000034 method Methods 0.000 description 8
- 239000003990 capacitor Substances 0.000 description 7
- 230000001276 controlling effect Effects 0.000 description 3
- 230000002596 correlated effect Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 238000009792 diffusion process Methods 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03543—Mice or pucks
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
An image sensor for operating on a work surface, comprising: an image frame buffer; an energy storage assembly; and an image sensing array for sensing reflected light from the work surface, the image sensing array comprising: a plurality of active sensing pixels for outputting image data according to the sensed reflected light, respectively, each of the plurality of active sensing pixels including a read switch for controlling the output of the image data to the image frame buffer; and a plurality of self-energy conversion pixels for outputting photocurrents according to the sensed reflected light, respectively, each of the plurality of self-energy conversion pixels including an energy storage switch for controlling the photocurrent to be output to the energy storage component so that the energy storage component stores electric energy of the photocurrent.
Description
The application is a divisional application of Chinese patent application with the application number of 201610080041.5, the application date of 2016, 02 and 04, and the name of self-powered optical mouse device and an operation method thereof.
Technical Field
The present invention relates to an optical mouse device, and more particularly, to a self-powered optical mouse device and an operating method thereof.
Background
Optical mouse devices typically include a light source and an image sensor. The power consumed by the light source occupies the largest proportion of the power consumed by the optical mouse device. Therefore, how to reduce the power consumption of the light source is an important issue.
In the prior art, when the optical mouse device is not operated for a period of time, the overall power consumption can be reduced by reducing the light emitting brightness of the light source or reducing the data reading speed of the image sensor.
However, as described above, the current optical mouse devices are designed to reduce power consumption, and cannot feed back the light energy of the light source as the power for the operation of the optical mouse device.
In view of the above, the present invention provides an optical mouse device, which can use part of the energy of the system light source as the power when the optical mouse operates, so as to improve the energy utilization efficiency.
Disclosure of Invention
The invention provides an optical mouse device which can convert part of light energy of a system light source into electric energy which can be utilized by the optical mouse device.
The invention provides an image sensor comprising an image frame buffer, an energy storage component and an image sensing array. The image sensing array is used for sensing reflected light from the working surface and comprises a plurality of active sensing pixels and a plurality of self-energy conversion pixels. The plurality of active sensing pixels are used for respectively outputting image data according to the sensed reflected light, and each of the plurality of active sensing pixels comprises a read switch for controlling the image data to be output to the image frame buffer.
The invention also provides an image sensor comprising the image frame buffer, the energy storage component and the image sensing array. The image sensing array comprises a plurality of active sensing pixels and a plurality of self-energy conversion pixels. The self-energy conversion pixels are used for outputting photocurrents according to the sensed reflected light respectively, and each self-energy conversion pixel comprises an energy storage switch used for controlling the photocurrent to be output to the energy storage component so that the energy storage component stores electric energy of the photocurrent.
To make the above and other objects, features and advantages of the present invention more apparent, the following detailed description will be made in conjunction with the accompanying drawings. In the description of the present invention, the same components are denoted by the same symbols, and are described in advance herein.
Drawings
FIG. 1 is a schematic diagram of an optical mouse device according to an embodiment of the invention.
FIGS. 2A-2C are schematic diagrams illustrating pixel arrangements of an image sensor array including self-energy converting pixels according to some embodiments of the present invention.
FIG. 3 is a flowchart illustrating a method for operating an optical mouse device according to an embodiment of the invention.
FIG. 4 is a schematic diagram illustrating a first mode of operation of the optical mouse device according to an embodiment of the invention.
FIG. 5 is a schematic diagram illustrating a second mode of operation of the optical mouse device according to an embodiment of the invention.
Fig. 6 is a circuit schematic of the pixel circuit of the present invention.
Description of the reference numerals
1 optical mouse device 11 light source
12 image sensing array 121 actively senses pixels
122 self-energy conversion pixel 13 image frame buffer
14 energy storage assembly 15 processing unit
16. 16' analog-to-digital converter 17 switch assembly
61-diode 62 energy storage structure
631 read switch 632 energy storage switch
64 read line If image data
Ip photocurrent S working surface
Sr column selection signal Sh energy storage signal
Detailed Description
To make the above and other objects, features, and advantages of the present invention more apparent, the following detailed description will be made in conjunction with the accompanying drawings. In the description of the present invention, like elements are denoted by like reference numerals and are previously described herein.
Referring to fig. 1, a schematic diagram of an optical mouse device 1 according to an embodiment of the invention includes a light source 11, an image sensing array 12, an image frame buffer 13, an energy storage component 14, and a processing unit 15. In some embodiments, the optical mouse device 1 is operated on the working surface S to detect the relative movement of the working surface S.
The light source 11 is, for example, an active light source, for illuminating the working surface S with light of a distinguishable spectrum. In some embodiments, the light source 11 is, for example, a light emitting diode or a laser diode, etc., for emitting red light and/or infrared light. In some embodiments, the optical mouse device 1 further comprises an optical component, such as a lens, to adjust the light emitting field (illumination field) of the light source 11.
The image sensor array 12 is, for example, included in an image sensor, and is configured to sense light energy of the light reflected from the working surface S by the light source 11. The image sensor is, for example, an active sensor, and includes a substrate layer (substrate layer) having a plurality of active sensing pixels and a plurality of self-energy conversion pixels (described later) fabricated by a semiconductor process; the plurality of active sensing pixels are used for respectively outputting image data If according to the sensed light energy of the reflected light, and the plurality of self-energy conversion pixels are used for respectively outputting photocurrent Ip according to the sensed light energy of the reflected light.
In the present invention, the image data If is used for the processing unit 15 to calculate the displacement, for example, the processing unit 15 calculates the displacement by comparing the image data If of two image frames; one image frame refers to image data If output during one scanning period of scanning the plurality of active sensing pixels. The plurality of active sensing pixels may be known as a three-transistor (3T) or four-transistor (4T) pixel structure, without particular limitation. For example, the plurality of active sensing pixels may be pixel structures of a known CMOS image sensor, for example.
In the present invention, the photocurrent Ip is used for the light source 11 to emit light. For example, the self-energy conversion pixels are coupled to at least one energy storage device 14 for storing the electric energy of the photocurrents Ip; the electric energy is mainly provided to the light source 11, but not limited thereto. In some embodiments, the optical mouse device 1 includes, for example, a capacitor (capacitor) as the energy storage component 14, and all of the self-energy conversion pixels are coupled to the capacitor. In some embodiments, the optical mouse device 1 includes a plurality of capacitors as the energy storage component 14, the self-energy conversion pixels are divided into a plurality of regions, and the self-energy conversion pixels of each region are respectively coupled to one capacitor, for example, each self-energy conversion pixel row/column is respectively coupled to one capacitor, but not limited thereto. The at least one energy storage component 14 is coupled to the light source 11, and is configured to provide the light source 11 with the stored electric energy.
The processing unit 15 is, for example, a Digital Signal Processor (DSP), a microprocessor (microcontroller) or an Application Specific Integrated Circuit (ASIC), and is configured to calculate a displacement according to the plurality of image data If output by the plurality of active sensing pixels, for example, calculate a displacement according to a correlation between two image frames, and determine an operation mode. The first mode is maintained when the determined displacement is greater than a displacement threshold and the second mode is entered when the displacement is less than the displacement threshold. In the present invention, the first mode refers to, for example, a mode in which the processing unit 15 detects a displacement amount and outputs the displacement amount at a report rate. The second mode, for example, refers to a mode in which the processing unit 15 detects that the optical mouse device 1 is in a substantially stationary state, and at least a part of the components are lowered or stopped. It should be noted that the first mode may be a normal mode and the second mode may be a sleep mode, but the present invention is not limited thereto, and this section is merely used to illustrate states of different modes.
In the present invention, in the first mode, the plurality of active sensing pixels and the plurality of self-energy conversion pixels are operated; in the second mode, the plurality of active sensing pixels are deactivated and the plurality of self-power conversion pixels continue to operate. That is, the plurality of self-power conversion pixels output the plurality of photocurrents Ip in both the first mode and the second mode, and the plurality of photocurrents Ip may have different functions in different modes. The plurality of active sensing pixels being deactivated (deactivated) in the second mode may mean that the plurality of image data If is not output, for example, a transistor in a pixel circuit controlling output of the image data If is not turned on, and the plurality of active sensing pixels outputting the plurality of image data If only in the first mode.
The image frame buffer 13 is, for example, a volatile memory (volatile memory) or a buffer, and is configured to store image data If output by the plurality of active sensing pixels or intensity data related to photocurrent Ip output by the plurality of self-energy conversion pixels. More specifically, in the present invention, the image frame buffer 13 is coupled to the plurality of active sensing pixels in the first mode and not coupled to the plurality of self-energy conversion pixels, so as to store the image data If output by the plurality of active sensing pixels; the image frame buffer 13 is coupled to the self-energy conversion pixels and not coupled to the active sensing pixels in the second mode, and is configured to store intensity data related to the photocurrent Ip output from the self-energy conversion pixels; wherein the intensity data may also be referred to as gray scale values.
In one embodiment, the optical mouse device 1 includes a multiplexer 17 (multiplexer), and the multiplexer 17 is coupled between the image frame buffer 13 and the self-energy conversion pixels and the active sensing pixels. When the processing unit 15 determines that the first mode is entered, the processing unit 15 controls the multiplexer 17 to electrically couple the image frame buffer 13 and the plurality of active sensing pixels to temporarily store the image data If; when the processing unit 15 determines that the second mode is entered, the processing unit 15 controls the multiplexer 17 to electrically couple the image frame buffer 13 and the plurality of self-energy conversion pixels to temporarily store the intensity data related to the photocurrent Ip. It should be noted that the multiplexer is only one embodiment, but is not limited to the present invention, and other switches may be used as long as the purpose of switching can be achieved.
The processing unit 15 is configured to calculate the displacement according to the image data If of the image frame buffer 13, and determine whether to leave the second mode according to the numerical variation of the intensity data in the image frame buffer 13. As described above, in the second mode, the plurality of self-energy conversion pixels store the intensity data related to the photo current Ip in the image frame buffer 13, and the processing unit 15 compares the value changes of the intensity data related to the photo current Ip of the two image frames; one image frame refers to a photocurrent Ip outputted during one scanning period in which the plurality of self-power conversion pixels are scanned. In the present invention, the image frame rate of the plurality of self-energy conversion pixels is lower than the image frame rate of the plurality of active sensing pixels. When the change of the value of the intensity data exceeds a change threshold, the optical mouse device 1 is indicated to move, and the processing unit 15 determines to leave the second mode; when the change in the value of the intensity data does not exceed the change threshold, which indicates that the optical mouse device 1 is not moving, the processing unit 15 determines to maintain the second mode. In some embodiments, the processing unit 15 may also calculate a correlation (correlation) of intensity data related to the photocurrent Ip between two image frames, and when the correlation is lower than a predetermined threshold, the correlation indicates that movement occurs; conversely, no movement occurs. In addition, the numerical variation may be determined by other known ways for determining the similarity of two image frames, and is not limited.
Fig. 2A-2C are schematic diagrams illustrating pixel arrangements of the image sensor array 12 according to some embodiments of the invention. As described above, the image sensor array 12 includes a plurality of active sensing pixels 121 and a plurality of self-energy conversion pixels 122. In some embodiments, the self-energy conversion pixels 122 are arranged in a partial pixel column (as in fig. 2B) or a partial pixel row (as in fig. 2A) of the image sensing array 12, and the partial pixel columns or the partial pixel rows of the self-energy conversion pixels 122 are not adjacent to each other. As shown in fig. 2A and 2B, an active sensing pixel column (row) is disposed between two self-energy converting pixel columns (or rows). In some embodiments, the plurality of active sensing pixels 121 and the plurality of self-energy conversion pixels 122 may be arranged in a checkerboard pattern, as shown in fig. 2C.
As described above, the processing unit 15 calculates the displacement amount from the image data If output by the plurality of active sensing pixels 121, and since the plurality of active sensing pixels 121 are not completely adjacent to each other, in order to increase the calculation accuracy, the processing unit 15 further performs interpolation operation (interpolation) on the plurality of image data If before calculating the displacement amount, and calculates the displacement amount from the interpolated image data.
For example, when the pixels of the image sensor array 12 are arranged in the manner of fig. 2C, the pixel data of the pixel positions (1, 2) can be obtained by interpolation of the pixel data of the pixel positions (1, 1), (2, 2), (1, 3); the pixel data of the pixel positions (1, 4) can be obtained by interpolation of the pixel data of the pixel positions (1, 3), (2, 4); and so on. The interpolation method is not limited to the one described in the description of the present invention.
Referring to fig. 2A to 2C, the optical mouse device 1 includes a reading circuit coupled to the image sensing array 12 for reading out pixel data of the plurality of active sensing pixels 121 and the plurality of self-energy conversion pixels 122, respectively. The read circuit is, for example, a correlated double sampling (correlated double sampling) circuit, and is coupled to two sets of read lines. A readout line is coupled to the plurality of active sensing pixels 121 and the image frame buffer 13 for outputting image data If. The other set of readout lines is coupled to the self-energy conversion pixels 122 and the image frame buffer 13 for outputting a photocurrent Ip. In addition, the optical mouse device 1 further includes a charging circuit coupled to the self-energy conversion pixels 122 and the energy storage component 14 for storing the photocurrent Ip in the energy storage component 14; the charging line is, for example, a bus line, and is used to transmit a part or all of the photocurrent Ip output from the energy conversion pixel 122. As described above, the optical mouse device 1 further includes a switching component (e.g. the multiplexer 17) for switching different connection modes between the first mode and the second mode, so that the image frame buffer 13 is coupled to the plurality of self-energy conversion pixels 122 or to the plurality of active sensing pixels 121. In addition, analog-to-digital converters (ADCs) 16, 16' may be provided between the read circuit and the image frame buffer 13 to convert pixel data into digital signals for storage in the image frame buffer 13.
Referring to fig. 3, a flowchart of an operation method of an optical mouse device according to an embodiment of the invention is shown. The present operation method is applicable to the optical mouse device 1 shown in fig. 1. In the first mode, the light source 11 irradiates the working surface S, and the image sensing array 12 includes a plurality of active sensing pixels 121 and a plurality of self-energy conversion pixels 122 for sensing the light energy of the reflected light from the working surface S. The plurality of active sensing pixels 121 are coupled to the image frame buffer 13 for storing image data If in the image frame buffer 13, and the processing unit 15 reads the image data If from the image frame buffer 13 to calculate the displacement. The self-energy conversion pixels 122 are coupled to at least one energy storage device 14 for storing the electric energy of the photocurrent Ip into the energy storage device 14, and the energy storage device 14 is coupled to the light source 11, for example, to provide the electric energy required by the light source 11 to emit light.
The operation method comprises the following steps: the light source emits light (step S30); calculating a displacement amount according to the image data output by the plurality of main sensing pixels (step S31); entering a second mode when the displacement amount is smaller than a displacement threshold (step S32); deactivating the plurality of active sensing pixels in the second mode (step S33); outputting photocurrents by using the plurality of self-energy conversion pixels, respectively (step S34); and storing the electric energy of the photocurrents to at least one energy storage component to provide light emission of the light source (step S35).
Referring to fig. 3 and 4, fig. 4 is a schematic diagram illustrating a first mode of operation of the optical mouse device according to an embodiment of the invention. In the first mode, the plurality of active sensing pixels 121 sense the light energy of the light source 11 to output image data If to the image frame buffer 13, respectively, and the processing unit 15 calculates a displacement amount according to the image data If (steps S30 and S31). As described above, since the plurality of active sensing pixels 121 are not arranged continuously, the processing unit 15 preferably performs interpolation operation on the plurality of image data If to accurately obtain the displacement amount before calculating the displacement amount. When the processing unit 15 determines that the displacement is greater than the displacement threshold, the operation is continuously performed in the first mode; when the processing unit 15 determines that the displacement amount is smaller than the displacement threshold, a second mode is entered (step S32), such as deactivating the plurality of active sensing pixels (step S33) and reducing or turning off operation of a part of the components. After entering the second mode, the self-energy conversion pixels 122 still operate continuously.
In the first mode, the self-energy conversion pixels 122 sense the light energy of the light source 11 to output a photocurrent Ip to the at least one energy storage component 14 (steps S30 and S34). The at least one energy storage device 14 stores the electric energy from the plurality of photocurrents Ip to provide the electric energy for the optical mouse (step S35), for example, but not limited to, the light emitted by the light source 11 may be provided to other components of the optical mouse device 1.
Referring to fig. 5, a schematic diagram of the operation of the optical mouse device according to the second mode of the embodiment of the invention is shown, which is also applicable to the optical mouse device 1 shown in fig. 1. In the second mode, the plurality of self-energy conversion pixels 122 sense light energy of the reflected light from the working surface S and generate a photocurrent Ip. As with the first mode of operation, the self-energy conversion pixels 122 are coupled to the at least one energy storage device 14 for storing the generated photocurrent Ip. The energy storage assembly 14 is coupled to the light source 11, for example, to provide stored electrical energy to the light source 11. In addition, in the second mode, the self-energy conversion pixels 122 may be further coupled to the image frame buffer 13 to store pixel data in the image frame buffer 13 for the processing unit 15 to perform post-operation. More specifically, in the second mode, the plurality of self-power conversion pixels 122 may be coupled to the image frame buffer 13 only, or coupled to both the image frame buffer 13 and the at least one energy storage device 14.
In some embodiments, in the second mode, the plurality of self-energy conversion pixels 122 output the intensity data related to the photocurrent Ip to the image frame buffer 13 for storage, and the processing unit 15 calculates the intensity value change according to the intensity data to determine whether to leave the second mode. For example, when the change in the value of the intensity data is less than a change threshold, continuing the second mode; when the change in the value of the intensity data is greater than a change threshold, the second mode is ended and the plurality of active sensing pixels 121 are activated again to enter the first mode.
The numerical change is, for example, a numerical change of the intensity data of each identical pixel (pixel-by-pixel) in two consecutive image frames by the processing unit 15, and when the number of pixels whose numerical change is greater than the change threshold exceeds a preset number, it is determined that the second mode is ended.
In another embodiment, the processing unit 15 calculates, for example, an average value of the intensity data of each image frame, and determines that the second mode is ended when the value of the average value is changed more than a change threshold.
In another embodiment, the processing unit 15 calculates the displacement amount (as If calculating the displacement amount according to the image data If) using the intensity data, and determines that the second mode is ended when the displacement amount is greater than a predetermined displacement amount; when the processing unit 15 calculates the displacement according to the intensity data, an interpolation operation may be performed before calculating the displacement.
For the purpose of saving more power, in the second mode, the light emitting brightness of the light source 11 may be lower than that of the first mode.
In the present invention, the image frame in the second mode refers to an image frame formed by the pixel data output from the plurality of self-energy conversion pixels 122; and the image frame in the first mode refers to an image frame formed by the pixel data outputted from the plurality of active sensing pixels 121.
As shown in fig. 4 and 5, the self-energy conversion pixels 122 are coupled to the at least one energy storage device 14 in the first mode and the second mode, and output the electric energy of the photocurrent Ip to the energy storage device 14. The energy storage component 14 is coupled to the light source 11, for example, and provides the electric energy required by the light source 11 to emit light. In the second mode, the self-energy conversion pixels 122 are further coupled to the image frame buffer 13 for the processing unit 15 to further calculate pixel data to determine whether to leave the second mode.
Fig. 6 is a schematic circuit diagram of a pixel circuit according to the present invention. As described above, the plurality of active sensing pixels 121 may be a known 3T or 4T pixel structure, and is not particularly limited. For example, the plurality of active sensing pixels 121 may include a light diode 61, an energy storage structure 62 (such as, but not limited to, a capacitor, a storage node, or a floating diffusion region, etc.), and a read switch 631. The light diode 61 is used to convert light energy into electrical energy. The energy storage structure 62 is used for temporarily storing the electric energy converted by the light emitting diode 61. The read switch 631 is configured to control and output the electric energy (i.e. the image data If) in the energy storage structure 62 to the read line 64 according to a column selection signal Sr. The readout line 64 is coupled to the readout circuit (as shown in fig. 2A-2C), for example, to store the output image data If into the image frame buffer 13.
The pixel structure of the self-energy-converting pixels 122 is not particularly limited, and includes, in addition to the light diode 61, the energy-storing structure 62 and the readout switch 631, an energy-storing switch 632, where the energy-storing switch 632 is configured to output the photocurrent Ip converted by the light diode 61 to the energy-storing component 14 according to an energy-storing signal Sh; wherein the column selection signal Sr and the energy storage signal Sh are provided, for example, by a timing controller to be turned on simultaneously or individually. Similarly, the light diode 61 is configured to convert light energy into a photocurrent Ip. The read switch 631 is configured to control the photocurrent Ip to be output to the read line 64. The readout line 64 is coupled to the readout circuit (as shown in fig. 2A-2C), for example, to store the output photocurrent Ip into the image frame buffer 13. Accordingly, the photocurrent Ip converted by the photodiode 61 can be output to the energy storage component 14 and/or the image frame buffer 13 in different operation modes.
It should be noted that, although the desktop mouse is described as an example in the above description, the present invention is not limited thereto. In some embodiments, the image sensor array 12 of the present invention can also be applied to an optical system including a system light source, such as an optical finger mouse, a proximity sensor, etc., for recycling a portion of the electrical energy.
The optical mouse device 1 of the present invention further comprises a timing controller (timing controller) or a signal generator (signal generator) for generating timing signals to control the reading circuit to read the pixel data (including the image data If and the photo current Ip) and control the opening and closing of the switch elements (e.g. 17, 631, 632).
The optical mouse device 1 further includes an output interface, which outputs the displacement calculated by the processing unit 15 to a host (host) at a report rate (report rate) to relatively control the cursor motion. In some embodiments, the reporting rate may be adjusted according to software currently being executed by the host.
As described above, the optical mouse is not provided with a power feedback mechanism, so the overall power saving ratio still has an upper limit. Therefore, the present invention further provides a self-powered optical mouse device (as shown in fig. 1, 2A-2C) and an operation method thereof, which can store and feed back part of the energy of the light source to the light source, so as to effectively improve the energy utilization efficiency of the optical mouse device.
Although the present invention has been described in terms of the foregoing embodiments, it is not intended to limit the invention to the particular embodiments disclosed, but on the contrary, the invention is capable of numerous modifications and variations within the spirit and scope of the invention as defined in the appended claims. The protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (12)
1. An image sensor of an optical mouse device, the image sensor being configured to operate on a work surface and comprising:
an image frame buffer;
an energy storage assembly;
an image sensing array for sensing reflected light from the work surface, the image sensing array comprising:
a plurality of active sensing pixels for outputting image data according to the sensed reflected light, respectively, each of the plurality of active sensing pixels including a read switch for controlling the output of the image data to the image frame buffer; and
A plurality of self-energy conversion pixels for outputting photocurrents according to the sensed reflected light, respectively, each of the plurality of self-energy conversion pixels including a storage switch for controlling the photocurrent to be output to the storage component so that the storage component stores electric energy of the photocurrent; and
a switching assembly for coupling the image frame buffer to the plurality of self-energy converting pixels or the plurality of active sensing pixels.
2. The image sensor of claim 1, wherein each of the plurality of self-energy converting pixels further comprises another read switch for controlling the photocurrent output to the image frame buffer.
3. The image sensor of claim 2, wherein the read switch and the other read switch are controlled by a selection signal provided by a timing controller.
4. The image sensor of claim 1, wherein the energy storage switch is controlled by an energy storage signal provided by a timing controller.
5. The image sensor of claim 1, wherein the plurality of self-energizable conversion pixels are arranged in a partial pixel column or a partial pixel row of the image sensing array, and the partial pixel column or the partial pixel row of the plurality of self-energizable conversion pixels are not adjacent to each other.
6. The image sensor of claim 1, wherein the plurality of active sensing pixels and the plurality of self-energy conversion pixels are arranged in a checkerboard pattern.
7. The image sensor of claim 1, wherein the plurality of active sensing pixels output the image data in a mode of calculating a displacement amount and do not output the image data in a stationary state.
8. The image sensor of claim 7, wherein the plurality of self-energy converting pixels are not coupled to the image frame buffer in the mode of calculating displacement.
9. The image sensor of claim 1, wherein the energy storage assembly is configured to provide the stored electrical energy to a light source.
10. The image sensor of claim 1, further comprising a readout circuit coupled to the plurality of active sensing pixels for reading out the image data and coupled to the plurality of self-energy conversion pixels for reading out the photocurrent.
11. An image sensor of an optical mouse device, the image sensor comprising:
an image frame buffer;
an energy storage assembly;
an image sensing array, the image sensing array comprising:
a plurality of active sensing pixels coupled to the image frame buffer through a read switch thereof; and
A plurality of self-energy conversion pixels coupled to the energy storage component through energy storage switches thereof; and
a switching assembly for coupling the image frame buffer to the plurality of self-energy converting pixels or the plurality of active sensing pixels.
12. The image sensor of claim 11, further comprising a readout circuit for reading out pixel data of the plurality of active sensing pixels and reading out photocurrents of the plurality of self-power converting pixels.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010294194.6A CN111522455B (en) | 2016-02-04 | 2016-02-04 | Image sensor comprising self-energy conversion pixels |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010294194.6A CN111522455B (en) | 2016-02-04 | 2016-02-04 | Image sensor comprising self-energy conversion pixels |
| CN201610080041.5A CN107037892B (en) | 2016-02-04 | 2016-02-04 | Self-powered optical mouse device and operation method thereof |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610080041.5A Division CN107037892B (en) | 2016-02-04 | 2016-02-04 | Self-powered optical mouse device and operation method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111522455A CN111522455A (en) | 2020-08-11 |
| CN111522455B true CN111522455B (en) | 2023-06-09 |
Family
ID=59532999
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010294194.6A Active CN111522455B (en) | 2016-02-04 | 2016-02-04 | Image sensor comprising self-energy conversion pixels |
| CN201610080041.5A Active CN107037892B (en) | 2016-02-04 | 2016-02-04 | Self-powered optical mouse device and operation method thereof |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610080041.5A Active CN107037892B (en) | 2016-02-04 | 2016-02-04 | Self-powered optical mouse device and operation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN111522455B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200300908A (en) * | 2001-12-05 | 2003-06-16 | Em Microelectronic Marin Sa | Sensing device for optical pointing devices such as an optical mouse |
| CN1677431A (en) * | 2004-04-02 | 2005-10-05 | 原相科技股份有限公司 | Optical mouse and image fetching chip thereof |
| CN2847376Y (en) * | 2005-10-17 | 2006-12-13 | 达方电子股份有限公司 | Optical input device |
| CN103425275A (en) * | 2012-05-17 | 2013-12-04 | 原相科技股份有限公司 | Sensing module and sensing method both applied to optical mouse and provided with electricity-saving function |
| CN103970300A (en) * | 2013-01-29 | 2014-08-06 | 原相科技股份有限公司 | Optical mouse device and data compression method used therein |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102033632B (en) * | 2010-12-28 | 2013-03-20 | 鸿富锦精密工业（深圳）有限公司 | Handwriting pen device with charging seat |
| TWI499941B (en) * | 2013-01-30 | 2015-09-11 | Pixart Imaging Inc | Optical mouse apparatus and method used in optical mouse apparatus |
| US9300937B2 (en) * | 2014-06-26 | 2016-03-29 | Pixart Imaging (Penang) Sdn, Bhd. | Color image sensor and operating method thereof |
| TWI545951B (en) * | 2014-07-01 | 2016-08-11 | 晶相光電股份有限公司 | Sensors and sensing methods |
-
2016
- 2016-02-04 CN CN202010294194.6A patent/CN111522455B/en active Active
- 2016-02-04 CN CN201610080041.5A patent/CN107037892B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200300908A (en) * | 2001-12-05 | 2003-06-16 | Em Microelectronic Marin Sa | Sensing device for optical pointing devices such as an optical mouse |
| CN1677431A (en) * | 2004-04-02 | 2005-10-05 | 原相科技股份有限公司 | Optical mouse and image fetching chip thereof |
| CN2847376Y (en) * | 2005-10-17 | 2006-12-13 | 达方电子股份有限公司 | Optical input device |
| CN103425275A (en) * | 2012-05-17 | 2013-12-04 | 原相科技股份有限公司 | Sensing module and sensing method both applied to optical mouse and provided with electricity-saving function |
| CN103970300A (en) * | 2013-01-29 | 2014-08-06 | 原相科技股份有限公司 | Optical mouse device and data compression method used therein |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107037892B (en) | 2020-05-12 |
| CN111522455A (en) | 2020-08-11 |
| CN107037892A (en) | 2017-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8462115B2 (en) | Motion estimation device and power saving method thereof | |
| US20080049989A1 (en) | Fingerprint detection apparatus | |
| US9046935B2 (en) | Motion estimation device and power saving method thereof | |
| TWI516990B (en) | Navigation device with adjustable tracking parameter | |
| EP3967028B1 (en) | Event-based vision sensor using on/off event and grayscale detection ramps | |
| KR20180068720A (en) | Event-based sensor and sensing method | |
| JPH10222285A (en) | Image extracting device | |
| US10775868B2 (en) | Navigation device with low power consumption | |
| US20230359264A1 (en) | Optical sensor device having sensing pixels and self-powered pixels | |
| TWI457678B (en) | Touch type electrophoretic display device | |
| TWI530828B (en) | Optical mouse including thermal sensor | |
| US20140028868A1 (en) | Displacement detection device and power saving method thereof | |
| KR101869277B1 (en) | Pixel circuit and depth sensor having the same | |
| JP2011138503A (en) | Object detection device | |
| CN111522455B (en) | Image sensor comprising self-energy conversion pixels | |
| US8519958B2 (en) | Optical sensor and operating method thereof | |
| US8531588B2 (en) | Method for adjusting exposure condition of optical sensor module and optical sensor module thereof | |
| EP3015958B1 (en) | Light sensor array device | |
| CN111429814B (en) | Multifunctional intelligent display screen and control method thereof | |
| JP6847373B2 (en) | Object detection sensor and electrical equipment unit | |
| WO2021157393A1 (en) | Rangefinder and rangefinding method | |
| KR20120121863A (en) | Optical navigation system with object detection | |
| CN115396612A (en) | Pixel circuit and sensor for suppressing noise event | |
| TW201500985A (en) | Optical sensor array apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |