US7433585B2 - System and method of lens placement - Google Patents
System and method of lens placement Download PDFInfo
- Publication number
- US7433585B2 US7433585B2 US11/273,990 US27399005A US7433585B2 US 7433585 B2 US7433585 B2 US 7433585B2 US 27399005 A US27399005 A US 27399005A US 7433585 B2 US7433585 B2 US 7433585B2
- Authority
- US
- United States
- Prior art keywords
- lens
- image
- placement
- sensor module
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B43/00—Testing correct operation of photographic apparatus or parts thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
Definitions
- a fixed-focus digital camera typically incorporates a lens placed in a lens mount at a fixed distance from an image sensor module that is used to convert incident light into a digital image.
- the placement of the lens in the lens mount is an important aspect of camera manufacture because the placement determines the effective focal range of the camera.
- a lens-placement system in accordance with the invention includes an imaging system having an imaging camera to capture an image of at least a portion of an image sensor module that is located in a fixed-focus camera. The captured image is used for placement of a lens in the fixed-focus camera.
- FIG. 1 shows a first exemplary embodiment of a lens-placement system in accordance with the invention.
- FIG. 2 shows a lens mount that provides alternative locations for placing a lens in accordance with the invention.
- FIG. 3 shows an exemplary embodiment of an imaging system used in the lens-placement system of FIG. 1 .
- FIG. 4 shows further details of the imaging system of FIG. 3 .
- FIG. 5 shows an exemplary embodiment of an automated lens-placement system in accordance with the invention.
- FIG. 6 shows an exemplary embodiment of a manual lens-placement system in accordance with the invention.
- FIG. 7 shows a flowchart of an exemplary method of placement of a lens in a fixed-focus camera.
- the various embodiments in accordance with the invention generally describe systems and methods of lens placement in a fixed-focus camera having an image sensor.
- FIG. 1 shows a first exemplary embodiment of a lens-placement system 100 in accordance with the invention.
- Lens-placement system 100 includes a fixed-focus camera 110 containing an image sensor module 125 and a lens-mount 115 housing a lens 120 .
- Image sensor module 125 converts light received from an object through lens 120 into electrical signals that are used to generate a digital image of the object.
- Lens-placement system 100 further includes an imaging system 105 that is located at a distance 130 from image sensor module 125 .
- Distance 130 corresponds to an optimal focal length of imaging system 105 whereby an image of an object, such as image sensor module 125 , can be captured by imaging system 105 with an acceptable degree of picture clarity.
- Focal distance 130 is independent of several specifications associated with fixed-focus camera 110 .
- focal distance 130 is independent of the resolution capacity or the field-of-view specifications of fixed-focus camera 110 . Consequently, imaging system 105 can be used upon a variety of fixed-focus cameras incorporating various types and sizes of image sensors and lens.
- the first step of the operation involves placing fixed-focus camera 110 in a power-down state.
- the power-down state is generally defined as a state where fixed-focus camera 110 cannot be operated to capture an image of an object located external to fixed-focus camera 110 .
- the power-down state may be achieved by disconnecting, if any, all intrinsic and/or extrinsic power sources to fixed-focus camera 110 . For example, this is carried out by removing a battery located inside fixed-focus camera 110 , and/or by electrically uncoupling an external power supply of fixed-focus camera 110 .
- the power-down state may also be achieved by disconnecting power provided to image sensor module 125 , thereby preventing normal operation of image sensor module 125 . In this power-down state, power may be provided to one or more elements of fixed-focus camera 110 other than image sensor module 125 .
- imaging system 105 is activated to capture an image of at least a portion 135 of image sensor module 125 .
- the surface of image sensor module 125 has certain optically-distinguishable characteristics such as surface texture, discontinuities, irregularities, 2-dimensional (2-D) features, and 3-dimensional (3-D) features. Such characteristics may be contributed in part by the pixelated opto-electronic sensors that are a part of image sensor module 125 .
- the image captured by imaging system 105 is evaluated, either manually or automatically, for image quality. Poor image quality is attributable in part, due to a sub-optimal placement of lens 120 with reference to image sensor module 125 . If the image quality of the first captured image is not acceptable, lens 120 is placed in an alternative location in lens-mount 115 and a second image is captured using imaging system 105 . The second captured image is then evaluated for image quality. If the image quality is still unacceptable, lens 120 is moved to yet another new location in lens-mount 115 and the image capture process is repeated until an acceptable level of image quality is obtained. Image quality is assessed using various standards, such as image focus, edge-characteristics, color characteristics, image brightness, image contrast, and image resolution at various points in the image. Such parameters are applied to an electronic image on a display screen of imaging system 105 and/or upon a hardcopy of the captured image.
- lens 120 is anchored to the optimal location in lens-mount 115 .
- Such anchoring may be carried out by using a mechanical device such as a locking-ring and/or by using a suitable adhesive.
- fixed-focus camera 110 contains one or more power sources that are operable to provide power to fixed-focus camera 110 . Furthermore, fixed-focus camera 110 is in a power-up condition, when imaging system 105 is used to capture an image of image sensor module 125 .
- system 105 is used to capture one or more images of an object other than image sensor module 125 .
- an object is located in the same plane as image sensor module 125 .
- the captured image of the object provides image quality information that is used to suitably place lens 120 in an optimal location of lens-mount 115 .
- Some examples of such an object are: a fiducial mark, a light-emitting element, a reflective element, a fluorescent element, a phosphorescent element, a protrusion having a uniquely-identifiable shape, and an indentation having a uniquely-identifiable shape.
- FIG. 2 shows lens mount 115 providing several alternative locations for placing lens 120 with respect to image sensor module 125 .
- location 210 is termed an optimal location for lens 120 because image sensor module 125 then lies at a focal point 220 of lens 120 .
- This location is identified using lens-placement system 100 as described above.
- locations 205 and 215 are sub-optimal positions because in either of these two positions, image sensor module 125 is located away from focal point 220 .
- FIG. 3 shows an exemplary embodiment of imaging system 105 that is a part of lens-placement system 100 .
- imaging system 105 includes an imaging camera 310 that is used to capture an image of image sensor module 125 .
- imaging camera 310 is a stand-alone digital camera that is operated manually.
- imaging camera 310 is part of an automated set-up, such as a computer system (not shown).
- imaging camera 310 is either built into the computer or is electrically coupled to the computer via a communication link (not shown).
- Imaging system 105 further includes a light source 305 .
- Light source 305 is used to illuminate image sensor module 125 for capturing an image of image sensor module 125 via imaging camera 310 .
- Light generated by light source 305 is focused via light-focusing lens 320 on to light-directing element 325 .
- light-directing element 325 is a beam splitter that directs light received from light source 305 on to image sensor module 125 via lens 120 .
- Image sensor module 125 reflects this light back towards light-directing element 325 via lens 120 .
- the reflected light is propagated through light-directing element 325 towards imaging camera 310 .
- Imaging lens 315 focuses the reflected light on to imaging camera 310 .
- the beam-splitter of this exemplary embodiment is formed of a directional mirror that reflects a first portion of light incident upon the mirror, while simultaneously allowing a second portion of the incident light to propagate through the mirror.
- light-directing element 325 may be formed of other optical elements such as a prism or a grating, and light source 305 generates a selected wavelength of light.
- the selected wavelength corresponds to a visible wavelength.
- the selected wavelength corresponds to an invisible wavelength such as an infra-red wavelength.
- FIG. 4 provides placement details of certain elements of imaging system 105 .
- Imaging camera 310 is located at a distance D 1 from imaging lens 315 .
- D 1 ranges from about 50 mm to about 270 mm.
- Fixed-focus camera 110 is located at a distance D 2 from imaging lens 315 .
- D 2 ranges from about 50 mm to about 70 mm.
- the values of D 1 and D 2 are selected based on various factors, such as the type of imaging camera 310 used, the focal length of imaging lens 315 , and various parameters of fixed-focus camera 110 such as focal length and depth-of-field.
- FIG. 5 shows an exemplary embodiment of an automated lens-placement system 500 in accordance with the invention.
- Automated lens-placement system 500 includes a controller 505 that is communicatively coupled to imaging camera 310 via communication link 515 .
- imaging camera 310 is a camera that provides a composite video output signal.
- the composite video output signal is carried over communications link 515 , which uses one or more co-axial cables, to controller 505 .
- Controller 505 contains a frame-grabber card that converts the composite video output signal into digital image data for further processing in controller 505 .
- controller 505 is a personal computer (PC) and communication link 515 is a Universal Serial Bus (USB) communication link. Digital image data directly provided by imaging camera 310 is coupled into controller 505 via communication link 515 .
- PC personal computer
- USB Universal Serial Bus
- Controller 505 processes the digital image data to evaluate captured image parameters. If the captured image parameters are outside a pre-determined range of values, controller 505 issues a control signal that is transmitted through communication link 520 to lens positioner 510 .
- Lens positioner 510 is an industrial robot for example, and has a mechanical arm 530 that is mechanically coupled to lens 120 for placing lens 120 in one of several locations in lens mount 115 .
- mechanical arm 530 operates to place lens 120 in an optimal location in lens mount 110 and further operates to anchor lens 120 by activating a collar ring (not shown).
- lens positioner 510 is operated to move mechanical arm 530 bi-directionally as indicated by bi-directional arrow 525 .
- mechanical arm moves in various directions such as lateral, longitudinal, rotational and traverse directions.
- FIG. 6 shows an exemplary embodiment of a manually-operated lens-placement system 600 in accordance with the invention.
- Lens-placement system 600 includes a human operator 605 who operates imaging camera 310 to capture an image of image sensor module 125 . Human operator 605 then evaluates the captured image, by looking at a display screen of imaging camera 310 for example. If the captured image proves unsatisfactory, human operator 605 manually re-positions lens 120 in lens-mount 115 , and captures a second image using imaging camera 310 . The process is repeated until lens 120 has been placed in an optimal location in lens-mount 115 when a satisfactory image has been captured.
- image camera 310 is eliminated and human operator 605 looks directly at image sensor module 125 through imaging lens 315 and light-directing element 325 .
- Human operator 605 manually adjusts the location of lens 120 in lens-mount 115 until image sensor module 125 is sharply focused upon the eye of human operator 605 .
- imaging lens 315 incorporates optical characteristics that provide such a focus.
- image camera 310 is replaced by a viewing screen.
- Human operator 605 observes an image of image sensor module 125 that is projected upon the viewing screen and manually adjusts the location of lens 120 in lens-mount 115 until image sensor module 125 appears visible in sharp focus upon the viewing screen.
- Imaging lens 315 incorporates optical characteristics that provide the sharp focus upon the viewing screen.
- Each of the imaging lenses 315 selected for each of the embodiments described above may differ from one another in their optical characteristics as well as their physical characteristics.
- FIG. 7 shows a flowchart of an exemplary method of placement of a lens in a fixed-focus camera.
- a fixed-focus camera is placed in a power-down state as described above.
- an image of at least a portion of an image sensor module is captured.
- an imaging camera is used to capture an image of a portion of the image sensor module surface, while in another embodiment; the imaging camera is used to capture an image of the entire surface of the image sensor module.
- various types of imaging cameras can be used for capturing the image. Some examples include: a digital still-camera, a conventional still-camera that uses a roll of film, a digital video-camera, and an analog video-camera. Consequently, the image is captured on various imaging media, such as, a display screen, a hardcopy, a roll of film, and a video tape.
- the captured image is evaluated to determine a desired placement of one or more lens in the fixed-focus camera.
- the placement involves placing one or more lens of a lens system in a suitable location in a lens-mount such that the image sensor module is located at the focus of the lens system.
- the lens-placement allows the fixed-focus camera to be subsequently used for capturing images with an acceptable level of picture quality.
- Evaluation of the captured image in block 715 includes evaluating various image parameters such as image contrast and sharpness. For example, image contrast over the entire image or over portions of the captured image is used to evaluate image quality. This is carried out for example, by measuring the difference in peak amplitudes between dark areas and bright areas of an object contained in the captured image.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
Abstract
Description
Claims (18)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/273,990 US7433585B2 (en) | 2005-11-15 | 2005-11-15 | System and method of lens placement |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/273,990 US7433585B2 (en) | 2005-11-15 | 2005-11-15 | System and method of lens placement |
Publications (2)
Publication Number | Publication Date |
---|---|
US20070110423A1 US20070110423A1 (en) | 2007-05-17 |
US7433585B2 true US7433585B2 (en) | 2008-10-07 |
Family
ID=38040916
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/273,990 Active 2027-01-10 US7433585B2 (en) | 2005-11-15 | 2005-11-15 | System and method of lens placement |
Country Status (1)
Country | Link |
---|---|
US (1) | US7433585B2 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3996038A1 (en) * | 2020-11-06 | 2022-05-11 | Canon Kabushiki Kaisha | Information processing apparatus, information processing method, and program |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6641878B2 (en) * | 1997-04-18 | 2003-11-04 | Kureha Kagaku Kogyo K.K. | Optical pickup device holding container |
US20040109080A1 (en) * | 2002-12-05 | 2004-06-10 | Chan Wai San | Fixed-focus digital camera with defocus correction and a method thereof |
US20060262429A1 (en) * | 2005-04-19 | 2006-11-23 | Intermec Ip Corp. | Optical data reader with removeable lens system |
US7233737B2 (en) * | 2003-08-12 | 2007-06-19 | Micron Technology, Inc. | Fixed-focus camera module and associated method of assembly |
US7274356B2 (en) * | 2003-10-09 | 2007-09-25 | Smart Technologies Inc. | Apparatus for determining the location of a pointer within a region of interest |
-
2005
- 2005-11-15 US US11/273,990 patent/US7433585B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6641878B2 (en) * | 1997-04-18 | 2003-11-04 | Kureha Kagaku Kogyo K.K. | Optical pickup device holding container |
US20040109080A1 (en) * | 2002-12-05 | 2004-06-10 | Chan Wai San | Fixed-focus digital camera with defocus correction and a method thereof |
US7233737B2 (en) * | 2003-08-12 | 2007-06-19 | Micron Technology, Inc. | Fixed-focus camera module and associated method of assembly |
US7274356B2 (en) * | 2003-10-09 | 2007-09-25 | Smart Technologies Inc. | Apparatus for determining the location of a pointer within a region of interest |
US20060262429A1 (en) * | 2005-04-19 | 2006-11-23 | Intermec Ip Corp. | Optical data reader with removeable lens system |
Also Published As
Publication number | Publication date |
---|---|
US20070110423A1 (en) | 2007-05-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6972797B2 (en) | Automatic focusing device and the electronic image pickup apparatus using the same | |
US8023016B2 (en) | Imaging device and manufacturing method thereof | |
KR101643321B1 (en) | A digital photographing apparatus, a method for controlling the same, and a computer-readable medium | |
US7986875B2 (en) | Sound-based focus system and focus method thereof | |
US6987531B2 (en) | Imaging system, photographing device and three-dimensional measurement auxiliary unit used for the system | |
KR20090018486A (en) | Camera module visible in day and night | |
JP2003125424A (en) | Stereo imaging device and automatic convergence adjusting device | |
KR101767934B1 (en) | Photographing apparatus and method for night photography | |
WO2017077906A1 (en) | Information processing device, information processing method, and program | |
US7532815B2 (en) | Lens unit, method of identifying characteristics thereof and method of judging deterioration thereof, and digital camera | |
US20140347543A1 (en) | Camera system for adjusting displayed image according to an aperture value | |
JP2006126652A (en) | Imaging apparatus | |
US20090237629A1 (en) | Optical system for infinite image formation and method for fabricating camera module using the same | |
KR100759512B1 (en) | Apparatus and method for focus regulation of camera module | |
CN108603745B (en) | Information processing apparatus, information processing method, and program | |
US7433585B2 (en) | System and method of lens placement | |
JP2007171505A (en) | Lens hood and camera | |
JP2018056799A (en) | Projector system and imaging apparatus | |
JP5451333B2 (en) | TV camera device for surveillance | |
CN101697571B (en) | Method for imaging minisize large-visual-angle polygon and novel camera device | |
JP2011191340A (en) | Imaging apparatus | |
WO2017134881A1 (en) | Information processing device, information processing method, and program | |
KR20090065854A (en) | Auto focusing apparatus of camera module and auto focusing method thereof | |
KR20060104566A (en) | Cctv camera for day and night with ir injection method | |
JP2019169822A (en) | Imaging apparatus and image display method in the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: AGILENT TECHNOLOGIES, INC., COLORADO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TELLA, RICHARD P.;FISHER, WILLIAM D.;REEL/FRAME:017134/0573 Effective date: 20051111 Owner name: AGILENT TECHNOLOGIES, INC.,COLORADO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TELLA, RICHARD P.;FISHER, WILLIAM D.;REEL/FRAME:017134/0573 Effective date: 20051111 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES GENERAL IP PTE. LTD., SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AGILENT TECHNOLOGIES, INC.;REEL/FRAME:017206/0666 Effective date: 20051201 Owner name: AVAGO TECHNOLOGIES GENERAL IP PTE. LTD.,SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AGILENT TECHNOLOGIES, INC.;REEL/FRAME:017206/0666 Effective date: 20051201 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES SENSOR IP PTE. LTD., SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAGO TECHNOLOGIES IMAGING IP (SINGAPORE) PTE. LTD.;REEL/FRAME:017675/0691 Effective date: 20060430 Owner name: AVAGO TECHNOLOGIES IMAGING IP (SINGAPORE) PTE. LTD Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:017675/0738 Effective date: 20060127 Owner name: AVAGO TECHNOLOGIES SENSOR IP PTE. LTD.,SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAGO TECHNOLOGIES IMAGING IP (SINGAPORE) PTE. LTD.;REEL/FRAME:017675/0691 Effective date: 20060430 |
|
AS | Assignment |
Owner name: MICRON TECHNOLOGY, INC., IDAHO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAGO TECHNOLOGIES IMAGING HOLDING CORPORATION;REEL/FRAME:018757/0159 Effective date: 20061206 Owner name: MICRON TECHNOLOGY, INC.,IDAHO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAGO TECHNOLOGIES IMAGING HOLDING CORPORATION;REEL/FRAME:018757/0159 Effective date: 20061206 |
|
AS | Assignment |
Owner name: MICRON TECHNOLOGY, INC.,IDAHO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAGO TECHNOLOGIES IMAGING HOLDING CORPORATION;REEL/FRAME:019407/0441 Effective date: 20061206 Owner name: MICRON TECHNOLOGY, INC., IDAHO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAGO TECHNOLOGIES IMAGING HOLDING CORPORATION;REEL/FRAME:019407/0441 Effective date: 20061206 |
|
XAS | Not any more in us assignment database |
Free format text: CORRECTED COVER SHEET TO ADD PORTION OF THE PAGE THAT WAS PREVIOUSLY OMITTED FROM THE NOTICE AT REEL/FRAME 018757/0183 (ASSIGNMENT OF ASSIGNOR'S INTEREST);ASSIGNOR:AVAGO TECHNOLOGIES IMAGING HOLDING CORPORATION;REEL/FRAME:019028/0237 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES IMAGING HOLDING CORPORATION, MA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAGO TECHNOLOGIES SENSOR IP PTE. LTD.;REEL/FRAME:021603/0690 Effective date: 20061122 Owner name: AVAGO TECHNOLOGIES IMAGING HOLDING CORPORATION,MAL Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAGO TECHNOLOGIES SENSOR IP PTE. LTD.;REEL/FRAME:021603/0690 Effective date: 20061122 |
|
AS | Assignment |
Owner name: APTINA IMAGING CORPORATION, CAYMAN ISLANDS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICRON TECHNOLOGY, INC.;REEL/FRAME:023159/0424 Effective date: 20081003 Owner name: APTINA IMAGING CORPORATION,CAYMAN ISLANDS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICRON TECHNOLOGY, INC.;REEL/FRAME:023159/0424 Effective date: 20081003 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 017206 FRAME: 0666. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:AGILENT TECHNOLOGIES, INC.;REEL/FRAME:038632/0662 Effective date: 20051201 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |