CN205563453U - Sight tracking and human eye region-of-interest positioning system - Google Patents
Sight tracking and human eye region-of-interest positioning system Download PDFInfo
- Publication number
- CN205563453U CN205563453U CN201521052147.1U CN201521052147U CN205563453U CN 205563453 U CN205563453 U CN 205563453U CN 201521052147 U CN201521052147 U CN 201521052147U CN 205563453 U CN205563453 U CN 205563453U
- Authority
- CN
- China
- Prior art keywords
- human eye
- hardware platform
- pupil
- camera
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 210000001747 pupil Anatomy 0.000 claims abstract description 56
- 230000004438 eyesight Effects 0.000 claims abstract description 21
- 238000013507 mapping Methods 0.000 claims abstract description 18
- 230000006870 function Effects 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 5
- 238000000034 method Methods 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- Studio Devices (AREA)
Abstract
The utility model discloses a sight tracking and human eye region of interest positioning system, which comprises an image acquisition device, a hardware platform and a display output device, wherein the image acquisition device comprises an infrared human eye camera and a foreground camera, the output ends of the infrared human eye camera and the foreground camera are respectively connected with the input end of the hardware platform, and the output end of the hardware platform is connected with the input end of the display output device; the hardware platform comprises a storage unit, and is based on an FPGA and a dual-core ARM9 processor; the infrared human eye camera is used for shooting a human eye pupil image and transmitting the image to the hardware platform in real time; the foreground camera is used for shooting images of the human eye sight area and transmitting the images of the human eye sight area to the hardware platform in real time; through utilizing the utility model discloses the point of interest/the point of fixation of people's eye in the regional image of sight can be confirmed to the mapping relation of pupil and mark point, has realized the function that the sight was tracked.
Description
Technical field
The utility model relates to a kind of wearable electronic equipment, especially a kind of based on pupil detection technology
Eye-controlling focus and human eye area-of-interest alignment system.
Background technology
Eye Tracking Technique be widely used in business data analysis, vehicle assistant drive, psychology grind with physiology
Study carefully, people is because of fields such as analysis, virtual realities.The research in current domestic Eye-controlling focus field has also been in
Step section, external Ji Jia developed country high-tech company the most few in number is grasped key technology and pushes away
Go out matured product.Their product price is the most sufficiently expensive, and software kit needs extra purchase, and
Structure is complicated, uses process relatively cumbersome, and these factors limit Eye Tracking Technique and more widely should
With.
Utility model content
In order to solve the problem in background technology, the utility model proposes a kind of precision higher, cost is relatively
Low, simple in construction, easy-to-use Eye-controlling focus and human eye area-of-interest alignment system.
The utility model provides techniques below scheme:
Eye-controlling focus and human eye area-of-interest alignment system, it is characterized in that and includes IMAQ
Equipment, hardware platform and display output equipment, image capture device includes infrared human eye camera and prospect phase
Machine, infrared human eye camera is connected with the input of hardware platform respectively with the output of prospect camera, hardware
The output of platform is connected with the input of display output equipment；
Described hardware platform includes that memory cell, hardware platform are based on FPGA and double-core ARM9 processor；
Described infrared human eye camera, is used for shooting human eye pupil image, and by this Image Real-time Transmission to firmly
Part platform；Prospect camera is used for shooting human eye sight area image, is passed in real time by human eye sight area image
Transport to hardware platform；
Hardware platform is for processing the human eye pupil image received, and obtains the movement locus of corresponding pupil；
Hardware platform is additionally operable to: generate the mark dot image being provided with multiple mark point, sets up mark dot image
The coordinate of middle mark point, sends mark dot image to showing output equipment；Gather pupil position, pupil
Position refers to observe in mark dot image and marks pupil position a little, sets up the coordinate of pupil: according to mark
The coordinate of point and the coordinate of pupil, set up the mapping relations of pupil and mark point；
Hardware platform is additionally operable to be combined the human eye sight area image received with pupil movement track, root
According to the mapping relations of the pupil set up with mark point, obtain pupil movement track and human eye sight area image
Mapping relations, and display output equipment show；
Wherein, mark dot image is identical with the resolution ratio of human eye sight area image；
Described memory cell is for storing human eye pupil image and the human eye sight region that hardware platform receives
Image.
Pupil is that the coordinate according to mark point is set up divided by corresponding pupil coordinate with the mapping relations of mark point
's.Concrete method for building up: hardware platform generates mark dot image, and (mark dot image is provided with multiple mark
Point), set up in mark dot image and mark coordinate a little, mark dot image is sent to showing output equipment,
Shown by human eye observation and on output equipment, mark the mark point in image, record pupil people's eye fixation this
Position during a little mark point, sets up pupil coordinate, then with the coordinate of each mark point divided by corresponding pupil
Coordinate, obtains mapping coefficient, utilizes mapping coefficient to set up the mapping relations of pupil and mark point.
Therefore only need to detect pupil movement track after, utilize pupil the most permissible with the mapping relations of mark point
Determine human eye blinkpunkt/point-of-interest in the image of gaze area, it is achieved the function of Eye-controlling focus.
The software systems that hardware platform runs include that (SuSE) Linux OS, kernel version are 3.03,
(SuSE) Linux OS runs QT and OpenCV cross compilation environment, generates double in cross compilation environment
Core ARM9 processor executable file；Memory cell is additionally operable to store (SuSE) Linux OS.
Above-mentioned hardware platform also includes power module, VGA display interface and USB OTG interface；
Described power module is TI company's T PS series of power chip；
Described VGA display interface is ADV7511 chip and HDMI-VGA adapter；
Described USB OTG interface is TUSB1210 chip；
Described memory cell is SD card and/or USB flash disk；
Described FPGA and the ZYNQ-7020 chip that double-core ARM9 processor is Xilinx company.
Infrared human eye camera is the near-infrared CMOS camera of 320*240 resolution ratio, and prospect camera is 640*480
The wide-angle visible ray CMOS camera of resolution ratio.
Linux operation, by being stored in the (SuSE) Linux OS in memory cell card, is by hardware platform
System carry is inside double-core AMR9 processor.
Above-mentioned QT software version is 4.8.1, and described OpenCV version is 2.4.11.
Above-mentioned infrared human eye camera is connected with hardware platform by USB OTG interface respectively with prospect camera；
Described display output equipment is connected with hardware platform by VGA display interface
Above-mentioned Eye-controlling focus and human eye area-of-interest alignment system also include that the outside with control function sets
Standby, the external equipment with control function is mouse and keyboard, and described mouse and keyboard are all by USB OTG
Interface is connected with hardware platform.
The utility model has following technical effect that
Utilize the mapping relations of the utility model pupil and mark point, it may be determined that human eye is at gaze area figure
Blinkpunkt/point-of-interest in Xiang, it is possible to realizing the function of Eye-controlling focus, therefore, the utility model is permissible
Observation effect is provided for the publicity official documents and correspondence of commercial field, poster design, webpage visual effect, package design etc.
The analysis of experiments of fruit, calculates the main observation location of interest that poster advertisement is designed by consumer, thus optimizes
The design of poster advertisement is to reach preferably to publicize expectation；The utility model can also be fabricated to wearable
, user can be assisted to analyze tester's area-of-interest in real time.
Accompanying drawing explanation
Fig. 1 be the utility model Eye-controlling focus and human eye area-of-interest alignment system realize block diagram.
Fig. 2 is hardware platform physical circuit schematic diagram.
Fig. 3 is the utility model software systems general structure.
Fig. 4 is the utility model external interface schematic diagram.
Fig. 5 is the utility model software systems flow chart.
Detailed description of the invention
The utility model proposes a kind of Eye-controlling focus and human eye area-of-interest alignment system, such as Fig. 1 extremely
Fig. 5, including image capture device, hardware platform and display output equipment, image capture device includes infrared
Human eye camera and prospect camera, the output of infrared human eye camera and prospect camera respectively with hardware platform
Input is connected, and the output of hardware platform is connected with the input of display output equipment；
Described hardware platform includes that memory cell, hardware platform are based on FPGA and double-core ARM9 processor；
Described infrared human eye camera, is used for shooting human eye pupil image, and by this Image Real-time Transmission to firmly
Part platform；Prospect camera is used for shooting human eye sight area image, is passed in real time by human eye sight area image
Transport to hardware platform；
Hardware platform is for processing the human eye pupil image received, and obtains the movement locus of corresponding pupil；
Hardware platform is additionally operable to: generate the mark dot image being provided with multiple mark point, sets up mark dot image
The coordinate of middle mark point, sends mark dot image to showing output equipment；Gather pupil position, pupil
Position refers to observe in mark dot image and marks pupil position a little, sets up the coordinate of pupil: according to mark
The coordinate of point and the coordinate of pupil, set up the mapping relations of pupil and mark point；
Hardware platform is additionally operable to be combined the human eye sight area image received with pupil movement track, root
According to the mapping relations of the pupil set up with mark point, obtain pupil movement track and human eye sight area image
Mapping relations, and display output equipment show；
Wherein, mark dot image is identical with the resolution ratio of human eye sight area image；
Described memory cell is for storing human eye pupil image and the human eye sight region that hardware platform receives
Image.
The software systems that hardware platform runs include that (SuSE) Linux OS, kernel version are 3.03, Linux
Operating system is customizing operating system based on Linux3.13 kernel version, and concrete version is Ubuntu
12.04LTS；In (SuSE) Linux OS, run QT and OpenCV cross compilation environment, compile intersecting
Translate and environment realize mapping relations, wherein, QT software version be 4.8.1, OpenCV version be 2.4.11；
Memory cell is additionally operable to store (SuSE) Linux OS；Hardware platform is by being stored in memory cell card
(SuSE) Linux OS, by (SuSE) Linux OS carry inside double-core AMR9 processor.
Such as Fig. 2, hardware platform also includes power module, VGA display interface and USB OTG interface；Power supply
Module is TI company's T PS series of power chip；VGA display interface is ADV7511 chip and HDMI-VGA
Adapter；USB OTG interface is TUSB1210 chip；Memory cell is SD card and/or USB flash disk.FPGA
With the ZYNQ-7020 chip that double-core ARM9 processor is Xilinx company.This chip internal is integrated
Up-to-date 7 Series FPGA of Xilinx company and double-core ARM9 processor, and realize FPGA by AXI bus
High-speed communication with arm processor.
Infrared human eye camera is connected with hardware platform by USB OTG interface respectively with prospect camera；Described
Display output equipment is connected with hardware platform by VGA display interface；
Infrared human eye camera can be adopted as the near-infrared CMOS camera of 320*240 resolution ratio, and prospect camera can
It is adopted as the high definition wide-angle visible ray CMOS camera of 640*480 resolution ratio.
Display output equipment is the USB interface display screen of one piece of 1280*800 resolution ratio.Display mainly shows
Show infrared camera shooting human eye pupil image, prospect camera simulation human eye field-of-view image, human eye region of interest
Field mark and tracking, parameter setting area.
Eye-controlling focus and human eye area-of-interest alignment system also include having the external equipment controlling function,
The external equipment with control function is mouse and keyboard, and described mouse and keyboard are all connect by USB OTG
Mouth is connected with hardware platform, it is achieved human-computer interaction interface controls and (SuSE) Linux OS order inputs.
See Fig. 3, be general structure and the module-external design of the software systems that hardware platform runs.According to
Software systems can be divided into 5 functional modules and be respectively as follows: camera by the functional requirements of software systems
Control and display, human eye sight centralized positioning, target location, the location of area-of-interest, Attitude estimation
Correct with target location.
Seeing Fig. 4, the key element in user interface mainly has three parts: the viewing area of infrared shooting pupil camera
Territory, the viewing area of prospect camera video, the display of test image and update area.
Seeing Fig. 5, tester completes pupil position by user interface according to system prompt and demarcates, pupil
Pose is set up with viewing area mapping relations.
Relative to existing technology, the utility model Eye-controlling focus and human eye area-of-interest alignment system,
Take full advantage of ARM and add FPGA hardware platform, embedded OS runs QT and OpenCV mirror
As library file, C Plus Plus is utilized to realize human eye pupil detection and Eye-controlling focus in QT programming interface, and
Set up friendly human-computer interaction interface, utilize high-clear display to mark human eye area-of-interest, unite the most at last
Count preservation in case subsequent analysis.Compared to existing similar-type products, there is similarity precision, but cost is relatively
Low, technical difficulty requires little feature.
Foregoing is to combine concrete preferred embodiment to explain the utility model, it is impossible to assert this
Being embodied as of utility model is confined to these explanations.General for the utility model art
For logical technical staff, without departing from the concept of the premise utility, it is also possible to make some simply
Deduction or replace.
Claims (5)
1. Eye-controlling focus and human eye area-of-interest alignment system, it is characterized in that: include image capture device, hardware platform and display output equipment, image capture device includes infrared human eye camera and prospect camera, infrared human eye camera is connected with the input of hardware platform respectively with the output of prospect camera, and the output of hardware platform is connected with the input of display output equipment；
Described hardware platform includes that memory cell, hardware platform are based on FPGA and double-core ARM9 processor；
Described infrared human eye camera is used for shooting human eye pupil image, and by this Image Real-time Transmission to hardware platform；Prospect camera is used for shooting human eye sight area image, by human eye sight area image real-time Transmission to hardware platform；
Hardware platform is for processing the human eye pupil image received, and obtains the movement locus of corresponding pupil；
Hardware platform is additionally operable to: generate the mark dot image being provided with multiple mark point, sets up in mark dot image and marks coordinate a little, sends mark dot image to showing output equipment；Gathering pupil position, pupil position refers to observe in mark dot image and marks pupil position a little, sets up the coordinate of pupil: according to coordinate and the coordinate of pupil of mark point, set up the mapping relations of pupil and mark point；
Hardware platform is additionally operable to be combined the human eye sight area image received with pupil movement track, according to the mapping relations of the pupil set up with mark point, obtains the mapping relations of pupil movement track and human eye sight area image, and shows at display output equipment；
Wherein, mark dot image is identical with the resolution ratio of human eye sight area image；
Described memory cell is for storing human eye pupil image and the human eye sight area image that hardware platform receives.
Eye-controlling focus the most according to claim 1 and human eye area-of-interest alignment system, it is characterised in that: described hardware platform also includes power module, VGA display interface and USB OTG interface；
Described power module is TI company's T PS series of power chip；
Described VGA display interface is ADV7511 chip and HDMI-VGA adapter；
Described USB OTG interface is TUSB1210 chip；
Described memory cell is SD card and/or USB flash disk；
Described FPGA and the ZYNQ-7020 chip that double-core ARM9 processor is Xilinx company.
Eye-controlling focus the most according to claim 2 and human eye area-of-interest alignment system, it is characterised in that: infrared human eye camera is the near-infrared CMOS camera of 320*240 resolution ratio, and prospect camera is the wide-angle visible ray CMOS camera of 640*480 resolution ratio.
Eye-controlling focus the most according to claim 3 and human eye area-of-interest alignment system, it is characterised in that: described infrared human eye camera is connected with hardware platform by USB OTG interface respectively with prospect camera；Described display output equipment is connected with hardware platform by VGA display interface.
Eye-controlling focus the most according to claim 4 and human eye area-of-interest alignment system, it is characterized in that: described Eye-controlling focus and human eye area-of-interest alignment system also include having the external equipment controlling function, the external equipment with control function is mouse and keyboard, and described mouse is all connected with hardware platform by USB OTG interface with keyboard.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201521052147.1U CN205563453U (en) | 2015-12-16 | 2015-12-16 | Sight tracking and human eye region-of-interest positioning system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201521052147.1U CN205563453U (en) | 2015-12-16 | 2015-12-16 | Sight tracking and human eye region-of-interest positioning system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN205563453U true CN205563453U (en) | 2016-09-07 |
Family
ID=56823486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201521052147.1U Expired - Fee Related CN205563453U (en) | 2015-12-16 | 2015-12-16 | Sight tracking and human eye region-of-interest positioning system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN205563453U (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105425967A (en) * | 2015-12-16 | 2016-03-23 | 中国科学院西安光学精密机械研究所 | Sight tracking and human eye region-of-interest positioning system |
| CN106814846A (en) * | 2016-10-24 | 2017-06-09 | 上海青研科技有限公司 | A kind of eye movement analysis method based on sight line and collision body intersection point in VR |
| CN107817899A (en) * | 2017-11-24 | 2018-03-20 | 姜翠英 | A kind of user watches content real-time analysis method |
| CN108415955A (en) * | 2018-02-06 | 2018-08-17 | 杭州电子科技大学 | A kind of point-of-interest database method for building up based on eye movement blinkpunkt motion track |
-
2015
- 2015-12-16 CN CN201521052147.1U patent/CN205563453U/en not_active Expired - Fee Related
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105425967A (en) * | 2015-12-16 | 2016-03-23 | 中国科学院西安光学精密机械研究所 | Sight tracking and human eye region-of-interest positioning system |
| CN105425967B (en) * | 2015-12-16 | 2018-08-28 | 中国科学院西安光学精密机械研究所 | Sight tracking and human eye region-of-interest positioning system |
| CN106814846A (en) * | 2016-10-24 | 2017-06-09 | 上海青研科技有限公司 | A kind of eye movement analysis method based on sight line and collision body intersection point in VR |
| CN106814846B (en) * | 2016-10-24 | 2020-11-10 | 上海青研科技有限公司 | Eye movement analysis method based on intersection point of sight line and collision body in VR |
| CN107817899A (en) * | 2017-11-24 | 2018-03-20 | 姜翠英 | A kind of user watches content real-time analysis method |
| CN107817899B (en) * | 2017-11-24 | 2018-06-26 | 南京同睿信息科技有限公司 | A kind of user watches content real-time analysis method |
| CN108415955A (en) * | 2018-02-06 | 2018-08-17 | 杭州电子科技大学 | A kind of point-of-interest database method for building up based on eye movement blinkpunkt motion track |
| CN108415955B (en) * | 2018-02-06 | 2021-12-28 | 杭州电子科技大学 | Interest point database establishing method based on eye movement fixation point moving track |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105425967B (en) | Sight tracking and human eye region-of-interest positioning system | |
| CN205563453U (en) | Sight tracking and human eye region-of-interest positioning system | |
| Mehrubeoglu et al. | Real-time eye tracking using a smart camera | |
| US20170285345A1 (en) | Augmented reality in a field of view including a reflection | |
| US20160131902A1 (en) | System for automatic eye tracking calibration of head mounted display device | |
| Li et al. | Etracker: A mobile gaze-tracking system with near-eye display based on a combined gaze-tracking algorithm | |
| US11340708B2 (en) | Gesture control of medical displays | |
| Ebert et al. | Invisible touch—Control of a DICOM viewer with finger gestures using the Kinect depth camera | |
| Lopez-Basterretxea et al. | Eye/head tracking technology to improve HCI with iPad applications | |
| CN114078278A (en) | Method and device for positioning fixation point, electronic equipment and storage medium | |
| CN107945607B (en) | Ultrasonic demonstration system and device | |
| Aditya et al. | Recent trends in HCI: A survey on data glove, LEAP motion and microsoft kinect | |
| CN102636483A (en) | Method and device for detecting urine iodine concentration | |
| KR20160068447A (en) | Method for determining region of interest of image and device for determining region of interest of image | |
| Chen et al. | The research and practice of medical image enhancement and 3D reconstruction system | |
| CN104123552A (en) | Automatic identification translating glasses | |
| CN112651270A (en) | Gaze information determination method and apparatus, terminal device and display object | |
| CN113842227B (en) | Medical auxiliary three-dimensional model positioning and matching method, system, equipment and medium | |
| Cao et al. | Gaze tracking on any surface with your phone | |
| TW201619754A (en) | Medical image object-oriented interface auxiliary explanation control system and method thereof | |
| CN111324274A (en) | Virtual makeup trial method, device, equipment and storage medium | |
| CN109508089B (en) | Sight line control system and method based on hierarchical random forest | |
| Wan et al. | A method of free-space point-of-regard estimation based on 3D eye model and stereo vision | |
| Yeung | Mouse cursor control with head and eye movements: A low-cost approach | |
| Xu et al. | Ravengaze: A dataset for gaze estimation leveraging psychological experiment through eye tracker |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160907 Termination date: 20191216 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |