KR101576630B1

KR101576630B1 - Method for displaying intelligent using pattern recognition

Info

Publication number: KR101576630B1
Application number: KR1020140060911A
Authority: KR
Inventors: 이동형
Original assignee: 이동형
Priority date: 2014-05-21
Filing date: 2014-05-21
Publication date: 2015-12-10
Also published as: KR20150134070A; WO2015178613A1

Abstract

The present invention provides a screen display method of a control unit of a terminal having an image sensor and a screen display unit, the screen display method comprising: a user facial recognition step of recognizing a pattern of image information input from the image sensor, The method comprising the steps of: recognizing a user's distance by measuring a ratio of a user's face image to an existing set user face image; designating a screen magnification of the user in a database; designating a screen magnification according to the specified screen magnification and the recognized distance; and adjusting a screen size of a reading object to be displayed on a screen display unit. The intelligent screen display method according to the present invention includes intelligent screen automatic adjustment of smart devices and various display devices, By using the device, the size of the screen It can prevent the inconvenience of adjustment and decreased vision.

Description

TECHNICAL FIELD [0001] The present invention relates to an intelligent pattern recognition method,

The present invention relates to an intelligent screen display method through pattern recognition of digital input / output terminals (e.g., tablet PC, smart phone).

Have you ever tried to expand your work by setting a few fonts that are visible on the screen? Or do you have experience surfing the web or surfing e-book on your smartphone? If the reader is in his late 40s, he / she will have had a bad experience because he can not see the small text because of the starting presbyopia.

Paper documents can be controlled by direct distance. However, I think that it is annoying if you directly control the digitized document which is made for convenience. Especially smartphones and smart devices should always be set up for each screen when surfing the documents and the web. In order to solve such a problem, it is necessary to develop a method and apparatus that can automatically adjust the size of a displayed screen to fit the screen focus to a personalized personalized image through facial recognition.

The existing method is used after manually adjusting the page or the screen to suit each individual. In addition, the patent 2010-292193 addresses a general user, not a user, and processes the screen magnification after measuring the distance, which may result in a problem that the screen can not be displayed in an optimal manner according to the user's situation such as the size of the face. In addition, the automatic page turning technique of existing digital contents has the inconvenience of using the automatic scrolling function and the user's head and the inclination of the device, so that the user uses the nerves little by little depending on the situation of the page turning. And the patent 10-2007-0060885 describes a method of providing an input interface using various recognition technologies, but it is applicable only to the input part, and the flow pattern and the security pattern part using the same are excluded, thereby making it a security pattern processing technology through the pupil flow recognition I can see that. Finally, the patent 2005-238184 discloses a technology that can provide images according to the viewing angle rather than a predetermined image depending on the viewing position of the user. That is, when viewing the window from various positions, There are problems in providing images. A kiosk system capable of automatically adjusting the height using a camera of the application No. 10-2013-0037380 describes a method of adjusting a physical position by an object and facial recognition using a camera and various input sensors. Because it is a physical equipment, it is not effective because it is influenced by the size increase and the surrounding environment.

The present invention was developed in order to solve the above-mentioned problems. Since the mid-40s, many people who have difficulty in seeing small screen and text in the beginning of presbyopia have seen. And PCs that are mainly used in the company are using notebook or smart devices. At this time, we often see that work efficiency is poor due to visual problems because we have a lot of work and work correctly.

In addition, most users feel the inconvenience of the screen enlargement function due to the increasing use of smart phones and smart devices.

Third, we saw that the size of the equipment size and the preparation time increase according to the personalization according to the mechanical automation of the unmanned information desk and the kiosk system.

Finally, the security pattern is used as a method to solve problems such as recognition errors in the smartphone and facial recognition system.

This has the drawback that the user is exposed to the outside when using the pattern.

In order to solve this problem, it is an object of the present invention to provide an intelligent screen display method by recognizing a flow of an image size and a pupil movement and automatically recognizing the size of a displayed screen and providing pattern security service.

According to an aspect of the present invention, there is provided an intelligent screen display method using pattern recognition,

The size of the facial image through the image sensor (camera) is recognized, and the distance is measured. Then, the ratio of the facial image to the existing facial image is measured and displayed intelligently in the size of the screen suitable for the ratio. After recognizing the pupil through the image processing, the flow of the pupil is grasped and the page turning or security pattern processing can be confirmed by the pupil. This can be applied to the face recognition field. I think it is possible to compensate for the shortcomings of facial recognition by adding a security pattern service to facial recognition and processing the pattern with eyes. Finally, the function of displaying the screen in accordance with the situation after confirming the user's position, that is, the distance and the direction, by the image size recognition enables the screen to be viewed as an optimal visual environment for the user by screen multiplexing such as concave or convex.

Specifically, the screen display method of the control unit of the terminal having the image sensor and the screen display unit may include: a user face recognition step of recognizing a pattern of the image information input from the image sensor by the control unit; The method comprising the steps of: recognizing a user's distance by measuring a ratio of a user's face image to an existing set user face image; designating a screen magnification of the user in a database; designating a screen magnification according to the specified screen magnification and the recognized distance; and adjusting a screen size of a reading object to be displayed on a screen display unit.

Preferably, the control unit recognizes the pupil flow in the user facial image using the pattern recognition, and the control unit automatically conveys a page after the recognized pupil flow arrives at the bottom of the leading object And further comprising:

If the security pattern setting display condition is satisfied, the control unit displays a security pattern on the screen display unit, recognizes a pupil flow pattern for the security pattern, recognizes the recognized pupil flow pattern and a predetermined pupil flow pattern And if the recognized pupil flow pattern is different from the predetermined pupil flow pattern, the step of setting the default pupil flow pattern is performed.

Preferably, the controller includes a user face recognition step of recognizing a pattern of the image information input from the image sensor, a ratio between the recognized user face image and a preset user face image, and a face image size, And adjusting the screen refraction, enlargement and reduction of the reading object according to the recognized distance and direction (or angle), and recognizing the direction (or angle) .

The present invention can prevent the inconvenience of adjusting the size of a screen and the deterioration of visual acuity by using an intelligent screen automatic adjustment function and apparatus of smart devices and various display devices.

And it can compensate defects such as facial and iris pattern recognition through the pupil flow recognition of the security pattern. It is expected to improve the processing ability of digital documents due to the resolution of visual problems and to improve the public service work by introducing screen automatic control device such as kiosk system.

FIG. 1 is a diagram showing a configuration of an apparatus to which an intelligent screen display method based on pattern recognition according to the present invention is applied
2A to 2D are diagrams illustrating various examples of an intelligent screen display method using pattern recognition according to the present invention.

1 is a block diagram of an apparatus to which an intelligent screen display method using pattern recognition according to the present invention is applied.

As shown in FIG. 1, the apparatus recognizes the size of the facial image through the image sensor (camera), measures the distance from the facial image, measures the distance, and intelligently displays the size of the image according to the ratio It is in the cage.

After recognizing the pupil through the image processing, the flow of the pupil is grasped and the page turning or security pattern processing can be confirmed by the pupil.

This can be applied to the face recognition field.

I think it is possible to compensate for the shortcomings of facial recognition by adding a security pattern service to facial recognition and processing the pattern with eyes.

Finally, the function of displaying the screen in accordance with the situation after confirming the user's position, that is, the distance and the direction, by the image size recognition enables the screen to be viewed as an optimal visual environment for the user by screen multiplexing such as concave or convex.

Specifically, the device (e.g., smart phone) is a structure including an image sensor (e.g., camera) 101, a control unit 102, a screen display unit 104, and a database 103.

Here, the controller 102 measures the user's facial recognition through pattern recognition of the image information inputted from the image sensor 101, and the ratio of the recognized user facial image to the existing set user facial image, Determines a screen magnification by searching the database 103 for the screen magnification of the user, adjusts the screen size of the reading object according to the specified screen magnification and the recognized separation distance, . The control unit 102 recognizes the pupil flow in the user facial image using the pattern recognition, and the control unit 102 automatically detects the pupil flow after the bottom part of the leading object arrives I turn it over. When the security pattern setting display condition is satisfied, the control unit 102 causes the security pattern to be displayed on the screen display unit 104, recognizes the pupil flow pattern for the security pattern, Unlocks if the preset pupil flow pattern is the same, and defaults to a case where the recognized pupil flow pattern and the predetermined pupil flow pattern are different. In addition, the control unit 102 may recognize the user's facial image through pattern recognition of the image information input from the image sensor 101, the ratio of the recognized user's facial image to the existing set user's facial image, And recognizes the distance and direction (or angle) by measuring the distance and adjusts the screen refraction and enlargement / reduction of the reading object according to the recognized distance and direction (or angle).

FIGS. 2A to 2D are diagrams illustrating various examples of an intelligent screen display method using pattern recognition according to the present invention.

1. FIG. 2A (customized optimal screen description based on distance by user)

In the present invention, a digital input / output terminal (e.g., a tablet PC, a smart phone) receives image information from an image sensor (e.g., a camera).

Then, the user recognizes the face distance by recognizing the pattern of the input image information, and then measures the ratio of the recognized face image to the user face image.

Then, the screen magnification of the user is found in the database, the screen magnification is specified, and the screen size of the reading object is adjusted according to the specified screen magnification and the recognized separation distance (for example, , The specified screen magnification is adjusted by the set distance according to the recognized distance distance) and displayed on the screen display section.

2. FIG. 2b (Automatic page turnover technique using pupil flow recognition)

First, the digital input / output terminal receives image information from an image sensor (e.g., a camera).

Then, the user's facial recognition is performed through pattern recognition of the input image information, and then the pupil flow in the user's facial image is recognized using the pattern recognition.

Then, the recognized pupil flow automatically passes the page after the bottom part of the leading object arrives.

3. Fig. 2c (security pattern processing technology through pupil flow recognition)

First, the security pattern is displayed on the screen display unit when the digital input / output terminal meets the security pattern setting display condition.

If the recognized pupil flow pattern is different from the preset pupil flow pattern after the recognized pupil flow pattern is identical to the preset pupil flow pattern after recognizing the pupil flow pattern for the security pattern, .

Figure 2d (technology to support screen multiplexing through facial recognition)

The digital I / O terminal performs user facial recognition through pattern recognition of the image information input from the image sensor, and then calculates the ratio of the recognized user facial image to the existing set user facial image and the facial image size And recognizes the distance and direction (or angle) by measuring the distance and adjusts the screen refraction and enlargement / reduction of the reading object according to the recognized distance and direction (or angle).

For example, the screen magnification of the user is found in the database, the screen magnification is specified, and the screen size of the reading object is adjusted according to the specified screen magnification and the recognized separation distance and direction (for example, When the magnification is specified, the designated screen magnification is adjusted by the set value according to the recognized distance and direction recognized) to be displayed on the screen display section.

Description of the Related Art [0002]
101: camera 102:
103: Database 104: Screen display section

Claims

A method of displaying a screen of a control unit of a terminal having an image sensor and a screen display unit,
A user facial recognition step of recognizing a face for each user based on the intelligent pattern recognition of the image information input from the image sensor;
Measuring a ratio of the recognized face image of the user to a predetermined face image of the user and recognizing a distance by user; And
Wherein the screen magnification of the user having the recognized face is searched in the database and specified as a display screen magnification, and the specified screen magnification of the designated user is set to a user's face distance corresponding to the user- So as to display the screen size of the reading object on the screen display unit;
Lt; / RTI >

Wherein the control unit recognizes a user's face according to a user's intelligent pattern recognition of the image information input from the image sensor;
Measuring a ratio between the recognized user facial image and an existing set user facial image and a facial image size to recognize a distance and a direction of each user; And
Searching the database for a specific screen magnification of the user having the recognized face, designating the specified screen magnification as a display screen magnification, setting a specific screen magnification of the specified user as a distance between the user's facial images, Adjusting the screen refraction, enlargement, and reduction of the reading object so as to be displayed on the screen display unit by adjusting the display object in a customized manner according to the user,
The method according to claim 1, further comprising the steps of:

The method according to claim 1,
Recognizing a flow of a pupil in a user's face image based on a user's face image based on the intelligent pattern recognition; And
The control unit automatically passes the page of the corresponding leading object when it detects that the recognized pupil flow of the corresponding user arrives at the lowermost part of the leading object.
The method according to claim 1, further comprising the steps of:

delete