KR102050387B1

KR102050387B1 - Green information providing method using image matching and terminal thereof

Info

Publication number: KR102050387B1
Application number: KR1020120085178A
Authority: KR
Inventors: 김병천
Original assignee: 김병천
Priority date: 2012-08-03
Filing date: 2012-08-03
Publication date: 2019-12-02
Also published as: KR20140017996A

Abstract

The present invention relates to a method for providing green information using image matching and a terminal thereof, and more particularly, to generate green information by converting a circled picture into a three-dimensional image, and the image of the green information and the actual green picture taken by a golfer. The present invention relates to a green information providing method using an image matching to display green information from a golf ball to a hole cup by matching images, and a terminal thereof.
According to the present invention, there is provided a method of providing green information using image matching, including photographing one green by using a camera, acquiring green information by imaging the one green photographed image in three dimensions by image-based modeling, and a golfer Photographing the actual green between the golf ball and the hole cup by using a camera; identifying the golf ball and the hole cup from the actual green photographed image to generate position information of the golf ball and the hole cup; and the image and the actual information of the 3D green information. Comparing and matching images of the green picture with each other; And displaying three-dimensional green information from the golf ball to the hole cup on the display unit.

Description

Green information providing method using image matching and terminal {GREEN INFORMATION PROVIDING METHOD USING IMAGE MATCHING AND TERMINAL THEREOF}

The present invention relates to a method for providing green information using image matching, and a terminal thereof, and more particularly, to generate green information by three-dimensionalizing a green picture by image-based modeling, and to take an image of the green information and a golfer. The present invention relates to a green information providing method for displaying green information from a golf ball to a hole cup by matching an image of an actual green picture, and a terminal thereof.

The golf market is largely divided into the US and Europe, and in Asia, as the economy of China grows and the national income increases, the golf population is increasing. Has declined and entered recession, golf experts say.

On the other hand, Putting Green is an area where golf balls are inserted into the hole cups with an average of two strokes by rolling the golf balls onto the grass on the mat where the hole cups are formed.

In the case of putting in golf, it is necessary to accurately grasp the inclination of the lie or the green on the green and hit the golf ball in the appropriate strength and direction to put the golf ball into the hole cup.

Therefore, putting has been considered the most important factor in a golf game because the impact on the score is so large that golfers step back a few steps behind the ball to figure out the lie between the golf ball and the hole cup before putting on the green. Sit down or observe the slope of the green, almost level with eye level.

At this time, in order to determine the intermediate inclination between the golf ball and the hole cup, it may be observed from the left or right side, may also be observed from the back or the rear of the hole cup, and grasping the fine lie around the hole cup is also essential for accurate putting.

In addition, the professional golfer rounds the course with the caddy in advance, and the caddy frequently grasps the characteristics of each hole to make a yard book, and provides the golfer with help information during the actual game. In this case, it is difficult to receive this help information, and the ability to read the green slope makes the process of putting a golf ball into a hole cup on a putting green very difficult.

Prior Patent Publication No. 10-2011-0072480 (June 29, 2011) discloses a practice green system for marking putting lines.

This prior patent has a green provided with a hole cup and composed of a plurality of pixels; Positioner for indicating the position of the golf ball to put; A controller which calculates a putting line by comparing the position information received from the positioner with information such as the inclination and the height value of each pixel of the green, which are stored in advance; A light source generator generating light on the green by the calculated putting line information and displaying the putting line; It is configured to include.

According to this prior patent, the correct putting line is displayed according to the slope, height and bend of the green so that amateur golfers can reduce the number of hits by practicing the putting in the practice green system.

By the way, the preceding patent is only one practice installed in indoor golf practice range, etc. There was a problem that can not be applied to the green of the actual golf course.

Publication No. 10-2011-0072480 (June 29, 2011)

The present invention has been made in order to solve the above problems, to generate green information by three-dimensional image of the green picture by image-based modeling, by matching the image of the green information taken by the golfer with the image of the green information By displaying the green information from the golf ball to the hole cup along with the distance and inclination, the green can be used to assist amateur golfers when the green ball is being attacked and to help popularize golf and revitalize the golf market. An object of the present invention is to provide a method and a terminal thereof.

Green information providing method using the image matching according to the present invention for achieving the above object, the first step of photographing the circle green to enter the green, green edge or the bunker surrounding the green using a camera;

A second step of obtaining green information by imaging the circle-drawn photographed image in three dimensions by image-based modeling;

A third step in which the golfer photographs the actual green so that the actual green appears between the golf ball and the hole cup using the camera;

A fourth step of identifying the golf ball and the hole cup from the actual green photograph and generating position information of the golf ball and the hole cup;

A fifth step of comparing and matching the image of the 3D green information with the image of the actual green picture; And

A sixth step of displaying three-dimensional green information from the golf ball to the hole cup on a display unit;

It is configured to include.

In addition, the green information providing terminal using the image matching according to the present invention stores the three-dimensional green information generated by imaging the three-dimensional green image, the feature points extracted from the image of the three-dimensional green information or a pattern of a specific area is stored Become,

Shoot the actual green so that the actual green appears between the golf ball and the hole cup using the self-equipped camera. Creates a,

The feature points extracted from the 3D green information or the pattern of the specific area are compared with the feature points extracted from the actual green photograph or the pattern of the specific area and matched with each other, and the position of the golf ball and the hole cup is matched with the image of the 3D green information,

Three-dimensional green information from the golf ball to the hole cup is characterized by displaying the distance from the golf ball to the hole cup and the slope and the left and right inclination.

According to the above-mentioned means for solving the problem, the green picture is generated by the three-dimensional image by the image-based modeling to generate the green information, and the golf ball to the hole cup by matching the image of the green information taken by the golfer with the image of the green information By displaying the green information of the car along with the distance and the slope, etc., it can help the amateur golfer when the hole cup is attacked on the green and help to popularize the golf and revitalize the golf market.

In addition, making the golf ball into the hole cup on the green easy for everyone to understand, adding to the fun of golf and actually reducing mistakes on the putter, allowing golfers to find more golf courses.

1 is a flowchart of a method for providing green information according to an embodiment of the present invention.
FIG. 2 is an exemplary view of one green for explaining FIG. 1. FIG.
3 is an exemplary view of an actual green for explaining FIG. 1.
4 is a block diagram of a green information providing terminal according to an embodiment of the present invention.

Hereinafter, the configuration and operation of the present invention will be described with reference to the accompanying drawings.

It should be noted that the same elements among the drawings are denoted by the same reference numerals and symbols as much as possible even though they are shown in different drawings. In the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

In addition, when a part is said to "include" a certain component, this means that it may further include other components, except to exclude other components unless otherwise stated.

1 is a flowchart of a method for providing green information according to an exemplary embodiment of the present invention, FIG. 2 is an exemplary view of one green for explaining FIG. 1, and FIG. 3 is an exemplary view of an actual green for explaining FIG. 1.

The green information providing method according to the present invention mainly comprises a raw DB acquisition process (S102-S108), a user's actual information acquisition process (S110-S116), a matching process (S118), and a display process (S220).

First, the process of acquiring the circle DB can capture the entire putting green in the vicinity of the circle green (1) while setting a position that can show the shape and features of the putting green well by using the camera as well as the circle green (1) as well as the green edge ( 6), the entire green (1) is taken so that the green surrounding bunker (5), etc. (S102).

At this time, in order to detect the image depth of the real object (green), which is information for acquiring a 3D image, parallel stereo imaging and cross vision stereo recording are performed, or one green Shoot (1).

Or by using Terrestrial LiDAR (Terrestrial Light Detection And Ranging) surveying equipment, the laser beam is emitted to the surveying target (circle green), and the return time and phase difference are calculated to calculate the position information and image of the target (circle green). Acquiring three-dimensional spatial information combining the information.

The original green picture is stored in a computer or the like, and the image program is executed to remove the additional images such as the hole position 3, the golf tool (for example, the flagpole of the hole cup), and other human shapes to generate a pure green image (S104).

Next, three-dimensional green information is obtained by post-processing image-based modeling such as simplifying the pure green image, rotating the simplified pure green image, and correcting the height (S106).

That is, green information is obtained by imaging in three dimensions by image-based modeling, which reconstructs three dimensions by detecting the depth of the real object from a two-dimensional circle green photograph.

At this time, the depth of the three-dimensional object and the three-dimensional image according to the depth may be calculated from at least two images based on the parallel stereoscopic method or the cross-visual stereo method, and the image obtained from one camera may be processed separately. It can also be 3D imaging.

For example, in the parallel-vision stereo system, when two lens projection center lines are placed in parallel, an image of the same object point is placed on an epipolar line generated by the object point (a line formed by two lens centers and an image plane). In this case, the depth of the real object may be sensed by the distance between the lens center and the focal length and the distance between the projection objects in the image plane through the two lenses.

In the next three-dimensional green information, feature points such as green edges and green surrounding bunkers, which are the characteristics of the green, are extracted, or patterns of specific regions are extracted and stored together with the three-dimensional green information (S108).

This feature point extraction uses face recognition or fingerprint recognition technology to perform block direction extraction, binarization, thinning, and finally, feature point data is extracted.

The pattern extraction converts an image of 3D green information into a binary image and extracts a pattern from a specific region of the binary image.

After the three-dimensional green information is stored in the original DB built in the green information providing server (not shown) through these steps, the green information providing server 10 is connected to the green information providing terminal 10 to display the three-dimensional green information of a specific golf course. Download and save.

Next, when the golfer is located on the actual green 7 shown in FIG. 3 when the golfer rounds as a user's actual information acquisition process, the green edge using the camera 14 provided in the green information providing terminal 10 ( 6), the actual green 7 is photographed so that the actual green 7 and the like appear between the golf ball 2 and the hole cup 3 (S110).

Remove the additional image, such as golf tools, the shape of the person from the actual green picture (S112).

A feature point is extracted from the actual green picture from which the additional image is removed, or a pattern of a specific region is extracted from the actual green picture (S114).

In addition, the golf ball and the hole cup are identified in the actual green picture from which the additional image is removed to generate position information of the golf ball and the hole cup (S116).

In the following matching process, the image of the 3D green information and the image of the green picture taken by the golfer are compared with each other, and the matching is performed by matching the feature points or patterns of step S108 with the feature points or patterns of step S114, The positions of the golf ball 2 and the hole cup 3 are extracted as relative values, and then converted into absolute positions and displayed on an image of 3D green information (S118).

After displaying the entire image of the 3D green information in the display process, the 3D green information from the golf ball 2 to the hole cup 3 is displayed on the display unit 18 of the green information providing terminal 10. (S120).

In this case, the distance between the golf ball 2 and the hole cup 3 and the slope and the left and right inclination may be displayed on one side of the display unit 18, and three-dimensional green information is displayed from the golf ball 2 to the hole cup 3. Then, the distance, the slope, and the left and right slopes may be sequentially displayed.

If the slope is-37cm, the golf ball (2) to the hole cup (3) downhill and the height is 37cm, if the left and right slopes R 12cm from the position of the golf ball (2), the right is high, the left is low, the slope The accuracy should be putt by setting 12cm to the right of the hole as an imaginary hole.

In this case, the correction putting distance is introduced and introduced as a new concept.

The correction putting distance is a distance corrected in consideration of the current green speed based on a general green speed (for example, 2.4 m / sec).

For example, if the current green speed is 1.5m / sec and the distance between the golf ball and the hole cup is 3m, a putting distance of 1m at 2.4m / sec is 1

When defined as (Nuto), (2.4 / 1.5) X 3 = 4.8 Nuto is the correction putting distance.

Thus 4.8

Swing to the size of the swing that sends the correct putting distance of (Nuto).

Similarly, the correction putting distance is expressed in Nuto units in consideration of the slope (downhill, uphill) between the golf ball and the hole cup.

If the slope is-37 cm, the correct putting distance is 4.8-0.37 = 4.43 noto.

4 is a block diagram of a green information providing terminal according to an embodiment of the present invention.

As shown in FIG. 3, the green information providing terminal 10 includes a control unit 11, a power supply unit 12, an input unit 13, a camera 14, a transceiver unit 15, a port unit 16, and a storage unit. 17, the display unit 18 is configured.

The power supply unit 12 is a means for applying current to each of the above-described components. When the user operates an ON / OFF button (not shown) to output a power on / off signal, the power supply unit 12 receives a signal to supply power to other components. Allow or block

The display unit 18 receives the processing result such as calculation and matching by the control unit 11 and displays the text or graphic.

The display unit 18 preferably uses a liquid crystal display (LCD) in terms of cost and efficiency, and in this case, the display unit 18 includes an LCD controller including a buffer, a memory, a register, and an LCD drive. It consists of a driver and an LCD screen.

The input unit 13 is provided so that a user (golf) can input various information, and in particular, pushes each mode so that the user (golf) can select and input a shooting mode, a matching mode, a display mode, a calculation mode, and the like. A button switch may be provided or one mode selection button may be provided so that each mode is sequentially selected as the mode selection button is pressed.

The control unit 11 performs different processing according to the command input from the input unit 13 or the selected mode. When the photographing mode is selected, the control unit 11 controls the operation of the camera 14 to the camera 14. Take a picture of the actual green (7) to be stored in the storage means (17).

The camera 14 has a plurality of lenses and is configured to adjust the optical focal length by moving each lens to change its relative distance.

The green information providing terminal 10 allows the capturing of still images and moving images, and the camera 14 is provided with an automatic focusing device, a macro device, an optical zoom device, and the like.

In the case of selecting the matching mode, the control unit 11 removes an additional image such as a golf tool or other human shape from the actual green picture stored in the storage unit 17, and then extracts a feature point or extracts a pattern of a specific area from the golf ball (2) and the hole cup (3) is identified to generate the position information of the golf ball (2) and hole cup (3).

In addition, by comparing the image of the three-dimensional green information stored in the storage means 17 and the image of the actual green picture taken by the golfer to match each other, by matching the feature points of each image or pattern of a specific area by matching In addition, the positions of the golf ball 2 and the hole cup 3 are extracted as relative values from the image of the 3D green information and then converted into absolute positions.

When the calculation mode is selected, the controller 11 calculates the correction putting distance with reference to the green speed, the distance between the golf ball 2 and the hole cup 3, and the slope.

In the case of selecting the display mode, the controller 11 displays the entire image of the 3D green information, and then displays the 3D green information from the golf ball 2 to the hole cup 3 of the green information providing terminal 10. It is displayed on the display unit 18.

At this time, the distance between the golf ball 2 and the hole cup 3 and the inclination and left and right inclinations are displayed on one side of the display unit 18, or three-dimensional green information is displayed from the golf ball 2 to the hole cup 3. Afterwards, the distance, the slope and the left and right slopes are displayed in order.

The storage means 17 stores not only the 3D green information, the actual green picture, the matched 3D green information (including the position, distance, inclination and tilt of the hole cup and the golf ball, and the correction putting distance), but also the control unit ( In 11), software for processing various data is mounted.

The port 16 may be connected to a USB storage device or a computer to upgrade 3D green information, and in particular, the green speed of the day may be downloaded and output to the display unit 18.

The transmitting and receiving unit 15 is connected to the green information providing server (not shown) by wireless or wired to download and store the three-dimensional green information in the storage means 17.

As described above, according to the method of providing green information using the image matching and the terminal thereof, the green information is generated by three-dimensional image of the original green picture by image-based modeling, and the actual image captured by the golfer and the image of the green information By displaying the green information from the golf ball to the hole cup along with the distance and inclination by matching the image of the green picture, it helps the amateur golfer when the hole cup is attacked on the green and helps the popularization of golf and the vitalization of the golf market. Can be.

10: green information providing terminal 11: control unit
12: power supply unit 13: input unit
14: camera 15: transceiver
16: port 17: storage means
18: display unit

Claims

A first step of photographing one green such that one green, green edge, or surrounding green bunker enters into a parallel stereo recording or a cross-visual stereo recording to detect depth of green using a camera;
A second step of obtaining green information by imaging the circle-drawn photographed image in three dimensions by image-based modeling;
A third step in which the golfer photographs the actual green so that the actual green appears between the golf ball and the hole cup using the camera;
A fourth step of identifying the golf ball and the hole cup from the actual green photograph and generating position information of the golf ball and the hole cup;
A fifth step of comparing and matching the image of the 3D green information with the image of the actual green picture; And
A sixth step of displaying three-dimensional green information from the golf ball to the hole cup on a display unit;
Green information providing method using an image matching comprising a.

delete

The method of claim 1,
In the second step, the feature point is extracted from the image of the one-shot photographed photo or the pattern of the specific region is extracted.
And matching the feature points or patterns of the second step with the feature points or patterns of the fourth step in the fifth step.

The method of claim 1,
Green information providing method using the image matching, characterized in that further displaying the distance from the golf ball to the hole cup and the inclination and left and right inclination in the sixth step.

The method according to claim 1 or 4,
And displaying a correction putting distance, which is a distance corrected in consideration of the current green speed, based on the general green speed, in a size of a predetermined virtual unit, in the sixth step.

The method of claim 5,
Green information providing method using the image matching, characterized in that for correcting the correction putting distance in consideration of the slope from the golf ball to the hole cup to display the size of a predetermined virtual unit.

Three-dimensional green information generated by imaging a green-green photographed image that senses the depth of green by taking a parallel or stereoscopic stereo method, and a feature point or a specific area extracted from the image of the three-dimensional green information. The pattern is saved,
Shoot the actual green so that the actual green appears between the golf ball and the hole cup using the self-equipped camera, extract the feature point or the pattern of a specific area from the image of the actual green shot, and check the golf ball and the hole cup to check the location of the golf ball and the hole cup. Creates a,
The feature points extracted from the 3D green information or the pattern of the specific area are compared with the feature points extracted from the actual green photograph or the pattern of the specific area and matched with each other, and the position of the golf ball and the hole cup is matched with the image of the 3D green information,
Green information providing terminal using the image matching, characterized in that the three-dimensional green information from the golf ball to the hole cup to display the distance and the slope and the left and right inclination from the golf ball to the hole cup.

The method of claim 7, wherein
Based on the general green speed, the correction putting distance, which is a distance corrected in consideration of the current green speed, is further displayed. However, the correction putting distance is further corrected in consideration of the inclination from the golf ball to the hole cup to display the size of a predetermined virtual unit. Green information providing terminal using image matching, characterized in that.