US20220072370A1 - System and Method for Tracking and Analyzing Golf Shot - Google Patents
System and Method for Tracking and Analyzing Golf Shot Download PDFInfo
- Publication number
- US20220072370A1 US20220072370A1 US17/012,479 US202017012479A US2022072370A1 US 20220072370 A1 US20220072370 A1 US 20220072370A1 US 202017012479 A US202017012479 A US 202017012479A US 2022072370 A1 US2022072370 A1 US 2022072370A1
- Authority
- US
- United States
- Prior art keywords
- golf
- ball
- image
- light
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/23—Recognition of whole body movements, e.g. for sport training
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0003—Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
- G06V20/647—Three-dimensional objects by matching two-dimensional images to three-dimensional objects
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B2071/0647—Visualisation of executed movements
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2102/00—Application of clubs, bats, rackets or the like to the sporting activity ; particular sports involving the use of balls and clubs, bats, rackets, or the like
- A63B2102/32—Golf
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/05—Image processing for measuring physical parameters
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/10—Positions
- A63B2220/16—Angular positions
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/20—Distances or displacements
- A63B2220/24—Angular displacement
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/30—Speed
- A63B2220/34—Angular speed
- A63B2220/35—Spin
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/80—Special sensors, transducers or devices therefor
- A63B2220/807—Photo cameras
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/80—Special sensors, transducers or devices therefor
- A63B2220/808—Microphones
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2225/00—Miscellaneous features of sport apparatus, devices or equipment
- A63B2225/74—Miscellaneous features of sport apparatus, devices or equipment with powered illuminating means, e.g. lights
Definitions
- the present invention pertains generally to the field of a system and a method for sport training, and more particularly to a system and a method for tracking and analyzing golf shot.
- golf simulation systems provide some elements of realism by using projected images from a player view after a shot has been played.
- these kinds of golf simulation systems do not provide detailed information which can affect the golf shot; thus, players lose opportunities to correct posture errors, and it is hard to sharpen their skills in the right ways.
- the present invention provides a system and a method for tracking and analyzing golf shot.
- the system and the method enable golf players to receive more accurate and detailed analysis report.
- the golf shot trajectory and the captured image sequence from the system to help players understand their swings better with data related to their shot from before to after contact between the golf club and the golf ball. Therefore, players can have opportunities to correct errors properly and sharpen their skills in the right ways.
- Embodiments of the inventive concept provide a system for tracking and analyzing golf shot comprising: a light source emitting light having a first wavelength range; a plurality of cameras each equipped with a light filter only passing light within the first wavelength range, the cameras comprising: a first and a second stereo camera having the same focal length and triggered by single signal, and a third camera capturing from before to after contact between a golf club and a golf ball, and a controller having at least one of image analyzing processor.
- the image analyzing processor produces: a disparity map, a three dimension simulation, and a first motion analysis data including positions, velocities, and angles of the golf shot using images captured from the first and the second stereo camera, and image sequences and a second motion analysis data including at least one of ball spinning, club face angle, and swing using images captured from the third camera.
- system further comprises a screen, the screen displays the three dimension simulation, image sequences as live replay, and the first and the second motion analysis data.
- the first wavelength range is within infrared light, and wherein the light filter is an infrared passing filter.
- the light source has a form of a flat panel comprising a plurality of light emitting devices, and wherein a direction of the flat panel is parallel to image planes of the cameras.
- the cameras are installed at least one place: in front of a ball hitting mat, and at a top ceiling facing the ball hitting mat in parallel.
- the system further comprises a golf ball, wherein the golf ball includes at least one mark on an outer surface, and the at least one mark is shown differently between one side of the golf ball from the other side from any angle.
- the mark is shown differently between one side and the other side by at least one of arrangement, shape, and color of the mark.
- the system further comprises a microphone, wherein the controller recognizes a voice command input through the microphone by a user and answers through at least one of a screen, an audio system, and other output devices.
- Embodiments of the inventive concept provide a method for tracking and analyzing golf shot comprising: turning on a light source; a first capturing a pair of images of the golf shot using a pair of stereo cameras having a same focal length and triggered by single signal; a first analyzing a disparity between the pair of images; a first producing a disparity map, a three dimension simulation, and a first motion analysis data; a second capturing an image of the golf shot from before to after contact between a golf club and a golf ball using a single camera; a second analyzing image sequences captured by the single camera; a second producing a second motion analysis data including at least one of ball spinning, club face angle, and swing, and displaying the three dimension simulation, the image sequence, and the first and the second motion analysis data.
- the step of the first producing the disparity map and the three dimension simulation uses a following equation:
- D is a vertical distance from the pair of cameras and a golf ball
- F is focal length
- Dcc is a distance between the pair of cameras
- Xl ⁇ Xr is a disparity between the pair of images.
- the first motion analysis data includes at least one of three dimensional positions, velocities, and angles of the golf shot.
- the golf ball includes at least one mark on an outer surface, wherein the mark is shown differently between one side of the golf ball from the other side from any angle, and wherein the ball spinning is calculated by position variations of the mark.
- the mark is shown differently between one side and the other side by at least one of arrangement, shape, and color of the mark.
- the step of the second producing the second motion analysis data of the club face angle and the swing includes a step of extracting a processed image representing only a pixel area of the golf club.
- the club face angle is calculated by measuring an angle between a shaft line of the golf club and a club face line of a head of the golf club using the processed image captured when the head is positioned just before the contact.
- a type of the swing is determined as in-to-in, out-to-in, or in-to-out by measuring an angle between a path of the golf club and a target line using the processed image from before the contact to after the contact.
- the steps of the first and the second analyzing and producing are performed through a controller, and the method further comprises controlling the controller by voice commands.
- the light source emits light having a first wavelength range
- each of the pair of stereo cameras and the single camera is equipped with a light filter only passing light within the first wavelength range.
- the first wavelength range is within infrared light, and wherein the light filter is an infrared passing filter.
- FIGS. 1 a and 1 b show block diagrams of golf shot tracking and analysis system 10 and 20 according to embodiments of the present invention.
- FIGS. 2 a to 2 c show an imaging device ID and exemplary physical placements of the imaging device ID in the golf shot tracking and analysis system 10 according to embodiments of the present invention.
- FIG. 3 shows a detailed structure of a light source LS in the golf shot tracking and analysis system 10 according to one embodiment of the present invention.
- FIG. 4 shows a flow chart of a method M 10 for tracking and analyzing a golf shot according to one embodiment of the present invention.
- FIG. 5 shows an actual trajectory of the golf shot and coordinate values of the golf shot determined from the golf shot tracking and analysis system 10 according to one embodiment of the present invention.
- FIGS. 6 a and 6 b are drawings to explain a step to calculate the depth of the image subjects and produce a disparity map using a difference between the two images respectively captured from stereo cameras C 1 and C 2 according to one embodiment of the present invention.
- FIG. 6 a shows images IMGl 1 and IMGr 1 when a golf ball B is located in a first position BP 1 .
- FIG. 6 b shows images IMGl 2 and IMGr 2 when a golf ball B is located in a first position BP 2 .
- FIGS. 7 a to 7 d are disparity maps DM 1 to DM 4 of the golf shot.
- FIGS. 8 a to 8 c are drawings to explain a step to analyze a ball spinning using marks MD 1 and ML 1 on the golf ball B according to one embodiment of the present invention.
- FIG. 8 a shows images I 1 and magnified images MI 1 of the golf ball B taken from a third camera C 3 .
- FIG. 8 b shows magnified images MI 1 in consecutive manner, representing position variations of the marks MD 1 and ML 1 on the golf ball B.
- FIG. 8 c shows additional mark-up images MMI 1 of the magnified images MI 1 in FIG. 8 b so that the marks MD 1 and ML 1 are clearly shown.
- FIGS. 9 a and 9 b are drawings to explain a step to analyze a swing in FIG. 10 and club face angle in FIG. 11 .
- FIG. 9 a shows images 12 of the golf shot taken from third camera C 3 .
- FIG. 9 b shows processed images PI 2 which subtracts the entire pixel area other than that of the golf club from the images 12 in FIG. 9 a.
- FIG. 10 is a drawing to explain a step to analyze the swing using the processed images PI 2 in FIG. 9 b.
- FIGS. 11 a to 11 c are a drawing to explain a step to analyze a club face angle using the processed images PI 2 in FIG. 9 b.
- FIG. 12 shows a three dimension golf shot simulation in a golf course on a screen 301 according to one embodiment of the present invention.
- FIG. 13 shows a live replay of a golf shot on a display 303 according to one embodiment of the present invention.
- FIG. 14 is a drawing to explain an operation of a voice recognition function of the golf tracking and analysis system 10 according to one embodiment of the present invention.
- FIGS. 1 a and 1 b show block diagrams of the golf shot tracking and analysis systems 10 and 20 according to embodiments of the present invention.
- FIGS. 2 a to 2 c show an imaging device ID and exemplary physical placements of the imaging device ID in the golf shot tracking and analysis system 10 according to embodiments of the present invention.
- FIG. 3 shows the detailed structure of the light source LS in the golf shot tracking and analysis system 10 according to one embodiment of the present invention.
- the golf shot tracking and analysis system 10 may comprise an imaging device ID, input devices 100 , a controller 200 , output devices 300 , and a memory 400 .
- the imaging device ID comprises multiple cameras C 1 , C 2 , C 3 and a light sources LS.
- the multiple cameras C 1 , C 2 , C 3 may comprise a pair of stereo cameras C 1 , C 2 and a single camera C 3 .
- the pair of stereo cameras C 1 , C 2 may be set far from each other in the imaging device ID to perform depth analysis and to produce disparity map and three dimension simulation using two images from the pair of stereo camera C 1 , C 2 .
- the specific steps to produce 3D simulation will be described later in more detail referring to FIGS. 5 to 7 d .
- the single camera C 3 may be located in a place close to any one of the stereo cameras C 1 , C 2 but is not limited to.
- the light source LS has a form of a flat panel comprising a plurality of light emitting devices LED.
- a direction of the flat panel of the light source LS may be parallel to image planes of the cameras C 1 , C 2 , C 3 .
- the image planes of the cameras C 1 , C 2 , C 3 will be explained later referring to FIGS. 6 a and 6 b.
- the light sources LS may comprise multiple light panels L 1 , L 2 , L 3 , L 4 , L 5 .
- Each of the light panels L 1 , L 2 , L 3 , L 4 , L 5 may comprise an array of multiple light emitting devices LED which emit infrared light L IR .
- infrared light L IR from the light panels L 1 , L 2 , L 3 , L 4 , L 5 are different wavelengths from that of noise light L N from other light sources, such as visible light
- the cameras C 1 , C 2 , C 3 equipped with an infrared pass filter CF can capture images without interference of the noise light L N . Accordingly, the captured images are not affected by noise light L N from random direction; therefore, the captured images can have clear and bright image quality and at the same time, can be analyzed more correctly.
- each of camera C 1 , C 2 , C 3 may have the structure comprising an imaging sensor CS, an infrared pass filter CF, and at least one of lens CL.
- the imaging sensor CS may be infrared light sensor which can detect only infrared light; however, the present invention is not limited to it.
- the light sources LS emit light having a first wavelength range
- each of the camera C 1 , C 2 , C 3 is equipped with a light filter only passing light within the first wavelength range.
- the pair of stereo cameras C 1 , C 2 can be used to track the golf ball in three dimensions, and the single camera C 3 to track a club head, a club shaft, a swing, a golf face angle, and ball spinning. Data from each of the pair of stereo camera C 1 , C 2 and the single camera C 3 are analyzed in views of different variables affecting the golf shot. Accordingly, a player can receive more accurate and detailed analysis report, have opportunities to correct errors properly, and sharpen their skills in the right ways.
- the operation of the stereo cameras C 1 , C 2 will be described later in more detail referring to FIGS. 5 to 7 d , and that of single camera C 3 referring to FIGS. 2, and 8 a to 11 .
- the input devices 100 may further comprise a microphone 109 and a keyboard 111 other than the multiple cameras C 1 , C 2 , C 3 .
- the microphone 109 can be used to transmit voice commands to the system 10 .
- the microphone 109 can be inbuilt inside the imaging device ID but is not limited to.
- the keyboard 111 can be used to transfer commands to the system 10 .
- the image data collected from the different cameras C 1 , C 2 , C 3 are sent to the controller 200 .
- the controller 200 may be implemented by software and/or firmware executed by at least one of processor.
- the processor can be microcomputers, signal processors, integrated circuits, and other analog and/or digital circuits but not limited to.
- the controller 200 comprises at least one of image analysis software including image processing function to provide analysis report regarding each of the golf ball and the club in view of various variables.
- the controller 200 may comprise a ball tracking analysis software 201 , a swing analysis software 203 , and a ball spinning analysis software 207 .
- the controller 200 comprises a simulation software 209 to display the three dimension trajectory of the golf ball based on the data from the ball tracking analysis software 201 , the swing analysis software 203 , and the ball spinning analysis software 207 .
- the operation of the live replay will be described later in more detail referring to FIG. 12 .
- the controller 200 also includes a live replay software 209 to display the image sequence captured from the single camera C 3 . The operation of the live replay will be described later in more detail referring to FIG. 13 .
- the controller 200 also comprise voice recognition software 211 to receive voice commands from the player. The operation of the voice recognition will be described later in more detail referring to FIG. 14 .
- the controller 200 may be connected to the output devices 300 such as a screen 301 , a monitor display 303 , and an audio system 305 .
- the screen 301 can display a three dimension golf course, a trajectory of the golf ball on the golf course, an analyzed datils such as 3D positions, velocities, angles, directions of the golf ball in the trajectory.
- the monitor display 303 may be used to monitor each element of the system 10 .
- the live replay software 209 can show the live video through the monitor display 303 .
- the audio system 305 can be used to transmit notification from the system 10 .
- the memory 400 may comprise a program memory and an image story memory for use by the controller 200 .
- the image story memory of the memory 400 may be a nonvolatile writable memory for storing images captured by the pair of stereo cameras C 1 , C 2 and the single camera C 3 .
- the imaging device ID, the input devices 100 , the controller 200 , the output devices 300 , and the memory 400 can be connected to each other through various means such as a USB cable, wireless Bluetooth, an electrical line, etc.
- an imaging device ID 2 of a golf shot tracking and analysis system 20 may comprise the microphone 109 , the controller 200 , the audio system 305 , and the memory 400 as well as the cameras C 1 , C 2 , C 3 and the light sources LS.
- the imaging device ID may be installed at least one place.
- the imaging device ID is placed at a top ceiling SC which faces a ball hitting mat BM and/or the floor SC in parallel.
- the imaging device ID is placed in front of the ball hitting mat BM on which a golf ball B is placed.
- each of two imaging devices ID is placed in front of the ball hitting mat BM and at the top ceiling SC, respectively.
- the golf shot tracking and analysis systems 10 , 20 are the embodiments of the present invention and the inventive concept of the present invention is not limited to the structure described above.
- the imaging device ID may further include more than three cameras.
- FIG. 4 shows a flow chart of a method M 10 for tracking and analyzing the golf shot according to one embodiment of the present invention.
- the method M 10 can be performed using the system 10 or 20 described before.
- the pair of stereo cameras C 1 , C 2 are referred to as a first stereo camera C 1 and a second stereo camera C 2 , respectively.
- the single camera C 3 will be referred to as a third camera C 3 .
- a user powers on the golf shot tracking and analysis 10 and turns on the light sources LS S 101 , S 103 .
- the cameras C 1 , C 2 , C 3 are in a capturing mode.
- FIG. 5 shows an actual trajectory Tb of the golf ball B and coordinate values (X, Y, B) of the golf shot determined by the golf shot tracking and analysis system 10 and method M 10 .
- the camera C 1 , C 2 , C 3 begin capturing images of the golf shot S 107 .
- both the first and the second stereo camera C 1 , C 2 keep capturing images by single trigger; therefore, the pair of images from the first and the second stereo camera C 1 , C 2 can be used to produce single stitched image or single three dimensional image in every frames.
- the golf shot tracking and analysis systems 10 needs to perform depth analysis and produce disparity map.
- the images captured from the camera C 1 , C 2 are sent to the controller 200 .
- FIGS. 6 a and 6 b are drawings to explain a step to calculate the depth of the subjects and produce the disparity map using a difference between the two images respectively captured from the first and second stereo camera C 1 and C 2 . Captured images the first and second stereo camera C 1 and C 2 are sent to the controller 200 , and the analysis of the depth, the disparity map, and the three dimension simulation can be performed in the ball tracking analysis software 201 of the system 10 .
- FIG. 6 a shows images IMGl 1 and IMGr 1 captured from the first and the second stereo camera C 1 , C 2 , respectively when a golf ball B is located in a first position BP 1 .
- FIG. 6 b shows images IMGl 2 and IMGr 2 captured from the first and the second stereo camera C 1 , C 2 , respectively when a golf ball B is located in a first position BP 2 .
- the first stereo camera C 1 is placed in left side while the second stereo camera C 2 is placed in right side.
- An optical center CO 1 of the first stereo camera C 1 and the optical center CO 2 of the second stereo camera C 2 are a certain distance Dcc away from each other.
- Optical axes of the first the second stereo camera C 1 and C 2 are parallel; accordingly, the first image plane Pl from the first stereo camera C 1 and the second image plane Pr are also parallel.
- each of the first and the second stereo camera C 1 , C 2 has the same focal length F
- each of the first and the second image plane Pl and Pr is placed at the same distance from each camera C 1 , C 2 .
- each of the first and the second stereo camera C 1 , C 2 captures the same scene, and the first stereo camera C 1 produces a first image IMGl 1 while the second stereo camera C 2 produces a second image IMGr 1 .
- a golf ball position IPl 1 (Xl1,Yl1) in the first image IMGl 1 is different from a golf ball position IPr 1 (Xr1,Yr1) in the second image IMGr 1 .
- a position difference of the golf ball B shown in the first and the second image IMGl 1 , IMGr 1 is a disparity Xl1 ⁇ Xr1.
- a depth D 1 , or distance, from the first and the second stereo camera C 1 , C 2 can be calculated as following equation:
- a golf ball position IPl 2 (Xl2,Yl2) in the first image IMGl 2 is different from a golf ball position IPr 2 (Xr2,Yr2) in the second image IMGr 2 .
- a position difference of the golf ball B shown in the first and the second image IMGl 2 , IMGr 2 is a disparity Xl2 ⁇ Xr2.
- a depth D 2 or distance, from the first and the second stereo camera C 1 , C 2 can be calculated as following equation:
- the disparity in two images from the stereo camera C 1 , C 2 becomes larger, and the depth D 1 , D 2 from the camera C 1 , C 2 becomes shorter.
- the ball tracking analysis software 201 can obtain depth of each frame from the first and the second stereo camera C 1 , C 2 .
- the ball tracking analysis software 201 also can produce disparity maps with these depth data of the frame as FIGS. 7 a to 7 d.
- FIGS. 7 a to 7 d are disparity maps DM 1 to DM 4 of the golf shot in FIG. 5 according to progress of the golf ball B.
- Disparity map represents a depth of the scene.
- FIG. 7 a is a disparity map when the golf ball is the first position BP 1 (Xb1,Yb1,Zb1).
- FIG. 7 b is a disparity map when the golf ball is the second position BP 1 (Xb1,Yb1,Zb1).
- FIG. 7 c is a disparity map when the golf ball is the third position BP 1 (Xb3,Yb3,Zb3).
- FIG. 7 d is a disparity map when the golf ball is the fourth position BP 4 (Xb4,Yb4,Zb4).
- the larger disparity images have the brighter color.
- the club CB is farther from the camera C 1 , C 2 than the golf ball B; therefore, the club CB is shown in dark gray color while the golf ball B is shown in bright gray color.
- the background is farther from the camera C 1 , C 2 than the club CB; therefore, the background is shown in almost black color.
- Ball Tracking Analysis Software 201 can obtain three dimensional position, three dimensional velocity, and vertical and horizontal angle.
- the data such as disparity maps and 3D position and speed are sent to the simulation software S 111 .
- the data also can be stored in the memory 400 .
- the third camera C 3 also begins capturing images of the golf shot S 113 .
- the first and the second stereo camera C 1 , C 2 may trigger the third camera C 3 .
- the images from the third camera C 3 can be analyzed and produce ball spinning, club face angle, and club swing data S 115 .
- FIGS. 8 a to 8 c are drawings to explain a step to analyze a ball spinning using the marks on the golf ball B according to one embodiment of the present invention.
- the golf ball B used in this system 10 and the method M 10 may comprise at least one of mark on an outer surface of the golf ball B.
- the mark is shown differently in one side of the golf ball B from the other side from any angle.
- at least one of arrangement, shape, and color of the mark are shown differently between one side and the other side.
- the golf ball B may comprise at least one of dot type mark MD 1 and at least one of line type mark ML 1 which have a different arrangement from any angle.
- FIG. 8 a shows images I 1 and magnified images MI 1 of a pixel area of the golf ball B taken from the third camera C 3 .
- positions of the marks MD 1 and ML 1 are changed in every frame as the golf ball B progresses.
- FIG. 8 b shows magnified images MI 1 in consecutive manner, representing position variations of the marks MD 1 and ML 1 on the golf ball B.
- the ball spinning analysis software 207 can calculate a spin direction, a spin speed, and other physical parameters based on the variations of the marks MD 1 and ML 1 .
- FIG. 8 c shows additional mark-up images MMI 1 of the magnified images MI 1 in FIG. 8 b so that the marks MD 1 and ML 1 are clearly shown.
- the ball spinning analysis software 207 can have a mark-up function which can add and/or modify the mark MD 1 and ML 1 in magnified images MT 1 to be clearer. As the mark MD 2 and ML 2 in the additional mark-up images MMI 1 can be easily detected, the ball spinning analysis may be performed accurately.
- FIGS. 9 a and 9 b are drawings to explain a step to analyze swing in FIG. 10 and club face angle in FIG. 11 .
- FIG. 9 a shows images I 2 of the golf shot taken from third camera C 3 from before to after contact between a golf club CB and a golf ball B.
- FIG. 9 b shows processed images PI 2 which subtracts the entire pixel area other than that of the golf club from the images I 2 in FIG. 9 a .
- the processed images PI 2 is an image extracting a pixel area of the golf club from the images I 2 in FIG. 9 a.
- FIG. 10 is a drawing to explain a step to analyze swing using the processed images PI 2 in FIG. 9 b . This step may be performed in the swing analysis software 203 .
- a final image representing the club path CP may be produced by overlapping the processed images PI 2 .
- the club path CP may be obtained based on a path of the center of the club head.
- the target line TL is an imaginary line to reach a target hole in the golf course.
- An angle between the club path CP and the target line TL can be calculated from before contact to after the contact. Each angle data can be used to determine if the swing is in-to-in, out-to-in, or in-to-out.
- FIGS. 11 a to 11 c are drawings to explain a step to analyze a club face angle using the processed images PI 2 in FIG. 9 b .
- This step may be performed in the swing analysis software 203 .
- the club face angle is referred to as an angle at contact between the golf club and the golf ball. This parameter affects a ball flight.
- the club face angle is an angle between a shaft line SL of the golf club and a club face line CF 1 , CF 2 , CF 3 .
- the club face line CF 1 , CF 2 , CF 3 is referred to a face line of a head of the golf club.
- the shaft line SL and the club face line CF 1 is parallel; accordingly, the club face angle is square.
- a club face angle ⁇ 1 between the shaft line SL and the club face line CF 1 is certain degree in an open form.
- a club face angle ⁇ 2 between the shaft line SL and the club face line CF 1 is certain degree in a closed form.
- the data such as image sequences, ball spinning, club face angle, swing can be sent to the simulation software and/or the live replay software S 111 .
- the data also can be stored in the memory 400 .
- the user can check his or her golf shot through a 3D simulation, a live replay, a swing analysis, and a shot analysis S 119 , S 121 , S 123 , S 125 .
- FIG. 12 shows a three dimension golf shot simulation in a golf course on a screen 301 according to one embodiment of the present invention. This step may be performed in the simulation software 207 .
- the screen 301 displays the 3D simulation of the golf ball trajectory Tb based on the data obtained from the analysis such as three dimension position and velocity, and horizontal and vertical angle of the golf ball B.
- FIG. 13 shows a live replay of a golf shot on the screen 301 or the monitor display 303 according to one embodiment of the present invention.
- This step may be performed in the live replay software 209 .
- All images captured from the third camera C 3 may be displayed as a form of a slow motion video. Therefore, the user can check a relation between the golf ball and the club on each frame, before contact, during the contact, and after contact.
- the live replay can help the user see the visual data in a real picture form and help to improve his or her skills.
- the user can try a new golf shot and repeat practice or start a new game S 127 .
- FIG. 14 is a drawing to explain an operation of a voice recognition function of the golf tracking and analysis system 10 according to one embodiment of the present invention. This step may be performed in the voice recognition software 211 .
- the golf shot tracking and analysis system 10 may provide hands-free command function.
- the system 10 receives a voice command VC from the user, the system 10 is recognized the voice command VC through the microphone 109 and the voice recognition software 211 .
- the microphone 109 may be inbuilt inside an imaging device ID 2 but is not limited to.
- the controller 200 may answer in forms of audio, video, graphics, or a combination of them through the output devices 300 such as the screen 301 , the monitor display 303 , and the audio system 305 .
- the system 10 may answer by changing a course or a player, displaying 3D simulation or live replay video, showing/telling analysis, score details, or current hole details.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Physical Education & Sports Medicine (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Image Analysis (AREA)
Abstract
Description
- The present invention pertains generally to the field of a system and a method for sport training, and more particularly to a system and a method for tracking and analyzing golf shot.
- As golf is becoming popular sport, there is an on-going interest in simple and effective ways to training and practicing golf shots for players. It is desirable for players to learn and analyze various variables of the game and train themselves to have muscle memory for the best results.
- In general, golf simulation systems provide some elements of realism by using projected images from a player view after a shot has been played. However, these kinds of golf simulation systems do not provide detailed information which can affect the golf shot; thus, players lose opportunities to correct posture errors, and it is hard to sharpen their skills in the right ways.
- In particular, most of ordinary systems provide simple trajectories of the golf ball after hitting even though the result of golf shot is affected by positions and directions of the club from before to after contact.
- The present invention provides a system and a method for tracking and analyzing golf shot. The system and the method enable golf players to receive more accurate and detailed analysis report. In particular, the golf shot trajectory and the captured image sequence from the system to help players understand their swings better with data related to their shot from before to after contact between the golf club and the golf ball. Therefore, players can have opportunities to correct errors properly and sharpen their skills in the right ways.
- Embodiments of the inventive concept provide a system for tracking and analyzing golf shot comprising: a light source emitting light having a first wavelength range; a plurality of cameras each equipped with a light filter only passing light within the first wavelength range, the cameras comprising: a first and a second stereo camera having the same focal length and triggered by single signal, and a third camera capturing from before to after contact between a golf club and a golf ball, and a controller having at least one of image analyzing processor.
- In one embodiment, the image analyzing processor produces: a disparity map, a three dimension simulation, and a first motion analysis data including positions, velocities, and angles of the golf shot using images captured from the first and the second stereo camera, and image sequences and a second motion analysis data including at least one of ball spinning, club face angle, and swing using images captured from the third camera.
- In one embodiment, the system further comprises a screen, the screen displays the three dimension simulation, image sequences as live replay, and the first and the second motion analysis data.
- In one embodiment, the first wavelength range is within infrared light, and wherein the light filter is an infrared passing filter.
- In one embodiment, the light source has a form of a flat panel comprising a plurality of light emitting devices, and wherein a direction of the flat panel is parallel to image planes of the cameras.
- In one embodiment, the cameras are installed at least one place: in front of a ball hitting mat, and at a top ceiling facing the ball hitting mat in parallel.
- In one embodiment, the system further comprises a golf ball, wherein the golf ball includes at least one mark on an outer surface, and the at least one mark is shown differently between one side of the golf ball from the other side from any angle.
- In one embodiment, the mark is shown differently between one side and the other side by at least one of arrangement, shape, and color of the mark.
- In one embodiment, the system further comprises a microphone, wherein the controller recognizes a voice command input through the microphone by a user and answers through at least one of a screen, an audio system, and other output devices.
- Embodiments of the inventive concept provide a method for tracking and analyzing golf shot comprising: turning on a light source; a first capturing a pair of images of the golf shot using a pair of stereo cameras having a same focal length and triggered by single signal; a first analyzing a disparity between the pair of images; a first producing a disparity map, a three dimension simulation, and a first motion analysis data; a second capturing an image of the golf shot from before to after contact between a golf club and a golf ball using a single camera; a second analyzing image sequences captured by the single camera; a second producing a second motion analysis data including at least one of ball spinning, club face angle, and swing, and displaying the three dimension simulation, the image sequence, and the first and the second motion analysis data.
- In one embodiment, the step of the first producing the disparity map and the three dimension simulation uses a following equation:
-
- and wherein D is a vertical distance from the pair of cameras and a golf ball, F is focal length, Dcc is a distance between the pair of cameras, and Xl−Xr is a disparity between the pair of images.
- In one embodiment, the first motion analysis data includes at least one of three dimensional positions, velocities, and angles of the golf shot.
- In one embodiment, the golf ball includes at least one mark on an outer surface, wherein the mark is shown differently between one side of the golf ball from the other side from any angle, and wherein the ball spinning is calculated by position variations of the mark.
- In one embodiment, the mark is shown differently between one side and the other side by at least one of arrangement, shape, and color of the mark.
- In one embodiment, the step of the second producing the second motion analysis data of the club face angle and the swing includes a step of extracting a processed image representing only a pixel area of the golf club.
- In one embodiment, the club face angle is calculated by measuring an angle between a shaft line of the golf club and a club face line of a head of the golf club using the processed image captured when the head is positioned just before the contact.
- In one embodiment, in the step of second producing the second motion analysis data of the swing, a type of the swing is determined as in-to-in, out-to-in, or in-to-out by measuring an angle between a path of the golf club and a target line using the processed image from before the contact to after the contact.
- In one embodiment, the steps of the first and the second analyzing and producing are performed through a controller, and the method further comprises controlling the controller by voice commands.
- In one embodiment, the light source emits light having a first wavelength range, and wherein each of the pair of stereo cameras and the single camera is equipped with a light filter only passing light within the first wavelength range.
- In one embodiment, the first wavelength range is within infrared light, and wherein the light filter is an infrared passing filter.
- Although the present invention is briefly summarized, the fuller understanding of the invention can be obtained by the following drawings, detailed description, and appended claims.
- These and other features, aspects and advantages of the present invention will become better understood with reference to the accompanying drawings, wherein:
-
FIGS. 1a and 1b show block diagrams of golf shot tracking andanalysis system -
FIGS. 2a to 2c show an imaging device ID and exemplary physical placements of the imaging device ID in the golf shot tracking andanalysis system 10 according to embodiments of the present invention. -
FIG. 3 shows a detailed structure of a light source LS in the golf shot tracking andanalysis system 10 according to one embodiment of the present invention. -
FIG. 4 shows a flow chart of a method M10 for tracking and analyzing a golf shot according to one embodiment of the present invention. -
FIG. 5 shows an actual trajectory of the golf shot and coordinate values of the golf shot determined from the golf shot tracking andanalysis system 10 according to one embodiment of the present invention. -
FIGS. 6a and 6b are drawings to explain a step to calculate the depth of the image subjects and produce a disparity map using a difference between the two images respectively captured from stereo cameras C1 and C2 according to one embodiment of the present invention.FIG. 6a shows images IMGl1 and IMGr1 when a golf ball B is located in a first position BP1.FIG. 6b shows images IMGl2 and IMGr2 when a golf ball B is located in a first position BP2. -
FIGS. 7a to 7d are disparity maps DM1 to DM4 of the golf shot. -
FIGS. 8a to 8c are drawings to explain a step to analyze a ball spinning using marks MD1 and ML1 on the golf ball B according to one embodiment of the present invention.FIG. 8a shows images I1 and magnified images MI1 of the golf ball B taken from a third camera C3.FIG. 8b shows magnified images MI1 in consecutive manner, representing position variations of the marks MD1 and ML1 on the golf ball B.FIG. 8c shows additional mark-up images MMI1 of the magnified images MI1 inFIG. 8b so that the marks MD1 and ML1 are clearly shown. -
FIGS. 9a and 9b are drawings to explain a step to analyze a swing inFIG. 10 and club face angle inFIG. 11 .FIG. 9a showsimages 12 of the golf shot taken from third camera C3.FIG. 9b shows processed images PI2 which subtracts the entire pixel area other than that of the golf club from theimages 12 inFIG. 9 a. -
FIG. 10 is a drawing to explain a step to analyze the swing using the processed images PI2 inFIG. 9 b. -
FIGS. 11a to 11c are a drawing to explain a step to analyze a club face angle using the processed images PI2 inFIG. 9 b. -
FIG. 12 shows a three dimension golf shot simulation in a golf course on ascreen 301 according to one embodiment of the present invention. -
FIG. 13 shows a live replay of a golf shot on adisplay 303 according to one embodiment of the present invention. -
FIG. 14 is a drawing to explain an operation of a voice recognition function of the golf tracking andanalysis system 10 according to one embodiment of the present invention. - Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings, which form a part of this disclosure. It is to be understood that this invention is not limited to the specific devices, methods, conditions or parameters described and/or shown herein, and that the terminology used herein is for the purpose of describing particular embodiments by way of example only and is not intended to be limiting of the claimed invention.
- Also, as used in the specification including the appended claims, the singular forms “a”, “an”, and “the” include the plural, and reference to a particular numerical value includes at least that particular value, unless the context clearly dictates otherwise. Ranges may be expressed herein as form “about” or “approximately” one particular value and/or to “about” or “approximately” another particular value. When such a range is expressed, another embodiment includes from the one particular value and/or to the other particular value. Similarly, when values are expressed as approximations, by use of the antecedent “about”, it will be understood that the particular value forms another embodiment.
-
FIGS. 1a and 1b show block diagrams of the golf shot tracking andanalysis systems FIGS. 2a to 2c show an imaging device ID and exemplary physical placements of the imaging device ID in the golf shot tracking andanalysis system 10 according to embodiments of the present invention.FIG. 3 shows the detailed structure of the light source LS in the golf shot tracking andanalysis system 10 according to one embodiment of the present invention. - According to
FIG. 1a , the golf shot tracking andanalysis system 10 may comprise an imaging device ID,input devices 100, acontroller 200,output devices 300, and amemory 400. - The imaging device ID comprises multiple cameras C1, C2, C3 and a light sources LS. The multiple cameras C1, C2, C3 may comprise a pair of stereo cameras C1, C2 and a single camera C3. Referring to
FIGS. 2a to 2c together, the pair of stereo cameras C1, C2 may be set far from each other in the imaging device ID to perform depth analysis and to produce disparity map and three dimension simulation using two images from the pair of stereo camera C1, C2. The specific steps to produce 3D simulation will be described later in more detail referring toFIGS. 5 to 7 d. The single camera C3 may be located in a place close to any one of the stereo cameras C1, C2 but is not limited to. - Referring to
FIG. 3 together, the light source LS has a form of a flat panel comprising a plurality of light emitting devices LED. A direction of the flat panel of the light source LS may be parallel to image planes of the cameras C1, C2, C3. The image planes of the cameras C1, C2, C3 will be explained later referring toFIGS. 6a and 6 b. - Specifically, the light sources LS may comprise multiple light panels L1, L2, L3, L4, L5. Each of the light panels L1, L2, L3, L4, L5 may comprise an array of multiple light emitting devices LED which emit infrared light LIR. As infrared light LIR from the light panels L1, L2, L3, L4, L5 are different wavelengths from that of noise light LN from other light sources, such as visible light, the cameras C1, C2, C3 equipped with an infrared pass filter CF can capture images without interference of the noise light LN. Accordingly, the captured images are not affected by noise light LN from random direction; therefore, the captured images can have clear and bright image quality and at the same time, can be analyzed more correctly.
- Also, the infrared light may help the camera C1, C2, C3 keep images having a great brightness and contrast in range while the cameras C1, C2, C3 have short exposure to reduce motion blur. As shown in
FIG. 3 , each of camera C1, C2, C3 may have the structure comprising an imaging sensor CS, an infrared pass filter CF, and at least one of lens CL. The imaging sensor CS may be infrared light sensor which can detect only infrared light; however, the present invention is not limited to it. - In another embodiment, the light sources LS emit light having a first wavelength range, and each of the camera C1, C2, C3 is equipped with a light filter only passing light within the first wavelength range.
- The pair of stereo cameras C1, C2 can be used to track the golf ball in three dimensions, and the single camera C3 to track a club head, a club shaft, a swing, a golf face angle, and ball spinning. Data from each of the pair of stereo camera C1, C2 and the single camera C3 are analyzed in views of different variables affecting the golf shot. Accordingly, a player can receive more accurate and detailed analysis report, have opportunities to correct errors properly, and sharpen their skills in the right ways. The operation of the stereo cameras C1, C2 will be described later in more detail referring to
FIGS. 5 to 7 d, and that of single camera C3 referring toFIGS. 2, and 8 a to 11. - The
input devices 100 may further comprise amicrophone 109 and akeyboard 111 other than the multiple cameras C1, C2, C3. Themicrophone 109 can be used to transmit voice commands to thesystem 10. Themicrophone 109 can be inbuilt inside the imaging device ID but is not limited to. Thekeyboard 111 can be used to transfer commands to thesystem 10. - The image data collected from the different cameras C1, C2, C3 are sent to the
controller 200. - The
controller 200 may be implemented by software and/or firmware executed by at least one of processor. The processor can be microcomputers, signal processors, integrated circuits, and other analog and/or digital circuits but not limited to. - Specifically, the
controller 200 comprises at least one of image analysis software including image processing function to provide analysis report regarding each of the golf ball and the club in view of various variables. For example, thecontroller 200 may comprise a ball trackinganalysis software 201, aswing analysis software 203, and a ball spinninganalysis software 207. - Also, the
controller 200 comprises asimulation software 209 to display the three dimension trajectory of the golf ball based on the data from the ball trackinganalysis software 201, theswing analysis software 203, and the ball spinninganalysis software 207. The operation of the live replay will be described later in more detail referring toFIG. 12 . Thecontroller 200 also includes alive replay software 209 to display the image sequence captured from the single camera C3. The operation of the live replay will be described later in more detail referring toFIG. 13 . - The
controller 200 also comprisevoice recognition software 211 to receive voice commands from the player. The operation of the voice recognition will be described later in more detail referring toFIG. 14 . - The
controller 200 may be connected to theoutput devices 300 such as ascreen 301, amonitor display 303, and anaudio system 305. Thescreen 301 can display a three dimension golf course, a trajectory of the golf ball on the golf course, an analyzed datils such as 3D positions, velocities, angles, directions of the golf ball in the trajectory. Themonitor display 303 may be used to monitor each element of thesystem 10. Also, thelive replay software 209 can show the live video through themonitor display 303. Theaudio system 305 can be used to transmit notification from thesystem 10. - The
memory 400 may comprise a program memory and an image story memory for use by thecontroller 200. The image story memory of thememory 400 may be a nonvolatile writable memory for storing images captured by the pair of stereo cameras C1, C2 and the single camera C3. - The imaging device ID, the
input devices 100, thecontroller 200, theoutput devices 300, and thememory 400 can be connected to each other through various means such as a USB cable, wireless Bluetooth, an electrical line, etc. - In embodiment of
FIG. 1a , the imaging device ID comprises only multiple cameras C1, C2, C3 and a light sources LS, but the present invention is not limited to. According to another embodiment of the present invention, referring toFIG. 1b , an imaging device ID2 of a golf shot tracking andanalysis system 20 may comprise themicrophone 109, thecontroller 200, theaudio system 305, and thememory 400 as well as the cameras C1, C2, C3 and the light sources LS. - Referring to
FIGS. 2a, 2b, 2c , the imaging device ID may be installed at least one place. In one embodiment ofFIG. 2a , the imaging device ID is placed at a top ceiling SC which faces a ball hitting mat BM and/or the floor SC in parallel. In another embodiment ofFIG. 2b , the imaging device ID is placed in front of the ball hitting mat BM on which a golf ball B is placed. In another embodiment ofFIG. 2c , each of two imaging devices ID is placed in front of the ball hitting mat BM and at the top ceiling SC, respectively. - The golf shot tracking and
analysis systems -
FIG. 4 shows a flow chart of a method M10 for tracking and analyzing the golf shot according to one embodiment of the present invention. The method M10 can be performed using thesystem - Referring to
FIG. 4 , a user powers on the golf shot tracking andanalysis 10 and turns on the light sources LS S101, S103. When the light sources LS are turned on, the cameras C1, C2, C3 are in a capturing mode. - The user places the golf ball B on the ball hitting mat BM and then hits the
golf ball B S 105.FIG. 5 shows an actual trajectory Tb of the golf ball B and coordinate values (X, Y, B) of the golf shot determined by the golf shot tracking andanalysis system 10 and method M10. - When a predetermined timing or event is occurred, the camera C1, C2, C3 begin capturing images of the golf shot S107.
- Specifically, both the first and the second stereo camera C1, C2 keep capturing images by single trigger; therefore, the pair of images from the first and the second stereo camera C1, C2 can be used to produce single stitched image or single three dimensional image in every frames. To achieve three dimension image and/or simulation, the golf shot tracking and
analysis systems 10 needs to perform depth analysis and produce disparity map. For this step, the images captured from the camera C1, C2 are sent to thecontroller 200. -
FIGS. 6a and 6b are drawings to explain a step to calculate the depth of the subjects and produce the disparity map using a difference between the two images respectively captured from the first and second stereo camera C1 and C2. Captured images the first and second stereo camera C1 and C2 are sent to thecontroller 200, and the analysis of the depth, the disparity map, and the three dimension simulation can be performed in the ball trackinganalysis software 201 of thesystem 10. -
FIG. 6a shows images IMGl1 and IMGr1 captured from the first and the second stereo camera C1, C2, respectively when a golf ball B is located in a first position BP1. Likewise,FIG. 6b shows images IMGl2 and IMGr2 captured from the first and the second stereo camera C1, C2, respectively when a golf ball B is located in a first position BP2. - Referring to
FIGS. 5 and 6 a, the first stereo camera C1 is placed in left side while the second stereo camera C2 is placed in right side. An optical center CO1 of the first stereo camera C1 and the optical center CO2 of the second stereo camera C2 are a certain distance Dcc away from each other. Optical axes of the first the second stereo camera C1 and C2 are parallel; accordingly, the first image plane Pl from the first stereo camera C1 and the second image plane Pr are also parallel. In addition, as each of the first and the second stereo camera C1, C2 has the same focal length F, each of the first and the second image plane Pl and Pr is placed at the same distance from each camera C1, C2. - When the golf ball B is positioned at a first position BP1 (Xb1,Yb1,Zb1), each of the first and the second stereo camera C1, C2 captures the same scene, and the first stereo camera C1 produces a first image IMGl1 while the second stereo camera C2 produces a second image IMGr1. Due to different position of the camera C1, C2, a golf ball position IPl1 (Xl1,Yl1) in the first image IMGl1 is different from a golf ball position IPr1 (Xr1,Yr1) in the second image IMGr1. A position difference of the golf ball B shown in the first and the second image IMGl1, IMGr1 is a disparity Xl1−Xr1.
- Accordingly, a depth D1, or distance, from the first and the second stereo camera C1, C2 can be calculated as following equation:
-
- Likewise, referring to
FIG. 6b together, when the golf ball B is positioned at a second position BP2 (Xb2,Yb2,Zb2) according to progress of the golf ball B. The first stereo camera C1 produces a first image IMGl2 while the second stereo camera C2 produces a second image IMGr2. Due to different position of the camera C1, C2, a golf ball position IPl2 (Xl2,Yl2) in the first image IMGl2 is different from a golf ball position IPr2 (Xr2,Yr2) in the second image IMGr2. A position difference of the golf ball B shown in the first and the second image IMGl2, IMGr2 is a disparity Xl2−Xr2. - Accordingly, a depth D2, or distance, from the first and the second stereo camera C1, C2 can be calculated as following equation:
-
- As the golf ball B progresses and becomes closer to the camera C1, C2, the disparity in two images from the stereo camera C1, C2 becomes larger, and the depth D1, D2 from the camera C1, C2 becomes shorter.
- In this way, the ball tracking
analysis software 201 can obtain depth of each frame from the first and the second stereo camera C1, C2. the ball trackinganalysis software 201 also can produce disparity maps with these depth data of the frame asFIGS. 7a to 7 d. -
FIGS. 7a to 7d are disparity maps DM1 to DM4 of the golf shot inFIG. 5 according to progress of the golf ball B. Disparity map represents a depth of the scene. - Referring to
FIG. 5 together,FIG. 7a is a disparity map when the golf ball is the first position BP1 (Xb1,Yb1,Zb1).FIG. 7b is a disparity map when the golf ball is the second position BP1 (Xb1,Yb1,Zb1).FIG. 7c is a disparity map when the golf ball is the third position BP1 (Xb3,Yb3,Zb3).FIG. 7d is a disparity map when the golf ball is the fourth position BP4 (Xb4,Yb4,Zb4). - The larger disparity images have the brighter color. In
FIG. 7a , the club CB is farther from the camera C1, C2 than the golf ball B; therefore, the club CB is shown in dark gray color while the golf ball B is shown in bright gray color. Likewise, as the background is farther from the camera C1, C2 than the club CB; therefore, the background is shown in almost black color. - Referring to
FIGS. 7a to 7d together in consecutive order, as the golf ball B progresses and the depth becomes short, the pixel areas of the golf ball B become brighter. Based on these depth data, plane positions data, and frame time, BallTracking Analysis Software 201 can obtain three dimensional position, three dimensional velocity, and vertical and horizontal angle. - The data such as disparity maps and 3D position and speed are sent to the simulation software S111. The data also can be stored in the
memory 400. - While the first and the second stereo camera C1, C2 begin operating S107, the third camera C3 also begins capturing images of the golf shot S113. In another embodiment, the first and the second stereo camera C1, C2 may trigger the third camera C3.
- The images from the third camera C3 can be analyzed and produce ball spinning, club face angle, and club swing data S115.
-
FIGS. 8a to 8c are drawings to explain a step to analyze a ball spinning using the marks on the golf ball B according to one embodiment of the present invention. - For analyzing the ball spinning, the golf ball B used in this
system 10 and the method M10 may comprise at least one of mark on an outer surface of the golf ball B. The mark is shown differently in one side of the golf ball B from the other side from any angle. Thus, at least one of arrangement, shape, and color of the mark are shown differently between one side and the other side. For example, referring toFIGS. 8a to 8c , the golf ball B may comprise at least one of dot type mark MD1 and at least one of line type mark ML1 which have a different arrangement from any angle. -
FIG. 8a shows images I1 and magnified images MI1 of a pixel area of the golf ball B taken from the third camera C3. Referring toFIG. 8a , positions of the marks MD1 and ML1 are changed in every frame as the golf ball B progresses. -
FIG. 8b shows magnified images MI1 in consecutive manner, representing position variations of the marks MD1 and ML1 on the golf ball B. Referring toFIG. 8b , the ball spinninganalysis software 207 can calculate a spin direction, a spin speed, and other physical parameters based on the variations of the marks MD1 and ML1. -
FIG. 8c shows additional mark-up images MMI1 of the magnified images MI1 inFIG. 8b so that the marks MD1 and ML1 are clearly shown. Referring toFIG. 8c , the ball spinninganalysis software 207 can have a mark-up function which can add and/or modify the mark MD1 and ML1 in magnified images MT1 to be clearer. As the mark MD2 and ML2 in the additional mark-up images MMI1 can be easily detected, the ball spinning analysis may be performed accurately. -
FIGS. 9a and 9b are drawings to explain a step to analyze swing inFIG. 10 and club face angle inFIG. 11 .FIG. 9a shows images I2 of the golf shot taken from third camera C3 from before to after contact between a golf club CB and a golf ball B. FIG. 9 b shows processed images PI2 which subtracts the entire pixel area other than that of the golf club from the images I2 inFIG. 9a . Thus, the processed images PI2 is an image extracting a pixel area of the golf club from the images I2 inFIG. 9 a. -
FIG. 10 is a drawing to explain a step to analyze swing using the processed images PI2 inFIG. 9b . This step may be performed in theswing analysis software 203. - Referring to
FIG. 10 , a final image representing the club path CP may be produced by overlapping the processed images PI2. The club path CP may be obtained based on a path of the center of the club head. The target line TL is an imaginary line to reach a target hole in the golf course. - An angle between the club path CP and the target line TL can be calculated from before contact to after the contact. Each angle data can be used to determine if the swing is in-to-in, out-to-in, or in-to-out.
-
FIGS. 11a to 11c are drawings to explain a step to analyze a club face angle using the processed images PI2 inFIG. 9b . This step may be performed in theswing analysis software 203. The club face angle is referred to as an angle at contact between the golf club and the golf ball. This parameter affects a ball flight. - Referring to
FIGS. 11a to 11c , an image when the club head is positioned just before the contact, is used to analyze the club face angle. The club face angle is an angle between a shaft line SL of the golf club and a club face line CF1, CF2, CF3. The club face line CF1, CF2, CF3 is referred to a face line of a head of the golf club. - Referring to
FIG. 11a , the shaft line SL and the club face line CF1 is parallel; accordingly, the club face angle is square. Referring toFIG. 11b , a club face angle θ1 between the shaft line SL and the club face line CF1 is certain degree in an open form. Referring toFIG. 11c , a club face angle θ2 between the shaft line SL and the club face line CF1 is certain degree in a closed form. - The data such as image sequences, ball spinning, club face angle, swing can be sent to the simulation software and/or the live replay software S111. The data also can be stored in the
memory 400. - After the image capturing steps S107, S113, the image analyzing steps S109, S115, and the data send steps S111, S117, the user can check his or her golf shot through a 3D simulation, a live replay, a swing analysis, and a shot analysis S119, S121, S123, S125.
-
FIG. 12 shows a three dimension golf shot simulation in a golf course on ascreen 301 according to one embodiment of the present invention. This step may be performed in thesimulation software 207. Thescreen 301 displays the 3D simulation of the golf ball trajectory Tb based on the data obtained from the analysis such as three dimension position and velocity, and horizontal and vertical angle of the golf ball B. -
FIG. 13 shows a live replay of a golf shot on thescreen 301 or themonitor display 303 according to one embodiment of the present invention. This step may be performed in thelive replay software 209. All images captured from the third camera C3 may be displayed as a form of a slow motion video. Therefore, the user can check a relation between the golf ball and the club on each frame, before contact, during the contact, and after contact. The live replay can help the user see the visual data in a real picture form and help to improve his or her skills. After checking the golf shot, the user can try a new golf shot and repeat practice or start a new game S127. -
FIG. 14 is a drawing to explain an operation of a voice recognition function of the golf tracking andanalysis system 10 according to one embodiment of the present invention. This step may be performed in thevoice recognition software 211. - Referring to
FIG. 14 , the golf shot tracking andanalysis system 10 may provide hands-free command function. When thesystem 10 receives a voice command VC from the user, thesystem 10 is recognized the voice command VC through themicrophone 109 and thevoice recognition software 211. In one embodiment, themicrophone 109 may be inbuilt inside an imaging device ID2 but is not limited to. - The
controller 200 may answer in forms of audio, video, graphics, or a combination of them through theoutput devices 300 such as thescreen 301, themonitor display 303, and theaudio system 305. According to the voice command VC, thesystem 10 may answer by changing a course or a player, displaying 3D simulation or live replay video, showing/telling analysis, score details, or current hole details. - While the invention has been shown and described with reference to different embodiments thereof, it will be appreciated by those skilled in the art that variations in form, detail, compositions and operation may be made without departing from the spirit and scope of the invention as defined by the accompanying claims.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/012,479 US11583728B2 (en) | 2020-09-04 | 2020-09-04 | System and method for tracking and analyzing golf shot |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/012,479 US11583728B2 (en) | 2020-09-04 | 2020-09-04 | System and method for tracking and analyzing golf shot |
Publications (2)
Publication Number | Publication Date |
---|---|
US20220072370A1 true US20220072370A1 (en) | 2022-03-10 |
US11583728B2 US11583728B2 (en) | 2023-02-21 |
Family
ID=80470470
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/012,479 Active 2040-09-25 US11583728B2 (en) | 2020-09-04 | 2020-09-04 | System and method for tracking and analyzing golf shot |
Country Status (1)
Country | Link |
---|---|
US (1) | US11583728B2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220111247A1 (en) * | 2020-10-08 | 2022-04-14 | Adam Wilson | Treadmill speed control |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU2123297A (en) * | 1996-02-12 | 1997-08-28 | Golf Age Technologies | Golf driving range distancing apparatus and methods |
US6093923A (en) * | 1996-09-11 | 2000-07-25 | Golf Age Technologies, Inc. | Golf driving range distancing apparatus and methods |
US20050012023A1 (en) * | 1996-02-12 | 2005-01-20 | Vock Curtis A. | Ball tracking in three-dimensions |
US9940508B2 (en) * | 2010-08-26 | 2018-04-10 | Blast Motion Inc. | Event detection, confirmation and publication system that integrates sensor data and social media |
-
2020
- 2020-09-04 US US17/012,479 patent/US11583728B2/en active Active
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220111247A1 (en) * | 2020-10-08 | 2022-04-14 | Adam Wilson | Treadmill speed control |
US11691047B2 (en) * | 2020-10-08 | 2023-07-04 | Adam Wilson | Treadmill speed control |
Also Published As
Publication number | Publication date |
---|---|
US11583728B2 (en) | 2023-02-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6983172B2 (en) | Methods and equipment for performing motion analysis of sports equipment | |
CN108697922B (en) | Sensing device and sensing method for baseball practice device, baseball practice device using the same, and control method thereof | |
US20190176020A1 (en) | Ball-striking assist method, ball-striking assist system, and portable electronic device | |
US6890262B2 (en) | Video game apparatus, method and recording medium storing program for controlling viewpoint movement of simulated camera in video game | |
JP5626939B2 (en) | Sensing processing device for moving ball, sensing processing method, and virtual golf simulation device using the same | |
KR20090021407A (en) | Apparatus for measuring motion of golf ball and control method thereof | |
JP6898415B2 (en) | Methods, systems and computer programs for measuring ball rotation | |
US20230285832A1 (en) | Automatic ball machine apparatus utilizing player identification and player tracking | |
US11583728B2 (en) | System and method for tracking and analyzing golf shot | |
JP5572853B2 (en) | Sensing device for moving object, sensing processing method, and virtual golf simulation device using the same | |
KR20170092929A (en) | Apparatus for base-ball practice, sensing device and sensing method used to the same and control method for the same | |
KR20210033290A (en) | Swing posture training method using golf simulation device | |
KR101019829B1 (en) | Sensing processing device and method for moving object, and virtual golf simulation device using the same | |
CN111228771B (en) | Golf entertainment system and golf training method | |
WO2023218692A1 (en) | Display control device, method, and program | |
JP2023171316A (en) | Method for grasping golf ball striking result using artificial intelligence and virtual golf device using the same | |
KR20050035563A (en) | Billiards teaching system and method using image processing | |
KR102517067B1 (en) | Ceiling golf simulation system using two cameras | |
KR102434326B1 (en) | Online-system for tennis virtual training with real-time video comparison of body motion | |
KR101078954B1 (en) | Apparatus for virtual golf simulation, and sensing device and method used to the same | |
KR20220036391A (en) | Golf Lesson System using Smart Mirror | |
KR102439549B1 (en) | Device for sensing golf swing and method for sensing impact position on club head using the same | |
KR102567201B1 (en) | A console-type golf simulation system using two cameras | |
JP7248353B1 (en) | Hitting analysis system and hitting analysis method | |
KR102567199B1 (en) | golf simulation system using 3D information |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: MICROENTITY |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: MICROENTITY |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO MICRO (ORIGINAL EVENT CODE: MICR); ENTITY STATUS OF PATENT OWNER: MICROENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |