AU2015203745B2

AU2015203745B2 - Imaging system

Info

Publication number: AU2015203745B2
Application number: AU2015203745A
Authority: AU
Inventors: Peter Kenneth Thomson
Original assignee: Yepp Australia Pty Ltd
Current assignee: Yepp Australia Pty Ltd
Priority date: 2008-10-02
Filing date: 2015-07-03
Publication date: 2017-03-30
Anticipated expiration: 2029-10-02
Also published as: AU2015203745A1

Description

1 2015203745 02 Mar 2017

IMAGING SYSTEMS

Field of the Invention

The invention relates to imaging systems and devices for 5 capturing images.

Background

An effective rowing stroke is a combination of athleticism, skill and technique. Developing technique 10 takes time and practice. One recognised problem in developing a better technique is the inability of a rower to remotely view their own stroke and identify and observe any inadequacies. This same issue exists for a rowing coach when communicating to the crew subtle observations 15 and the modifications that are required.

The present invention seeks to at least partly mitigate this problem. The systems and devices of this invention may also be useful in other sports and areas, such as 20 forensics.

Summary of the Invention

According to one aspect of the present invention there is provided an imaging device for capturing images of a 25 rower's stroke while rowing in a rowing apparatus, the device comprising: amount to fix the imaging device to be stationary on the rowing apparatus and to align the imaging device at the same angle each time the imaging device is mounted to 30 the rowing apparatus, wherein the imaging device is fixed substantially at or above a pivot point of the rower's oar, and does not move relative to the rowing apparatus during the rower's stroke; waterproof body wherein the array includes first and 35 second lenses having substantially parallel axes, the first and second lenses facing in opposing directions whereby the field of view of the first lens in the array 8791455_1 (GHMatters) P78743.AU.2 2/03/17 2 2015203745 02 Mar 2017 does not overlap with the field of view of the second lens, wherein each one of the first and second lenses is associated with an image sensor and the image sensors associated with the first and second lenses are coupled to 5 an image processor, such that the imaging device can simultaneously capture an image of the rower via the first lens and an opposing image of the rower's oar tip via the second lens when the imaging device is mounted to the rowing apparatus and the rower is rowing in the rowing 10 apparatus; and means for determining, receiving and storing accurate time data for each one of the image of the rower and the opposing image of the rower's oar tip by using either: (a) a GPS satellite; or 15 (b) a wireless transmission of time data from a single clock; such that each one of the image of the rower and the opposing image of the rower's oar tip is time stamped with accurate time data, and the accurate time data can be used 20 as the basis for synchronisation of the image of the rower and the opposing image of the rower's oar.

According to another aspect of the present invention there is provided a system for capturing images of a rower's 25 stroke including an imaging device as described above, wherein the imaging device is fixed at a position simulating the location of the pivot point of a rower's oar for recording side elevational view images of the rower and the rower's oar. 30

Brief Description of the Drawings

In order that the invention may be more easily understood, embodiments will now be described, by way of example only, with reference to the accompanying drawings, in which: 35

Figure 1: is a side view of a camera in a first embodiment of the invention, 8791455_1 (GHMatters) P78743.AU.2 2/03/17 2015203745 02 Mar 2017 3

Figure 2: is a perspective view of an inner face of the camera, 5 Figure 3: is a front view of an outer face of the camera,

Figure 4: 10 Figure 5: is a general layout of a system for rowing training including the camera, is a front view of the camera fitted to a mount,

Figure 6: 15 is a perspective view of the mount for the camera,

Figure 7: 20 Figure 8 : is a perspective view of a camera in accordance with a second embodiment of the invention, is a general layout of cameras in the second embodiment of the invention, 25 Figure 9: is a perspective view of part of a rowing boat unoccupied illustrating the mounting of a camera,

Figure 10: is a perspective view of part of a rowing 30 boat showing the relationship of a rower with cameras mounted on either side of the rower,

Figures 11a, b, c: show side views of the stroke of a 35 rower, 8791455J (GHMatters) P78743.AU.2 2/03/17 4 2015203745 02 Mar 2017

Figures lid, e, f: show plan views of the stroke of the rower,

Figures 12a, b, c: show the stroke of the rower as viewed from a camera mounted on the centre line of the boat; and

Figure 13: shows a camera mounted on the centre line of the stern of the boat. 10

Description of the Embodiments A first embodiment of the invention is shown in Figures 1 to 6. In this embodiment, an imaging device (a camera 2) is specifically adapted for use in coaching sports, particularly rowing.

The camera has two lenses 8, 10 mounted to a single body 22. The two lenses 8, 10 face in opposing directions. Each lens has an axis passing transversely through its 20 centre. The axes of the two lenses are parallel. The device is adapted to simultaneously capture images from both lenses.

In this embodiment both lens are housed in a single 25 device. However, it is understood that each lens could be housed in a separate device. For example, two devices could be mounted back to back with one lens in each device. Such a combination of devices is referred to as a "system" which is adapted to simultaneously capture images 30 from both the first and second lenses even though they are in different devices.

Figure 1 shows the camera 2 having two lenses which face in opposite directions, fixed to a single camera body 22. 35 One lens is, relative to the boat, an outward facing lens 10 and the other an inward facing lens 8. The camera 2 is able to record and synchronise images from both lenses at 8791455_1 (GHMatters) P78743.AU.2 2/03/17 5 2015203745 02 Mar 2017 the same time. The camera 2 can simultaneously record still or video images in two different directions from the same perspective. 5 Each lens focuses on an image sensor located inside the camera body 22. The inward facing lens 8 is mounted slightly higher in the body 22 than the outer lens 10.

The axes of the two lenses are offset to allow a more compact camera body, and to match the perspective of each 10 image. If they were back to back the body 22 would potentially need to be wider. The two image sensors are coupled to an image processor which receives data from the image sensors and can encode it for storage. The camera incorporates a digital memory for storing the image and 15 video data. A battery mounted inside the body 22 powers the camera, the battery can be recharged using electrical connectors located on the bottom of the camera.

The processor and image sensors are capable of recording 20 video at frame rates in excess of 100 frames/sec from both viewpoints. A wired, or wireless, interface allows data stored in the memory to be transferred to another device, such as a computer, for playback, analysis, or permanent storage . 25

Figure 2 shows an inner face 11 of the camera 2. The inward facing lens 8 is located on this face. The inner face 11 also includes a display screen 12, which provides the user with a Graphical User Interface (GUI) to the 30 device. The GUI includes a menu structure that allows options, including deleting and transmitting data from the memory of the camera, as well as starting and stopping recording. 35 On the outer face 15, shown in Figure 3, the camera has a round 'touch' interface 14. The interface can be used to operate the GUI on the display screen 12. Sensors behind 8791455_1 (GHMatters) P78743.AU.2 2/03/17 6 2015203745 02 Mar 2017 the surface of the interface 14 detect the presence of a user's finger on the surface of the interface. The user can move their finger in a rotational pattern around the interface 14 to scroll through and select various options 5 on the GUI.

The camera 2 has a sealed, waterproof body 22 to facilitate operation in exposed and wet environments. 10 One application of this embodiment is as part of a coaching system which is illustrated in Figure 4; this application may require the use of several cameras 2. Figure 9 shows an unoccupied boat 6 with cameras 2 mounted on oars 5 extending from both sides of the boat. Figure 15 10 illustrates a boat with a rower and a pair of cameras 2 mounted outboard of each side of the boat with lens facing towards the rower. Both cameras 2 are mounted on the oar rigger 4 to be fixed relative to the boat. 20 The system is used for capturing images of a rower's stroke while in a rowing boat 6, rowing simulator, rowing device or an exercise machine. The cameras 2 are fixed relative to the rowing apparatus. In the case where the device is mounted on a rowing boat 6, each camera 2 is 25 fixed at the pivot point of each rower's oar 5 for recording a side elevation view of a stroke of the rower and the rower's oar simultaneously.

To obtain the side elevation view of the stroke of the 30 rower and the rower's oar 5, each camera 2 is mounted on the oar's rigger 4 of the rowing boat 6. The cameras are mounted near to the fulcrum of the oar 5. When mounted, the inward facing lens 8 of the camera faces into the boat and can be used to record the rower's rowing action from a 35 side elevation view. The outward facing lens 10 faces toward the oar's movement arc 7, and can be used to record the action of the oar. The cameras 2 are fixed relative 8791455U (GHMatters) P78743.AU.2 2/03/17 7 2015203745 02 Mar 2017 to the boat 6 and they do not rotate as the oar moves through its arc and the rower's body rocks back and forth during the stroke. 5 By recording both the action of the rower and the oar the camera 2 provides an improved visual record of the stroke that could not be achieved with a single lens camera.

Figures 11a, b, c, d, e and f illustrate the stroke of a 10 rower viewed from the side and from above. It should be noted that the camera 2 does not move relative to the boat during the rower's stroke.

From the coach and rower's perspective this record of the 15 stroke plays an important training role. The recording provides an important view of the rowing action which can be used as a basis for further training and improvement.

From the coach's perspective, the camera 2 plays an 20 important role. It can be difficult to describe in words what problems exist in a rower's stroke. The recording provides a basis to clearly identify problems and suggest solutions. Being able to record both the action of the rower and the oar tip in synchronisation is significantly 25 advantageous to the coach. For example, if the tip is clearly leaving the water too late (shown in the recording from the outward facing lens 10) the coach can point specifically to which part of the rower's action (recorded by the inward facing lens 8) is causing this problem. 30

Figure 5 shows the camera 2 fitted onto a mount 16 which can be bolted to the rigger 4 of the boat 6. Figure 5 shows a perspective view of the mount. The camera locks onto magnets 18 in the mount. Alignment with the mount is 35 achieved by way of a spigot 20 in the mount. The magnets 18, allow the camera to be easily removed from the mount for the purposes of downloading the recorded data, 8791455_1 (GHMatters) P78743.AU.2 2/03/17 8 2015203745 02 Mar 2017 recharging a battery in the camera, and for storage and security.

The mount can be bolted to the rigger 4 using a bolt 5 assembly 24. As the mount is permanently fixed to the rigger 4 the camera will align to the same angle each time it is fitted to the mount 16. Thus, the lens of the camera 2 will capture the same perspective, from the same direction each time the camera is fitted to the mount 16. 10 This will ensure the camera 2 always captures a full view of the rower and oar tip without any adjustment each time it is fitted to the boat 6, and that all future images will be able to be overlayed on previous images for direct comparison . 15

As shown in Figure 4, a set of cameras 2 can be mounted on the same boat 6 to record several rowers. The images recorded by each lens are accurately synchronised and time stamped when recorded. The time data used to stamp the 20 image data could be determined in number of ways: • Each camera could include its own clock. • Each camera could include a GPS module and an antenna, and receive accurate time data from a GPS satellite 25 · A single clock could transmit accurate time data either wirelessly or over a network of wires to each camera on the boat.

Single or dual lens cameras 2 can be positioned on the 30 centre line of the boat as shown in Figure 13. It is understood that cameras 2 can be placed on the deck of the vessel between rowers to produce the images of the rower's stroke shown in Figures 12a, b and c. 35 The cameras 2 are adapted to transmit recorded data wirelessly to a computer 32. The data is recorded on the computer for later playback on a monitor 36. Thus, once a 8791455_1 (GHMatters) P78743.AU.2 2/03/17 9 2015203745 02 Mar 2017 training session is complete, playback can be activated without having to remove the cameras 2 from the boat 6 or physically wiring them to the computer 32. 5 Coordination of the stroke's segment timing and length between different crew members is critical to developing a balanced boat and a successful rowing crew. However, it can be difficult for each crew member to determine if he/she is "in time", particularly while he/she 10 simultaneously concentrates on his/her own rowing stroke.

The various time-stamped recordings can be played back simultaneously to give rowers an accurate perception of their own timing relative to the rest of the crew. For 15 example, the image of each rower's oar tip captured by the outward facing lens 10 could be played back in various viewing panes on the monitor 36 to demonstrate any timing issues . 20 Alternatively, the various images could be superimposed on each other 36 to more fully demonstrate timing problems. The recordings from the inward facing lens 8 (the recording of the rower's action) can also be superimposed or compared in separate frames on the monitor 36. When 25 superimposing the images the oars or rowers could be shaded in different colours to demarcate each rower in the team. Thus, any rowers who were not in sync with the rest of the team can be easily identified. 30 The high frame capture rate allows the coach or rower to play back the recording at slow speeds and accurately determine the timing of each part of the rowing action.

The cameras are mounted so as to capture the full range of 35 the rowing stroke, from the 'catch' position shown in Figures 11a and lid to the 'finish' position shown in Figures 11c and Ilf. Figures 12a, b and c show three 8791455_1 (GHMatters) P78743.AU.2 2/03/17 10 2015203745 02 Mar 2017 still frames from the video as it appears in a piece of software which forms part of the training system, along with the cameras . 5 The software allows a user to mark on screen the various 'points' of the stroke at various times. For example, the user could mark the point at which the oar enters the water at the start of the drive. The user could then mark the point at which the oar leaves the water at the finish 10 of the drive. By marking these two points at least two calculations can be made: • The 'drive' time, by establishing the time elapsed between the frames. • The 'drive' angle; that is the angle swept by the oar 15 during the drive.

It is understood that, by marking various points on the video frames, a wide variety of data could be established, for example, to determine if a rower is improving or if 20 rowers are in time with one another. The following could be calculated: • the swept angle 'lost' at each end of the stroke; • the travel of the seat during each stroke; • the angle formed between the rowers upper and lower 25 leg at the catch position.

It is understood that the above measurements and many others could assist a coach in selecting and training rowers. They would also be useful to the rower in 30 monitoring and understanding his/her own stroke. The camera is fixed relative to the boat such that calculations can be easily performed by marking points on the frames of the video. 35 The software may include the capability to automatically recognise and measure the various parts of the stroke without the user having to mark the various points. 8791455J (GHMatters) P78743.AU.2 2/03/17 11 2015203745 02 Mar 2017

The rower may wear highlighted tabs on their clothing. These tabs could be reflective, or simply be coloured to contrast with the rower's clothing. Such tabs will assist 5 the user to mark the required points on the frames so as to assess the stroke. The tabs could also assist the software in recognising and automatically marking these same points on the stroke. 10 This embodiment includes a recording device (not shown) located within the boat. This device includes a multi axis gyroscope and an 3D accelerometer. The gyroscope measures the roll, pitch and yaw of the boat about its primary longitudinal axis. The accelerometer measures the 15 boat acceleration.

This embodiment also includes a remote control 34, which can be used by the coach. The control 34 can be used to start and stop recording by the various cameras 2, and to 20 re-configure the cameras parameters. The remote control allows the coach to capture particular strokes or parts of session they feel need review during the debriefing session. The camera devices contain a circular memory which provides the user with the ability to post-trigger 25 the capture point of a particular event after it has occurred.

The cameras 2 can also be used in conjunction with a load or strain gauge 38 which is also mounted to the rigger 4. 30 The gauge measures the amount of force applied by the oar 7 to the rigger 4. The gauge 38 thus monitors each stroke's force profile. The gauge 38 is in wired or wireless communication with the camera 2. The data from the gauge 38 is transferred to the camera where it is 35 stored in the memory alongside each image frame of the rowing strokes. Thus, during playback and debriefing the coach and rower have access to this data as well as the 8791455_1 (GHMatters) P78743.AU.2 2/03/17 12 2015203745 02 Mar 2017 images. This data can be displayed visually on the monitor 36 alongside the stroke recording to assist in critiquing and providing the rower with feedback on their technique. For example, the force measured on the strain 5 gauge 38 can be shown on a graph alongside the video of the rower or the oar.

As discussed above, the system could include two separate imaging devices mounted back to back, one monitoring the 10 oar, the other the rower. However, it is expedient that a single device can record images in both directions.

The same cameras 2 can also be fixed to rowing training machine, or other rowing apparatus, to record the stroke 15 of a rower during training. Where the machine is a flywheel type machine, there is no oar, and a single lens could be used to record only the rower. A second embodiment of the invention is shown in Figures 7 20 and 8. In this embodiment, a hexagonal camera 50 is specifically adapted for use in forensic applications.

The camera can be used to capture a still or video record of a crime scene. 25 The hexagonal camera 50 has a total of seven lenses each capable of recording images at different angles from substantially the same perspective. Six side lenses 52 are located on the side walls 54 of the camera. A top lens 56 faces upwards. 30

The side lenses 52 are made up of three pairs of opposing lenses, which not only have parallel axes, but by virtue of the fact that they are directly opposite each other, share the same axis. 35 A problem which can arise in photographing a crime scene is that the photographer will subjectively capture images 8791455_1 (GHMatters) P78743.AU.2 2/03/17 13 2015203745 02 Mar 2017 they perceive to be important at the time. However, as the investigation proceeds a record of any number of other perspectives or angles of the scene may become vital to determining what happened at the scene. 5

This embodiment provides means for simultaneously recording an array of different perspectives and angles quickly and without the subjective bias of a photographer. The hexagonal camera 50 (an imaging device) can be set up 10 to gather a breadth of visual data before evidence begins to degrade.

As in the first embodiment the camera comprises a image sensor located behind each lens, as well as a processor 15 and digital memory. Images can be recorded simultaneously from all image sensors. Each image is recorded with two pieces of data, the time it was taken and the location from which it was taken. 20 Figure 8 shows one application of this hexagonal camera 50. In this application the hexagonal camera 50 is used in combination with six dual lens cameras 60 which are also used to record images at a crime scene. The dual lens cameras 60 have an inward facing lens 62 and an 25 outward facing lens 64. Each camera is mounted on a telescopic stand 66 to enable, if desired, matching of their image planes.

The hexagonal camera 50 is placed in a central location at 30 the scene and uses various lenses to record in multiple different directions (including upwards) at one time. The dual lens cameras 60 are placed in a ring around the camera 50. The inward facing lenses 62 of each dual lens camera 60 are directed toward the hexagonal camera 50. 35 The outward facing lens 64 record images radially outward from the circle. 8791455_1 (GHMatters) P78743.AU.2 2/03/17 14 2015203745 02 Mar 2017

This embodiment provides an extensive visual record of a crime scene. Importantly, images are taken without a subjective bias. No particular perspective or angle is given precedence over another. If desired, the various 5 images can be used to reconstruct a multi-dimensional model of the scene during the investigation that follows.

Importantly, the recordings are time stamped. Thus, the investigator can easily ascertain what was occurring in 10 two or more parts of the crime scene at the same time.

The hexagonal camera 50 can also be used in a dynamic rather than static fashion. For example, a user can hold the hexagonal camera 50 in their hand and walk in a 15 circle, circumnavigating the scene. The multiple lenses 52 and 56 can thus capture images both toward the centre of the circle and also outwards from the circle. Such extensive visual information provides a useful record of the scene. 20

The images captured by this camera provide a rich pool of data from the array of lenses. The value of this data is increased by having a fixed relationship between the opposing lens pairs. One can view an image from a first 25 lens in a pair and compare or contrast it with an image taken in an opposite direction at the same time, and from the same perspective.

Throughout this specification, except where the context 30 requires otherwise due to express language or necessary implication, the word "comprise" or variations such as "comprises" or "comprising" is used in an inclusive sense, i.e. to specify the presence of the stated features but not to preclude the presence or addition of further 35 features in various embodiments of the invention. 8791455_1 (GHMatters) P78743.AU.2 2/03/17 2015203745 02 Mar 2017 5

It will be invention departing 15 understood to persons skilled in the art of the that many modifications may be made without from the spirit and scope of the invention. 8791455_1 (GHMatters) P78743.AU.2 2/03/17

Claims

CLAIMS :

1. An imaging device for capturing images of a rower's stroke while rowing in a rowing apparatus, the device comprising: amount to fix the imaging device to be stationary on the rowing apparatus and to align the imaging device at the same angle each time the imaging device is mounted to the rowing apparatus, wherein the imaging device is fixed substantially at or above a pivot point of the rower's oar, and does not move relative to the rowing apparatus during the rower's stroke; waterproof body wherein the array includes first and second lenses having substantially parallel axes, the first and second lenses facing in opposing directions whereby the field of view of the first lens in the array does not overlap with the field of view of the second lens, wherein each one of the first and second lenses is associated with an image sensor and the image sensors associated with the first and second lenses are coupled to an image processor, such that the imaging device can simultaneously capture an image of the rower via the first lens and an opposing image of the rower's oar tip via the second lens when the imaging device is mounted to the rowing apparatus and the rower is rowing in the rowing apparatus; and means for determining, receiving and storing accurate time data for each one of the image of the rower and the opposing image of the rower's oar tip by using either: (a) a GPS satellite; or (b) a wireless transmission of time data from a single clock; such that each one of the image of the rower and the opposing image of the rower's oar tip is time stamped with accurate time data, and the accurate time data can be used as the basis for synchronisation of the image of the rower and the opposing image of the rower's oar.
2. An imaging device according to claim 1, wherein the first and second lenses share the same axis.
3. An imaging device according to claim 1 or 2, wherein the single body supports a third lens and a fourth lens, the third and fourth lenses face in opposing directions; the axes of the third and fourth lenses are substantially parallel; and the imaging device is adapted to simultaneously capture and record images from all four lenses.
4. An imaging device according to claim 3, wherein the field of view of the third lens in the array does not overlap with the field of view of the fourth lens in the array .
5. An imaging device according to any one of claims 1 to 4, wherein the device includes a display screen and/or a graphical user interface.
6. An imaging device according to claim 5, wherein the device includes a touch interface.
7. An imaging device according to any one of claims 1 to 6, wherein the device can simultaneously record images in two different directions.
8. An imaging device according to claim 1, wherein the image processor and imaging sensor are capable of recording images at frame rates exceeding 100 frames/sec.
9. A system for capturing images of a rower's stroke while rowing in a rowing apparatus, comprising an imaging device in accordance with any one of claims 1 to 8, wherein the imaging device is fixed at a position simulating the location of the pivot point of a rower's oar for recording side elevational view images of the rower and the rower's oar.
10. A system for capturing images of a rower's stroke in accordance with claim 9, wherein at least one other imaging device is positioned on the rowing apparatus and is synchronised with the imaging device mounted at or above the pivot point of the rower's oar or at the position simulating the location of the pivot point of the rower's oar.
11. A system for capturing images of a rower's stroke in accordance with claim 9, wherein at least one single lens camera is positioned on a centre line of the rowing apparatus and is synchronised with the imaging device mounted at or above the pivot point of the rower's oar or on the point simulating the rower's oar.
12. A system for capturing images of a rower's stroke in accordance with any one of claims 9 to 11, wherein the system comprises at least one other imaging device and a clock wherein time data is transmitted from the clock wirelessly to the imaging devices and is used as the basis for synchronizing images captured by the imaging devices.
13. A system for capturing images of a rower's stroke in accordance with any one of claims 9 to 12, including highlighted tabs for wear by the rower to provide a marking point on the image of the rower.
14. An imaging device according to claim 1, wherein the mount includes a bolt assembly to fix the mount to a rigger of the rowing apparatus, and magnets for locking body onto the mount.