EP2867809A1 - Retail training application - Google Patents
Retail training applicationInfo
- Publication number
- EP2867809A1 EP2867809A1 EP13741903.2A EP13741903A EP2867809A1 EP 2867809 A1 EP2867809 A1 EP 2867809A1 EP 13741903 A EP13741903 A EP 13741903A EP 2867809 A1 EP2867809 A1 EP 2867809A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- user
- computer
- data
- sensor
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
- A61B5/0022—Monitoring a patient using a global network, e.g. telephone networks, internet
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/743—Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/7435—Displaying user selection data, e.g. icons in a graphical user interface
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
- A61B2562/02—Details of sensors specially adapted for in-vivo measurements
- A61B2562/0252—Load cells
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/6804—Garments; Clothes
- A61B5/6807—Footwear
Definitions
- One or more aspects describe systems, apparatuses, computer readable media, and methods for tracking performance metrics of a user during an exercise session.
- the systems, apparatuses, computer readable media, and methods may be configured to process input specifying a user attribute, adjust a performance zone based on the user attribute, receive data generated by at least one of an accelerometer
- the systems, apparatuses, computer readable media, and methods may include receiving data generated by a sensor (e.g., an accelerometer, a force sensor, temperature sensor, heart rate monitor, etc.) as a user performs an athletic movement, and comparing the data with comparison data of a plurality of playing styles to determine a particular one of the playing styles most closely matching the data.
- a sensor e.g., an accelerometer, a force sensor, temperature sensor, heart rate monitor, etc.
- the systems, apparatuses, computer readable media, and methods may include receiving data generated by a force sensor indicating a weight distribution during a performance of a plurality of exercise tasks, processing first input indicating successful completion of an exercise task, associating a first weight distribution at a time preceding the first input with the successful completion of the exercise task, processing second input indicating unsuccessful completion of the exercise task, and associating a second weight distribution at a time preceding the second input with the unsuccessful completion of the exercise task.
- the systems, apparatuses, computer readable media, and methods may include receiving signature move data corresponding to acceleration and force measurement data measured by a first, user performing a sequence of events, receiving player data from at least one of an accelerometer and a force sensor by monitoring a second user attempting to perform the sequence of events, and generating a similarity metric indicating how similar the player data is to the signature move data.
- the systems, apparatuses, computer readable media, and methods may include receiving data generated by at least one of an accelerometer and a force sensor, comparing the data to jump data to determine that the data is consistent with a jump, processing the data to determine a lift off time, a landing time, and a loft time, and calculating a vertical leap based on the loft time.
- FIGs. 1A-B illustrate an example of a personal training system in accordance with example embodiments.
- FIGs. 2A-B illustrate example embodiments of a sensor system in accordance with example embodiments.
- FIGs. 3A-B illustrate an example of a computer interacting with at least one sensor in accordance with example embodiments.
- FIG. 4 illustrates examples of pod sensors that may be embedded and removed from a shoe in accordance with example embodiments.
- FIG. 5 illustrates example on-body configurations for a computer in accordance with example embodiments.
- FIGs. 6-7 illustrates example various off-body configurations for a computer in accordance with example embodiments.
- FIG. 8 illustrates an example display of a graphical user interface (GUI) presented by a display screen of a computer in accordance with example embodiments.
- GUI graphical user interface
- FIG. 9 illustrates example performance metrics for user selection in accordance with example embodiments.
- FIGs. 10-11 illustrate an example of calibrating sensors in accordance with example embodiments.
- FIG. 12 illustrates example displays of a GUI presenting information relative to a session in accordance with example embodiments.
- FIG. 13 illustrates an example display of a GUI providing a user with information about their performance metrics during a session in accordance with example embodiments.
- FIG. 14 illustrates example displays of a GUI presenting information about a user's virtual card (vcard) in accordance with example embodiments.
- FIG. 15 illustrates an example user profile display of a GUI presenting a user profile in accordance with example embodiments.
- FIG. 16 illustrates a further example of user profile display presenting additional information about the user in accordance with example embodiments.
- FIGs. 17-20 illustrate further example displays of a GUI for displaying performance metrics to a user in accordance with example embodiments.
- FIG. 21 illustrates example freestyle displays of a GUI providing information on freestyle user movement in accordance with example embodiments.
- FIG. 22 illustrates example training displays presenting user-selectable training sessions in accordance with example embodiments.
- FIGs. 23-26 illustrate example training sessions in accordance with example embodiments.
- FIGs. 27-30 illustrate display screens for GUIs for a basketball shooting training session in accordance with example embodiments.
- FIG. 31 illustrates an example display of a GUI informing the user of shooting milestones in accordance with example embodiments.
- FIG. 32 illustrates example signature moves displays for a GUI prompting a user to perform a drill to imitate a professional athlete's signature move in accordance with example embodiments.
- FIG. 33 illustrates example displays of a GUI for searching for other users and/or professional athletes for comparison of performance metrics in accordance with example embodiments.
- FIGs. 34-35 illustrate example displays for comparing a user's performance metrics to other individuals in accordance with example embodiments.
- FIG. 36 illustrates a flow diagram of an example method for determining whether physical data obtained monitoring a user performing a physical activity is within a performance zone in accordance with example embodiments.
- FIG. 37 il lustrates a system that may be used to promote the sale of products that have embedded or attached sensors in accordance with an embodiment of the invention.
- FIG. 38 illustrates a method that may be used to promote the sale of products that have embedded or attached sensors in accordance with an embodiment of the inventions.
- FIG. 1 A illustrates an example of a personal training system 100 in accordance with example embodiments.
- Example system 100 may include one or more electronic devices, such as computer 102.
- Computer 102 may comprise a mobile terminal, such as a telephone, music player, tablet, netbook or any portable device.
- computer 102 may comprise a set-top box (STB), desktop computer, digital video recorder(s) (DVR), computer server(s), and/or any other desired computing device.
- computer 102 may comprise a gaming console, such as for example, a Microsoft® XBOX, Sony® Playstation, and/or a Nintendo® Wii gaming consoles.
- gaming console such as for example, a Microsoft® XBOX, Sony® Playstation, and/or a Nintendo® Wii gaming consoles.
- computer 102 may include computing unit 104, which may comprise at least one processing unit 106.
- Processing unit 106 may be any type of processing device for executing software instructions, such as for example, a microprocessor device.
- Computer 102 may include a variety of non-transitory computer readable media, such as memory 108.
- Memory' 108 may include, but is not limited to, random access memory (RAM) such as RAM 1 10, and/or read only memory (ROM), such as ROM 1 12.
- Memory 108 may include any of: electronically erasable programmable read only memory (EEPRQM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by computer 102.
- EEPRQM electronically erasable programmable read only memory
- flash memory or other memory technology
- CD-ROM compact disc-read only memory
- DVD digital versatile disks
- magnetic storage devices or any other medium that can be used to store the desired information and that can be accessed by computer 102.
- the processing unit 106 and the system memory 108 may be connected, either directly or indirectly, through a bus 114 or alternate communication structure to one or more peripheral devices.
- the processing unit 106 or the system memory 108 may be directly or indirectly connected to additional memory storage, such as a hard disk drive 1 16, a removable magnetic disk drive, an optical disk drive 118, and a flash memory card.
- the processing unit 106 and the system memory 108 also may be directly or indirectly connected to one or more input devices 120 and one or more output devices 122.
- the output devices 122 may include, for example, a display device 136, television, printer, stereo, or speakers.
- one or more display devices may be incorporated into eyewear.
- the display devices incorporated into eyewear may provide feedback to users.
- Eyewear incorporating one or more display devices also provides for a portable display system.
- the input devices 120 may include, for example, a keyboard, touch screen, a remote control pad, a pointing device (such as a mouse, touehpad, stylus, trackball, or joystick), a scanner, a camera or a microphone.
- input devices 120 may comprise one or more sensors configured to sense, detect, and/or measure athletic movement from a user, such as user 124, shown in FIG. I A.
- image-capturing device 126 and/or sensor 128 may be utilized in detecting and/or measuring athletic movements of user 124.
- data obtained from image-capturing device 126 or sensor 128 may directly detect athletic movements, such that the data obtained from image-capturing device 126 or sensor 128 is directly correlated to a motion parameter.
- data from image- capturing device 126 and/or sensor 128 may be utilized in combination, either with each other or with other sensors to detect and/or measure movements. Thus, certain measurements may be determined from combining data obtained from two or more devices.
- Image- capturing device 126 and/or sensor 128 may include or be operatively connected to one or more sensors, including but not limited to: an accelerometer, a gyroscope, a location- determining device (e.g., GPS), light sensor, temperature sensor (including ambient temperature and/or body temperature), heart rate monitor, image-capturing sensor, moisture sensor and/or combinations thereof.
- Example uses of illustrative sensors 126, 128 are provided below in Section I.C, entitled "Illustrative Sensors.”
- Computer 102 may also use touch screens or image capturing device to determine where a user is pointing to make selections from a graphical user interface.
- One or more embodiments may utilize one or more wired and/or wireless technologies, alone or in combination, wherein examples of wireless technologies include Bluetooth® technologies, Bluetooth® low energy technologies, and/or ANT technologies.
- Computer 102, computing unit 104, and/or any other electronic devices may be directly or indirectly connected to one or more network interfaces, such as example interface 130 (shown in FIG. I B) for communicating with a network, such as network 132.
- network interface 130 may comprise a network adapter or network interface card (NIC) configured to translate data and control signals from the computing unit 104 into network messages according to one or more communication protocols, such as the Transmission Control Protocol (TCP), the Internet Protocol (IP), and the User Datagram Protocol (UDP). These protocols are well known in the art, and thus will not be discussed here in more detail.
- TCP Transmission Control Protocol
- IP Internet Protocol
- UDP User Datagram Protocol
- An interface 130 may employ any suitable connection agent for connecting to a network, including, for example, a wireless transceiver, a power line adapter, a modem, or an Ethernet connection.
- Network 132 may be any one or more information distribution network(s), of any type(s) or topology(s), alone or in corabination(s), such as internet(s), intranet(s), cloud(s), LAN(s).
- Network 132 may be any one or more of cable, fiber, satellite, telephone, cellular, wireless, etc. Networks are well known in the art, and thus will not be discussed here in more detail.
- Network 132 may be variously configured such as having one or more wired or wireless communication channels to connect one or more locations (e.g., schools, businesses, homes, consumer dwellings, network resources, etc.), to one or more remote servers 134, or to other computers, such as similar or identical to computer 102.
- system 100 may include more than one instance of each component (e.g., more than one computer 102, more than one display 136, etc.).
- a single device may integrate one or more components shown in FIG. lA.
- a single device may include computer 102, image-capturing device 126, sensor 128, display 136 and/or additional components.
- sensor device 138 may comprise a mobile terminal having a display 136, image-capturing device 126, and one or more sensors 128.
- image-capturing device 126, and/or sensor 128 may be peripherals configured to be operatively connected to a media device, including for example, a gaming or media system.
- a media device including for example, a gaming or media system.
- Computer 102 and/or other devices may comprise one or more sensors 126, 128 configured to detect and/or monitor at least one fitness parameter of a user 124.
- Sensors 126 and/or 128 may include, but are not limited to: an accelerometer, a gyroscope, a location- determining device (e.g., GPS), light sensor, temperature sensor (including ambient temperature and/or body temperature), sleep pattern sensors, heart rate monitor, image- capturing sensor, moisture sensor and/or combinations thereof.
- Network 132 and/or computer 102 may be in communication with one or more electronic devices of system 100, including for example, display 136, an image capturing device 126 (e.g., one or more video cameras), and sensor 128, which may be an infrared (IR) device.
- IR infrared
- sensor 128 may comprise an IR transceiver.
- sensors 126, and/or 128 may transmit waveforms into the environment, including towards the direction of user 124 and receive a "reflection" or otherwise detect alterations of those released waveforms.
- image-capturing device 126 and/or sensor 128 may be configured to transmit and/or receive other wireless signals, such as radar, sonar, and/or audible information.
- signals corresponding to a multitude of different data spectrums may be utilized in accordance with various embodiments.
- sensors 126 and/or 128 may detect waveforms emitted from external sources (e.g., not system 100).
- sensors 126 and/or 128 may detect heat being emitted from user 124 and/or the surrounding environment.
- image-capturing device 126 and/or sensor 128 may comprise one or more thermal imaging devices.
- image-capturing device 126 and/or sensor 128 may comprise an IR device configured to perform range phenomenology.
- image-capturing devices configured to perform range phenomenology are commercially available from Fiir Systems, Inc. of Portland, Oregon.
- image capturing device 126 and sensor 128 and display 136 are shown in direct (wirelessly or wired) communication with computer 102, those skilled in the art will appreciate that any may directly communicate (wirelessly or wired) with network 132.
- User 124 may possess, carry, and/or wear any number of electronic devices, including sensory devices 138, 140, 142, and/or 144.
- one or more devices 138, 140, 142, 144 may not be specially manufactured for fitness or athletic purposes. Indeed, aspects of this disclosure relate to utilizing data from a plurality of devices, some of which are not fitness devices, to collect, detect, and/or measure athletic data.
- device 138 may comprise a portable electronic device, such as a telephone or digital music player, including an IPOD®, IPAD®, or iPhone®, brand devices available from Apple, Inc. of Cupertino, California or Zune® or Microsoft® Windows devices available from Microsoft of Redmond, Washington.
- digital media players can serve as both an output device for a computer (e.g., outputting music from a sound file or pictures from an image file) and a storage device.
- device 138 may be computer 102, yet in other embodiments, computer 102 may be entirely distinct from device 138. Regardless of whether device 138 is configured to provide certain output, it may serve as an input device for receiving sensory information.
- Devices 138, 140, 142, and/or 144 may include one or more sensors, including but not limited to: an aceelerorneter, a gyroscope, a location-determining device (e.g., GPS), light sensor, temperature sensor (including ambient temperature and/or body temperature), heart rate monitor, image-capturing sensor, moisture sensor and/or combinations thereof.
- sensors may be passive, such as reflective materials that may be detected by image-capturing device 126 and/or sensor 128 (among others), in certain embodiments, sensors 144 may be integrated into apparel, such as athletic clothing. For instance, the user 124 may wear one or more on-body sensors 144a-b.
- Sensors 144 may be incorporated into the clothing of user 124 and/or placed at any desired location of the body of user 124. Sensors 144 may communicate (e.g., wireiessly) with computer 102, sensors 128, 138, 140, and 142, and/or camera 126. Examples of interac i e gaming apparel are described in U.S. Pat. App. No. 10/286,396, filed October 30, 2002, and published as U.S. Pat. Pub, No. 2004/0087366, the contents of which are incorporated herein by reference in its entirety for any and all non-limiting purposes. In certain embodiments, passive sensing surfaces may reflect waveforms, such as infrared light, emitted by image- capturing device 126 and/or sensor 128.
- waveforms such as infrared light
- passive sensors located on user's 124 apparel may comprise generally spherical structures made of glass or other transparent or translucent surfaces which may reflect waveforms.
- Different classes of apparel may be utilized in which a given class of apparel has specific sensors configured to be located proximate to a specific portion of the user's 124 body when properly worn.
- golf apparel may include one or more sensors positioned on the apparel in a first configuration and yet soccer apparel may include one or more sensors positioned on apparel in a second configuration.
- Devices 138-144 may communicate with each other, either directly or through a network, such as network 132. Communication between one or more of devices 138-144 may take place via computer 102, For example, two or more of devices 138-144 may be peripherals operative ly connected to bus 1 14 of computer 102. in yet another embodiment, a first device, such as device 138 may communicate with a first computer, such as computer 102 as well as another device, such as device 142, however, device 142 may not be configured to connect to computer 102 but may communicate with device 138. Further, one or more electronic devices may be configured to communicate through multiple communication pathways.
- device 140 may be configured to communicate via a first wireless communication protocol with device 138 and further communicate through a second wireless communication protocol with a different device, such as for example, computer 102.
- Example wireless protocols are discussed throughout this disclosure and are known in the art. Those skilled in the art will appreciate that other configurations are possible.
- Some implementations of the example embodiments may alternately or additionally employ computing devices that are intended to be capable of a wide variety of functions, such as a desktop or laptop personal computer. These computing devices may have any combination of peripheral devices or additional components as desired. Also, the components shown in FIG. IB may be included in the server 134, other computers, apparatuses, etc.
- sensory devices 138, 140, 142 and/or 144 may be formed within or otherwise associated with user's 124 clothing or accessories, including a watch, armband, wristband, necklace, shirt, shoe, or the like. Examples of shoe-mounted and wrist- worn devices (devices 140 and 142, respectively) are described immediately below, however, these are merely example embodiments and this disclosure should not be limited to such.
- sensory device 140 may comprise footwear which may include one or more sensors, including but not limited to: an accel.erom.eter, location-sensing components, such as GPS, and/or a force sensor system.
- FIG. 2A illustrates one example embodiment of a sensor system 202 in accordance with example embodiments.
- system 202 may include a sensor assembly 204.
- Assembly 204 may comprise one or more sensors, such as for example, an accelerometer, location-determining components, and/or force sensors.
- assembly 204 incorporates a plurality of sensors, which may include force-sensitive resistor (FSR) sensors 206.
- FSR force-sensitive resistor
- other sensor(s) may be utilized.
- Port 208 may be positioned within a sole structure 209 of a shoe. Port 208 may optionally be provided to be in communication with an electronic module 210 (which may be in a housing 211) and a plurality of leads 212 connecting the FSR sensors 206 to the port 208. Module 210 may be contained within a well or cavity in a sole structure of a shoe. The port 208 and the module 210 include complementary interfaces 214, 216 for connection and communication.
- At least one force-sensitive resistor 206 shown in FIG. 2 A may contain first and second electrodes or electrical contacts 218, 220 and a force-sensitive resistive material 222 disposed between the electrodes 218, 220 to electrically connect the electrodes 218, 220 together.
- the resistivity and/or conductivity of the force-sensitive material 222 changes, which changes the electrical potential between the electrodes 218, 220.
- the change in resistance can be detected by the sensor system 202 to detect the force applied on the sensor 216.
- the force- sensitive resistive material 222 may change its resistance under pressure in a variety of ways.
- the force-sensitive material 222 may have an internal resistance that decreases when the material is compressed, similar to the quantum tunneling composites described in greater detail below. Further compression of this material may further decrease the resistance, allowing quantitative measurements, as well as binary (on/off) measurements. In some circumstances, this type of force-sensitive resistive behavior may be described as "volume-based resistance,” and materials exhibiting this behavior may be referred to as “smart materials.” As another example, the material 222 may change the resistance by changing the degree of surface-to-surface contact.
- This surface resistance may be the resistance between the material 222 and the electrodes 218, 220and/or the surface resistance between a conducting layer (e.g., carbon/graphite) and a force-sensitive layer (e.g., a semiconductor) of a multi-layer material 222.
- a conducting layer e.g., carbon/graphite
- a force-sensitive layer e.g., a semiconductor
- this type of force-sensitive resistive behavior may be described as "contact-based resistance.”
- the force-sensitive resistive material 222 as defined herein, may be or include a doped or non-doped semiconducting material.
- the electrodes 218, 220 of the FS sensor 206 can be formed of any conductive material, including metals, carbon/graphite fibers or composites, other conductive composites, conductive polymers or polymers containing a conductive material, conductive ceramics, doped semiconductors, or any other conductive material.
- the leads 212 can be connected to the electrodes 218, 220 by any suitable method, including welding, soldering, brazing, adhesively joining, fasteners, or any other integral or non-integral joining method. Alternately, the electrode 218, 220 and associated lead 212 may be formed of a single piece of the same materi al.
- the sensor system 202 may contain a different quantity and/ or configuration of sensors and generally include at least one sensor.
- the system 202 includes a much larger number of sensors, and in another embodiment, the system 202 includes two sensors, one in the heel and one in the forefoot of a shoe or device to be close proximity to a user's foot.
- one or more sensors 206 may communicate with the port 214 in a different manner, including any known type of wired or wireless communication, including Bluetooth and near-field communication.
- a pair of shoes may be provided with sensor systems 202 in each shoe of the pair, and it is understood that the paired sensor systems may operate synergistically or may operate independently of each other, and that the sensor systems in each shoe may or may not communicate with each other. It is further understood that the sensor system 202 may be provided with computer-executable instructions stored on one or more computer-readable media that when executed by a processor control collection and storage of data (e.g., pressure data from interaction of a user's foot with the ground or other contact surface), and that these executable instructions may be stored in and/or executed by the sensors 206, any module, and/or an external device, such as device 128, computer 102, server 134 and/or network 132 of FIG. 1A.
- a processor control collection and storage of data e.g., pressure data from interaction of a user's foot with the ground or other contact surface
- device 226 (which may resemble or be sensory device 142 shown in FIG. 1A) may be configured to be worn by user 124, such as around a wrist, arm, ankle or the like.
- Device 226 may monitor athletic movements of a user, including all-day activity of user 124.
- device assembly 226 may detect athletic movement during user's 124 interactions with computer 102 and/or operate independently of computer 102.
- device 226 may be an -all day activity monitor that measures activity regardless of the user's proximity or interactions with computer 102.
- Device 226 may communicate directly with network 132 and/or other devices, such as devices 138 and/or 140.
- athletic data obtained from device 226 may be utilized in determinations conducted by computer 102, such as determinations relating to which exercise programs are presented to user 124.
- device 226 may also wirelessly interact with a mobile device, such as device 138 associated with user 124 or a remote website such as a site dedicated to fitness or health related subject matter. At some predetermined time, the user may wish to transfer data from the device 226 to another location.
- device 226 may include an input mechanism, such as a depressible input button 228 assist in operation of the device 226.
- the input button 228 may be operably connected to a controller 230 and/or any other electronic components, such as one or more of the elements discussed in relation to computer 102 shown in FIG. IB.
- Controller 230 may be embedded or otherwise part of housing 232.
- Housing 232 may be formed of one or more materials, including elastomeric components and comprise one or more displays, such as display 234.
- the display may be considered an iliuminable portion of the device 226.
- the display 234 may include a series of individual lighting elements or light members such as LED lights 234 in an exemplary embodiment.
- the LED lights may be formed in an array and operably connected to the controller 230.
- Device 226 may include an indicator system 236, which may also be considered a portion or component of the overall display 234. it is understood that the indicator system 236 can operate and illuminate in conjunction with the display 234 (which may have pixel member 235) or completely separate from the display 234.
- the indicator system 236 may also include a plurality of additional lighting elements or light members 238, which may also take the form of LED lights in an exemplary embodiment.
- indicator system may provide a visual indication of goals, such as by illuminating a portion of lighting members 238 to represent accomplishment towards one or more goals.
- a fastening mechanism 240 can be unlatched wherein the device 226 can be positioned around a wrist of the user 124 and the fastening mechanism 240 can be subsequently placed in a latched position. The user can wear the device 226 at all. times if desired.
- fastening mechanism 240 may comprise an interface, including but not limited to a USB port, for operative interaction with computer .102 and/or devices 138, 140.
- device 226 may comprise a sensor assembly (not shown in FIG, 2B).
- the sensor assembly may comprise a plurality of different sensors.
- the sensor assembly may comprise or permit operative connection to an accelerometer (including in the form of a multi-axis accelerometer), heart rate sensor, location-determining sensor, such as a GPS sensor, and/or other sensors.
- Detected movements or parameters from device's 142 sensor(s) may include (or be used to form) a variety of different parameters, metrics or physiological characteristics including but not limited to speed, distance, steps taken, calories, heart rate, sweat detection, effort, oxygen consumed, and/or oxygen kinetics.
- Such parameters may also be expressed in terms of activity points or currency earned by the user based on the activity of the user.
- Various examples may be implemented using electronic circuitry configured to perform one or more functions.
- a computing device such as a smart, phone, mobile device, computer, server, or other computing equipment may be implemented using one or more application-specific integrated circuits (A SICs). More typically, however, components of various examples of the invention will be implemented using a programmable computing device executing firmware or software instructions, or by some combination of purpose-specific electronic circuitry and firmware or software instructions executing on a programmable computing device.
- a SICs application-specific integrated circuits
- FIGs. 3A-B illustrate examples of a computer interacting with at least one sensor in accordance with example embodiments.
- the computer 102 may be implemented as a smart phone that may be carried by the user.
- Example sensors may be worn on a user's body, be situated off-body, and may include any of the sensors discussed above including an accelerometer, a distributed sensor, a heart rate monitor, a temperature sensor, etc.
- a pod sensor 304 and a distributed sensor 306 (including, for example, sensor system 202 discussed above having one or more FSRs 206) is shown.
- the pod sensor 304 may include an accelerometer, a gyroscope, and/or other sensing technology.
- pod sensor 304 may at least one sensor to monitor data that does not directly relate to user movement.
- ambient sensors may be worn by the user or may be external to the user.
- Ambient sensors may include a temperature sensor, a compass, a barometer, a humidity sensor, or other type of sensor. Other types of sensors and combinations of sensors configured to measure user movement may also be used.
- computer 102 may incorporate one or more sensors.
- the pod sensor 304, the distributed sensor 206, as well as other types of sensors, may include a wireless transceiver to communicate with one another and the computer 102.
- sensors 304 and 306 may communicate directly with the network 132, with other devices worn by the user (e.g., a watch, arm band device, etc.), with sensors or devices worn by a second user, an external device, etc.
- a sensor in a left shoe may communicate with a sensor in a right shoe.
- one shoe may include multiple sensors that communicate with one another and/or with a processor of the shoe.
- a pair of shoes may include a single processor that collects data from multiple sensors associated with the shoes, and a transceiver coupled to the single processor may communicate sensor data to at least one of computer 102, network 132, and server 134.
- one or more sensors of a shoe may communicate to a transceiver that communicates with at least one of computer 102, network 132, and server 134.
- sensors associated with a first user may communicate with sensors associated with a second user.
- sensors in the first user's shoes may communicate with sensors in a second user's shoes.
- Other topographies may also be used.
- the computer 102 may exchange data with the sensors, and also may communicate data received from the sensors via the network 132 to the server 134 and/or to another computer 102.
- a user may wear head phones or ear buds to receive audio information from the computer 102, directly from one or more of the sensors, from the server 134, from the network 132, from other locations, and combinations thereof.
- the head phones may be wired or wireless.
- a distributed sensor 306 may communicate data to head phones for audible output to the user.
- a user may wear shoes that are each equipped with an accelerometer, a force sensor or the like, to allow the computer 102 and/or the server 134 to determine the individual movement and metrics of each foot or other body part (e.g., leg, hand, arm, individual fingers or toes, regions of a person's foot or leg, hips, chest, shoulders, head, eyes) alone or in combination with the systems described above with reference to FIGs. 1A-B and 2A-2B.
- body part e.g., leg, hand, arm, individual fingers or toes, regions of a person's foot or leg, hips, chest, shoulders, head, eyes
- Processing of data may distributed in any way, or performed entirely at one shoe, at the computer 102, in the server 134, or combinations thereof.
- computer 102 may be described as performing a function.
- Other devices including server 134, a controller, another computer, a processor in a shoe or other article of clothing, or other device may performing the function instead of or in addition to computer 102.
- one or more sensors of each shoe or other peripheral sensor
- the controller's processing, at any given time, may be subject to command and control of a higher tiered computing device (e.g., computer 102).
- That higher tiered device may receive and further process the processed sensor signals, from that one or plural controllers, e.g., via one or more transceivers. Comparisons and calculations may be made at one or more computing devices, including some or all of the above computing devices, with or without additional computing devices. Sensors may sense desired conditions and generate raw signals, the raw signals being processed so as to provide processed data. The processed data may then be used for determining current performance metrics (e.g., current speed of travel, etc.) and the determinations may change depending on user input (e.g., how high did I jump?) and/or programming (e.g., did the user do the indicated exercise and, if that is detected, how is it qualified/quantified in the user experience).
- current performance metrics e.g., current speed of travel, etc.
- sensors 304 and 306 may process and store measurement data, and forward the processed data (e.g., average acceleration, highest speed, total distance, etc.) to the computer 102 and/or the server 134.
- the sensors 304 and 306 may also send raw data to the computer 102 and/or the server 134 for processing.
- Raw data may include an acceleration signal measured by an accelerometer over time, a pressure signal measured by a pressure sensor over time, etc. Examples of multi-sensor apparel and the use of multiple sensors in athletic activity monitoring are described in U.S. Application No. 12/483,824, entitled “FOOTWEAR HAVING SENSOR SYSTEM,” and published as U.S. Publication No. 2010/0063778 A l and U.S.
- an athlete may wear shoes 302 having one or more force sensing systems, e.g., that utilize force-sensitive resistor (FSR) sensors, as shown in FIG. 2A and described in the above noted patent publications.
- the shoe 302 may have multiple FSR sensors 206 that detect forces at different regions of the user's foot (e.g., a heel, mid-sole, toes, etc.).
- Computer 102 may process data from FSR sensors 206 to determine balance of a user's foot and/or between a user's two feet. For example, computer 102 may compare a force measurement by a FSR 206 from a left shoe relative to a force measurement by a FSR 206 from a right shoe to determine balance and/or weight distribution.
- FIG. 3B is another example data flow diagram in which computer 102 interacts with at least one sensor processing system 308 to detect user actions.
- Sensor processing system 308 may be physically separate and distinct from computer 102 and may communicate with computer 102 through wired or wireless communication.
- Sensor processing system 308 may include sensor 304, as shown, as well as other sensors (e.g., sensor 306) instead of or in addition to sensor 304.
- sensor system 308 may receive and process data from sensor 304 and FSR sensor 206.
- Computer 102 may receive input from a user about a type of activity session (e.g., cross training, basketball, running, etc.) the user desires to perform. Instead or additionally, computer 102 may detect a type of activity the user is performing or receive information from another source about the type of activity being performed.
- a type of activity session e.g., cross training, basketball, running, etc.
- Computer 102 may identify one or more predefined action templates and communicate a subscription to sensor system 308.
- Action templates may be used to identify motions or actions that a user may perform while performing the determined type of activity.
- an action may correspond to a group of one or more events, such as detecting that a user has taken a step to the right followed by a step to the left or detecting that a user has jumped while flicking his or her wrist.
- different sets of one or more action templates may be defined for different types of activities.
- a first set of action templates defined for basketball may include dribbling, shooting a basketball , boxing out, performing a slam dunk, sprinting and the like.
- a second set of action templates defined for soccer may include kicking a bail to make a shot, dribbling, stealing, heading the ball and the like.
- Action templates may correspond to any desired level of granularity.
- a particular type of activity may include 50-60 templates.
- a type of activity may correspond to 20-30 templates. Any number of templates may be defined as needed for a type of activity.
- the templates may be manually selected by a user rather than being selected by the system.
- Sensor subscriptions may allow sensor system 308 to select the sensors from which data is to be received.
- the sensor processing system 308 may manage subscriptions that are used at any particular time.
- Types of subscriptions may include force sensitive resistance data from one or more force sensitive resistors, acceleration data from one or more accelerometers, summation information over multiple sensors (e.g., summation of acceleration data, summation of force resistance data over one or more sensors, etc.), pressure maps, mean centered data, gravity adjusted sensor data, force sensitive resistance derivatives, acceleration derivatives, and the like and/or combinations thereof.
- a single subscription may correspond to a summation of data from multiple sensors.
- a single subscription may correspond to a summation of forces of all sensors in the forefoot region.
- force data for each of the forefoot force sensors may correspond to a distinct subscription.
- the subscriptions may specify which of those 5 sensors are monitored for sensor data.
- subscriptions may specify receiving/monitoring sensor data from a right shoe accelerometer but not a left shoe accelerometer.
- a subscription may include monitoring data from a wrist-worn sensor but not a heart rate sensor.
- Subscriptions may also specify sensor thresholds to adjust the sensitivity of a sensor system's event detection process.
- sensor system 308 may be instructed to detect all force peaks above a first specified threshold.
- sensor system 308 may be instructed to detect all force peaks above a second specified threshold.
- Use of different sensor subscriptions may help a sensor system to conserve power if some sensor readings are not needed for a particular activity. Accordingly, different activities and activity types may use different sensor subscriptions.
- Sensor processing system 308 may be configured to perform initial processing of raw sensor data to detect various granular events. Examples of events may include a foot strike or launch when jumping, a maximum acceleration during a time period, etc. Sensor system 308 may then pass events to computer 102 for comparison to various templates to determine whether an action has been performed. For example, sensor system 308 may identity one or more events and wireiessly communicate BLUETOOTH® Low Energy (BLE) packets, or other types of data, to computer 102, In another example, sensor system 308 may instead or additionally send raw sensor data.
- BLE BLUETOOTH® Low Energy
- computer 102 may perform post-match processing including determining various activity metrics such as repetitions, air-time, speed, distance and the like.
- Activity classification may be performed by identifying various events and actions represented within data received from any number and type of sensors. Accordingly, activity tracking and monitoring may include determining whether one or more expected or known actions within an activity type has been performed and metrics associated with those actions.
- actions may correspond to a series of one or more low-level or granular events and may be detected using predefined action templates.
- computer 102 may automatically detect when a user has performed a particular activity or a particular motion expected during that activity. If a user is playing basketball, for instance, detecting that the user has jumped while flicking his or her wrist may indicate that the user has taken a shot. In another example, detecting that a user has moved both feet outward while jumping followed by moving both feet inward while jumping may register as a user performing one repetition of a jumping jack exercise.
- a variety of other templates may be defined as desired to identify particular types of activities, actions or movements within types of activities.
- FIG. 4 illustrates examples of pod sensors 304 that may be embedded and removed from a shoe in accordance with example embodiments.
- the pod sensor 304 may include a rechargeable battery that may be recharged when inserted into a wall adapter 402. Wired or wireless charging of the pod sensor 304 may be used.
- the pod sensor 304 may be inductively charged
- a pod sensor 304-1 may be configured with an interface (e.g., Universal Serial Bus) permitting insertion into a computer or other device for downloading and/or receiving data.
- An interface of the pod sensor may provide for wired or wireless communication.
- software updates may be loaded onto the pod sensor when connected to a computer.
- the pod sensor may vvireiessly receive software updates. When physically coupled to a computer 102 (or other device having a port), the pod sensor may charge and communicate with the computer 102.
- FIG. 5 illustrates example on-body configurations for the computer 102 in accordance with example embodiments.
- Computer 102 may be configured to be worn at desired locations on a user's body, such as, for example, a user's arm, leg, or chest, or otherwise integrated in clothing. For example, each article of clothing may have its own integrated computer.
- the computer may be a thin client, driven by the context, of what the user is doing and otherwise equipped/networked.
- Computer 102 may also be located apart from the user's body, as shown in FIGs. 6-7.
- FIGs. 6-7 illustrates example various off-body configurations for the computer 102 in accordance with example embodiments.
- Computer 102 may be placed in a docking station 602 to permit display of the GUI on a larger screen and output of audio through a stereo system.
- computer 102 may respond to voice commands, via direct user input (e.g., using a keyboard), via input from a remote control, or other manners to receive user commands.
- Other off-body configurations may include placing the computer 102 on a floor or table nearby where a user is exercising, storing the computer 102 in a workout bag or other storage container, placing the computer 102 on a tripod mount 702, and placing the computer 102 on a wall mount 704.
- Other off-body configurations may also be used.
- a user When worn off-body, a user may wear head-phone, ear buds, a wrist-worn device, etc. that may provide the user with real-time updates.
- the pod sensor 304 and/or the distributed sensor 306 may wirelessly communicate with the computer 102 at the off-body locations w r hen in range, at periodic time intervals, when triggered by the user, and/or may store data and upload the data to the computer 102 when in range or when instructed by the user at a later time.
- FIG. 8 illustrates an example display of a GUI presented by a display screen of the computer 102 in accordance with example embodiments.
- Home page display 802 of the GUI may present a home page to provide the user with general information, to prompt the user to select what type of physical activity session the user is interested in performing, and to permit the user to retrieve information about previously completed sessions (e.g., basketball games, workouts, etc.).
- the display screen of the computer 102 may be touch sensitive and/or may receive user input through a keyboard or other input means. For instance, the user may tap a display screen or provide other input to cause the computer 102 to perform operations.
- the user may tap or otherwise select on a field 804 including the last session to cause the computer 102 to update the home page display 802 to display performance metrics (e.g., vertical leap, total air, activity points, etc.) from at least one previous session.
- performance metrics e.g., vertical leap, total air, activity points, etc.
- the selected field 804 may expand, as seen in FIG. 8, to display information about duration of the last session, the user's top vertical leap, a total amount of time a user was in the air during the last session, and incentive points (e.g., activity points) earned in the previous session.
- the computer 102 may determine performance metrics (e.g., speed, vertical leap, etc.) by processing data sensed by the sensors 304 and 306 or other sensing devices.
- Home page display 802 may prompt a user to select whether they wish to have the computer 102 track one or more user performance metrics during a workout or athletic activity session (e.g., track my game) by selecting field 806 or assist the user in improving their athletic skills (e.g., raise my game) by selecting field 808.
- FIGs. 9-21 discuss the former and FIGs, 22-31 discuss the latter,
- FIG. 9 illustrates example performance metrics for user selection in accordance with example embodiments.
- a user may be interested in monitoring their total play time, vertical leap, distance, and calories burned and/or other metrics, and may use the home page display 802 to select from the desired metrics shown in FIG. 9.
- the metrics may also vary based on type of athletic activity performed in a session.
- home page display 802 may present certain default performance metric selections, depending on the activity of the session. The user may provide input to change the default performance metric selections.
- Other performance metrics than the ones shown in FIG. 9 may include a total number of jumps, a number of vertical jumps above a certain height (e.g., above 3 inches), a number of sprints (e.g., speed above a certain rate, either user selected or specified by computer 102), a number of fakes (e.g., quick changes in direction), a jump recovery (e.g., a fastest time between two jumps), a work rate (e.g., may be a function of average power multiplied by time length of workout session), a work rate level (e.g., low, medium, high), total steps, steps per unit time (e.g., per minute), number of bursts (e.g., number of times a user exceeds a speed threshold), balance, weight distribution (e.g., compare weight measured by a FSR 206 in a user's left shoe to weight measured by a FSR 206 in a user's right shoe, as well as amount FRSs 206 in one
- computer 102 may prompt the use to indicate which metrics to monitor for each type of session (e.g., baseball, soccer, basketball, etc.) and store the identified metrics in a user profile.
- Computer 102 may also prompt the user for desired metrics at the beginning of each session.
- computer 102 may track all of the performance metrics, but may only display the selected metrics to the user in the GUI. For example, computer 102 may only monitor certain base metrics (e.g., based on battery life may be extended, to vary responsiveness, to avoid data overload, etc.). If the user desires to review metrics other than the ones currently displayed by the GUI, the user may input the desired metrics and the computer 102 may update the GUI accordingly.
- the metrics being displayed may be changed at any time. The default metrics may be presented once the session resumes or another session begins.
- computer 102 may later go into a lower level of monitoring (e.g., as resources are consumed together with warnings to user), down to and through base and ultimately to one or no metrics being monitored.
- computer 102 may only display base metrics for a user, unless/until configured otherwise by user. Based on resources, computer 102 may reduce what is being displayed to only present the base pertonnance metrics or fewer metrics.
- Sensors may contmue to monitor the other performance metrics, and data from these sensors may be later available (e.g., via web experience, etc.).
- FIGs. 10-11 illustrate an example of calibrating sensors in accordance with example embodiments.
- Calibration may involve computer 102 confirming ability to communicate directly or indirectly with the sensors (e.g., sensors 304 and 306), that the sensors are functioning property, that the sensors have adequate battery life, and to establish baseline data.
- computer 102 may communicate with (e.g., send a wireless signal) pod sensor 304 and distributed sensor 306 contained with a user's shoes. The pod sensor and the distributed sensor may reply with the requested data.
- Calibration may also occur at other time instances (e.g., mid-session, at the end of a session, etc.).
- the GUI may prompt the user to stand still to take baseline data measurements with pod sensor 304 and distributed sensor 306 (e.g., acceleration, weight distribution, total weight, etc.), as seen in displays 10G2A-B. Calibration may also prompt the user to individually lift their feet to permit computer 102 to determine which foot is associated with whic sensor data.
- Distributed sensor 306 may also be encoded with footwear information, such as, for example, shoe type, color, size, which foot (e.g., left or right), etc., that the computer 102 obtains during calibration.
- the computer 102 may process the reply from the sensors 304 and 306, and update the GUI to inform the user of any issues and how to address those issues (e.g., change battery, etc.) or if the calibration was successful, as seen in display 1002C.
- field 1104 shown to the left of display 1102 A includes example displays of battery life as well as connectivity status (e.g., connected, not connected). Calibration may also occur at certain events, such as detecting removal of a pod 304.
- the display 1102B presents a weigh distribution for the user and a gauge 1106 representing remaining battery life.
- a GUI may be configured to display performance data in substantially real-time (e.g., as fast as may be permitted to capture (and/or process) and transmit the data for display),
- FIG. 1 I B shows example GUIs that may be implemented in accordance with one embodiment.
- display 1 1 Q2C may provide one or more selectable activity parameters for displaying captured values relating to that selectable parameter.
- a user desiring to view values relating to their vertical height during a jump may select the "vertical" icon (see icon 1108); yet other icons may include, but are not limited to: quickness (which may display values relating to steps per second and/or distance per second), pressure, and/or any other detectable parameter.
- a plurality of different parameters may be selected for simultaneous display. Yet in further embodiments, the parameters are not required to be selected.
- Default parameters may be displayed absent a user input.
- Data relating to the parameters) may be provided on display 1102C in real-time. For example, output 1110 indicates that the user has jumped "24.6 INCHES". Values may be provided graphically, such as for example represented by graph 112 indicating the value is 24.6 inches.
- outputting of values may show the real-time data
- at least one of the outputs 1 110/1112 may show other values, such as historical values, desired goal values, and/or a maximum or minimum value.
- graph 1 1 12 may fluctuate depending on the user's current (e.g., real-time) height; however, output 1110 may display the user's highest recorded jump during that session or an all-time best.
- Outputting of values or results may be correlated to physical objects and/or actions. For example, upon a user jumping a vertical height within a first range, such as between 24 inches to 30 inches, they may receive an indication that the)'
- FIG. 12 illustrates example displays of the GUI presenting information relative to a session in accordance with example embodiments.
- Display 1202A may initially prompt the user to check in to a court and to start a session. The user may also input a type of the session (e.g., practice, pickup game, league, half-court game, full court game, 3 on 3, 5 on 5, etc.).
- Dis lay 1202B may inform the user of a duration of the session as well as prompting the user to pause and/or end their session.
- Display 1202C may present current performance metrics of the user (e.g., top vertical, air time, tempo, etc.).
- display 1202 may present default or user-selected statistics, but a swipe or other gesture may trigger a scroll, sequencing groups of predetermined number of performance metrics (e.g., 3 or other number, based on the performance metrics that can be shown on the screen in portrait versus landscape orientation) or otherwise brings up other performance metrics.
- predetermined number of performance metrics e.g., 3 or other number, based on the performance metrics that can be shown on the screen in portrait versus landscape orientation
- Computer 102 may also update display 1202 when a particular event is identified. For example, if a new record (e.g., personal best) is identified (e.g., new vertical max leap), computer 1202 may at least one of update the display (e.g., color, information presented, etc.), vibrate, sound a noise indicative of the specific record (e.g., based on color change placement on shoe corresponding to a specific metric), or prompt the user that some record (e.g., any metric) has been reached. Display 1202 may also present a button for the user to select signifying that a record has been achieved. Display 1202B may prompt the user to check their performance metrics (e.g., check my stats), as further described in FIG. 13.
- performance metrics e.g., check my stats
- FIG. 13 illustrates an example display of a GUI providing a user with information about their performance metrics during a session in accordance with example embodiments.
- Display 1302 may present information about a length of a current or previous session in field 1304, various performance metrics (e.g., top vertical, total airtime, tempo, etc.) for the user in field 1308, as well as who the user played with during the session in field 1310.
- computer 102, sensor 304 or 306, or other device associated with a first user may exchange a first user identifier with a computer 102, sensor 304 or 306, or other device associated with a second user to that each computer may be aware of who participated in a session.
- the computer 102 may also process the performance metrics to assign a playing style to the user as indicated in field 1306, Field 1306 may indicate that the user is a "hot streak" in response to determining that the user hustled hard for thirty minutes in a row.
- the box to the right of field 1306 may indicate alternative playing styles.
- the computer 102 may identify other types of playing styles.
- the computer 102 may assign a 'silent assassin' playing style when identifying periods of inactivity followed by explosive bursts, a 'vortex' playing style when a user exhibits little movement or jumping during the session, a 'cobra' playing style when a user exhibits perpetual easy movement with huge bursts and jumps, a 'track star' playing style when a user is fast, has good stamina, and has a high peak speed, and a 'skywalker' playing style when a user has a big vertical leap and a long hang time.
- more than one style may be assigned to the user, with a different style associated with one individual session as compared with another session. Plural styles may be assigned and displayed for a single session.
- the computer 102 may assign a particular playing style based on receiving user data from at least one of pod sensor 304 (e.g., accelerometer data), distributed sensor 306 (e.g., force data), or other sensors.
- the computer 102 may compare the user data with playing style data for a plurality of different playing styles to determine which of the playing styles most closely matches the data. For example, the computer 102 may set performance metric thresholds for each of the playing styles. Some playing styles may require that, at least once during the session, the user jumped a certain height, ran at a certain speed, played for a certain amount of time, and/or performed other tasks.
- playing styles may require that the user data indicate that the user performed certain sequences of events (e.g., little movement followed by quick acceleration to at least a certain top speed). Some playing styles may require that the user data indicate that the user maintained thresholds for a certain amount of time (e.g., maintained average speed over a threshold throughout a game).
- a playing style may be assigned based on a data set obtained from a set of sensors including sensors worn at various locations on a user's body (e.g., accelerometers at the gluteus and or upper body to identify a "BANGER" playing style).
- other, non- activity data may come into determining a playing style, such as user profile data (e.g., user age, height, gender, etc.).
- user profile data e.g., user age, height, gender, etc.
- some playing styles may be gender specific or based on ambient conditions (e.g., a "POSTMAN” style because use plays in rain, sleet, snow, etc.).
- a user or user group may define their own playing styles, based on a combination of metrics and analytics.
- the users or user groups may change a name of the playing style, without changing the associated metrics and analytics.
- Playing styles may be updated automatically.
- personal training system 100 may periodically update a playmg style specified by system 100,
- system 100 may automatically update a playing style when the name of the playing style is associated with a particular location (e.g., state, city, court), and that playing style is referred to by a different name at another location (e.g., keep the designation consistent with local lingo).
- display 1302 permits the user to share their performance metrics with other users and/or to post to a social networking website by selecting field 1312.
- the user may also input a message (e.g., "check out my vertical leap") to accompany the performance metrics being sent.
- the computer 102 may distribute performance metric data of a current and/or previous session and the message to the server 134 in response to a user request to share.
- the server 134 may incorporate the data and/or message in the social networking website and/or may distribute the data/message to other desired or all users.
- FIG. 14 illustrates example displays of the GUI presenting information about a user's virtual card (vcard) in accordance with example embodiments.
- the vcard may include information about a user's athletic history.
- the vcard may include data on a user's performance metrics, sessions, and awards at individual sessions as well as averages of the performance metrics.
- the vcard statistics display 1402A may indicate a number of points a user has acquired (e.g., activity points or metrics), as well as running totals and/or top performances by the user.
- the activity points may a statistic indicating physical activity performed by a user.
- the server 134 and/or computer 102 may award activity points to the user upon achieving certain athletic milestones.
- the vcard sessions display 1402B may indicate a total amount of playtime and number of sessions a user has completed, as well as providing historical information about completed sessions.
- the vcard sessions display 1402B may also indicate a playing style the user exhibited for each session as well as a session length and date of the session.
- the vcard awards display 1402C may indicate awards the user has accrued over time. For example, the server 134 and/or computer 102 may award the user a flight club award after accruing a total amount of loft time during the sessions.
- Other example awards may be a "king of the court" award for a user who has one or more top metrics at a specific court, a "flier mile” award earned with one mile of flight time (or for other quanta of time and distance), a "worldwide wes” award when a player participates in sessions in multiple countries, an "ankle-breaker” award to those having at least a certain top speed or quickest first step, a "jump king" award for a user having at least a certain vertical leap, a “24/7 bailer” award for a user who plays a certain number of days in a row or at a certain number of different courts, an "ice man” award if a certain number of rivals follow a user, a “black mamba” award if an even greater number of rivals follow a user (compared to an ice-man), a "prodigy” award for a young player achieving certain performance metric levels, and an “old school” award for older players achieving certain performance metric levels.
- FIG. 15 illustrates an example user profile display of the GUI presenting a user profile in accordance with example embodiments.
- the user profile display 1502 may present information about the user, such as height, weight, and position, playing style (e.g., "The Silent Assassin"), as well as other information.
- the user profile display 1502 may also indicate one or more types of shoe worn by the user.
- the user profile display 1502 may present information about the user's activity, and may permit the user to control sharing this information with other users. For example, the user may specify which other users can view user profile information, or may make all of the user's information accessible to any other user.
- FIG. 16 illustrates further examples of information about the user that may be presented in user profile display 1502 in accordance with example embodiments.
- FIGs. 17-20 illustrate further example displays of a GUI for displaying performance metrics to a user in accordance with example embodiments.
- the computer 102 may communicate with at least one of pod sensor 304, distributed sensor 306, or other sensor, to obtain data to generate the performance metrics.
- Example displays of the GUI while capturing data are shown in FIG. 17, such as top vertical in display ⁇ 702 ⁇ , total airdme in display 1702B, tempo statistics in display 1702C, and points in display 1702D.
- Scroll bar 1704 represents the progress in transferring data from the sensors to computer 102.
- FIG. 1 8A illustrates example leap displays relating to a user's vertical leap in accordance with example embodiments.
- the computer 102 may track information on the user's vertical leap during an exercise session as well as at what times during the session the leaps occurred.
- the computer 102 may determine a user's vertical leap based on an amount of loft time between when both feet of a user leave the ground and when a first of the user's feet next contacts the ground.
- the computer 102 may process accelerometer data from pod sensor 304 and/or force data from distributed sensor 306 to determine a moment when both of the user's feet are off the ground and when a first of the feet next contacts the ground.
- the computer 102 may also compare user data from pod sensor 304 and distributed sensor 306 with jump data to confirm that the user actually jumped and landed, rather than merely lifted their feet off of the ground or hung on a basketball rim (or other object) for a predetermined time.
- the jump data may be data generated to indicate what a force profile and/or acceleration profile should look like for someone who actually jumped.
- the computer 102 may use a similarity metric when comparing the user data to the jump data. If the user data is not sufficiently similar to the jump data, the computer 102 may determine that the user data is not a jump and may not include the user data when determining a user's performance metrics (e.g., top or average vertical leap).
- the computer 102 may process the user data to determine a vertical leap, a time of the vertical leap, a user's average vertical leap height, maintain a running total of loft time for jumps, and/or determine which foot is dominant, as well as other metrics.
- the computer 102 may identify a dominant foot based on the force data and/or accelerometer data associated with each shoe.
- the force data and/or accelerometer data may include timing information so that the computer 102 can compare events in each shoe.
- the computer 102 may process the force data and/or accelerometer data as well as the timing mform.ati.on to determine which foot was last on the ground prior to a jump.
- the computer 102 may identify a dominant foot based on the one that is last on the ground when a user jumps and/or the one associated with a user's largest vertical leap.
- the computer 102 may also present leap display 1802A including a user's top five vertical leaps and depict which foot, or both feet, was last on the ground immediately preceding the jump.
- Leap display 1802 A may display any desired number of top leaps, which may be specified by the user or set by system 100. The number of top leaps may be based on an amount of time.
- leap display 1802 A may present the top five leaps over the full time of a session, top five in the most recent predetermined number of minutes or percentage of total session time, or based on the type of session (e.g., pick-up basketball game as compared to an organized game).
- the leap display 1802 A or 1802B may also display vertical leaps over durations other than by session, and may include, for example, month, week, all time, or other time ranges.
- Leap display 1802A or 1802B may also present a total number of jumps, a cumulative amount of hang time, an average hang time, hang time corresponding to a highest vertical leap, or other information relating to jumping.
- Orientation of computer 102 may control which of leap display 1802A and leap display 1802B is currently being presented. For example, a user may rotate computer 102 (e.g., 90 degrees) to change from presenting leap display 1802A (e.g., a portrait orientation) to presenting leap display 1802B (e.g., a landscape orientation). A user may rotate computer 102 in the opposite direction to change from presenting leap display 1802B to presenting leap display 1802A. Similarly, rotation of computer 102 may be used to alternate between displays in other examples described herein. [98] In another example, leap display 1802B may display a user's jumps chronologically over a session and may indicate a time when each jump occurred as well as vertical height for each jump during the session.
- the leap display 1802B may also display a user's personal best vertical leap from a previous session or previously set during the session.
- a personal best line can be changed during a session, either via a step function, or by adding a new line of the new best to supplement the existing line (e.g., "new best" color) and showing lines for the session in which the new best occurs.
- Computer 102 may also update leap display 1802B by replacing the previous personal best line (e.g., in one color) with a new line (e.g., in a new personal best color, which may only be used during the session in which the personal best occurred). Further, the color may change as the user's personal best improves to indicate ability compared to other users (e.g., you jumped higher than 85% of other users).
- the leap display 1802B may include a performance zone (e.g., dunk zone) indicating when a user may be able to perform an act (e.g., dunk a basketball).
- the computer 102 may tailor the performance zone to the user based on the user's physical attributes (e.g., height, arm length, leg length, torso length, body length, etc.). For example, a dunk zone may require a higher vertical leap for a shorter user than a taller user.
- a performance zone may correspond to a range of values, a minimum value, or a maximum value.
- the one or more values may correlate to when a user's athletic performance is expected that a user could perform a particular act.
- a performance zone may be a minimum vertical leap that would permit a user to dunk a basketball.
- the user need not actually perform the act (e.g., dunking), but instead the performance zone may indicate when the computer 102 calculates that the user could perform the act.
- computer 102 may provide a recommendation to help the user achieve the performance zone. For example, computer 102 analysis of sensor data associated with leaps by the user may enable more feedback to the user to enhance ability to get into the dunk zone or to improve personal bests in rare air. For instance, computer 102 may process sensor data and recommend that the user adjust certain body parts to increase the user's leaping ability. In another example, computer 102 may suggest that the user obtain greater acceleration of leading foot or more pressure on trailing foot by increasing upper body acceleration.
- a performance zone may be established for any desired athletic movement.
- Example performance zones may correspond to a minimum amount of pressure measured by distributed sensor 306, a maximum amount of pressure, pressure falling within a particular range or pressures.
- Other example performance zones may correspond to a minimum amount of acceleration measured by the sensor 306, a maximum amount of pressure, pressure falling within a particular range or pressures.
- a performance zone may be based on a combination of different measurements or a sequence of measurements. For example, a performance zone may specify at least a certain amount of acceleration, followed by at least a certain amount of loft time, followed by at least a certain amount of measured pressure.
- acceleration and body rotation may be monitored. For instance, it may be desirable for a gymnast to have a specific amount of body rotation during a dismount from the uneven bars. If the gymnast rotates too quickly or slowly, he or she may not orient their body in a proper position when landing.
- the performance zone may be a "spin zone" specifying minimum and maximum rotational accelerations, and computer 102 may monitor for over and under rotation to provide the gymnast with feedback on whether they are within a performance zone during a dismount.
- Computer 102 may provide a recommendation to adjust certain body parts to adjust an amount of acceleration when dismounting to increase or decrease rotation by the user.
- a performance zone may be established for other sports (e.g., track and field, golf, etc.),
- Computer 102 may tailor the performance zone based on feedback received form the user.
- computer 102 may receive input from a user indicating for which vertical leaps the user was able to perform the act (e.g., dunk a basketball), and the computer 102 may adjust a minimum required vertical leap for the user to be in the performance zone based on the user's feedback.
- Computer 102 may award one or more activity points to a user for being in the performance zone as well as for the amount of time the user maintained their performance within the performance zone.
- Computer 102 may also determine an amount of calories burned by the user while in the performance zone.
- Computer 102 may present information indicating a rate of activity points earned by a user over the duration of an exercise session.
- FIG, 18B illustrates an example activity points display 1804 in accordance with example embodiments.
- Computer 102 may determine and award activity points to a user during the exercise session. To do so, computer 102 may compare measured user performance to any number of metrics to award activity points. For example, computer 102 may award a predetermined number of activity point for running a predetermined distance.
- line 1806 of activity points display 1804 may represent the rate at which a user earned activity points at various times during the exercise session
- line 1806 may represent an all-time average rate at which a user has accrued activity points
- line 1808 may represent the average rate at which the user accrued activity points during this particular session
- line 1812 may represent an ail-time best rate for accruing activity points.
- line 1806 may represent how may activity points a user accrues per minute, or other interval of time (e.g., per millisecond, per second, per ten seconds, per thirty seconds, etc.).
- Activity points display 1804 may also present indicia, such as lines, indicating other matrices, such as averages, including hut not limited to an average rate of accrued activity points for a predetermined number of previous session (e.g., last three sessions). Further, the lines may be of different colors. If a new all-time best is established, activity points display 1804 may flash or otlienvise present an indication signifying the accomplishment.
- indicia such as lines, indicating other matrices, such as averages, including hut not limited to an average rate of accrued activity points for a predetermined number of previous session (e.g., last three sessions). Further, the lines may be of different colors. If a new all-time best is established, activity points display 1804 may flash or otlienvise present an indication signifying the accomplishment.
- Computer 102 may categorize activities performed by the user as well as a percentage of time during an exercise session a user was in a particular category, and present this information to the user in the activity points display 1804.
- activity points display 1804 may indicate a percentage of time during a session that a user was idle, percentage of time that the user moved laterally, percentage of time that the user was walking, percentage of time that the user was running, percentage of time that the user was sprinting, and percentage of time that the user was jumping, etc.
- Other categories instead of or in addition to the ones shown in activity points display 1804 may also be presented.
- activity points display 1804 may display a cumulative amount of time, rather than percentage of time, for each of these statistics.
- Computer 102 may determine that amount of activity points a user earned while in each category, as well as a total amount of activity points earned during an exercise session, and present such information via activity points display 1804. In an example, computer 102 may determine that a user earned 25 activity points while walking, 75 activity points while walking, and 150 activity points while sprinting, for a total of 250 activity points. Computer 102 may also determine a caloric burn rate for each of the categories instead of or in addition to determining activity points,
- the computer 102 may also display performance metric data based on measurements of a user's hustle and tempo.
- FIG. 19 illustrates example hustle displays 1902A-B and tempo displays 1904A-B in accordance with example embodiments.
- Hustle display 1902A may present a user's hustle over time during a session, as well as other performance metrics.
- computer 102 may track various performance metrics including a running total of jumps, sprints, fakes, and jump recovery (e.g., a shortest amount of time between consecutive jumps) during a session, and hustle may be a function of these metrics.
- With reference to hustle display 1902B computer 102 may divide hustle into three categories: low, medium and high. More or fewer categories of hustle may be defined.
- Hustle display 1902B may also present line 1906 indicating an average hustle level over a session.
- Tempo may be based on a rate of steps taken by a user per interval of time (e.g., steps per minute).
- the categories may be defined by ranges of step rates. For example, walking may be defined as one to 30 steps per minute, jogging may be 31 -50 steps per minute, running may be defined as 51 -70 steps per minute, and sprinting may be defined as 71 or more steps per minute.
- computer 102 may indicate how often a user was in each categor during a session.
- Tempo display 1904B may indicate what percentage of the time a user was in each category (e.g., 12% sprinting). Tempo display 1904 may also indicate a user's quickest number of steps per second (e.g., 4.1 steps/second) or any other time interval, a total number of steps, a total number of sprints, etc.
- FIG. 20 illustrates an example activity points display of a GUI informing a user of points earned during a session in accordance with example embodiments.
- the computer 102 may process data taken during a workout session to award points to a user.
- the points may track a user's activity across different sports and workout sessions.
- the points display 2002 A-B may permit the user to determine points earned by date range, workout session, or other ranges.
- the computer 102 may also track user defined movement.
- FIG. 21 illustrates example freestyle displays of a GUI providing information on freestyle user movement in accordance with example embodiments.
- computer 102 may prompt the user to start a movement for tracking. The user may perform any desired type of movement, denoted hereafter as "freestyle" movement.
- freestyle display 2102B computer 102 may display a user's vertical leap, airtime, and foot used for a jump during the freestyle movement. Freestyle display 2102B may display performance metrics deemed relevant by the system 100, by the user, or both.
- performance metrics could be the vertical leap, airtime, foot, as shown in display 2102B, could be the weight distribution shown in display 2102C, or both with the user cycling through.
- computer 102 may display a weight distribution measured by distributed sensor 306. The user may also review weight distributions over time to determine how the user's weight distribution may have affected a user's availability to move or leap. A user may, for example, slide their finger across display to move between displays 2102A-C.
- computer 102 may assist a user in improving their athletic skills.
- FIG. 22 illustrates example training displays 2202A-B presenting user-selectable training sessions in accordance with example embodiments.
- the training sessions may guide the user throug a set of movements designed to improve a user's athletic ability.
- Example training sessions may include a shooting practice, an all around the world game, a buzzer beater game, a pro-player game, a basic game, an air time game, a continuous crossover game, a free throw balance game, a signature moves game, a pro battles game, and a horse game. These training sessions are further described in FIGs. 23-26.
- computer 102 may have a touchscreen permitting a user to scroll between and select the training sessions shown in FIGs. 23-26.
- FIGs. 27-30 illustrate display screens for GUIs for a basketball shooting training session in accordance with example embodiments.
- training display 2702 may present the user with information on their last session (e.g., shooting percentage for free throws, three pointers, and jump shots) and prompt the user to begin a new session.
- the computer 102 may monitor touches on a pressure sensitive display screen to track makes and misses. To do so, the computer 102 may monitor how many fingers were used to distinguish between basketball shots. For example, three fingers may be used to indicate a three point shot in basketball, two fingers may be used to indicate a two point shot, and a single finger may be used to indicate a free throw, as seen in FIG. 28.
- a tap of one or more fingers on the display screen may indicate a made shot, and a swipe of one or more fingers across a portion of the display screen may indicate a miss.
- a down swipe across a display screen of computer 102 with one or more fingers may indicate a make and an up swipe with one or more fingers may indicate a miss,
- the computer 102 may process the user input to determine a number of fingers used as well as between a tap and a swipe.
- the computer 102 may determine an amount of area of the display screen covered by the fingers when tapping and/or swiping the display screen to distinguish between one, two, or three fingers.
- the computer 102 may also determine duration of the touch and if a region of the display screen initially contacted by the user differs from a region of the display screen at the end of the touch to distinguish between a tap and a swipe.
- the training display 2702 may display information on makes and misses to the user, as seen in FIG. 29.
- the training display 2702 may display makes/misses by shot type as well as totals for all shot types.
- training display 2702A may display makes and misses for free throws
- training display 2702B may display makes and misses for jump shots.
- Training display 2702B may aggregate 2 and 3 2 - point basketball shots and may display makes and misses together, or separate displays may present makes and misses for each type of shot.
- FIG. 30 illustrates example displays for a GUI providing the user with information on a shooting practice session in accordance with example embodiments.
- Shot summary display 3002A may permit the user to select all shots or a particular shot type to receive information on percentage of shots made (e.g., 55.6%), a streak of how many shots were made consecutively, and the user's vertical leap "sweet spot" for the makes.
- the sweet spot may indicate a vertical leap where a user's shooting percentage (e.g., percentage of made shots) exceeds a predetermined amount (e.g., 50%).
- the computer 102 may process data from the pod sensor 304 and/or from distributed sensor 306 to provide the user information about their makes and misses via the GUI.
- Shot summary display 3002B may inform the user which foot was used when jumping as part of a shot along with a height of a vertical leap, and whether a shot was made or missed.
- Shot summary display 3002C may provide the user with information about three point shots made and missed.
- the shot summary display 3002 may provide the user with statistic information as to how their balance affects their shots by indicating how many balanced shots were made and how many off-balanced shots were made.
- the computer 102 may determine balance based on weight distribu tion measured by distribu ted sensor 306 while a user took a shot. If weight is relatively evenly distributed between a user's two feet (i.e., within a certain threshold), the computer 102 may identity a shot as being balanced. When weight is not relatively evenly distributed between a user's two feet (i.e., outside of a certain threshold), the computer 102 may identify a shot as being unbalanced.
- the shot summary display 3002C may also provide a user with feedback about their balance and tips to correct any issues with unbalanced weight distribution. For example, field 3004 may indicate how many shots were made when a user's weight was balanced and field 3006 may indicate how many shots were made when a user's weight was off-balance.
- computer 102 may receive and process data generated by a force sensor to determine a weight distribution during a performance of an exercise task (e.g., shooting a jump shot in basketball).
- Computer 102 may process user input indicating successful completion of an exercise task (e.g., a make).
- Computer 102 may associate a detected weight distribution at a time preceding the user input indicating successful completion of the exercise task.
- computer 102 may process sensor data to identify movement consistent with a basketball shot, and determine a weight distribution starting with detecting lift-off when a user j umps during a jump shot, a period of time prior to lift-off, landing, and a period of time after landing.
- Computer 102 may monitor weight distribution for these periods of time.
- computer 102 may process additional user input indicating unsuccessful completion of the exercise task (e.g., a miss).
- Computer 102 may associate a detected weight distribution at a time preceding the user input with the unsuccessful completion of the exercise task.
- computer 102 may present to the user information about their weight distribution and about how the distribution has affected the user's ability to complete the exercise task.
- FIG. 31 illustrates an example display of a GUI informing the user of shooting milestones in accordance with example embodiments.
- Milestone display 3102 may inform the user of one or more shot thresholds and how many shots a user has made. For example, milestone display 3102 may indicate that a user has made 108 shots, such that the user has reached amateur status, and needs to make an additional 392 shots to achieve the next status level.
- computer 102 may prompt the user to perform moves similar to the ones used by professional athletes.
- FIG. 32 illustrates example signature moves displays for a GUI prompting a user to perform a drill to imitate a professional athlete's signature move in accordance with example embodiments.
- users may create and share signatures moves with other users.
- a user may input a search query into signature moves display 3202 A to initiate a search for a desired professional athlete.
- the computer 102 may forward the search query to the server 134, which may reply with query results.
- the server 134 may also provide the computer 102 with suggested signature moves for display prior to a user inputting a search query.
- signature moves display 3202A computer 102 may display different signature moves for user selection.
- signature moves display 3202B may present video of the signature move and provide the professional's performance metrics for the move.
- the computer 102 may, for instance, query the server 134 for signature move data in response to the user's selection to generate signature moves display 3202B.
- the signature move data may include data from pod sensor 304 and distributed sensor 306 of a professional athlete performing a signature move. The user may attempt to imitate the signature move and the computer 102 may process the user data to indicate the accuracy of the imitation.
- the computer 102 may inform the user how well they successfully imitated the move. To identify a match, the computer 102 may compare data obtained from pod sensor 304 and/or distributed sensor 306 with the signature move data to determine if the two are similar. The computer 102 may monitor how long a user took to complete the signature move, a vertical leap of the user, airtime of the user, tempo of the user, or other information and compare this data to corresponding data from the professional athlete. The computer 102 may also indicate how accurately the user imitated the signature move of the professional athlete, as shown in signature moves display 3202C. Accuracy may be based on a combination of how similar each of the performance metrics is to the professional's.
- the computer 102 may weight certain metrics more highly than others, or may weight each metric equally.
- the signature move data may provide information on three different metrics, and may compare the user's data to each of the three metrics.
- the computer 102 may determine a ratio of the user's performance metric to the professional's metric and may identify a match if the ratio is above a threshold (e.g., more than 80%). Accuracy also may be determined in other manners.
- computer 102 may receive signature move data corresponding to acceleration and force measurement data measured by a first user (e.g., a professional athlete) performing a sequence of exercise tasks (e.g., cuts in basketball followed by a dunk).
- Computer 102 may receive and process user data generated by at least one of sensors 304 and 306 by monitoring a second user attempting to perform the same sequence of exercise tasks.
- Computer 102 may then generate a similarity metric indicating how similar the user data is to the signature move data,
- Computer 102 may also provide the user with data on performance metrics from other users and/or professional athletes for comparison as part of a social network.
- FIG. 33 illustrates example displays of a GUI for searching for other users and/or professional athletes for comparison of performance metrics in accordance with example embodiments.
- Computer 102 may communicate with the server 134 to identify professional athletes or friends of the user, as seen in display 3302A. Each individual may be associated with a unique identifier. For example, the user may select to add a friend or a professional, as seen in the GUI display on the left.
- the user may input a search query into the computer 102 for communication to the server 134, which may respond with people and/or professional athletes matching the search query, as seen in display 3302B.
- the user may establish a user profile to identify their friends and/or favorite professional athletes so that the computer 102 may automatically load these individuals, as seen in display 3302C.
- Computer 102 may present data for sharing with friends and/or posted to a social networking website, in FIG. 34, for example, display 3402A provides information for sharing, including points, top vertical, total airtime, and top tempo.
- Display 3402B for instance, provides a side by side comparison of performance metrics of a user and an identified friend.
- the server 134 may store performance metric data on each user and may communicate the data with computer 102 of the other user upon request.
- FIG. 35 illustrates example displays for comparing a user's performance metrics to other individuals in accordance wit example embodiments.
- display 3502A may provide a leader board for comparison of a user's performance metric to friends, selected professional athletes, or all other users including professional athletes.
- Example leader boards may be for a top vertical, a top tempo, a total airtime, total games played, total awards won, or for other performance metrics.
- Display 3502B permits a user to view individuals whose performance metrics indicate they are in and are not in a performance zone (e.g., dunk zone).
- Computer 102 may also permit the user to compare their performance metrics to a particular group (e.g., friends) or to all users.
- FIG. 36 illustrates a flow diagram of an example method for determining whether physical data obtained monitoring a user performing a physical activity is within a performance zone in accordance with example embodiments.
- the method of FIG. 36 may be implemented by a computer, such as, for example, the computer 102, server 134, a distributed computing system, a cloud computer, other apparatus, and combinations thereof.
- the order of the steps shown in FIG. 36 may also be rearranged, additional steps may be included, some steps may be removed, and some steps may be repeated one or more times.
- the method may begin at block 3602.
- the method may include processing input specifying a user attribute.
- computer 102 may prompt the user to input on one or more user attributes.
- Example user attributes may include height, weight, arm length, torso length, leg length, wing span, etc.
- user may specify their body length. Body length may be a measurement of how high a user can reach one of their hands while keeping the opposite foot on the floor.
- the method may include adjusting a performance zone based on the user attribute.
- computer 102 may adjust a performance zone relating to how high a user must jump to dunk a basketball based on one or more of user height, arm length, torso length, and leg length. For taller users, the performance zone may specify a lower minimum jump height to dunk a basketball as compared with a minimum jump height required for a smaller user to dunk or reach a basketball rim.
- the method may include receiving data generated by a sensor.
- computer 102 may receive data from at least one of sensor 304 and 306 during an exercise session in which the user performs one or more jumps.
- the data may be raw signals or may be data processed by the sensors prior to sending to computer 102.
- the method may include determining whether the data is within the performance zone, in an example, computer 102 may process data received from at least one of sensor 206 and 304 to determine if any jump performed by the user met or exceeded the minimum j ump height of the performance zone tailored to the user's attributes. For example, computer 102 may determine that a minimum vertical leap of 30 inches would be required for a user to dunk a basketball, based on the user attributes. Computer 102 may process data received from at least one of sensor 304 and 306 to determine whether any jump performed by the user met or exceeded 30 inches.
- computer 102 may process data generated by at least one of an accelerometer and a force sensor, and comparing the data to jump data to determine that the data is consistent with a jump (e.g., that a user sitting on a chair didn't merely lift their feet off of the ground for a predetermined amount of time).
- Computer 102 may, in response to the comparing, process data generated by at least one of an accelerometer and a force sensor to determine a lift off time, a landing time, and a loft time.
- Computer 102 may calculate vertical leap based on the loft time.
- the method may include outputting the determination.
- computer 102 may output the determination of whether the user was within the performance zone.
- the output may be at least one of audible and visual.
- Computer 102 may provide the output immediately upon detecting the user is within the performance zone, or may output the determination at some later time (e.g., post workout). The method may then end, or may return to any of the preceding steps.
- FIG. 37 il lustrates a system that may be used to promote the sale of products that have embedded or attached sensors in accordance with an embodiment of the invention.
- Products 3702a, 3702b and 3702c may be implemented with footwear, jackets, shorts or other articles of clothing.
- Products 3702a, 3702b and 3702c have embedded or attached sensors 3704a,
- sensors 3704a, 3704b and 3704c may be implemented with any of the sensors described above or combinations of the sensors, in one exemplaiy embodiment, products 3702a, 3702b and 3702c are footwear and sensors 3704a, 3704b and 3704c are force-sensitive resistor (FSR) sensors 206, shown in FIG. 3 A.
- Performance data generated by sensors 3704a, 3704b and 3704c may be transmitted to performance applications 3706a, 3706b and 3706c hosted on computing units 3708a, 3708b and 3708c, respectively.
- Applications 3706a, 3706b and 3706c may be configured to convert performance data into performance metrics.
- Exemplaiy performance metrics include vertical leap height, air time and activity points.
- a synchron zat on and scoring application 3710 may be configured to receive data from performance applications 3706a, 3706b and 3706c and generate a leaderboard.
- the leaderboard may be displayed on one or more large display- screens 3712.
- Computing units 3708a, 3708b and 3708c may be connected via a local area network 3714.
- Local area network 3714 may be connected to a wide area network 3716.
- Some embodiments may use a control computer 3720 to control the gathering of data and generation of a leaderboard.
- computing units 3708a, 3708b and 3708c may be configured to transmit and receive data.
- a central database 3722 may also be used to store performance data and/or performance metrics in a central location. Alternatively, performance data and/or performance metrics may be stored at computing units 3708a, 3708b and 3708c.
- the system shown in FIG 37 may be used to encourage potential customers to try products and compete with one another.
- the results of the competition may be displayed on display screen 3712, which may be located in close proximity to displayed products 3718. This configuration allows customers to view the status or results of a competition that utilizes the products while the customers are also examining the products.
- FIG. 38 illustrates a method 3800 that may be used to promote the sale of products that have embedded or attached sensors in accordance with an embodiment of the inventions.
- a user is prompted to perform physical activities while using footwear offered for sale at a store.
- the footwear may include one or more attached or embedded sensors.
- Performance application 3706 may prompt the user to perform physical activities by display instructions or examples on a display of computing unit 3708.
- Performance data is received at a computing unit and from at least one sensor embedded in the footwear in block 3804.
- the performance data may be received via a wireless connection, such as Bluetooth connection.
- a processor may determine performance metrics in block 3806.
- the processor may be part of computing unit 3708.
- Block 3806 may include converting data received from sensors to performance metrics such as vertical leap height, air time, activity points and a number of repetitions during a predetermined time period.
- a processor may determine an activity score from the performance metric.
- An activity score may show how the user ranks among a large number of other users. For example, the activity may correspond to a percentile ranking.
- a leaderboard may be generated based on activity scores for multiple users performing the physical activities while using footwear offered for sale at the store.
- Block 3810 may include converting percentile scores to rankings among the users in a store who are currently participating in the physical activities or who have recently participated in the physical activities. For example, three users may perform the physical activities and rank in the 95 th , 63 ld and 21 st percentiles.
- Block 3810 may convert this data to 1 st , 2 nd and 3 ra place to display on a leaderboard.
- the leaderboard may be displayed on a display viewable in the store in proximity to a display of the footwear offered for sale.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Physics & Mathematics (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Physiology (AREA)
- Cardiology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physical Education & Sports Medicine (AREA)
- Pulmonology (AREA)
- Radiology & Medical Imaging (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- User Interface Of Digital Computer (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/538,832 US20130024248A1 (en) | 2011-02-17 | 2012-06-29 | Retail Training Application |
PCT/US2013/048157 WO2014004813A1 (en) | 2012-06-29 | 2013-06-27 | Retail training application |
Publications (1)
Publication Number | Publication Date |
---|---|
EP2867809A1 true EP2867809A1 (en) | 2015-05-06 |
Family
ID=48875158
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13741903.2A Withdrawn EP2867809A1 (en) | 2012-06-29 | 2013-06-27 | Retail training application |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP2867809A1 (zh) |
JP (1) | JP6059804B2 (zh) |
KR (1) | KR20150036180A (zh) |
CN (2) | CN109065123A (zh) |
WO (1) | WO2014004813A1 (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101877114B1 (ko) * | 2016-05-12 | 2018-07-10 | 전자부품연구원 | 패시브 센싱을 이용한 사용자 행동 인식 방법 및 장치 |
EP3332697B1 (fr) * | 2016-12-12 | 2019-08-14 | The Swatch Group Research and Development Ltd | Procédé de détection et de calcul de durée d'un saut |
JP7071018B1 (ja) | 2021-02-16 | 2022-05-18 | Necプラットフォームズ株式会社 | 評価装置、方法及びプログラム |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09506978A (ja) * | 1993-08-24 | 1997-07-08 | ジョン イースターブルック,ノーマン | 生徒の教育のための装置 |
JP2001523140A (ja) * | 1997-05-08 | 2001-11-20 | リアル ヴィジョン コーポレイション | 対話的運動パッドシステム |
US7171331B2 (en) * | 2001-12-17 | 2007-01-30 | Phatrat Technology, Llc | Shoes employing monitoring devices, and associated methods |
US20030054327A1 (en) * | 2001-09-20 | 2003-03-20 | Evensen Mark H. | Repetitive motion feedback system and method of practicing a repetitive motion |
US8206219B2 (en) | 2002-10-30 | 2012-06-26 | Nike, Inc. | Interactive gaming apparel for interactive gaming |
US8740751B2 (en) * | 2005-07-25 | 2014-06-03 | Nike, Inc. | Interfaces and systems for displaying athletic performance information on electronic devices |
JP4622745B2 (ja) * | 2005-08-26 | 2011-02-02 | ソニー株式会社 | 情報交換装置 |
US7579946B2 (en) * | 2006-04-20 | 2009-08-25 | Nike, Inc. | Footwear products including data transmission capabilities |
JP4305671B2 (ja) * | 2006-08-22 | 2009-07-29 | ソニー株式会社 | 健康運動支援システム、携帯型音楽再生装置、サービス情報提供装置、情報処理装置、健康運動支援方法 |
US8892999B2 (en) * | 2007-11-30 | 2014-11-18 | Nike, Inc. | Interactive avatar for social network services |
JP2011508615A (ja) * | 2007-12-07 | 2011-03-17 | ナイキ インコーポレーティッド | カーディオバスキュラーマイル |
WO2009126818A2 (en) * | 2008-04-09 | 2009-10-15 | Nike International, Ltd. | System and method for athletic performance race |
WO2009152456A2 (en) | 2008-06-13 | 2009-12-17 | Nike, Inc. | Footwear having sensor system |
US20100184564A1 (en) * | 2008-12-05 | 2010-07-22 | Nike, Inc. | Athletic Performance Monitoring Systems and Methods in a Team Sports Environment |
AU2010229693B2 (en) * | 2009-03-27 | 2014-04-03 | Russell Brands, Llc | Monitoring of physical training events |
US20110136627A1 (en) * | 2009-12-03 | 2011-06-09 | Williams Michael C | Exercise derived currency for exchange or grading |
CN102218214A (zh) * | 2010-04-13 | 2011-10-19 | 上海薄荷信息科技有限公司 | 一种捕捉运动信息的装置及相应的*** |
CN103282907A (zh) * | 2010-11-05 | 2013-09-04 | 耐克国际有限公司 | 自动个人训练的方法和*** |
-
2013
- 2013-06-27 CN CN201811024462.1A patent/CN109065123A/zh active Pending
- 2013-06-27 CN CN201380042275.5A patent/CN104520863B/zh active Active
- 2013-06-27 KR KR20157001914A patent/KR20150036180A/ko active Search and Examination
- 2013-06-27 JP JP2015520497A patent/JP6059804B2/ja active Active
- 2013-06-27 EP EP13741903.2A patent/EP2867809A1/en not_active Withdrawn
- 2013-06-27 WO PCT/US2013/048157 patent/WO2014004813A1/en active Application Filing
Non-Patent Citations (2)
Title |
---|
None * |
See also references of WO2014004813A1 * |
Also Published As
Publication number | Publication date |
---|---|
CN104520863B (zh) | 2018-10-09 |
WO2014004813A1 (en) | 2014-01-03 |
CN109065123A (zh) | 2018-12-21 |
JP6059804B2 (ja) | 2017-01-11 |
CN104520863A (zh) | 2015-04-15 |
JP2015531904A (ja) | 2015-11-05 |
KR20150036180A (ko) | 2015-04-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US12046347B2 (en) | Selecting and correlating physical activity data with image data | |
US9381420B2 (en) | Workout user experience | |
US20130245966A1 (en) | User experience | |
US20130002533A1 (en) | User experience | |
US20130024248A1 (en) | Retail Training Application | |
EP2867809A1 (en) | Retail training application | |
EP3005193A1 (en) | Skateboard system | |
WO2013126655A1 (en) | User activity performance monitoring and displaying | |
WO2013126404A1 (en) | Workout user experience |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20141230 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20180507 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
18W | Application withdrawn |
Effective date: 20180829 |