System and method for measuring and displaying athletic activities based on time
The system tracks and displays timeline-based athletic metrics, addressing the challenge of isolating specific performance moments by allowing continuous recording and editing, thereby improving user analysis and engagement.
Patent Information
- Application Number
- JP2023186132
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2010-11-10
- Filing Date
- 2023-10-31
- Publication Date
- 2025-07-30
- Estimated Expiration
- 2031-11-10
AI Technical Summary
Athletic performance information is typically presented in isolation or based on the entire activity, making it difficult for users to identify specific moments or periods during a workout when particular metrics or performance statistics were achieved.
A system and method for tracking timeline-based athletic activity metrics, allowing continuous or defined timeline recordings with multiple values associated with specific times, enabling users to display and edit metrics during or after the activity session, and share or compare performance data.
Enables users to analyze instantaneous and specific metric values at particular points in time, facilitating detailed review and comparison of athletic performance, enhancing user engagement and data utilization.
Smart Images

Figure 0007715783000001 
Figure 0007715783000002 
Figure 0007715783000003
Abstract
Description
[Technical Field]
[0001] The present invention relates generally to recording and visualization of athletic activities. In particular, aspects described herein relate to time-based recording and review of athletic activities and associated time-specific metrics. [Background technology]
[0002] Exercise and fitness are becoming increasingly popular, and the benefits of such activities are well known. Fitness and other athletic activities incorporate various types of technology. For example, fitness activities can utilize a wide variety of portable electronic devices, such as MP3 or other audio players, radios, portable televisions, DVD players and other video playback devices, watches, GPS systems, pedometers, cell phones, pagers, beepers, and the like. Many fitness enthusiasts or athletes use one or more of these devices when exercising or training, for example, for entertainment, to provide performance data, or to interact with others. Such users have also expressed an interest in tracking their athletic activities and associated metrics. Accordingly, various sensors may be used to detect, store, and / or transmit athletic performance information. Summary of the Invention [Problem to be solved by the invention]
[0003] However, in many cases, athletic performance information is presented in isolation or based on the entire athletic activity. Athletic performance data is not readily available for a specific period or moment during an athletic activity session. Thus, a user may not be able to identify a specific time or period within a workout or other athletic activity when a particular metric or performance statistic was achieved.
[0004] A detailed description of the features and advantages of the present invention will be made in the following description with reference to the accompanying drawings.
[0005] The following description is an overview of aspects of the present invention and provides an understanding of at least some of those aspects. This overview is not an exhaustive overview of the present invention. It is not intended to identify key or essential elements of the present invention or to define the scope of the present invention. The following overview presents some concepts of the present invention in a general form as a prelude to the detailed description that follows.
Means for Solving the Problems
[0006] According to one or more aspects of the present invention, a system and method for tracking timeline-based athletic activity metrics are described. The metrics may be recorded continuously or based on a defined timeline. In either case, multiple values may be recorded for the same metric and associated with the specific time at which the value was detected. For example, athletic performance data may be detected and recorded every minimum time unit. The minimum time unit may correspond to 1 second, 2 seconds, 1 millisecond, 10 seconds, etc. By using such time-based recordings, a user can consider instantaneous and specific metric values to determine how the user was moving at a particular point in time during the performance of the athletic activity.
[0007] According to another aspect, a user can simultaneously display multiple metrics on an interface during a review of an athletic activity session. For example, the user can display a video with an overlay of one or more desired metrics within a primary visualization area. In addition to or instead of this, a toolbar may be displayed to provide other metrics not currently displayed within the primary visualization area.
[0008] According to yet another aspect, a plurality of metrics may be recorded using a plurality of different applications or widgets. The user may select the metrics and / or widgets to use before or at the start of the athletic activity session. The user may also modify the selected metrics or applications during the session recording.
[0009] According to yet another aspect, the user may edit the collected data either before or after the metrics and other data are stored in a single athletic activity session file of an electronic content item (e.g., high-performance video). For example, the user may remove a metric from the athletic activity session file even if the metric has already been recorded. In addition to or instead of this, the user may be able to clip the video or other metrics at a desired time (e.g., a time shorter than the total duration of the athletic activity session).
[0010] Other aspects and features are described throughout the disclosure.
Brief Description of the Drawings
[0011] Next, for the purpose of understanding the present invention, it will be described by way of example with reference to the following accompanying drawings.
Figure 1
Figure 2
Figure 3A
Figure 3B
Figure 3C
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16A
Figure 16B
Figure 17A
Figure 17B
Figure 17C
Figure 17D
Figure 18A
Figure 18B
Figure 19
Figure 20
Figure 21
Best Mode for Carrying Out the Invention
[0012] In the following description of examples of various embodiments of the present invention, the accompanying drawings are referred to. These reference drawings form part of the present invention and illustrate, by way of example, various devices, systems, and environments in which aspects of the present invention can be implemented. It should be understood that other specific component, device, system, and environment configurations are available and that structural and functional changes are possible without departing from the scope of the present invention. Also, in this specification, terms such as "upper", "lower", "front", "rear", "side", etc. are used to describe various exemplary features and elements of the present invention. These terms are used herein for convenience based on, for example, the exemplary directions shown in the figures. The description in the specification is not to be construed as requiring a specific three-dimensional direction of the structure within the scope of the invention.
[0013] Various examples of the present invention can be implemented using electronic circuits configured to perform one or more functions. For example, in some embodiments of the present invention, an athletic information monitoring device, a collection device, a display device, or any combination thereof can be implemented using one or more application-specific integrated circuits (ASICs). However, more typically, examples of various components of the present invention are implemented using a programmable computing processing device that executes firmware or software instructions, or by some combination of a dedicated electronic circuit and firmware or software instructions executed on a programmable computing processing device.
[0014] (Examples of Hardware Devices) FIG. 1 shows an example of a computer 101 capable of implementing various embodiments of the present invention. As can be seen in this figure, the computer 101 has a computing unit 103. The computing unit 103 typically includes a processor unit 105 and a system memory 107. The processor unit 105 can be any type of processing device that executes software instructions, and is conventionally a microprocessor device. The system memory 107 can include both a read-only memory (ROM) 109 and a random access memory (RAM) 111. As will be understood by those skilled in the art, both the read-only memory (ROM) 109 and the random access memory (RAM) 111 can store software instructions for execution by the processor unit 105.
[0015] The processor unit 105 and the system memory 107 are connected, directly or indirectly, via a bus 113 or an alternative communication structure to one or more peripheral devices. For example, the processor unit 105 or the system memory 107 may be connected, directly or indirectly, to additional memory storage devices such as a hard disk drive 117, a removable magnetic disk drive 119, an optical disk drive, a flash memory card, etc. Also, the processor unit 105 and the system memory 107 may be connected, directly or indirectly, to one or more input devices 121 and one or more output devices 123. Examples of the input device 121 include a keyboard, a touch screen, a remote control pad, a pointing device (such as a mouse, a touch pad, a stylus, a trackball, a joystick, etc.), a scanner, a camera, or a microphone. Examples of the output device 123 include a monitor display device, a television, a printer, a stereo, or a speaker.
[0016] Furthermore, computing unit 103 is directly or indirectly connected to one or more network interfaces 115 for communicating with a network. This type of network interface 115 is sometimes referred to as a network adapter or network interface card (NIC), and it converts data and control signals from computing unit 103 into network messages compliant with one or more communication protocols such as Transmission Control Protocol (TCP), Internet Protocol (IP), User Datagram Protocol (UDP), etc. Since these protocols are well-known in the art, detailed descriptions thereof are omitted. Interface 115 may use, for example, any connection agent suitable for connecting to a network including a wireless transceiver, a power line adapter, a modem, or an Ethernet connection.
[0017] It should be understood that in addition to the input, output, and storage peripheral devices specifically described above, the computing processing device may be connected to various other peripheral devices including those capable of performing input, output, and storage functions, or combinations thereof. For example, computer 101 may be connected to a digital music player such as an IPOD (registered trademark) available from Apple, Inc. of Cupertino, California. This type of digital music player can act as both an output device for a computer (e.g., outputting music from an audio file or photos from an image file) and a storage device, as is known in the art. Furthermore, this type of digital music player can also act as an input device for inputting recorded athletic information, as will be described in more detail later.
[0018] In addition to the digital music player, computer 101 may be connected to one or more other peripheral devices, such as a telephone, or may otherwise include such devices. The telephone may be, for example, a wireless "smartphone". As is known in the art, this type of telephone communicates via a wireless network using radio frequency transmission. A "smartphone" can provide a user with one or more data management functions, such as sending, receiving, or displaying electronic messages (e.g., email messages, SMS text messages, etc.), recording or playing audio files, recording or playing image files (e.g., still or video files), and displaying and editing files containing text (e.g., Microsoft Word or Excel files, or Adobe Acrobat files), in addition to its basic communication function. With the data management functions of this type of telephone, a user may connect the telephone to computer 101 so that its maintenance data is synchronized.
[0019] Of course, as is well known in the art, computer 101 of the type shown in FIG. 1 may include other peripheral devices connected thereto in other ways. In some cases, the peripheral devices may be connected to computing unit 103 permanently or semi-permanently. For example, in many computers, computing unit 103, hard disk drive 117, removable optical disk drive 119, and the display device are semi-permanently housed within a single housing. However, further, other peripheral devices may be removably connected to computer 101. Computer 101 includes, for example, one or more communication ports for connecting the peripheral devices to computing unit 103 (either directly or indirectly via bus 113). Thus, these communication ports may include parallel bus ports or serial bus ports, such as serial bus ports using the Universal Serial Bus (USB) standard or the IEEE 1394 high-speed serial bus standard (e.g., Firewire ports). Alternatively or in addition, computer 101 may include wireless data “ports” such as a Bluetooth interface, a Wi-Fi interface, an infrared data port, etc.
[0020] It should be understood that the computing devices used in various examples of the present invention can include more components than computer 101 shown in FIG. 1, fewer components than computer 101, or a combination of components different from those of a computer. Some embodiments of the present invention may use one or more computing devices designed to have very specific functions, such as, for example, a digital music player or a server computer. Thus, these computing devices may omit unnecessary peripheral devices such as network interface 115, removable optical disk drive 119, printer, scanner, external hard disk, etc. Some embodiments of the present invention may, instead of or in addition to this, use computing devices intended to be able to perform a variety of functions, such as a desktop or laptop personal computer. These computing devices may, as required, have any combination of peripheral devices or additional components.
[0021] Figure 2 shows an example of an athletic information monitor device 201 that can be used in various examples of the present invention to measure athletic information corresponding to a user's athletic activity. As shown in this figure, the athletic information monitor device 201 includes a digital music player 203, an electronic interface device 205, and an athletic parameter measurement device 207. As will be described in more detail, in one embodiment, the digital music player 203 may be (removably) connected to the electronic interface device 205. While the user is engaged in an athletic activity such as running or walking, the combination of the digital music player 203 and the electronic interface device 205 is worn by the user or carried in some other way. While the user is engaged in an athletic activity, the athletic parameter measurement device 207 is worn or carried by the user and measures one or more athletic parameters related to the athletic performance being performed by the user. The athletic parameter measurement device 207 transmits a signal corresponding to the measured athletic parameter to the electronic interface device 205. The electronic interface device 205 receives the signal from the athletic parameter measurement device 207 and provides the received information to the digital music player 203. Note that if the digital music player 203 or other electronic devices can directly interface with the measurement device 207, there is no need to use the electronic interface device 205. For example, the athletic parameter measurement device 207 is configured to communicate using the Bluetooth wireless communication protocol and as a result can be used with a Bluetooth mobile phone, a portable information terminal, a watch, or a personal computer.
[0022] As shown in more detail in FIG. 3A, the athletic parameter measuring device 207 includes one or more sensors 301 for measuring athletic parameters related to a person wearing the athletic parameter measuring device 207 or using it in some other way. In the illustrated embodiment, for example, sensors 301A and 301B are accelerometers (such as piezoelectric accelerometers) for measuring the acceleration of the athletic parameter measuring device 207 in two perpendicular directions. The athletic parameter measuring device 207 is carried by the user or worn in some other way in order to measure the desired athletic parameters while the user is exercising. For example, as shown in FIG. 3B, the athletic parameter measuring device 207 may be disposed on the sole of the user's shoe 401 while the user is walking or running. With this configuration, the sensors 301 generate electrical signals corresponding to the movement of the user's feet. As is known in the art, these signals can be used to generate athletic data representing the athletic activities performed by the user.
[0023] The athletic parameter measuring device 207 also includes a processor 303 for processing the electrical signals output from the sensors 301. In an embodiment of the present invention, the processor 303 is a programmable microprocessor. However, in still other embodiments of the present invention, the processor 303 may be a dedicated circuit device such as an ASIC. The processor 303 may perform desired processing on the signals output from the sensors 301, such as curve smoothing, noise filtering, outlier removal, amplification, addition, integration, and the like. The processor 303 provides the processed signals to the transmitter 307. The athletic parameter measuring device 207 also includes a power source 307 for supplying power to the sensors 301, the processor 303, and the transmitter 305 as needed. The power source 307 is, for example, a battery.
[0024] As shown in Figure 3B, the athletic parameter measuring device 207 transmits the processed signal to the electronic interface device 205. Returning to Figure 3A, the electronic interface device 205 includes a receiver 309 that receives the processed signal sent by the transmitter 305 within the athletic parameter measuring device 207. The receiver 309 relays the processed signal to the second processor 311, and the second processor 311 further processes the signal. Similar to the processor 303, the processor 311 may perform desired processing such as curve smoothing, noise filtering, outlier removal, amplification, addition, and integration on the processed signal.
[0025] The processor 303 provides the processed signal to the digital music player 203. Referring back to Figure 2, the electronic interface device 205 has a connector system 209 that is physically plugged into or connected to the conventional input port 211 provided to the digital music player 203. The input port 211 to which the connector system 209 of the electronic interface device 205 is connected can be any desired type of input port for transferring data such as a parallel data port, a serial data port, an earphone, a microphone terminal, etc. The connector system 209 may include any suitable connection devices such as wires, pins, electrical connectors, etc. to make an electrical connection or other appropriate connection with the corresponding element provided to the input port 211 of the digital music player 203 (for example, enabling electronic and / or data communication between the interface device 205 and the electronic interface device 205). Additional fixing elements such as straps, hooks, buckles, clips, clamps, fasteners, retaining elements, mechanical connectors, etc. may be provided to securely connect the interface device 205 to the digital music player 203 as required or demanded.
[0026] Next, returning to FIG. 3A, the processor 311 provides the processing signal to the computing unit 313. The computing unit 313 may first store the processing signal in the memory 315. Further, in some embodiments of the present invention, the computing unit 313 may process the processing signal provided by the athletic information monitor device 201 to generate a set of athletic data corresponding to the athletic activity performed by the user. For example, if the athletic information monitor device 201 includes an accelerometer for measuring the movement of the user's foot, the computing unit 313 may analyze the processing signal from the athletic information monitor device 201 to generate a set of athletic data representing the user's speed at a particular instant during the user's athletic activity and the total distance the user has moved at each of such particular instants.Various techniques for determining a user's velocity from an accelerometer signal are described, for example, in U.S. Patent No. 6,898,550, entitled "Monitoring Activity Of A User In Locomotion On Foot," issued May 24, 2005 and assigned to Blackadar et al.; U.S. Patent No. 6,882,955, entitled "Monitoring Activity Of A User In Locomotion On Foot," issued April 19, 2005 and assigned to Ohlenbusch et al.; U.S. Patent No. 6,876,947, entitled "Monitoring Activity Of A User In Locomotion On Foot," issued April 5, 2005 and assigned to Darley et al.; U.S. Patent No. 6,493,652, entitled "Monitoring Activity Of A User In Locomotion On Foot," issued December 10, 2002 and assigned to Ohlenbusch et al.; U.S. Patent No. 6,298,314, entitled "Detecting The Starting And Stopping Of Movement Of A Person On Foot," issued October 2, 2001 and assigned to Blackadar et al.; U.S. Patent No. 6,052,654, entitled "Measuring Foot Contact Time And Foot Loft Time Of A Person In Locomotion," issued April 18, 2000 and assigned to Gaudet et al.; and U.S. Patent No. 6,018,705, entitled "Measuring Foot Contact Time And Foot Loft Time Of A Person In Locomotion," issued January 25, 2000 and assigned to Gaudet et al., each of which is hereby incorporated by reference in its entirety.
[0027] The athletic dataset can also include time values associated with each speed value and / or each distance value. When the athletic information monitoring device 201 is used to collect athletic information from various users, the athletic data computing unit 313 can further prompt the user to identify himself in some way. Next, this identification information can be included together with the athletic dataset generated from the information provided by the athletic information monitoring device 201. After the computing unit 313 generates a set of athletic data from the information provided by the athletic information monitoring device 201, the computing unit 313 may store the athletic dataset in the memory 315. As will be described in more detail later, when the digital music player 203 is connected to a computing device that implements an athletic information collection tool, the computing unit 313 downloads the athletic data to a display configuration tool hosted on a remote computing device.
[0028] In the embodiments shown in FIGS. 2 to 3B, wireless communication between the athletic parameter measurement device 207 and the interface device 205 is described, but without departing from the present invention, a desired method including a wired connection for communicating between the athletic parameter measurement device 207 and the interface device 205 may be used. Also, without departing from the present invention, a desired method is provided for shaping or formatting data obtained from physical or physiological data from the athletic parameter measurement device 207 into a form or format suitable for display on or output from the electronic device 210.
[0029] Optionally, according to at least some examples of the present invention, the electronic interface device 205 may further include one or more rotary input devices, switches, buttons (such as those illustrated in FIG. 2), mouse or trackball elements, touch screens or the like, or a combination thereof, and / or a user input system 222. The display device 220 may be used, for example, to indicate information regarding the music played by the digital music player 203, information regarding the athletic information signal received by the digital music player 203, athletic data generated by the digital music player 203 from the received athletic information signal, and the like. The user input system 222 may be used, for example, to control one or more aspects of the processing of input data received via the interface device 205, control the reception of input data (such as timing, type of information received, on-demand data requests, etc.), control the data output to the electronic device 203, control the athletic parameter measurement device 207, and the like. In addition or alternatively, optionally, the input system of the digital music player 203 (such as buttons 222, touch screen, digitizer / stylus-type input, rotary input device, trackball or roll ball, mouse, etc.) may be used to provide user input data to the interface device 205 and / or the athletic parameter measurement device 207. As yet another example, optionally, the interface device 205 and / or the digital music player 203, etc. may include a voice input device to enable user input via voice commands. Without departing from the present invention, for the control of any system element and / or for any purpose, any other desired type of user input system may be provided.
[0030] The digital music player 203 may include additional input and / or output elements such as ports 224 and 226 shown in FIG. 2, for example, for headphones (or other audio output), power, wireless communication, infrared input, microphone input, or other devices. Optionally, and if these ports 224 and / or 226 are covered when the interface device 205 is attached to the electronic device 203, the interface device 205 may be equipped with external ports similar to ports 224 and / or 226. Inside the interface device 205, an internal circuit may be provided that allows a user to insert into the interface device 205 the same additional devices that the user inserts into the digital music player 203 and further utilize the same functions (e.g., thereby allowing necessary data, signals, power, and / or information to pass through the interface device 205 to the user, another output, and / or the digital music player 203).
[0031] Although some embodiments of the present invention described above relate to the digital music player 203, it should be understood that, as an alternative to the present invention, it can be implemented using any portable electronic device. For example, in some embodiments of the present invention, the athletic parameter measuring device 207 can be used with a mobile phone, a watch, a personal digital assistant, another type of music player (such as a compact disc or satellite radio music player), a portable computer, or any other desired electronic device.
[0032] Also, although an example of the athletic parameter measurement device 207 has been described for ease of understanding, it should be understood that any type of desired athletic parameter measurement device 207 can be used with various embodiments of the present invention. For example, in some embodiments of the present invention, the athletic parameter measurement device 207 may be a heart rate monitor, a blood oxygen monitor, a satellite positioning device (e.g., a Global Positioning System (GPS) navigation device), a device for measuring the electrical activity of the user (e.g., an EKG monitor), or other devices for measuring one or more physical parameters of the user. Further, the athletic parameter measurement device 207 may measure one or more operating parameters of a device operated by the user, such as the speed and / or distance of a bicycle, a treadmill, a rowing machine, an elliptical machine, the speed and / or work performed by an aerobike, the speed and / or distance traveled by skis (water or snow), skates (roller or ice), or snowshoes worn by the user. Other types of sensors include strain gauges, temperature sensors, heart rate monitors, and the like. In one or more configurations, the user may be equipped with multiple sensors, and in some examples, the same type of sensor may be equipped at multiple locations. For example, the user may wear shoes equipped with accelerometers, weight sensors, etc., so that the system can determine the individual movements and metrics of each foot or other body part (e.g., legs, hands, arms, individual fingers or toes, a person's feet or legs, waist, chest, shoulders, head, eye area). Examples of multi-sensor clothing for monitoring athletic activity and the use of multiple sensors are described in U.S. Patent Publication No. 2010 / 0063778 A1, entitled "FOOTWEAR HAVING SENSOR SYSTEM," U.S. Patent Application No. 12 / 483,824, and U.S. Patent Publication No. 2010 / 0063779 A1, entitled "FOOTWEAR HAVING SENSOR SYSTEM," U.S. Patent Application No. 12 / 483,828. The contents of the above-referenced applications are hereby incorporated by reference in their entirety into this specification.In a specific example, a sports player may wear one or more force detection systems that utilize, for example, a force-sensitive resistor (FSR) sensor. The shoe may include a plurality of FSR sensors that detect forces at various parts of the user's foot (e.g., heel, midsole, toe, etc.). This helps to determine the balance of the user's foot or the user's two feet. As an example of an embodiment, the FSR sensor array may adopt a form as shown in FIG. 3C.
[0033] Also, although the athletic parameter measurement device 207 is shown to be a device different from the digital music player 203 and other portable electronic devices that receive signals from the athletic parameter measurement device 207, in some embodiments of the present invention, the athletic parameter measurement device 207 may be incorporated into or integrated with the digital music player 203 and other portable electronic devices. For example, some embodiments of the present invention may use a music player, a mobile phone, a watch, or a personal digital assistant that incorporates an accelerometer, a satellite positioning device, or other desired devices for measuring athletic activities. Further, it should be understood that various embodiments of the present invention may use a plurality of athletic parameter measurement devices 207 incorporated into a digital music player 203, other portable electronic devices, or a combination thereof, that are different from the digital music player 203 and other portable electronic devices.
[0034] (Time-based data collection) Using an athletic performance monitoring system such as the digital music player 203 and the interface 205 in FIG. 2, athletic performance data measured by one or more external or internal sensors may be collected, edited, stored, and shared. This athletic performance data may be collected over the entire period during which the user is engaged in an activity. To provide data specificity and flexibility in data use, the monitoring system may collect data multiple times during an athletic activity. As an example, the monitoring system collects and stores athletic data every minimum time unit. For example, the minimum time unit corresponds to each second that the user is involved in an athletic activity. As another example, the monitoring system may collect and store athletic data, for example, every 0.5 seconds, 5 seconds, 10 seconds, 30 seconds, or 1 minute. Next, the collected data may be mapped, associated, and / or stored in other ways at the corresponding moment or time when the data was acquired. The minimum time unit may be defined by the user or the system, or may be defined based on the minimum time unit used to record the video or audio of the activity session. For example, if the video provides a playback subdivision at the level of half a second, the system may record performance data every half second. As another example, if the video is recorded at 30 frames per second, the system may record performance data (e.g., metrics) every 1 / 30 of a second to match each frame of the video.
[0035] Figure 4 shows a general process by which a user can collect user athletic performance data. For example, the user first obtains the desired metric data. For example, the user selects or otherwise specifies the type of metric that the user wants to record during an athletic activity session. As an example, the user selects a metric by selecting or deselecting an individual type of metric from a user interface. As another example, the user may select a metric by identifying a previously recorded athletic performance data set and indicating that the user wants to record the same metrics as the previous athletic performance data set. Examples of metric data include video, audio, speed, pace, reaction time, jump height, position (e.g., using a GPS sensor or cell triangulation), sweat rate, body temperature, distance traveled, weight lifted, strength, etc. After obtaining the data, the user can edit the data (e.g., by attempting to overcome one or more metrics of a previously recorded activity session), share the data, and motivate themselves and / or others.
[0036] Various types of metrics can be measured and recorded in relation to the time at which the metric was detected. FIG. 5 shows an exemplary user interface where a user can select various time-specific metrics to record. Even if not selected, other metrics related to the athletic activity may be recorded, but such other metrics may be recorded simply as the average for the entire training (rather than storing metric information at the same level of granularity as the selected metrics (e.g., 1 second, 2 seconds)). Thus, the selected metrics may be detected, recorded, and / or selected at a first level of granularity (e.g., first speed - every 1 second, 2 seconds, 30 seconds, 1 millisecond, etc.), and the unselected metrics may be detected, recorded, and / or stored at a second level of granularity (e.g., every 2 minutes, 10 minutes, 15 minutes). In this case, the first level of granularity is more than the second level of granularity. For some metrics that correspond to time (e.g., pace), the metric is recorded for a specific time period (e.g., 2 seconds) and associated with the time units of that period (e.g., a pace of 7.8 mi / hour over 2 seconds is recorded and associated with each second of those 2 seconds). Thus, other metrics may not be specific to any particular time during the training (or may not be recorded as being specific to it) (e.g., a time shorter than the overall training / activity duration, the smallest time unit, etc.). Each of the selectable metrics shown in FIG. 5 corresponds to an application or applet (e.g., widget) and can be recorded thereby. In one configuration, each metric widget or application may be configured to measure and record a particular set of one or more metrics along a timeline. For example, each metric widget or application may be specific to the corresponding metric configured to be recorded by the widget or application. Next, the timelines of multiple metric widgets or applications may be merged to integrate metric data into a single activity session based on those timelines.Generally, the timelines of various widgets or applications coincide with each other because the recordings are likely to start simultaneously.
[0037] Metric applications or widgets can be created by sports players or other users. As an example, a metric application can be obtained via a marketplace or community where a user can download a new and / or updated metric application. The application can include specific metrics and algorithms, instructions, visual features, and functional elements unique to the application. Thus, in one or more configurations, a metric selection interface can include multiple different applications or applets for the same type of metric. As an example, a user defines accolades, messages, and interface functions for various types of metrics. In a particular example, a vertical (e.g., jump height) widget can include an accolade after the user achieves a jump height of two feet, and a pace widget can include an accolade provided after the user achieves a seven-minute mile pace.
[0038] As shown in FIG. 5, metrics can include recovery time, pace, vertical jump, court map, walking line, running line, heart rate, balance, distance, calories, reaction time, hassle points, pedometer, flight time, trial, alley, impact, and balance center. For example, the recovery time may be a measure of the length of time the user is stationary or shows a level of activity or movement below a certain threshold. This time is considered the time the user spends recovering or resting. On the other hand, the court map may plot the user's position relative to an athletic activity court or field, or other predetermined space. For example, when the user is playing basketball, a virtual representation of the basketball court is generated and displayed along with the user's movement around the virtual court. As another example, a football player may be illustrated around a virtual football stadium. On the other hand, the reaction time may measure the length of time between two events such as the ball bouncing back off the rim or the user jumping to catch the ball (e.g., bounce-back reaction time). As another example, the reaction time to a pass by a basketball player may be measured between the time the ball is released from another player's hand and the moment the user starts moving towards the ball (e.g., as measured by a movement of the hips or a movement of the hand or body direction). Hassle points are given in various ways including the speed at which a sports player achieves an objective, reaches an object (e.g., the ball), moves a distance of a predetermined length, moves from one designated point to another designated point, etc. As an example, hassle points may be given per second the user is moving at a speed exceeding a threshold (e.g., 0.5 points / second when exceeding 10 mph).
[0039] An athletic monitoring system can determine the flight time or hang time by measuring the time from when the user's foot leaves the floor until the user's foot touches the ground. The flight time or hang time may be measured based on other body parts or a device including a skateboard (e.g., skateboard flight time), or between the hands and feet (e.g., backflip). The flight or hang time of a specific activity can have its own metric such as the number of ollies on a skateboard. The ollie metric can use various parameters to measure the hang time of a skateboard trick. As yet another example, the hang time of a ring exercise in gymnastics may be measured based on when the user's hand leaves the ring and when the user's hand returns to the ring or the user's foot touches the ground. Various other flight times or hang times can be defined based on various body and device sensors.
[0040] Impact represents the amount of force exerted by the user. As an example, a boxing activity can be measured with respect to the impact of the fist when the user punches. As another example, in basketball, the impact when the user lands may be measured. As yet another example, to determine effectiveness or strength in football, the impact when the user hits or tackles another user may be measured. The walking line and running line can each measure the direction or pattern of the movement of the user's feet while walking or running. As another example, the pattern or direction of the movement of other body parts may be measured and analyzed. According to one or more configurations, the running line metric can identify the path taken by the user while running. The path can be determined using a positioning system such as a global positioning satellite.
[0041] Both balance and the center of balance relate to the amount of weight placed on each foot. As an example, balance can indicate the difference in weight placed on each foot, and the center of balance can provide an indicator showing the location of the center of balance relative to the position of the user's feet.
[0042] Alternatively or in addition, the system may provide a trial metric configured to measure the user's performance per unit time. In a trial, the user is typically racing against the clock and trying to achieve the task as quickly as possible. Thus, the system may measure the user's trial and provide time information associated with the trial.
[0043] To simplify the use of the performance monitoring system and the selection of metrics, one or more sets of metrics may be predefined. For example, for each of running, basketball, training, and skateboarding, as shown in FIG. 6, one or more metrics of a first set may be preselected and / or defined. Thus, when the user selects one of the activity options or types, the corresponding set of metrics may be automatically selected. In some configurations, the corresponding set of metrics may be automatically selected along with an activity type-specific widget or application configured to record the selected metrics and the activity of that type.
[0044] Users may be provided with the opportunity to customize the automatic selection after selecting an activity. Alternatively or in addition, the user may create a predetermined custom set, or manually select the metrics they want to use for the current activity (e.g., using the "Create my own options" option). As described above, the user may select a previously performed training and request that the same metrics as the previously performed training be recorded. Thus, the system can automatically retrieve the metrics recorded for the previously performed training from the athletic performance dataset associated with the previously performed training. When the user customizes their own metric set, the user can choose to save and label the customized set. In that case, the customized set will appear in the menu for a given activity when the user next starts an activity session (e.g., as shown in FIG. 6). Only basketball, running, training, and skateboarding are listed as activities in FIG. 6, but many other activities have a given metric or widget set and can be similarly displayed in such an interface. In fact, according to the features described herein, any movement can be tracked, including dancing, swimming, jumping rope, wrestling, public speaking (e.g., tracking the user's hand movements or amount of eye contact), traveling (number of steps during travel, elevation change during travel), etc.
[0045] Furthermore, the user may share a customized metric or widget set with other users. For example, a marketplace or share space may be created where users can exchange, purchase, and / or download metric and widget sets from other users, services, coaches, etc. In one or more configurations, the metric and widget sets may be shared among users with a particular interest (e.g., skateboarding or swimming), or more generally. Other privacy and security parameters may be defined, including whether the general public is permitted to download and view the metric set, or only a specified group (e.g., friends, community groups, etc.) is permitted to view and download. In one or more aspects, the user may be able to define their own metrics. In one example, the user may define a metric called "one-leg vertical height" that records the height the user can jump on one leg or foot. The user may define the type of sensor to use, the conditions for activating or deactivating the sensor, and the metric that specifies the detected sensor output. Thus, the user may indicate that the metric is measured only when the sensor on one shoe touches the surface, and that the metric corresponds to half the length of the time between detecting the loss of contact between one shoe and the surface and then detecting the next contact between the same shoe and the surface.
[0046] FIG. 7 shows an exemplary interface for a user to start recording a session of activities when selecting a set of desired metrics to be tracked. The interface may include a timeline at the bottom of the screen to show the length of the elapsed time since the start of the activity. The user can select the running start / recording option displayed in the center of the screen to start recording the metrics and / or video of the activity. As an example, the video may be recorded by a metric recording device (e.g., a video camera on a mobile communication device or a laptop). When data is recorded, the data (video and metrics) can be stored in relation to a specific moment or time during the activity session in which the data was acquired. As described above, the data may be collected substantially continuously (e.g., every 0.1 second or 0.5 second, every 1 second). Other recording intervals (e.g., every 2 seconds, 5 seconds, 10 seconds, 15 seconds, 5 minutes) may be defined. The interface may further display the currently selected basic metric. The basic metric may be displayed in the visualization area of the interface. For example, in FIG. 7, the running line is displayed in the visualization area (partially covered by the recording option). The user can pause or stop the recording using the corresponding option displayed on the header bar (e.g., on one side of the basic metric name).
[0047] Figure 8 shows an athletic performance monitor interface that may be displayed when a user starts an athletic activity session. Icons within the header bar can indicate that the current activity and its metrics are being recorded. In the illustrated example, the primary visualization area can display specific metrics such as a running route or a running line. In one configuration, the user's current position on the map may be identified by an indicator. Other metrics may be displayed in a metric bar. The metrics may be updated continuously while the activity is being performed or may be updated based on a specified schedule. For example, the user's pace (e.g., 7:46 miles) can be updated in real time when the user increases or decreases speed. Similarly, the user's balance (currently showing 46% of the user's weight on the left foot and 54% on the right foot) can be updated in real time. The data shown may be instantaneous data, or the data may include the average of the amount of data up to that point (e.g., all the data recorded in the session up to that point, or an appropriate subset of the data recorded in the session).
[0048] Other metrics may be displayed by selecting one of the directional arrow options along the metric bar (as described and illustrated in more detail below). Selecting one of the metrics within the metric bar can cause the primary visualization area to change to display the selected metric. The previously displayed metric may be returned to the metric bar (e.g., replaced by the newly selected metric / widget). Further, the current elapsed time may be displayed relative to a timeline. Further, the length of the elapsed time may be represented on the timeline by different colors or patterns (e.g., red, polka dots, stripes, blue, green, etc.).
[0049] Figure 9 shows an example of another activity selection interface in which basketball activities are emphasized in the selected process. As shown here, various activities can correspond to different sets of metrics. As an example, basketball metrics can include video and / or audio recordings. Thus, when selecting a basketball activity, the recording function can be activated.
[0050] Figure 10 shows an example of a metric monitoring interface in which video related to basketball activities is recorded. The basketball activity may include activities related to training or skill improvement related to basketball and is not necessarily limited to basketball games. For other sports and activities, similar training or evaluation-type activities may be monitored. When video is being recorded, other metrics shown on the metric bar may be recorded simultaneously and associated with the time when the data was acquired. The metric or metric widget displayed in the main visualization area may be modified by selecting a different metric from the metric toolbar. The video may continue to be recorded and displayed in the metric widget on the metric toolbar. The metric toolbar may include metric widgets such as a pace metric widget, a vertical jump widget, and an impact widget. The vertical jump widget measures the user's vertical height above the ground at a particular point in time, and the impact widget can measure the magnitude of the force exerted by the user's foot (e.g., when landing) or hand (e.g., when blocking a shot), or the magnitude of the force with which the ball is shot or thrown. The pace metric for basketball activities may measure vertical or horizontal acceleration (e.g., instead of measuring miles per pace). The metrics shown may be specific to the instant identified on the timeline (i.e., 4 minutes and 58 seconds into the athletic activity session). Alternatively or in addition, one or more of the illustrated metrics may be the average of the metrics up to the instant identified on the timeline (e.g., the average over the first 4 minutes and 58 seconds).
[0051] Also, data collection can be facilitated by including identifiers in one or more sensors or other wearable devices (such as shoes, gloves, headgear, etc.). Metric acquisition devices such as video cameras or speed cameras may automatically adjust their direction and focus based on the proper discovery of the object using the identifier and the determination of its location. In other configurations, identifiers or wearable identifier tags may not be necessary. The camera or other sensor device may automatically determine the location of the desired object based on image recognition (such as face recognition or body recognition). Using the identifier, the data may be displayed as an overlay near the corresponding sensor, individual, or body part of the individual. For example, by detecting the position of the user's foot with the identifier, gait information is displayed near the user's foot during video playback. As another example, multiple sets of metrics regarding multiple individuals displayed in the video may be displayed. Thus, using the identifier, the metrics can be placed near the appropriate individual.
[0052] Video collection is facilitated by combining videos from multiple different video sources as shown in FIG. 21. For example, multiple individuals may record the same event (such as a soccer game or dance competition) using their own video cameras. The processing system can detect that the multiple videos each correspond to the same event and can stitch the videos together to fill in the gaps between the individual videos. Further, the system can ensure that the video maximizes the image of the desired object. In this case as well, body or face recognition may be used to identify a particular object and combine the portions containing the desired object into a single video. Each portion may have a duration corresponding to a portion of the duration of the source video or content item or the entire time thereof. Also, by using multiple cameras or video streams, an individual can view an object (such as themselves, a child, a player, etc.) in three dimensions from multiple angles and at several instants.
[0053] According to another aspect, video recording by cameras and other recording devices at specific locations may be automatically triggered based on the detection of identifiers or other electronic tags. FIG. 21 shows, for example, a location such as a gymnasium or park with a camera 2 belonging to or otherwise associated with the location. Thus, when a connected camera or system detects a player or individual within the location, the camera may automatically start recording. As an example, the detection of sports players or other individuals may utilize shoes with RFID tags. When the RFID tag is detected, the video camera may be automatically triggered to start recording an event or athletic activity session. These cameras may be fixed or movable cameras placed in public facilities, semi-personal or personal athletic facilities (e.g., gymnasiums, grounds, pools, courts, etc.). Next, the camera data at a specific location may be combined with data collected by the user's personal recording device (e.g., a camera-equipped mobile phone or a portable video camera) during the editing of an athletic activity session file. In some configurations, data from various sources may be automatically synchronized when uploaded to a server or other monitoring system.
[0054] (Visualization and Modification of Data) FIG. 11 shows an interface that displays a recorded activity session, an extended metric toolbar and display for vertical jump metrics, in a primary visualization area. As described above, by selecting one of the direction arrows, the metric toolbar can be scrolled to display other metric widgets. If there are no more metric widgets in that direction, the arrow is not displayed. The scroll may be performed using gestures such as swiping left or right.
[0055] When a new metric such as a vertical jump is selected, the metric or interface that was previously displayed within the primary visualization area is reduced to widget or toolbar size and placed in the toolbar for display within the primary visualization area. For example, a video that was previously displayed within the primary visualization area is reduced and displayed in a smaller size suitable for the metric widget toolbar. When expanded or placed within the primary visualization area, the metric widget can display additional or extended information than what was displayed within the metric widget toolbar. For example, within the primary visualization area, a vertical jump metric widget graphically displays the current vertical jump value as well as the historical vertical jump values of the activity session. This enables the user to better understand their progress and improvement during the activity session. A current value of 49.5 inches (i.e., a selected value on the timeline or a value associated with the current value) may be displayed. Each widget metric may include an animation as time progresses upon receiving new metric data. For example, with respect to the vertical jump, the line extends slightly to the next vertical jump value detected after the timeline has advanced to a later point in time. As another example, the line retreats if the user decides to rewind to a previous point in time. The metric widget may display actual moving information within the primary visualization area as well as within the metric toolbar.
[0056] FIG. 12 shows another example of an interface that displays a video of an athletic activity session along with a timeline representing the duration of the session. In this example of the interface, the video may be displayed in landscape format, and the metric widget toolbar may be hidden or otherwise not displayed to save space. However, the timeline may further be displayed such that the user can jump forward and backward in time or fast forward or rewind as needed. The timeline and / or the metric widget toolbar may be displayed and / or hidden based on the user's interaction with the device on which the interface is displayed. For example, the user may perform a first gesture along a touch screen interface to display the metric widget toolbar and a second gesture to hide the toolbar. Similarly, the hiding and display of the timeline may be controlled.
[0057] According to one aspect, various metrics may be displayed as an overlay on the primary visualization area. That is, the information displayed in the primary visualization area can be viewed under the metric overlay. The user can select the desired metrics that overlap the primary visualization area. The overlaid metrics may be hidden as needed. The user can also customize the number of metrics displayed on top of the primary visualization area, as well as the appearance, including color, font, size, typical symbols, units of measurement, etc. As an example, the best or optimal metrics are called out using highlighting, color, blinking, patterns, etc. In other configurations, the overlaid information may be displayed along with information regarding the user's personal best record to show how well the user is matching or exceeding it. In addition to or instead of this, comments, words of encouragement, etc. may be displayed as an overlay on the interface's toolbar or information bar.
[0058] Figures 16A and 16B show examples of metric overlays. In Figure 16A, for example, the user's speed is displayed as a translucent running meter superimposed on the video of the user's skateboarding activity session.
[0059] In Figure 16B, the user's impact is displayed as an arrow with an indicator of the magnitude of the impact on top of the video of the user jumping.
[0060] The superimposed metric information may include other parts of the activity session (e.g., of the current user or another user) or videos of other activity sessions. As an example, the user may superimpose a video from a professional sports player's activity session to compare movements.
[0061] Figure 17A shows an example of a side-by-side video comparison of a user with a famous sports player or another user. Specifically, the comparison shows the difference in hang time or flight time. The videos may be aligned at similar points in time, such as when the user leaves the ground to dunk. This time can be identified based on an indicator stored in relation to each video or on pre-processed or ongoing image analysis. The comparison between two users may include synchronizing the timelines of the athletic activity performances of the two users. For example, if two users run for 20 minutes, the system may synchronize the two timelines temporarily or in another way to compare the paces at various points during the 20-minute run. Synchronization may include aligning the two timelines and comparing the elapsed time. The system may further enable the user to view the video, listen to the audio, or view the video data as it crosses the timeline.
[0062] Figure 17B shows another example of a video comparison between a skateboard user and a professional or competing skateboarder. In the illustrated example, the comparison displays the metric using typical symbols such as skateboards. That is, the skateboard may display some ollies being performed.
[0063] Figures 17C and 17D show wireframe representations of interfaces that can be used to compare the performance of various users. For example, Figure 17C shows a comparison of the performance of a sports player and the performance of the coach of the sports player. The widget application displayed in the toolbar may be displayed in a split-screen format with both the sports player's performance metrics and the coach's performance metrics. Similarly, the videos of the sports player and the coach may be displayed as a split screen in the main visualization area.
[0064] Figure 17D shows a comparison interface displayed in landscape format. Instead of displaying a widget toolbar, the interface may display X metrics. In this example, the number of metrics may be 4 (video, jump height, impact, and balance). The video may be displayed in a split screen, with two columns displayed next to the video, one column representing the sports player's metrics and the other column representing the coach's metrics. The interface configurations of Figures 17C and 17D may be used to compare the athletic performance of any number of sports players (e.g., 2, 3, 5, 10, etc.), and the sports players may have any type of relationship (e.g., friends, competitors, coach-trainee, etc.).
[0065] The video overlay may be automatically triggered based on the detection of various events such as pitch release, slam dunk execution, and / or football throw. For example, the video of a professional pitcher's pitch is overlaid on top of the user's pitching video to facilitate a visual comparison between the two videos. In addition to or instead of this, metrics of the overlaid video and the user's video may be displayed in relation to each other for comparison. The two sets of metrics may be visually distinguishable from each other. For example, the first set of metrics may be displayed in one color, and the other set of metrics may be displayed in a different color. As visual distinctions, font size, font, font style (e.g., bold, italic, underlined), pattern, etc. may be used. At the same time, the displayed video (e.g., overlapping) may be enlarged so that the object of the video is displayed in a sufficiently large size. For example, if the user is far away in one video, the video may zoom in or enlarge the part that includes the user.
[0066] In addition to or instead of this, the user may use thresholds to customize the appearance of the timeline and / or metric overlay. For example, when the timeline is 75% complete, the appearance of the timeline (e.g., color, pattern, shape, size, etc.) may change. As another example, the metric information may have a color or other appearance change when the metric exceeds or falls below a specified threshold (e.g., red text when the pace is below 6 minutes per mile).
[0067] FIG. 13 shows an interface that allows a user to clip or select (e.g., less than all) a portion of the total duration of a recorded activity session. Thus, the selected portion may have a time or duration that represents a portion of the total duration. Next, the user may clip the selected portion and further process, analyze, and / or share other portions. For example, the clipped portion or the entire recorded session may be uploaded to a social networking site, saved to a sports performance monitoring service site, or sent to a friend via email, along with associated metrics. In one or more configurations, when an average metric for the entire activity session is provided, by the user selecting or clipping a portion of the activity session, the system may automatically modify the average to reflect the average of the selected or clipped portion. With a save option, the user can save the selected portion. In addition to or instead of this, the monitoring system may automatically save the clipped portion and the remaining portion as separate files or data items. This can prevent the user from accidentally deleting a portion of the activity session.
[0068] The user is further permitted to select a particular metric value, and the system may automatically identify and display a portion of a content file (e.g., a video or audio file) corresponding to the time of the athletic activity session in which the particular metric value was recorded. Instead of or in addition to this, the user may select a portion of the content file (e.g., a range or a particular time), and one or more metric values specific to the selected portion may be displayed.
[0069] The timeline may further include one or more metrics that identify specific events of a user's activity session. For example, within the timeline, the number of times corresponding to the user's highest or best value for one or more metrics may be marked. Thus, if the user achieved their personal best vertical jump at time 2:03, that metric may be placed at the 2:03 point within the timeline. The metrics may be color-coded and / or labeled to provide some information about what is marked. According to one aspect, if the user selects a portion of the timeline (rather than the entire timeline), the metrics may be modified to reflect and identify the best (e.g., highest or lowest) metric value measured for the user between the selected portions. For example, the system may automatically determine the best metric value for the selected portion of the activity session. Alternatively, the metrics may not be modified such that the user can see their metrics throughout the entire activity session. Instead of this, additional metrics may be added in addition to the existing metrics. For example, the additional metrics may identify the best times and / or other metrics for the selected portion of the activity session. The user may further name the portion cut out at the time of saving. The save name may be displayed in the title bar. The metrics may be used to identify other events that do not correspond to the best metric. For example, the metrics may identify a substantial change in pace (e.g., from a 12-minute mile pace to a 7-minute mile pace within a predetermined time such as one minute), a slam dunk, a tennis ace, dancing, a tackle, a football pass over 20 yards, etc. The metrics may specify the lowest metric or point in the activity session where the user needs improvement (e.g., coaching or improvement advice).
[0070] Selection or cropping of a portion of the video may be done by the user sliding a finger along the timeline (e.g., using a touch screen interface) to the desired start and end times of the desired portion. With the aforementioned indicators, the user can more easily select one or more portions of the video that are their highlight (e.g., best performance time). Alternatively, the user may use a cursor or time input field to specify the start and end times. In one or more configurations, the user may have the monitor system automatically select a portion. For example, the user may request that the monitor system crop the video such that only the time or period during which the user's best dunk of a particular metric (e.g., highest hang time, highest rating by the user and / or other users) was achieved is retained. In a particular example, the system may automatically retain the event along with a predetermined length of time around the event (e.g., 2 minutes, 1 minute, 30 seconds, 15 seconds). Only the metric data for the remaining portion of the activity session may be retained. Further, a new average of the retained portion may be calculated when non-selected portions are cropped. On the other hand, the metric data for the non-retained portion of the activity session may be discarded or saved to another file (e.g., the file of the cropped portion). Instead of or in addition to this, in one or more examples, an average of the non-retained portion may be automatically generated for comparison.
[0071] The cropped video may also be automatically stored as a separate content file that is depicted (e.g., displayed, aurally reproduced, visually reproduced) independently of other content files or athletic data sets. The separate content file may correspond to an audio file (e.g., with or without the video) or an application file that animates a sequence of recorded athletic data. The user may select multiple portions of the recorded athletic activity session, and each selected portion may be stored as a separate content file. Thereby, the user can create multiple content files at once by selecting multiple portions of the activity session.
[0072] FIG. 14 shows a video / metric sharing interface that may be displayed after the user selects a save option (e.g., as shown in FIG. 13). The sharing interface may include one or more predefined sharing options (e.g., Youtube, FACEBOOK, etc.). The interface may further allow the user to customize or define their own sharing site (e.g., by entering a website or network address).
[0073] FIG. 15 shows a community website that displays a shared video including metrics related to the user shown in the shared video. On the community website, various individuals can comment on the video and / or the user's athletic performance. As an example, a coach may comment to assist the user's improvement or to further encourage the user. The comments may be associated with a specific time similar to the metric information. This allows the comments to be triggered or displayed only when a specific time in the video is reached. The user can specify who can comment on the video and / or record the video. For example, the user can indicate that only individuals within a specific group of people, a specific individual, or individuals meeting criteria defined by the user (e.g., age, location, relationship, etc.) are permitted to comment or evaluate the video / metric. The user may specify individual permissions for the video and the metric. This allows some users to view both the video and the metric, while other users can only view the video or the metric internally.
[0074] Individuals accessing this video may suggest other videos to view. The other videos may be selected based on the type of athletic activity, the age, gender or location of the subject, the school or gym of the subject, the subject's sport and the similarity of the subject's sport to other videos and / or other criteria within the other videos.
[0075] Figures 18A and 18B show a series of interfaces in which metrics can be displayed in various regions of the motion visualization area. In this case, the user can adjust the size of the regions by moving the intersection point between the various regions. The size of each region may be automatically adjusted according to the position of the intersection point. For example, in Figure 18A, the intersection point is displayed in the middle of the visualization area, thereby providing a display area equal for each metric. Next, the user can decide to move the intersection point to another position as shown in Figure 18B (e.g., by selecting and dragging the intersection point using a touch screen). When the user moves the intersection point to the position shown in Figure 18B, the sizes of the various regions can automatically change to compensate for the new intersection point. For example, the widths of the impact and balance metric display areas become smaller, while the widths of the vision / video and jump height metric display areas become larger. Further, the heights of the vision / video metric and impact metric areas become higher, while the heights of the balance and jump height areas become smaller.
[0076] In one or more configurations, the user may be permitted to edit the parameters or aspects of a recorded activity session before all recorded metrics are incorporated into a single activity session file or content item. Further, the session may be truncated before being accumulated into a single file or content item. FIG. 19 shows, for example, a process by which metrics to be incorporated and stored in a file corresponding to an athletic activity session can be selected or deselected. Thus, even if various widget applications record eight different metrics, the user can select only five of the eight metrics to accumulate in the activity session file. Alternatively or in addition, the user may define the placement of various metrics and widget applications within the display area so that the system can assemble video and other data in a desired form. Further, the user may add comments, audio (e.g., soundtrack, narration, sound effects, etc.), interactive buttons (e.g., send an email to a sports player, download a video, etc.).
[0077] Video, audio, or other athletic content data may further be associated with location information. For example, location is used as a metric as described herein. Further, information regarding a particular location may be displayed, stored, and / or associated in detail with an athletic performance or a portion thereof. For example, location information of the user's location at each minimum time unit (e.g., 1 second, 1 minute, 5 minutes, 30 minutes, etc.) is acquired and stored. Thus, if the user is in a park at the 1-minute mark and then runs to a bridge at the 8-minute mark, information regarding the park is associated with the athletic performance at the 1-minute mark, and information regarding the bridge is associated with the athletic performance at the 8-minute mark. The location description information may indicate the type of location, the location history, events occurring at the location, etc. Next, the location description information may be displayed, and the user may display the progress of the athletic performance data (e.g., video, audio, video data).
[0078] (Conclusion) The foregoing description has been presented with respect to specific examples that include presently preferred forms of implementing the invention, but it will be apparent to those skilled in the art that numerous variations and substitutions exist for the above-described systems and methods. For example, various aspects of the invention may be used in different combinations without departing from the invention. Also, different sub-combinations of various aspects of the invention may be used together in a single system or method. As an example, the software and applications described herein may be implemented as computer-readable instructions stored on a computer-readable medium. Also, without departing from the invention, the various elements, components, and / or steps described above may be changed, the order changed, omitted, and / or additional elements, components, and / or steps may be added. Accordingly, the invention should be construed broadly as set forth in the appended claims.
[0079] (Cross - Reference to Related Applications) This application claims the benefit of priority from U.S. Provisional Application No. 61 / 412,285, filed on November 10, 2010, entitled "SYSTEMS AND METHODS FOR TIME - BASED ATHLETIC ACTIVITY MEASUREMENT AND DISPLAY", the contents of which are hereby incorporated by reference in their entirety.
Description of Reference Numerals
[0080] 101: Computer, 103: Computing Unit, 105: Processor Unit, 107: System Memory, 115: Network Interface, 117: Hard Disk Drive, 119: Removable Optical Disk Drive, 121: Input Device, 123: Output Device
Claims
1. Receiving, from a sensor, athletic data of a first user related to an athletic activity; Displaying a video of a second user performing the athletic activity, where the video includes activity information; Associating a first timeline of the athletic data of the first user with a second timeline of the activity information of the second user; where the first timeline indicates a first time display indicating a duration of the athletic activity performed by the first user and one or more metrics related to the activity information of the first user; the second timeline indicates a second time display that is a duration of the athletic activity performed by the second user and one or more metrics related to the activity information of the second user; During execution of the athletic activity by the first user, displaying a comparison display of the first timeline and the second timeline; including where the displaying step further includes displaying a plurality of selectable metrics along at least one of the first time display and the second time display, and displaying the selected metric selected from the metrics and the non - selected metrics not selected from the metrics with different granularities.
2. The method according to claim 1, wherein the activity information corresponds to a completed athletic activity.
3. The method according to claim 2, wherein the video of the completed athletic activity by the second user includes a video of a celebrity who has completed the athletic activity.
4. The method according to claim 2, wherein the video of the completed athletic activity by the second user includes a video of an instructor who has completed the athletic activity.
5. The method according to claim 2, wherein the video of the completed athletic activity by the second user includes a saved video of the first user who completed the athletic activity at an earlier time.
6. The method according to claim 1, further including calculating at least one of the metrics of the first user using the athletic data.
7. The method according to claim 6, wherein the at least one metric is output for real - time display.
8. The method according to claim 7, wherein the at least one metric includes the speed of the first user.
9. An athletic parameter measuring device, A display, A processor, At least one athletic measurement sensor, A memory storing computer-executable instructions, Comprising: When executed by the processor, the memory causes the athletic parameter measuring device to Receive athletic data of a first user related to an athletic activity from the at least one athletic measurement sensor, Display, via the display, a video of a second user performing the athletic activity, where the video includes activity information, Associate a first timeline of the athletic data of the first user with a second timeline of the activity information of the second user, Where The first timeline indicates a first time display indicating the duration of the athletic activity performed by the first user and one or more metrics related to the activity information of the first user, The second timeline indicates a second time display that is the duration of the athletic activity performed by the second user and one or more metrics related to the activity information of the second user, During execution of the athletic activity by the first user, display, via the display, a comparison display of the first timeline and the second timeline, Use the athletic data to calculate at least one metric of the first user, The at least one metric is output for real-time overlay display on a video of the athletic activity by the first user that is displayed in association with the comparison display, The at least one metric includes the speed of the first user or the distance traveled by the first user, Via the display, display a plurality of selectable metrics along at least one of the first time display and the second time display, and the selected metric selected from the metrics and the non-selected metrics not selected from the metrics are displayed with different granularities, An athletic parameter measuring device.
10. The athletic parameter measuring device according to claim 9, wherein the activity information corresponds to a completed athletic activity.
11. The video of the completed athletic activity by the second user includes the video of a famous person who has completed the athletic activity, the athletic parameter measuring device according to claim 10.
12. The video of the completed athletic activity by the second user includes the video of an instructor who has completed the athletic activity, the athletic parameter measuring device according to claim 10.
13. The video of the completed athletic activity by the second user includes the saved video of the first user who completed the athletic activity at an earlier time, the athletic parameter measuring device according to claim 10.
14. One or more non-transitory computer-readable media storing computer-readable instructions, When the instructions are executed, cause the device to Receive, from a sensor, athletic data of a first user related to an athletic activity, Display a video of a second user performing the athletic activity, where the video includes activity information, Associate a first timeline of the athletic data of the first user with a second timeline of the activity information of the second user, where The first timeline indicates a first time display indicating the duration of the athletic activity performed by the first user and one or more metrics related to the activity information of the first user, The second timeline indicates a second time display that is the duration of the athletic activity performed by the second user and one or more metrics related to the activity information of the second user, During the execution of the athletic activity by the first user, display a comparison display of the first timeline and the second timeline, Use the athletic data to calculate at least one metric of the first user, The at least one metric is output for real-time overlay display on the video of the athletic activity by the first user that is displayed in association with the comparison display, The at least one metric includes the speed of the first user or the distance traveled by the first user, Display a plurality of selectable metrics along at least one of the first time display and the second time display, Display the selected metric selected from the metrics and the non-selected metrics not selected from the metrics with different levels of granularity. One or more non-transitory computer-readable media. [
15. ] The activity information corresponds to a completed activity session, and the one or more non-transitory computer-readable media according to claim 14. [
16. ] The video of the completed activity session by the second user includes videos of famous people who have completed the athletic activity, and the one or more non-transitory computer-readable media according to claim 15. [
17. ] The video of the completed activity session by the second user includes videos of instructors who have completed the athletic activity, and the one or more non-transitory computer-readable media according to claim 15. [
18. ] The video of the completed activity session by the second user includes videos of friends who have completed the activity session, and the one or more non-transitory computer-readable media according to claim 15. [
19. ] The recording of the video of the second user is triggered based on the detection of an identifier associated with the second user, and the method according to claim 1. [
20. ] The step of displaying the comparative display of the first timeline and the second timeline automatically triggers the comparative display of the first timeline and the second timeline based on the detection of events in the video, and the method according to claim 1. [
21. ] A first saving step of saving the selected metric with a first level of granularity, A second saving step of saving the non-selected metric with a second level of granularity, and The method according to claim 1. [
22. ] The level of the first granularity is greater than the level of the second granularity, and the method according to claim 21.
Citation Information
Patent Citations
Golf swing analyser
JP1987044275A
Motion training display system
JP2005111178A
Method and system for displaying swing
JP2009089816A
Method and system for marking content for physical motion analysis
US20020115047A1
Athletic Performance Monitoring Systems and Methods in a Team Sports Environment
US20100184564A1