FI123245B - Control of physical exercise - Google Patents

Description

5

FIELD OF THE INVENTION - STYRNING AV FYSISK TRÄNING

The invention relates generally to the control of physical training.

BACKGROUND OF THE INVENTION

Physical training is essential for everyone in general for good health and general well-being. In connection with this, there are a huge number of different methods and devices. However, the fast pace of modern life makes it difficult to participate in 10 team sports and, in general, any practice with other people. In addition, the scarcity of time sets requirements for the effectiveness of physical training. The training should be performed at the desired intensity. Personal coaches can help you optimize your training but not everyone can afford their services. Thus, new alternatives to physical training are needed.

SUMMARY

According to a first exemplary aspect of the invention, there is provided a method of controlling physical training with a controller, the method comprising: maintaining a training program; and presenting the training program to the user; characterized in that the instructor produces computer animation corresponding to the movements of the training program; pacing animation with music; and C 25 of a computer animation is displayed to the user on a screen.

i

C/O

cp cvj Usefully, the animation instructor can be presented to the user to control his or her physical x training according to the training program. So practice

CL

speed and shape can be controlled by a technical device.

- 30

C/O

o The production of the animation may comprise a three-dimensional character with different body parts o

CNJ

imitation of movement. A character can imitate a person.

2

Advantageously, imitation can allow for a cost-effective retention and combination of a wide range of motion within a training program.

Synchronizing the animation with the music may involve adjusting the animation speed 5 according to an external source. The external source may comprise a music player and / or an external power sensor, which may be a heart rate monitor. The method may further comprise receiving a signal corresponding to an external music source by means of a microphone.

Advantageously, the method may allow the training program to be adapted to the user-selected music.

Advantageously, using a microphone to receive a signal corresponding to an external music source can also be used music that is only available during playback thereof (such as music protected by DRM or radio stations).

Advantageously, the method enables feedback to be obtained from the user's heart rate or pulse. Feedback can be obtained in the form of an ANT signal.

20

Advantageously, the method may allow the program to be adjusted to the user's heart rate. In addition, conventional ANT-compatible equipment may be usefully employed.

C \ J

The method may further comprise increasing the animation rate of the training program g if the heart rate is below a given lower limit. The method may further comprise reducing the speed of the cm training program if the heart rate is above a given upper limit x.

Q_

(M

Conveniently, the method can allow fine-tuning of the training power o by adjusting the animation speed of the training program.

CM

3

The method may further comprise changing the training program to adjust the program to changes in speed exceeding a given threshold.

The method may further comprise maintaining a permanent safety margin and stopping animation 5 if the heart rate reaches or exceeds the safety threshold.

The method may further comprise analyzing the music used in combination with the training, at least in part, prior to the presentation of the animation, and producing the animation in accordance with the prior analysis. Advantageously, music 10 may be obtained from a music source such as a CD, DVD, USB flash drive, Internet storage, or local or online music storage.

The method may comprise determining the rhythm and tempo of the music in real time and timing the animation while the animation is presented to the user.

The method may further comprise playing the music and performing the animation in a synchronized manner and adjusting the tempo of the music to maintain the pacing.

The method may further comprise maintaining the user's preferences and modifying or preparing the training taking into account the user's preferences. Preferences may include a selection of certain movements that are favored or avoided.

C \ J

0 25 Usefully, the program can be tailored to meet individual needs g such as avoiding risky movements after surgery or cm strengthening especially weak muscles.

1 CC Q_

The method may further comprise configuring a training program based on the user ί 30 input. Defining a training program may include: o incorporating appropriate elements into a given training area such as power, aerobic, balance, etc.

4

The method may comprise determining a training program based on general or customized expert recommendations. The training program can be configured so that the muscles used by the opposing movements are in balance.

The method may further comprise providing additional computer animations to the additional instructors. The method may further comprise adjusting additional controllers individually based on feedback from different users.

According to another aspect of the invention, there is provided a controller for controlling physical training, the controller comprising: a memory configured to maintain a training program; and a video output which can be connected to a display configured to display the training program to the user through the device; characterized in that the controller further comprises: 15 a processor configured to produce computer animation of the controller corresponding to the movements of the training program; and the processor is further configured to provide computer animation via a video output.

According to a third aspect of the invention, there is provided a computer program for controlling physical training, said computer program comprising computer executable program code which causes a computer to perform a method according to the first aspect of the invention when executing a program.

OJ

According to a fourth aspect of the invention there is provided a system comprising a controller according to a second aspect of the invention and a user feedback means c / j to enable the operation of the controller to be adjusted.

CC

CL

The system may further comprise a display device configured to display ^ 30 animation under controller control.

00 o o C \ l 5

BRIEF DESCRIPTION OF THE FIGURES

The invention will be described by way of example only with reference to the accompanying figures, in which: Figure 1 shows a schematic diagram of a system according to an embodiment of the invention;

Fig. 2 is a schematic block diagram of a controller suitable for operating the system shown in Fig. 1;

Figure 3 shows a flow chart of a process method 10 according to an embodiment of the invention

Fig. 4 shows an exemplary curve showing the heart rate and various thresholds and events of a user's heart according to an embodiment of the invention.

15 DETAILED EXPLANATION

In the following description, like numbers correspond to like elements.

Figure 1 shows a schematic diagram of a system 100 according to an embodiment of the invention. The system comprises a controller 110, a display device 120, a music player 130, a heart rate monitor 140, and a remote station 150 communicatively connected to the controller 110. Figure 1 also illustrates a view 160 controller 180 for controlling a plurality of features of controller 110. Remote control 180 may be your example

C \ J

5 a dedicated device or multifunction device such as a wristop computer or

(M

^ function included in the mobile phone. The MFP may be able to communicate with the controller 110 using the ANT protocol.

(M

CC

Figure 2 shows a block diagram for operating the system shown in Figure 1

(M

The controller 110 comprises a processor 210, a memory 220

CD

a processor for use in controlling the operation of the controller 110, a persistent memory

O

^ 230 for storing long-term data such as software 240, typically comprising an operating system and computer executable applications, a user interface 6 250 for user interaction such as video and audio output, and user 160 for receiving commands and / or settings, remote objects for I / O 260 such as remote 150 , a music player 270, and a heart rate monitor 280. The heart rate monitor may be any 5 commercial heart rate monitor such as a heart rate monitor. The heart rate monitor may be configured to transmit a pulse signal or a heart rate signal with a special (proprietary) or standard signal such as an ANT signal present in a number of modern heart rate sensors.

The processor 210 may be, for example, a central processing unit of a microprocessor, a DSP digital signal processor, or generally any digital signal processor or a combination of various individual processors.

Figure 3 shows a flow chart of a system 15 according to an embodiment of the invention. The process begins with step 310, where training programs are stored so that they are available in the next steps. Programs can be stored one at a time or in larger numbers on remote station 150 or controller 110. Programs can be categorized according to their primary use (e.g., balance, strength, aerobic training) and may have different 20 sets of alternate movements in each section. In addition, various alternative sets can be combined with weight factors that correspond to the power of the exercise.

In step 320, the user 160 selects the type of training program or a particular training program. The selection can be made using the δ 25 250 interface of the controller 110.

CM

C/O

O

cm The controller then animates according to the instructions in the 330 program.

x The process may be performed through processor 210 according to program 240 and may be displayed on a display device as outlined in view 170. The animation may also comprise instructions which may be spoken by voice or sounds such as hand clapping. 00 o Instructions included are especially helpful as people do not during exercise

CM

you may need to wear your regular eyeglasses or may need to turn from time to time to view the display device 120 may be uncomfortable or even impossible.

7

The animation can be synchronized with music played during 340 training sessions. Synchronization 340 can be performed by the controller. Synchronization 340 can be performed using the attached music player in real time or in advance. 5 Alternatively, you can use a standalone music player to play music. When using independent music playback, real-time detection of tempo and rhythm can be performed, for example, by the controller 110 or the accompanying equipment. In the case of independently played music, the controller may receive an electronic signal corresponding to the music, for example, via a microphone or a wired connection. The electrical signal 10 can be normalized by means of an automatic level control circuitry and filtered by eliminating normal training sounds that can interfere with the rhythm and beat of the music. The controller can then detect the impact of the music in real time on an analog or digital circuit in combination with the software. In yet another alternative, the controller can obtain playable music in digital form 15 along with stroke and tempo information so that the player is aware of the stroke and tempo during playback without having to analyze the music. However, it is desirable that the music be able to provide a timing for the exact training of a given training program and thus have a technical effect by enabling the user or the practitioner to synchronize the training.

20

As part of pacing 340, instructions included in the animation (step 350) may be added or modified to inform the user 160 of the change in shock and / or tempo in the animation.

C \ J

o 25 The controller displays 360 animation on a display 120 with a view of 170.

oo o cm When displaying animation 360, controller 110 may continuously obtain user x 160 heart rate information from the heart rate monitor 140. The controller may then

CL

determine 370 whether the training power should be changed. The determination can be based on comparing ^ 30 heart rate with the given thresholds. The thresholds may include any of the following: upper fine-tuning threshold (th3), which should be slowed down when encountered; upper upper limit (th4) which, when encountered, should be reduced by changing the training program lighter; the safety limit (ths), 8 which, when encountered, stops training; lower fine tuning limit (th2), which should be accelerated when encountered; lower upper limit (thi), which should be increased by changing the training program to a heavier one when faced with training power; the lowest threshold (Tho), which, when encountered, does not seem to work and should advise the user to check the meter. Thresholds, associated functions, and heart rate are further described with reference to Figures 4 and 5.

Figure 4 shows an exemplary user heart rate graph and various thresholds and events in accordance with one embodiment of the invention. Thresholds th0 - th5 are described above. At the beginning, at time t0, the user begins to practice and his heart rate is approximately lower than thi. No adjustments are currently being made as the heart rate has clearly not yet reached a steady state. Further, while practicing the training program, the user's heart rate rises to a level that encounters a lower fine-tuning limit th2 at the first time t1, which is still within the initial start time period tst. However, at the second time point t2, the start period has ended and the heart rate is still between the lower fine-tuning limit th2 and the upper fine-tuning limit th3. Therefore, the heart rate is now in the target area and the training continues. Then there is a change in the program so that the heart rate starts to rise.

20 At time t2, the heart rate has risen to the upper fine-tuning limit th2. Then the training speed is reduced to fine tune the training. In the case where training is synchronized to music, fine tuning may be tied to the impact of the music. In one embodiment, more control is obtained by changing the tempo of the music being played (relatively slow down the music).

CM

5 25 This kind of tempo reduction can be done either by using

CM

^ frequency range measurement so that the audible frequencies of the music remain subjectively unchanged (as is known, for example, in Windows Media

CM

Player ™ version 11). Training may then continue at a slightly slower pace, but in this example the heart rate will still rise so fast that it will soon exceed

C \ J

30 upper boundary th4 and training program adjusted. Run lighter

CD

g movements and diminished power are reflected in the stabilization and lowering of heart rate, o

CM

9

The heart rate then passes the upper main limit th4 and the upper fine adjustment limit th3 at times U and t5, respectively. In this case, the heart rate develops towards the target zone so that the training program is not changed until the heart rate leaves the target zone between the upper and lower fine-tuning limits th3 and th2.

5 At time t6, a relatively short time after the heart rate has reached the target zone, the heart rate falls below the lower fine-tuning threshold th2. Then the training pace will be raised slightly to make the training more effective. As a result, the downward curve of the heart rate curve is reduced. However, the heart rate continues to count and at t7 the heart rate falls below the lower limit of thi. In response, training program 10 becomes heavier. The heart rate may still remain below the lower limit for some time, for example, if the user has stopped training, or needs to take some time to learn a new movement or set of movements, or if he or she needs to change orientation to exercise for some time. Here, the heart rate again crosses the lower limit at thi at 15 te, but shortly thereafter, heart rate detection drops down almost perpendicularly through the lowest limit Tho.

The lower limit means that heart rate information is no longer available. This may be due, for example, to a lack of contact between the belt contact surfaces of the heart rate monitor and the skin near the wearer's heart 20 or other defect. The decrease in heart rate may not be perpendicular, as typically the heart rate is averaged over a period of time to stabilize training power control. When it is detected that the heart rate goes below the lower limit th0, the user 160 can be instructed to ensure the heart rate monitor 140 is fastened and functioning.

™ 25 o, Fig. 5 shows a flow chart of an embodiment of the invention

C/O

° a process suitable for the synchronization step 340 of Figure 3. Figure 5 illustrates

OJ

some embodiments of the invention including real-time rhythm

X

£ in detection step 510 and the independent music player, if necessary, to determine the timing of the music stroke to be played 520. The process determines the timing of repetitive movements of the program 530 00 and then determines the correlation between the detected timing and stroke of 540 01. It is understood that typical movements begin at the first moment from the start position and at the second moment arrive at the end position. Either or both of the first and second moments can be used as a basis for determining the velocity that is in line with the rhythm of the music. In fact, the basis can be determined by selecting the speed that is closest to the rhythm of the music in relation to the successive strokes. If the correlation requires 5 significant changes in the speed of animation, it is clear that the current training program does not fit well with the current piece of music and thus which one should change. In one embodiment (not shown) where the music source is controlled by the training system, a more suitable music track, if available, may be selected, in which case the operation would return to step 1010. However, if the music is not controlled by the training system, 550, which looks for an alternate program, and if found, changes the program to better fit with the music currently playing. If a suitable program is not already identified, the program may be terminated and / or the user may be prompted to change the type of program to identify a suitable program. After step 550, the operation returns to step 530.

On the other hand, if the correlation was good so that the velocity was close to the rhythm, or even compatible with the rhythm, the animation speed would only be fine-tuned to 20,560 to keep the animation in the rhythm of the music. If minor changes are required, they can be made gradually based on relative, differential and / or integrative control.

In step 570, the animation continues. Animation is produced from a given angle. The angle can be changed and / or a second parallel animation from different angles can be provided at the same time to show the animated character from different angles and to facilitate learning of a new movement.

CM

CM

In one embodiment, the system comprises a speech recognition unit S 30 for controlling the system. Such a unit may be configured to enable speech-controlled switching at an angle of animation

O

° presented. In addition or alternatively, remote animation 180 may be provided to control animation and / or music playback, to adjust animation speed, skip 11 animation forward or backward, stop animation, switch animation to another, and / or control other system options.

In step 580, the heart rate signal is compared to the target 5 power levels of the training program. If the heart rate is within the target range or within the fine-tuning range, the operation returns to step 510 (while animation continues). On the other hand, if the slight deviation is above the fine-tuning limits but within the main limits, the operation proceeds to step 540 to increase or decrease the speed accordingly. Thus, in order to find synchronization with the music, the operation returns to step 540 for the entire 10 steps rather than merely returning to step 560 (which is still done in an alternative embodiment). Returning to step 540, the training can be conveniently adjusted to control the training so that the heart rate remains within the desired range. However, if the heart rate is far from the target zone, ie below the lower limit or above the upper limit 15 (but below the safety limit), the operation returns to step 550 to change the program (lighter or heavier) depending on the heart rate signal.

Alternatively, or in addition to using heart rate, other measures of training power may be used as input to direct training 20 by customizing the animation. Such measures include, for example, one or more acoustic breath monitoring, direct or indirect breath measurements, such as muscle or air flow measurement, sweating, heat production (e.g., measured by an infrared sensor), and energy applied to the floor by the user performing movements.

2 25 o ^ The inventors have realized that physical training can be controlled by a computer animated virtual controller using interactive 3D 0X1 (3D) animation. In addition, interactive 3D animation allows you to provide a free ^ interactive angle during presentation of the animation, while 30g 3D animation can be based on a well-known skeletal animation model.

O

cv The animation is favorable compared to the recorded video because it has, for example,

powerful animation storage, the ability to combine animations from multiple sources including 12 runtime, the ability to produce standard animation with different characters, and the ability to switch angles without excessive memory consumption (without parallel video footage). The user can also change the angle of the animation while playing the animation.

5

Note that animation can be based on recorded movements of a real person. The animation can also contain synthetic data such as random noise or variations that make repeating sequences look natural.

10 In the examples of this description, several embodiments were described with reference to a single user training with the help of an animated training instructor. It will be appreciated that more than one training instructor can be animated using a common or separate circuitry, allowing for different parallel angles for the same operation or from different instructors. For example, various animated instructors may be used to display an exercise with varying degrees of difficulty and / or power. This allows different users to practice simultaneously based on a joint presentation by different animated instructors. Various animated guides can be displayed on one or more screens connected to a standard controller. It is even possible to utilize more than one controller 20 in parallel so that each one operates according to the music being played and listened to on each separate controller. In this case, different controllers can share a common microphone or audio output.

When multiple animated trainees are shown and individual power is used

OJ

o 25 feedback devices (e.g., heart rate monitor) to control training power, the user can simply follow the animated instructor that best suits the user's own preferences. Alternatively, different users may have x personalized power feedback devices (e.g., heart rate monitor) for

CL

customize the animated director accordingly. Alternatively, if there is more than ^ 30 one user corresponding to a common animated instructor, feedback may be overlooked or training may be controlled by averaging feedback from different users C \ | so that the power is maintained at an appropriate average level. In such a case, individual messages may still be presented to users who should either practice harder, e.g., by performing more efficient movements, practice lighter, e.g., by performing less effective movements, stop practicing completely, or ensure their feedback device functions.

The foregoing description has provided, by way of non-limiting examples of certain embodiments and embodiments of the invention, a full and informative description of the presently preferred embodiment of the invention by the inventors. It will be apparent to one skilled in the art that the invention is not limited to the above embodiments, but that it may be practiced in other embodiments 10 using equivalent means or various combinations of embodiments without departing from the features of the invention.

In addition, some features of the above embodiments of the present invention may be utilized without the corresponding use of other features. Thus, the foregoing description is to be construed as merely illustrative of the principles of the invention and not limiting thereof. Thus, the scope of the invention is limited only by the appended claims.

C \ J

δ

(M

i co o

(M

(M

X

I do not

CL

(M

m δ oo o o

(M

Claims (20)

A method for controlling physical training with a controller (110), the method comprising: maintaining a training program (310); and 5, showing a training program to a user (360), characterized by: providing (330) a computer animation corresponding to the movements according to the training program; synchronizing (340) the animation with the music; and displaying (360) a computer animation to the user on a screen. 10 Method according to Claim 1, characterized in that the production (330) of the animation comprises imitating the motion of different parts of the body of a three-dimensional figure. The method according to claim 2, characterized in that the character imitates a human being. Method according to any one of the preceding claims, characterized in that the synchronization (340) of the animation to the music comprises adjusting the speed of the animation 20 according to an external source (130,140). Method according to claim 4, characterized in that the external source comprises a music player (130). 6. The method of claim 4, wherein the external source comprises a heart rate monitor (140). o i CVJ A controller (110) for controlling physical training, the controller (110) comprising: a CC memory (220) configured to maintain a training program; and S! A video output (250) operable to a display configured to display the training program to the user (160) by means of the device; characterized in that the o <m controller (110) further comprises: a processor (210) configured to produce (330) a computer animation of the controller, which animation responds to movements according to the training program; the processor (210) is further configured to synchronize (340) the animation with the music; and the processor (210) is further configured to provide (360) computer animation via a video output. A controller (110) according to claim 7, characterized in that the production of the animation comprises imitating the motion of different parts of the body of a three-dimensional figure. 10 Controller (110) according to claim 8, characterized in that the figure imitates a human being. A controller (110) according to any one of claims 7 to 9, characterized in that synchronizing the animation with the music comprises adjusting the speed of the animation according to an external source (130, 140). Controller (110) according to claim 10, characterized in that the external source comprises a music player (130). Controller (110) according to claim 10, characterized in that the external source comprises a training power meter (140). Controller (110) according to claim 12, characterized in that the power meter for exercise training is a heart rate monitor (140). Controller (110) according to any one of claims 10 to 12, characterized in that the processor (210) is configured to change the training program x to adapt the training to changes in speed exceeding a given limit. CL 30 (M ^ 15. Controller (110) according to any one of claims 7 to 14, characterized in that the processor (210) is further configured to determine the music stroke and C 1 pace in real time and to synchronize the animation to the music while providing the user with a video output. Controller (110) according to any one of claims 7 to 15, characterized in that the processor (210) is further configured to include, based on the user input, desired training program program elements suitable for a given training area such as strength, aerobic, balance, etc. Controller (110) according to any one of claims 7 to 16, characterized in that the processor (210) is further configured to provide additional computer animation to additional controllers. 10 Controller (110) according to any one of claims 7 to 17, characterized in that the processor (210) is further configured to control the additional controllers individually based on the feedback received from different users. A computer program (240) for controlling physical training, the program comprising computer executable program code configured to cause the computer (110) to perform a method according to any one of claims 1 to 6. A system (100) according to any one of claims 7 to 18, comprising a controller (110) and a user feedback means (180) for adjusting the operation of the controller (110). C \ J δ {M co o {M {M X en CL {M m δ oo o o {M Krav