Motion interaction method and device based on intelligent device

Abstract

The invention discloses a motion interaction method and device based on an intelligent terminal device, and relates to the field of fitness sports, and the method comprises the steps: receiving a fitness video; acquiring an action video of the first user for body building according to the body building video; the action video of the first user is processed to obtain action information, the action information is display information of a virtual image of the first user, and action features of the virtual image of the user correspond to action features of the user; interaction request information from a terminal device of a second user is received, and the interaction request information is used for triggering an interaction effect related to the virtual image of the first user in a picture displayed in a display device of the first user.

Description

Technical Field

[0001] The present invention relates to the field of sports and fitness, and in particular to a sports interaction method and device based on an intelligent device. Background Art

[0002] More and more people are exercising through smart fitness devices, such as smart fitness mirrors or other smart fitness devices with camera recognition. The sports video is displayed on the display and the user's movements are recognized by the camera.

[0003] Users usually exercise alone using smart fitness equipment. How can smart fitness devices provide interactive functions between users through technical means to reduce the boredom of users during exercise and help users persist in using smart fitness equipment for exercise for a long time? Summary of the invention

[0004] The purpose of the present invention is to provide a sports interaction method and device based on an intelligent device, which can enhance the interaction between users in exercising through the intelligent fitness device, reduce the boredom during exercise, and help users persist in using the intelligent fitness equipment for exercise for a long time.

[0005] According to one aspect of the present application, a motion interaction method based on a smart device is provided, the method comprising:

[0006] Receive fitness videos;

[0007] Acquire an action video of the first user performing fitness according to the fitness video;

[0008] Processing the action video of the first user to obtain action information, where the action information is display information of the virtual image of the first user, and the action characteristics of the virtual image of the user correspond to the action characteristics of the user;

[0009] Receive interaction request information from a terminal device of a second user, where the interaction request information is used to trigger an interaction effect related to the first user's virtual image in a picture displayed on a display device of the first user.

[0010] In combination with the first aspect, in certain implementations of the first aspect, when the sports score of the first user is lower than the sports score of the second user, the terminal device of the second user displays the interaction request information determined to be sent by the second user on the display interface, and after receiving the sending confirmation from the second user, sends the interaction request information confirmed by the second user to the terminal device of the first user.

[0011] In combination with the first aspect, in some implementations of the first aspect, triggering an interactive effect related to the first user virtual image includes:

[0012] Presenting the content indicated by the interaction request in the display area of ​​the virtual image of the first user, wherein the content includes at least one of text or animation; or

[0013] Changing the virtual image of the first user includes changing at least one of the avatar, avatar expression, posture and action of the virtual image of the first user.

[0014] In combination with the first aspect, in certain implementations of the first aspect, the interaction request information is used to request the first user to complete fitness together, and is displayed as the interaction between the first user's virtual image and the second user's virtual image to complete the exercise, and the interaction between the virtual images to complete the exercise is a dynamic interaction between the two virtual images on the display.

[0015] In combination with the first aspect, in certain implementations of the first aspect, the interaction request information is used to request the first user and multiple other users including the second user to complete a fitness exercise together, display the virtual images of the first user and the other users on the display device of the first user, and perform differential processing on the virtual image of at least one user based on the exercise scores of multiple users; the differential processing includes enlarging the virtual image of the at least one user, adjusting the position of the virtual image among all virtual images, and performing animation special effects processing on the virtual image.

[0016] In combination with the first aspect, in some implementations of the first aspect, it is preset that if the first user agrees to the interaction requested by the interaction request information, the interaction request sent by the second user will not be displayed on the display interface of the first user.

[0017] In combination with the first aspect, in certain implementations of the first aspect, when the first user sets a default rejection of one or more of a plurality of different types of interaction request information, and the first user receives interaction request information of the type set to be rejected by default, the interaction request sent by the second user will not be displayed on the display interface of the first user.

[0018] In combination with the first aspect, in certain implementations of the first aspect, the interaction request information is also used to request the first user to conduct voice interaction. When the first user agrees to the voice interaction, the first user receives a voice message sent by the second user, and the voice message is sound information recorded by the second user, real-time voice information of the second user, or voice special effect information preset in the terminal device.

[0019] In combination with the first aspect, in certain implementations of the first aspect, the interaction request information is also used to request the first user to make a voice call. When the first user agrees to the voice call, the first user can have a real-time two-way conversation with the second user during exercise through the terminal device.

[0020] In a second aspect, a terminal device is provided, which can specifically execute each step in the above-mentioned first aspect and any possible implementation method thereof.

[0021] In a third aspect, a computer program product is provided, which includes: a computer program (also referred to as code, or instruction), which, when executed, enables a computer to execute the method in the first aspect and any possible implementation thereof.

[0022] In a fourth aspect, a computer-readable medium is provided, which stores a computer program (also referred to as code or instruction) which, when executed on a computer, enables the computer to execute the method in the first aspect and any possible implementation thereof.

[0023] In a fifth aspect, a smart fitness mirror is provided, comprising a display for displaying a user interface or an exercise interface; a mirror arranged in front of the display, the mirror being used to display the user's image on the mirror, and the display displaying the user interface to the user through the mirror; the smart fitness mirror is used to execute each step in the above-mentioned first aspect and any possible implementation method thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A schematic diagram of a flow chart of a motion interaction method based on a smart terminal device provided in an embodiment of the present application;

[0025] Figure 2 A schematic diagram of a terminal device provided in an embodiment of the present application;

[0026] Figure 3 A schematic diagram of another terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments can be combined with each other without conflict.

[0028] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those within the scope of this description. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0029] It is to be understood that the term "one" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element may be one, while in another embodiment, the number of the element may be multiple, and the term "one" should not be understood as a limitation on the quantity.

[0030] The terminal device referred to in this application is not limited to any intelligent electronic product that can interact with the user (for example, through a touchpad), such as a smart phone, a tablet computer, etc. The mobile electronic product can use any operating system, such as an Android operating system, an iOS operating system, etc., or a dedicated fitness smart box, which is connected to an external display device by wired or wireless means; or a smart fitness mirror, a hardware terminal device with a camera and a display screen. The smart fitness mirror may include a processor that partially controls the operation of various subcomponents in the smart fitness mirror and manages the data flow (for example, video content, audio from the user, biometric feedback analysis) flowing into / out of the smart fitness mirror. The smart fitness mirror may include a display for displaying video content, a graphical user interface (GUI) with which the user can interact and control the smart fitness mirror, biometric feedback data and / or other visual content. The sensor may be coupled to the processor to collect user-related data. The antenna may be coupled to the processor to provide data transmission between the smart fitness mirror and another device (for example, a remote control device, a biometric sensor, a wireless router). The antenna may include multiple transmitters and receivers, each transmitter and receiver being customized for a specific frequency and / or wireless standard (e.g., Bluetooth, 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 2G, 3G, 4G, 4GLTE, 5G). The amplifier may be coupled to the processor to receive an audio signal from the processor so as to output subsequent sound through the left speaker and / or the right speaker. The network device includes an electronic device capable of automatically performing numerical calculations and information processing according to pre-set or stored instructions, and its hardware includes but is not limited to a microprocessor, a dedicated integrated circuit, a programmable logic device, a field programmable gate array, a digital signal processor, an embedded device, etc. The network device includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets, or a cloud consisting of a plurality of servers; here, the cloud is composed of a large number of computers or network servers based on cloud computing, wherein cloud computing is a type of distributed computing, a virtual supercomputer consisting of a group of loosely coupled computer sets. The network includes but is not limited to the Internet, wide area network, metropolitan area network, local area network, VPN network, wireless ad hoc network, etc. Preferably, the device can also be a program running on the user device, network device, or a device formed by integrating the user device and network device, network device, touch terminal, or network device and touch terminal through a network. Other display devices in this application include but are not limited to televisions, projectors, independent displays, computer display screens, other fitness devices with displays, smart virtual reality glasses, and other smart electronic products.

[0031] According to one aspect of the present application, reference Figure 1 , provides a motion interaction method based on an intelligent device, the method comprising:

[0032] S101, obtaining an action video of a first user;

[0033] In an optional implementation, a terminal device equipped with a camera and an application installed on the terminal device is used to start a mobile phone application, and the camera is used to capture human body movements. The user's movement video is obtained through the camera to capture human body movements.

[0034] In another optional implementation, the terminal device and the camera used are not integrated, and the smart device may be connected to other cameras.

[0035] S102, processing the action video of the first user to obtain action information, where the action information is display information of the virtual image of the first user, and the action characteristics of the virtual image of the user correspond to the action characteristics of the user;

[0036] Optionally, the collected image and video data may be preprocessed, such as scaling, rotating, cropping, etc., to facilitate subsequent processing.

[0037] Computer vision algorithms, such as keypoint detection and optical flow tracking, are used to extract features related to human movements from images.

[0038] In one embodiment, human skeleton points are detected for each image frame to obtain the coordinates of the skeleton points of the user in each image frame. The detected skeleton points may include multiple skeleton points of the following: top of the head, nose tip, left ear, right ear, chin, neck, left shoulder, right shoulder, left elbow, right elbow, left wrist, right wrist, left metacarpophalangeal joint, right metacarpophalangeal joint, left fingertips, right fingertips, left hip, right hip, left knee, right knee, left ankle, right ankle, left toe tip, right toe tip, left heel, right heel, etc.; the straight-line distance between the top skeleton point and the pelvic skeleton point is obtained, and the unit length of the coordinate system is obtained according to the straight-line distance; the straight-line distance between the top skeleton point and the pelvic skeleton point is obtained, and the straight-line distance is converted into One sixth of the distance is taken as the unit length of the coordinate system, that is, the size of the unit length 1 of the coordinate system is one sixth of the straight line distance; the straight line between the top bone point and the pelvic bone point is taken as the ordinate, the pelvic bone point is taken as the origin, and a rectangular coordinate system is constructed with the obtained unit length; the bone point coordinates in the second content are obtained by scaling the user's bone point coordinates in proportion, and a virtual image is obtained according to the bone point coordinates. The virtual image can be a stick figure with bone points, or a human body model with muscle shape. The virtual image is obtained by identifying and processing each frame of fitness action, and the order of the dynamic virtual image generated by the terminal device is determined according to the generation time of the bone point. Through this recognition technology, the user's movement posture can be scored or corrected; the user's actions can also be counted. In addition, optionally, the terminal device sends the data of the virtual image to a remote server or a terminal device of another user. The action information of the virtual image of the user's bone point obtained according to the video image can be called display information, and the dynamic display of the user's virtual image can be realized through the display information. In addition, the action video obtained may not be all videos after the fitness action is completed, and action acquisition and image processing can be performed in real time.

[0039] In another implementation, the trained motion recognition model can be deployed in a mobile phone application. The application reads the image data captured by the mobile phone camera in real time, performs motion recognition through the model, and displays the results in real time.

[0040] S103, receiving interaction request information from a terminal device of a second user, wherein the interaction request information is used to trigger an interaction effect related to the virtual image of the first user in a picture displayed on a display device of the first user.

[0041] The second user is another user who uses other smart terminal devices. The smart device used by the second user can be the same as that of the first user or different. For example, the first user uses a smart fitness mirror, and the second user can use a smart fitness mirror or a smart phone terminal installed with a fitness application that is integrated with the smart fitness device; or the first user and the second user both use smart phones installed with the same fitness application. When a user uses a mobile phone as a smart fitness terminal, the user can also cast the screen onto other display devices through mobile phone screen projection.

[0042] The smart fitness device can allow the second user to send an interactive request message if the second user meets certain conditions. However, when the first user and the second user are both taking the same fitness course, the smart fitness device scores the first and second users' sports performances. The score can be a specific score, such as a score of 10 or 100, or a score for the accuracy of a single user's action and a cumulative score for the overall action; in addition, the score can also be a graded evaluation, such as an excellent or good score.

[0043] In an optional embodiment, when the smart fitness device determines that the sports score of the second user is higher than the sports score of the second user, one or more alternative interaction information is displayed on the display interface of the second user's terminal device. When only one alternative interaction information is displayed to the second user, the second user can determine whether to send the interaction request information; when multiple alternative interaction information are displayed to the first user's terminal device, the second user first makes a selection and sends the selected information in the alternative interaction information to the terminal device.

[0044] In addition, the selection or confirmation of the second terminal can be performed through voice recognition, or gesture recognition through a camera, and the user's selection or confirmation can be determined by confirming that the user makes a specific gesture. The second user can also directly touch the smart terminal device to select and confirm, such as when the smart device has a keyboard or touch screen, the keyboard or touch screen is used for operation.

[0045] In another embodiment, the second user can actively trigger, for example, the second user selects and confirms the interaction request information to be sent to the second user through the user interface of the smart device, and the smart device does not actively provide the second user with a prompt or content for sending the interaction request information.

[0046] The interaction request messages sent to the first user can be divided into different types:

[0047] In one embodiment, the interaction request information is first interaction request information, which is used to request that the content indicated by the first interaction request be presented in the display area of ​​the first user's virtual image, and the content includes at least one of text or animation. In one example, the first interaction request information can trigger the display of text and / or animation in an area related to the first user's virtual image, such as around the virtual image or the upper layer of the image covering or partially covering the virtual image. The text or animation can be encouraging content, or when the second user's score is higher than that of the first user, the text or animation can also be content for showing off or announcing victory.

[0048] In another embodiment, the interaction request information is the second interaction request information, which is used to trigger a change in the virtual image of the first user; in one example, a change in the avatar of the first user's virtual image is triggered, such as changing the avatar to the avatar requested by the second interaction request information; in another example, the avatar of the first user's virtual image is triggered to display an expression requested by the interaction request information, which expression may be static or dynamic; in another example, the second interaction information may trigger the first user's virtual image to perform specific dynamic actions; in another example, the second interaction information may trigger the first user's virtual image to display a specific posture.

[0049] Among them, the new avatar, dynamic or static expression image, etc. displayed by the user's virtual image can be pre-configured in the intelligent auxiliary device, and each avatar, image, dynamic video or animation, etc. can be numbered. The interactive request information includes the number of the requested feature. When the intelligent terminal device receives the interactive request information, it determines the number included in the information, retrieves the pre-stored avatar, image, dynamic video or animation according to the number, and processes it in combination with the user's virtual image.

[0050] When users perform fitness exercises through smart terminal devices, a course usually has multiple users participating at the same time. The interactivity of the course mainly lies in the fact that users follow the coach's video to exercise through camera recognition. In this application, multiple users can send interactive request information to each other, so that the interactivity between different users is greatly improved in the scenario of multi-person exercise, and combined with the virtual image generated by camera recognition, an interactive effect is produced on the virtual image representing the user, which increases the real competitiveness and interactive fun in the exercise, so that users can develop the habit of using smart devices for exercise for a long time and achieve the desired exercise effect.

[0051] In another embodiment, the interaction request information is third interaction request information, and the third interaction request information is used to request the first user to complete fitness together, and is displayed as the interaction between the first user's virtual image and the second user's virtual image to complete the exercise, and the interaction between the virtual images to complete the exercise is a dynamic interaction between the two virtual images on the display. In some sports courses, users are in different geographical locations, but the courses allow users to interact with each other, such as some fencing courses, boxing courses, or other courses that allow users' virtual images to interact with each other. By generating interaction request information, the virtual images of two or more users are aggregated or juxtaposed together, and the virtual images are presented as two characters interacting in the display effect, such as fencing, boxing, etc. The user's virtual image recognizes the user's actions through a camera and is displayed by the virtual image. Taking a boxing course as an example, after the first user receives the interaction request information from the second user, the first user and the second user jointly conduct a boxing course. The first user and the second user perform actions according to the course video. The first user and the second user respectively identify their actions through their respective smart terminal devices and display them through virtual images. The virtual images of the first user and the second user also appear on the display screen of the other party, and the two virtual images can interact directly. For example, the first user can make his virtual image interact with the virtual image of the second user through action posture or movement. The interaction can be a partial overlap between the two virtual images, or it can be through the action of the virtual image of one user (such as a specific boxing posture or standard completion of the action) to affect the virtual image of the other user, such as causing the posture and position of the virtual image of the other user to change, such as causing the virtual image of the other user to fall to the ground, freeze, retreat, etc. during boxing, and can also cause the other virtual image to produce a specific animation effect. Further, the smart terminal devices of the first user and the second user send each other's action information or virtual image information to each other, so that the virtual image of the other party can be displayed in their respective display screens.

[0052] When users perform fitness exercises through smart terminal devices, the exercise of a single user often lacks physical interaction with other fitness users. On the smart fitness device based on camera recognition of actions, users have virtual images corresponding to their actions, and transmit their virtual image information to other users, so that on the screen seen by the user, multiple users perform fitness in the same space, and through the interaction between virtual images, users can further feel the cooperation with other users during exercise, making the experience of multiple people exercising together more realistic.

[0053] In another embodiment, the interaction request information is fourth interaction request information, and the fourth interaction request information is used to request the first user and multiple other users including the second user to complete fitness exercises together, display the virtual images of the first user and other users on the display device of the first user, and perform differential processing on the virtual image of at least one user based on the exercise scores of multiple users; the differential processing includes enlarging the virtual image of the at least one user, adjusting the position of the virtual image among all virtual images, and performing animation special effects processing on the virtual image.

[0054] The fourth interactive request information is used to invite other users to complete the same course together, and requires all users who accept the invitation to share virtual image information or action information, that is, to receive virtual image information or action information of other users, and send their own virtual image or action information to the smart fitness devices of other users; in a possible implementation manner, the user sends his or her own virtual image information or action information to a remote server, and the remote server sends the information to the smart terminal devices of other relevant users.

[0055] In a scenario where multiple users are exercising together, such as a group class, the virtual images of the multiple users participating in the class are displayed on the user's screen; the users are scored according to the standard degree of their postures and movements, and the positions of the virtual images of one or more users with the highest scores in the screen are specially processed, such as adjusting them to the front of all other virtual images, or to the top of the screen of other virtual images, or adjusting the display size of their virtual images, for example, the size of the virtual images of one or more users with the highest scores is larger than the virtual images of other users, and the processing of adjusting the size of the virtual images can also be combined with the processing of adjusting the positions of the virtual images.

[0056] Before step S103, optionally, the method may also include that the first user may pre-set and agree to the interaction requested by the interaction request information, and the interaction request sent by the second user will not be displayed on the display interface of the first user. This eliminates the process of requiring the user to confirm each time an interaction request information is received; the first user may also pre-set to reject all interaction information. Or pre-set to reject one or more of a plurality of different types of interaction request information by default, and the first user receives the interaction request information of the set default rejection type, and the interaction request sent by the second user will not be displayed on the display interface of the first user. Or pre-set to agree to one or more of a plurality of different types of interaction request information by default, and the first user receives the interaction request information of the set default agreement type, and other sent interaction requests will not be displayed on the display interface.

[0057] In an optional implementation, the interaction request information is also used to request the first user to conduct voice interaction. When the first user agrees to the voice interaction, the first user receives the voice message sent by the second user. The voice message is the sound message recorded by the second user, or the real-time voice message of the second user, or the voice special effect information preset in the terminal device. That is, the second user can request the first user to interact by voice. In one example, the second user starts recording through the user interface, records the voice message, and sends the recorded voice message to the terminal device of the first user. In addition, the second user can also pre-record or set one or more recorded voice messages in the terminal device. When the second user needs to send a voice message to the first user for interaction, the information to be sent can be directly selected from the pre-recorded or set voice message. It is also possible for the second user to open a one-way voice connection, and the second user can make a real-time voice call to the first user, so that the second user can realize a one-way real-time voice interaction or online shouting with the first user. In addition, the interaction request information is also used to request a two-way voice call between the first user and the second user.

[0058] In the above-mentioned multiple implementations, different implementations can be combined with each other. For example, the first user can perform voice interaction with the second user, and the second user can perform other virtual image-related interactions with the first user.

[0059] Figure 2 2 is a schematic block diagram of a terminal device 200 provided in an embodiment of the present application. As shown in the figure, the terminal device 200 may include: a transceiver unit 210, a processing unit 220, and a video acquisition unit 230.

[0060] It should be understood that the terminal device 200 may correspond to the terminal device in the method according to the embodiment of the present application, and the various units in the terminal device 200 and the above-mentioned other operations and / or functions are the corresponding processes of the above-mentioned method embodiments.

[0061] Wherein, when the terminal device 200 is used to execute Figure 1 In method 100, the video acquisition unit 230 acquires the user's action video, the transceiver unit 210 is used to receive the fitness video and send a request to the server to obtain the fitness video, as well as other steps involving the sending and receiving of data and / or information, and the processing unit 220 can be used to execute other steps in the method.

[0062] Figure 3 is a schematic block diagram of a terminal device 300 provided in an embodiment of the present application. Figure 3As shown, the terminal device 300 includes: at least one processor 310 and a communication interface 320. The processor 310 is coupled to a memory and is used to execute instructions stored in the memory to control the communication interface 320 to send and / or receive information or video files. Exemplarily, the terminal device 300 also includes a memory 330 for storing instructions.

[0063] It should be understood that the processor 310 and the memory 330 can be combined into one processing device, and the processor 310 is used to execute the program code stored in the memory 330 to implement the above functions. In specific implementation, the memory 330 can also be integrated into the processor 310, or independent of the processor 310.

[0064] An example of the terminal device 200 or the terminal device 300 can be a smart fitness mirror, which includes a communication interface for receiving a video image of a fitness coach, a display operably coupled to the communication interface to display the video image of the fitness coach, and a mirror arranged in front of the display to reflect the image of the person opposite to the display. The mirror has a reflection area portion to transmit the video image of the fitness coach to the person opposite to the display so that the video image of the fitness coach appears to be superimposed on a part of the image of the person. The reflection area portion can overlap with the display area, or at least cover the area of ​​the display. The reflection area in the embodiment of the present application can also be referred to as a partial reflection portion.

[0065] An example of an interactive fitness method includes the steps of: streaming fitness content to an interactive video system including a mirror having a partially reflective portion and a display disposed on one side of the partially reflective portion; displaying the fitness content to a user via the display and the partially reflective portion of the mirror; and reflecting an image of the user using the mirror so that the image of the user is at least partially superimposed on the fitness content displayed via the display and the partially reflective portion of the mirror.

[0066] An example of a method for using a smart fitness mirror includes the following steps: while displaying fitness content to a user on a video display behind a partially transmissive mirror: reflecting an image of the user using the partially transmissive mirror; measuring the user's heart rate using a heart rate monitor attached to the user; transmitting the heart rate from the heart rate monitor to an antenna operably coupled to the video display; displaying the user's heart rate on the video display; and displaying the user's target heart rate on the video display.

[0067] The interactive object is used to show the user the controls or operations that the user can perform, such as page switching, selection, pause / play of the course, etc. The interactive object can be an icon, text, highlight selection, other forms that can prompt the user to interact, or a combination thereof.

[0068] In addition, an embodiment of the present application provides a fitness system, which includes a remote server and a terminal device installed with an application program for executing the above method. The fitness system may further include terminal devices of other users. And the system may further include a display device for displaying a video screen to a user by means of screen projection using the display device.

[0069] Based on the method in the above embodiment, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method in the above embodiment.

[0070] Based on the method in the above embodiment, an embodiment of the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method in the above embodiment.

[0071] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0072] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0073] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be an intelligent fitness mirror device, a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a tape) or a semiconductor medium (for example, a solid state disk (SSD)), etc.

[0074] The above embodiments may be implemented in a variety of ways. For example, the embodiments may be implemented using hardware, software, or a combination thereof. When implemented in software, the software code may be executed on a suitable processor or set of processors, whether provided in a single computer or distributed among multiple computers.

[0075] Furthermore, the computer may be embodied in any of a variety of forms, such as a rack-mounted computer, a desktop computer, a laptop computer, or a tablet computer. In addition, the computer may be embedded in a device not generally regarded as a computer but having suitable processing capabilities, including a personal digital assistant (PDA), a smart phone, or any other suitable portable or fixed electronic device.

[0076] In addition, the computer may have one or more input and output devices. Among other things, these devices may also be used to present a user interface. Examples of output devices that may be used to provide a user interface include a printer or display screen for visual presentation of the output and a speaker or other sound-generating device for audible presentation of the output. Examples of input devices that may be used for a user interface include a keyboard and a pointing device, such as a mouse, a touch pad, and a digitized tablet computer. As another example, a computer may receive input information through speech recognition or other audible formats.

[0077] Such computers may be interconnected in a suitable form through one or more networks, including local area networks or wide area networks, such as enterprise networks, intelligent networks (IN) or the Internet. Such networks may be based on suitable technologies, may operate according to suitable protocols, and may include wireless networks, wired networks or fiber optic networks.

[0078] The various methods or processes outlined herein may be encoded as software that can be executed on one or more processors using any of a variety of operating systems or platforms. In addition, such software may be written using any of a number of suitable programming languages ​​and / or programming or scripting tools, and may also be compiled into executable machine language code or intermediate code that is executed on a framework or virtual machine. Some embodiments may specifically employ one or more of a specific operating system or platform and a specific programming language and / or scripting tool to facilitate execution.

[0079] In the claims and the description above, all transitional phrases such as "includes," "comprising," "carrying," "having," "containing," "involving," "holding," "consisting of," etc. should be understood as open-ended, i.e., including but not limited to.

[0080] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A motion interaction method based on an intelligent terminal device, characterized in that: The method comprises: Receive fitness videos; Acquire an action video of the first user performing fitness according to the fitness video; Processing the action video of the first user to obtain action information, where the action information is display information of the virtual image of the first user, and the action characteristics of the virtual image of the user correspond to the action characteristics of the user; Receive interaction request information from a terminal device of a second user, where the interaction request information is used to trigger an interaction effect related to the first user's virtual image in a picture displayed on a display device of the first user.

2. The method according to claim 1, characterized in that The method includes: when the sports score of the first user is lower than the sports score of the second user, the terminal device of the second user displays the interaction request information determined to be sent by the second user on a display interface, and after receiving the sending confirmation from the second user, sends the interaction request information confirmed by the second user to the terminal device of the first user.

3. The method according to claim 1 or 2, characterized in that: Triggering an interactive effect related to the first user's virtual image, including: Presenting the content indicated by the interaction request in the display area of ​​the virtual image of the first user, wherein the content includes at least one of text or animation; or Changing the virtual image of the first user includes changing at least one of the avatar, avatar expression, posture and action of the virtual image of the first user.

4. The method according to any one of claims 1 to 3, characterized in that: The interaction request information is used to request the first user to complete fitness together, and is displayed as the interaction between the first user's virtual image and the second user's virtual image to complete the exercise. The interaction between the virtual images to complete the exercise is a dynamic interaction between the two virtual images on the display.

5. The method according to any one of claims 1 to 4, characterized in that: The second user is multiple, The interaction request information is used to request the first user and multiple other users including the second user to complete fitness exercises together, display the virtual images of the first user and other users on the display device of the first user, and perform differential processing on the virtual image of at least one user according to the exercise scores of multiple users; the differential processing includes enlarging the virtual image of the at least one user, adjusting the position of the virtual image among all virtual images, and performing animation special effects processing on the virtual image.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises, It is assumed that the first user agrees to the interaction requested by the interaction request information, and then the interaction request sent by the second user is not displayed on the display interface of the first user.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises, When the first user sets a default rejection for one or more of a plurality of different types of interaction request information, and the first user receives interaction request information of the type set to be rejected by default, the interaction request sent by the second user will not be displayed on the display interface of the first user.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises, The interaction request information is also used to request the first user to conduct voice interaction. When the first user agrees to the voice interaction, the first user receives the voice information sent by the second user. The voice information is the sound information recorded by the second user, the real-time voice information of the second user, or the voice effect information preset in the terminal device.

9. The method according to any one of claims 1 to 8, characterized in that: The method also includes that the interaction request information is also used to request the first user to conduct a voice call. When the first user agrees to the voice call, the first user conducts a real-time two-way call with the second user during exercise through the terminal device.

10. A terminal device, characterized in that: The terminal device is used to execute the method according to any one of claims 1-9.

11. A smart fitness mirror, comprising a display for displaying a user interface or an exercise interface; a mirror disposed in front of the display, the mirror being used to display the image of the user on the mirror, and the display showing the user interface to the user through the mirror; The smart fitness mirror is used to execute any one of the methods described in claims 1-9.

Images