Apparatus and method for providing immersive video content service based on cardio exercise device control

Abstract

The present invention relates to an apparatus and method for providing immersive video content services based on cardio-exercise device control. An electronic device according to one embodiment of the present invention includes a memory and a processor connected to the memory, and the processor receives selection information regarding video content information selected by a user from a user terminal, outputs a multi-view video included in the video content information corresponding to the selection information to a display device, and can adjust the difficulty of a cardio exercise device based on the exercise difficulty according to the video playback time included in the video content information.

Description

Technology Field

[0001] The present invention relates to an apparatus and method for providing immersive video content services based on cardio-exercise device control. Background Technology

[0002] Unless otherwise indicated in this specification, the contents described in this section are not prior art for the claims of this application, and are not to be recognized as prior art simply because they are included in this section.

[0003] With the recent increase in interest in health and well-being, the importance of indoor exercise is being emphasized. In particular, cardio exercise equipment such as treadmills, stationary bikes, and elliptical machines allows for stable aerobic exercise without weather or environmental constraints. However, these devices generally provide a monotonous exercise environment, which presents a problem in maintaining user interest.

[0004] To overcome these limitations, exercise environments utilizing immersive video content are being researched. Attempts are being made to apply Virtual Reality (VR) or Augmented Reality (AR) technologies to provide users with experiences similar to actually running or cycling outdoors. However, existing immersive exercise content primarily relies on visual feedback and often fails to synchronize with the user's exercise intensity or the device's resistance level. Consequently, this can lead to a lack of realism and potentially limited exercise effectiveness.

[0005] Meanwhile, some advanced fitness devices integrate video content with exercise equipment to provide features where the environment within the video changes according to the user's movements. For instance, there are methods where speed is adjusted along a specific path or resistance is modified based on changes in incline. However, these technologies have the disadvantage of being difficult for general users to access easily, as they primarily rely on expensive specialized equipment or lack content diversity.

[0006] Therefore, there is a need for cardio exercise device control technology that can be linked with various video content while providing a more realistic sense of immersion. To provide users with a realistic exercise experience, such as hiking in tourist areas or mountainous terrain, this invention proposes a system in which exercise devices, such as treadmills or indoor cycles, are automatically adjusted to match the difficulty level of the video content. Through this, users receive an experience similar to exercising in a real environment, enabling more effective and enjoyable workouts. Prior art literature

[0007] Korean Registered Patent No. 10-2224618 (March 2, 2021) The problem to be solved

[0008] One embodiment of the present invention provides an immersive video content service provision device and method based on cardio exercise device control.

[0009] The technical problems to be solved by the present invention are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which the present invention belongs from the description below. means of solving the problem

[0010] To achieve the above-mentioned objective, an electronic device according to one embodiment of the present invention includes a memory and a processor connected to the memory, and the processor receives selection information regarding video content information selected by a user from a user terminal, outputs a multi-view video included in the video content information corresponding to the selection information to a display device, and can adjust the difficulty of a cardio exercise device based on the exercise difficulty according to the video playback time included in the video content information.

[0011] At this time, the video content information may include a multi-view video in which videos of various angles are combined, information regarding the video playback time of the multi-view video and a first travel distance corresponding to the video playback time, an exercise difficulty corresponding to the video playback time, an overall difficulty derived based on the exercise difficulty for the entire video playback time, and information regarding the type of cardio exercise device to which the video content information can be applied.

[0012] At this time, the processor derives a second travel distance according to the operation of the cardio exercise device, compares the second travel distance with the first travel distance, controls the video playback time of the multi-view video to correspond to the second travel distance and outputs it to the display device, and can adjust the difficulty of the cardio exercise device based on the exercise difficulty corresponding to the video playback time of the multi-view video.

[0013] At this time, the processor can track the user's head movement through a camera and change the viewpoint of the multi-view image output to the display device based on the head movement.

[0014] At this time, the user terminal may have a user account logged in that includes information about the user's gender and age group and identifies the user at all times.

[0015] At this time, the processor can derive recommended video content information from the entire video content information based on the user account and transmit the recommended video content information to the user terminal.

[0016] At this time, the processor may derive similar users among all users whose gender and age group are identical to the gender and age group of the user, derive a recommendation score for each video content information based on the usage history of the video content information of the similar users, and derive video content information in which the recommendation score exceeds a preset threshold recommendation score as the recommended video content information.

[0017] At this time, the processor can derive a preference score for specific video content information based on the usage history of video content information of the similar user, derive a difficulty score for specific video content information based on the usage history of video content information of the similar user, and derive a recommendation score for specific video content information based on the preference score and the difficulty score.

[0018] At this time, the processor may derive a first ratio representing the ratio of the number of times the similar user used the specific video content information to the total number of times the similar user used the video content information, derive a second ratio representing the ratio of the number of similar users who used the specific video content information to the total number of users who used the specific video content information, derive a correction weight based on the number of video content information used by the similar user relative to the total number of video content information, and derive the preference score for the specific video content information based on the first ratio, the second ratio, and the correction weight.

[0019] At this time, the processor may derive a first average representing the average of the overall difficulty of the entire video content information used by the similar user, derive a second average representing the average of the completion time of all users using the specific video content information, derive a third average representing the average of the completion time of the similar user using the specific video content information, and derive the difficulty score for the specific video content information based on the overall difficulty of the specific video content information, the first average, the second average, and the third average.

[0020] At this time, the above recommendation score is derived by the following mathematical formula,

[0021]

[0022] rs represents the recommendation score for the specific video content information, ps represents the preference score for the specific video content information, and ds represents the difficulty score for the specific video content information.

[0023] The above preference score is derived by the following mathematical formula, but,

[0024]

[0025] ps represents the preference score for the specific video content information, r1 represents the first ratio, r2 represents the second ratio, and w represents the correction weight.

[0026] The above correction weight is derived by the following mathematical formula,

[0027]

[0028] w represents the above correction weight, tc represents the total number of video content information, and suc represents the number of video content information used by the above similar user, and

[0029] The above difficulty score is derived by the following mathematical formula, but,

[0030]

[0031] ds represents the difficulty score for the specific video content information, a1 represents the first average, a2 represents the second average, a3 represents the third average, and d may represent the overall difficulty of the specific video content information. Effects of the invention

[0032] As such, according to one embodiment of the present invention, an immersive video content service provision device and method based on cardio exercise device control can be provided.

[0033] The effects obtainable from the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description below. Brief explanation of the drawing

[0034] Other aspects, features, and benefits of specific preferred embodiments of the present invention, as described above, will become more apparent from the following description in conjunction with the accompanying drawings. FIG. 1 is a conceptual diagram of an immersive video content service providing device based on cardio exercise device control according to one embodiment of the present invention. FIG. 2 is a block diagram of an electronic device according to one embodiment of the present invention. FIG. 3 is a drawing showing video content information according to an embodiment of the present invention. FIG. 4 is a diagram showing multi-view video playback and difficulty level adjustment of a cardio exercise device according to one embodiment of the present invention. FIG. 5 is a diagram showing a viewpoint change of a multi-view image according to an embodiment of the present invention. FIG. 6 is a diagram showing the derivation of recommended video content information according to an embodiment of the present invention. FIG. 7 is a flowchart of a method for providing an immersive video content service based on cardio exercise device control according to an embodiment of the present invention. It should be noted that in the drawings above, similar reference numbers are used to illustrate identical or similar elements, features, and structures. Specific details for implementing the invention

[0035] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0036] In describing the embodiments, technical details that are well known in the art to which the present invention belongs and are not directly related to the present invention are omitted. This is intended to convey the essence of the present invention more clearly without obscuring it by omitting unnecessary explanations.

[0037] For the same reason, some components in the attached drawings have been exaggerated, omitted, or schematically depicted. Additionally, the size of each component does not entirely reflect its actual dimensions. Identical or corresponding components in each drawing have been assigned the same reference numbers.

[0038] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but can be implemented in various different forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims. Throughout the specification, the same reference numerals refer to the same components.

[0039] At this point, it will be understood that each block of the process flow diagrams and combinations of the flow diagrams can be executed by computer program instructions. Since these computer program instructions can be loaded into the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing equipment, the instructions executed through the processor of the computer or other programmable data processing equipment create means to perform the functions described in the flow diagram block(s). Since these computer program instructions can also be stored in computer-available or computer-readable memory that can be directed toward the computer or other programmable data processing equipment to implement the function in a specific way, the instructions stored in computer-available or computer-readable memory can also produce a manufactured item containing instruction means to perform the function described in the flow diagram block(s). Since computer program instructions can be loaded onto a computer or other programmable data processing equipment, instructions that perform a series of operation steps on the computer or other programmable data processing equipment to create a process executed by the computer can also provide steps for executing the functions described in the flowchart block(s).

[0040] Additionally, each block may represent a module, segment, or part of code containing one or more executable instructions for executing a specified logical function(s). It should also be noted that in some alternative execution examples, the functions mentioned in the blocks may occur out of order. For instance, two blocks described in succession may actually be executed substantially simultaneously, or the blocks may be executed in reverse order according to their corresponding functions.

[0041] In this embodiment, the term "part" refers to a software or hardware component such as a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC), and the "part" performs certain roles. However, the meaning of "part" is not limited to software or hardware. The "part" may be configured to reside in an addressable storage medium or configured to run one or more processors. Accordingly, as an example, the "part" includes components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functions provided within the components and "parts" may be combined into a smaller number of components and "parts" or further separated into additional components and "parts." In addition, the components and '~parts' may be implemented to play one or more CPUs within the device or secure multimedia card.

[0042] In describing the embodiments of the present invention in detail, the primary focus will be on examples of specific systems, but the main point claimed in this specification is applicable to other communication systems and services having a similar technical background without significantly departing from the scope disclosed in this specification, and this will be possible at the judgment of a person with skilled technical knowledge in the relevant technical field.

[0043] FIG. 1 is a conceptual diagram of an immersive video content service providing device based on cardio exercise device control according to one embodiment of the present invention.

[0044] Referring to FIG. 1, an immersive video content service providing device based on cardio exercise device control according to one embodiment of the present invention provides various moving videos of tourist attractions, travel destinations, or other virtual reality environments to users who do not have the time or physical strength to visit tourist attractions or travel destinations in person, and can provide immersive video content to users by allowing them to experience the moving videos while operating the cardio exercise device.

[0045] Meanwhile, the immersive video content service providing device based on cardio exercise device control may also be referred to as an 'electronic device (100)' in the present invention.

[0046] At this time, the buyer terminal (200) and the selling farm terminal (300) may include a communication-enabled desktop computer, laptop computer, notebook, smartphone, tablet PC, mobile phone, smart watch, smart glass, e-book reader, PMP (portable multimedia player), portable game console, navigation device, digital camera, DMB (digital multimedia broadcasting) player, digital audio recorder, digital audio player, digital video recorder, digital video player, PDA (Personal Digital Assistant), etc.

[0047] FIG. 2 is a block diagram of an electronic device (100) according to one embodiment of the present invention.

[0048] An electronic device (100) according to one embodiment includes a processor (110) and a memory (120). The processor (110) can perform at least one of the methods described above. The memory (120) can store information related to the method described above or store a program in which the method described above is implemented. The memory (120) may be volatile memory or non-volatile memory. The memory (120) may be referred to as a 'database', 'storage unit', etc.

[0049] The processor (110) can execute a program and control the electronic device (100). The code of the program executed by the processor (110) can be stored in memory (120). The device (100) can be connected to an external device (e.g., a personal computer or a network) through an input / output device (not shown) and exchange data.

[0050] At this time, the processor (110) can receive selection information regarding the video content information selected by the user from the user terminal.

[0051] In addition, the processor can output a multi-view image included in the video content information corresponding to the selection information to a display device.

[0052] At this time, the display device may be located within the field of view of a user using the cardio exercise device described below, or it may be a display device in the form of an HMD.

[0053] In addition, the processor can adjust the difficulty level of the cardio exercise device based on the exercise difficulty according to the video playback time included in the video content information. This will be described in more detail later.

[0054] FIG. 3 is a drawing showing video content information according to an embodiment of the present invention.

[0055] Referring to FIG. 3, the video content information may include a multi-view video in which videos of various angles are combined, information on the video playback time of the multi-view video and a first distance of movement corresponding to the video playback time, an exercise difficulty corresponding to the video playback time, an overall difficulty derived based on the exercise difficulty for the entire video playback time, and information on the type of cardio exercise device to which the video content information can be applied.

[0056] At this time, the above multi-view video may be a video generated as a multi-view of 180 degrees, 360 degrees, etc., such as VR video.

[0057] In addition, the video playback time of the multi-view video and a first movement distance representing the movement distance according to the video playback time are set, and the video playback time of the multi-view video can be adjusted by comparing it with a second movement distance caused by the operation of the cardio exercise device as described below.

[0058] As another example, the movement speed resulting from the operation of the above cardio-movement device may be derived, and the playback speed of the above multi-view video may be controlled to match the said movement speed, so that the second movement distance and the first movement distance are mutually matched.

[0059] In addition, the exercise difficulty may be set to have a higher value as the difficulty increases within a preset numerical range. For example, the numerical range may range from 1 to 10, and the exercise difficulty of a specific area may be set to 3.

[0060] In addition, the above-mentioned overall difficulty refers to the overall exercise difficulty across the entire video content information, and may be set as the average of the overall exercise difficulty.

[0061] In addition, the above cardio exercise device may refer to aerobic exercise equipment such as a treadmill, rowing machine, or cycle. Therefore, if the above multi-view video is a video of hiking, the applicable cardio exercise device may be set to a treadmill or cycle, etc.

[0062] FIG. 4 is a diagram showing multi-view video playback and difficulty level adjustment of a cardio exercise device according to one embodiment of the present invention.

[0063] Referring to FIG. 4, the processor derives a second movement distance according to the operation of the cardio exercise device, compares the second movement distance with the first movement distance, controls the video playback time of the multi-view video to correspond to the second movement distance and outputs it to the display device, and can adjust the difficulty of the cardio exercise device based on the exercise difficulty corresponding to the video playback time of the multi-view video.

[0064] For example, if the above cardio exercise device is a treadmill, the incline of the treadmill can be adjusted according to the difficulty of the exercise, and if the above cardio exercise device is a cycle, the pedal pressure can be adjusted according to the difficulty of the exercise.

[0065] FIG. 5 is a diagram showing a viewpoint change of a multi-view image according to an embodiment of the present invention.

[0066] In order to provide the user with a greater sense of immersion, it is desirable to change the viewpoint of the multi-view video according to the user's head movements.

[0067] To this end, referring to FIG. 5, the processor can track the user's head movements through a camera and change the viewpoint of the multi-view image output to the display device based on the head movements.

[0068] Through this, users can be enabled to have an immersive field experience through a cardio exercise device and a display device, and can also post video content information completed by users to communities, etc., allowing multiple users to communicate and compete with each other.

[0069] FIG. 6 is a diagram showing the derivation of recommended video content information according to an embodiment of the present invention.

[0070] As described above, video content information is selected by the user. In this case, to assist the user in making a selection, a recommendation score is derived for each piece of video content information based on difficulty levels derived from the preferences and physical abilities of users similar to the user, and recommended video content information can be provided to the user through this.

[0071] Looking more closely, the user terminal may have a user account logged in that includes information about the user's gender and age group and identifies the user at all times.

[0072] In addition, the processor can derive recommended video content information from the entire video content information based on the user account and transmit the recommended video content information to the user terminal.

[0073] Looking at it in more detail, the processor can derive similar users among all users whose gender and age group are the same as the gender and age group of the user.

[0074] In addition, the processor can derive a recommendation score for each video content information based on the usage history of the video content information of the similar user, and derive video content information in which the recommendation score exceeds a preset threshold recommendation score as the recommended video content information.

[0075] At this time, the above threshold recommendation score can be set as the average of the recommendation scores of the entire video content information.

[0076] Looking more closely, the processor can derive a preference score for specific video content information based on the usage history of video content information of the similar user, derive a difficulty score for specific video content information based on the usage history of video content information of the similar user, and derive a recommendation score for specific video content information based on the preference score and the difficulty score.

[0077] This is intended to derive a recommendation score by reflecting the preferences of similar users and a difficulty level that is not overly strenuous relative to their physical stamina.

[0078] Looking more closely, the processor can derive a first ratio representing the ratio of the number of times the similar user used the specific video content information to the total number of times the similar user used the video content information, derive a second ratio representing the ratio of the number of similar users who used the specific video content information to the total number of users who used the specific video content information, derive a correction weight based on the number of video content information used by the similar user relative to the total number of video content information, and derive a preference score for the specific video content information based on the first ratio, the second ratio, and the correction weight.

[0079] At this time, the above correction weight is designed so that when the number of video content information viewed by similar users is small, the second ratio needs to be reflected somewhat higher in the preference score even if it is small. When the above correction weight is 1, the first ratio and the second ratio are reflected equally, and when the correction weight becomes less than 1, the second ratio may be reflected higher than the first ratio by that amount. More details will be described later.

[0080] Additionally, the processor may derive a first average representing the average of the overall difficulty of the entire video content information used by the similar user, derive a second average representing the average of the completion times of all users using the specific video content information, derive a third average representing the average of the completion times of the similar user using the specific video content information, and derive the difficulty score for the specific video content information based on the overall difficulty of the specific video content information, the first average, the second average, and the third average.

[0081] This is intended to determine whether the video content information was difficult or easy for similar users based on the time it takes for them to complete the specific video content information.

[0082] Looking at it in more detail, the above recommendation score can be derived by the following mathematical formula 1.

[0083] [Mathematical Formula 1]

[0084]

[0085] At this time, rs may mean the recommendation score for the specific video content information, ps may mean the preference score for the specific video content information, and ds may mean the difficulty score for the specific video content information.

[0086] In addition, the above preference score can be derived by the following mathematical formula 2.

[0087] [Mathematical Formula 2]

[0088]

[0089] At this time, ps represents the preference score for the specific video content information, r1 represents the first ratio, r2 represents the second ratio, and w may represent the correction weight.

[0090] In addition, the above correction weight can be derived by the following mathematical formula 3.

[0091] [Mathematical Formula 3]

[0092]

[0093] At this time, w represents the above correction weight, tc represents the total number of video content information, and suc may represent the number of video content information used by the above similar user.

[0094] In addition, the above difficulty score can be derived by the following mathematical formula 4.

[0095] [Mathematical Formula 4]

[0096]

[0097] At this time, ds represents the difficulty score for the specific video content information, a1 represents the first average, a2 represents the second average, a3 represents the third average, and d may represent the overall difficulty of the specific video content information.

[0098] Through this, recommended video content information can be derived by reflecting both the user's preferences and the recommended difficulty level, and by providing this to the user, the user can more easily select the video content information they wish to experience.

[0099] FIG. 7 is a flowchart of a method for providing an immersive video content service based on cardio exercise device control according to an embodiment of the present invention.

[0100] Referring to FIG. 7, a method for providing an immersive video content service based on cardio exercise device control according to one embodiment of the present invention can receive selection information regarding video content information selected by a user from a user terminal (S101).

[0101] In addition, the method for providing an immersive video content service based on cardio exercise device control according to one embodiment of the present invention can output a multi-view video included in the video content information corresponding to the selection information to a display device (S103).

[0102] In addition, the method for providing an immersive video content service based on cardio exercise device control according to one embodiment of the present invention can adjust the difficulty of the cardio exercise device based on the exercise difficulty according to the video playback time included in the video content information (S105).

[0103] In addition, the method for providing an immersive video content service based on cardio exercise device control according to one embodiment of the present invention may be configured in the same way as the device for providing an immersive video content service based on cardio exercise device control disclosed in FIGS. 1 to 6.

[0104] The embodiments described above may be implemented as hardware components, software components, and / or combinations of hardware and software components. For example, the devices, methods, and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are also possible.

[0105] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the embodiment, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

[0106] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively. Software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0107] Although the embodiments have been described above with reference to the limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0108] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

Claims

Claim 1 An electronic device comprising: a memory; and a processor connected to the memory; wherein the processor receives selection information regarding video content information selected by a user from a user terminal, outputs a multi-view video included in the video content information corresponding to the selection information to a display device, and adjusts the difficulty level of a cardio exercise device based on the exercise difficulty level according to the video playback time included in the video content information. Claim 2 An electronic device according to claim 1, wherein the video content information comprises: a multi-view video in which videos of various angles are combined; information regarding the video playback time of the multi-view video and a first movement distance corresponding to the video playback time; an exercise difficulty corresponding to the video playback time; an overall difficulty derived based on the exercise difficulty for the entire video playback time; and information regarding the type of cardio exercise device to which the video content information is applicable. Claim 3 An electronic device according to claim 2, wherein the processor derives a second travel distance according to the operation of the cardio exercise device, compares the second travel distance with the first travel distance, controls the video playback time of the multi-view video to correspond to the second travel distance and outputs it to the display device, and adjusts the difficulty level of the cardio exercise device based on the exercise difficulty level corresponding to the video playback time of the multi-view video.

Images