Method and system of projecting formation and movement of dancers

Abstract

The present disclosure relates to a method and system for projecting a formation and movement path of a dancer. A system according to one embodiment of the present disclosure may include a projection device that projects a plurality of node markings corresponding to a plurality of dancers toward a floor surface, at least one sensor that detects position values ​​of a plurality of dancers, and a control device that transmits a first control signal to the projection device to project a plurality of node markings based on a predefined first formation and receives position values ​​from at least one sensor.

Description

Technology Field

[0001] The present disclosure relates to a method and system for projecting the formation and movement of dancers, and more specifically, to a method and system for projecting the formation and movement of dancers onto a floor surface using a projection device, and making movement and choreography practice easier and more enjoyable by interacting based on the dancers' positions and choreographic movements. Background Technology

[0002] At the current level of technology, dancers primarily use methods such as placing tape on the floor or visually checking through mirrors to verify their movement and formations on stage. While these methods are relatively simple and intuitive, they have limitations in accurately identifying or modifying movements and formations. In particular, the tape method is cumbersome to modify when movements change because it relies on physical markings, whereas checking through mirrors can make accurate judgments difficult due to visual distortion or limited field of view.

[0003] Existing methods like this have the problem of requiring manual adjustments whenever the movement path changes. When the dancers' movement trajectories are complex or change frequently, manually adjusting them one by one is time-consuming and labor-intensive. Furthermore, because it is difficult to dynamically represent the movement trajectories of multiple dancers, there are limitations in checking or adjusting the overall formation and movement harmony in real time.

[0004] Another issue pointed out is that the existing setup must be completely redone when the stage size, configuration, or movement patterns change. This is particularly inefficient in performances or rehearsals where the stage environment can vary significantly. These problems not only hinder dancers' creative expression and efficient practice but can also lead to a waste of time and physical resources during the performance preparation process. The problem to be solved

[0005] The object of the present disclosure is to provide a method and system for projecting a dancer's formation and movement path, which enables a subject to practice movements more effectively and interestingly by interacting based on the subject's position and movement using a projection device. means of solving the problem

[0006] In one embodiment of the present disclosure, a system for projecting a formation and movement path of a dancer may be provided. The system may include a projection device that projects a plurality of node markings corresponding to a plurality of dancers toward a floor surface, at least one sensor that detects position values ​​of the plurality of dancers, and a control device that transmits a first control signal to the projection device to project the plurality of node markings based on a predefined first formation and receives the position values ​​from the at least one sensor.

[0007] In one embodiment of the present disclosure, the control device may transmit a first control signal to the projection device at a first time point and a second control signal to the projection device to project a movement line indication from a predefined first formation to a predefined second formation at a second time point following the first time point.

[0008] In one embodiment of the present disclosure, the system includes a personal communication device worn by each of the plurality of dancers, and the at least one sensor obtains an identification code corresponding to each of the plurality of dancers from the personal communication device, and the control device can determine a personal location value of each of the plurality of dancers based on the identification code and the location values.

[0009] In one embodiment of the present disclosure, the control device determines whether at least one of the plurality of dancers is located on the plurality of node markings based on the individual position value, and can transmit a third control signal to the projection device to project an error mark toward the floor surface based on the determination that at least one of the plurality of dancers is not located on the plurality of node markings.

[0010] In one embodiment of the present disclosure, a personal communication device includes a vibration motor, and a control device can transmit a feedback control signal to the personal communication device to provide vibration feedback through the vibration motor to a dancer among the plurality of dancers corresponding to the error indication.

[0011] In one embodiment of the present disclosure, at least one sensor includes an image sensor that captures choreography movements of the plurality of dancers, and a control device acquires a choreography video corresponding to the choreography movements from the image sensor, acquires a pose value of each of the plurality of dancers using a first artificial intelligence model that takes the choreography video as input, determines a score of the choreography movements using a second artificial intelligence model that takes the pose value as input, and transmits a fourth control signal to the projection device to project the score of the choreography movements toward the floor surface.

[0012] In one embodiment of the present disclosure, the control device may generate a third control signal to project an arrow as the error indication, indicating a direction from the dancer's current position corresponding to the error indication toward a node indication where the dancer should be located.

[0013] In one embodiment of the present disclosure, the control device may generate a third control signal to calculate the distance between the individual position value and the target position value of each of the plurality of node indicators, project an error indicator of a first color when the calculated distance is greater than a first threshold and less than a second threshold, and project an error indicator of a second color when the calculated distance is greater than or equal to the second threshold.

[0014] In one embodiment of the present disclosure, the control device receives user input and can adjust the projection speed of the movement line display changing from a first large size to a second large size based on the user input.

[0015] In one embodiment of the present disclosure, a method for projecting a formation and movement path of a dancer may be provided. The method may include the steps of: transmitting a first control signal to a projection device to project a plurality of node markings based on a first formation defined by a control device; projecting a plurality of node markings corresponding to a plurality of dancers toward a floor surface based on the first control signal by the projection device; detecting position values ​​of a plurality of dancers by at least one sensor; and receiving the position values ​​from the at least one sensor by the control device. Effects of the invention

[0016] According to one embodiment of the present disclosure, a plurality of node indicators corresponding to a plurality of dancers are projected onto a floor surface, and a control device detects the position values ​​of the dancers and transmits a control signal based thereon, thereby enabling automatic adjustment of the formation and movement path even when the movement path changes. According to one embodiment of the present disclosure, by interacting with the projected node indicators based on the dancers' positions and choreographic movements, the dancers can practice the movement path and choreography more intuitively and efficiently. Furthermore, it can flexibly respond to changes in stage size or configuration, allowing the movement path to be dynamically expressed without the need for new settings. Brief explanation of the drawing

[0017] FIG. 1 is a conceptual diagram showing a system for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure. FIG. 2 is a block diagram schematically showing the operation of a system for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure. FIG. 3 is a conceptual diagram showing a formation of dancers according to one embodiment of the present disclosure. FIG. 4 is a drawing showing a case where a dancer according to one embodiment of the present disclosure is not located on a corresponding node mark. FIGS. 5a and 5b are drawings showing changes in a projection screen according to the positional relationship between a node and a dancer according to one embodiment of the present disclosure. FIG. 6 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure. FIG. 7 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure. FIG. 8 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure. FIG. 9 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure. FIG. 10 is a drawing showing a method for outputting a choreography movement score from a choreography video according to one embodiment of the present disclosure. FIG. 11 is a drawing showing a method for obtaining pose values ​​from a choreography video according to one embodiment of the present disclosure. FIG. 12 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure. FIG. 13 is a block diagram showing a system for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure. FIG. 14 is a block diagram showing the detailed configuration of a control device according to one embodiment of the present disclosure. Specific details for implementing the invention

[0018] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. The embodiments will be described clearly and in detail so that a person skilled in the art can easily practice the present disclosure. However, the scope of the rights is not limited or restricted by these embodiments. Identical or similar reference numerals are used for similar components in each drawing, and redundant descriptions of identical or similar components are omitted.

[0019] The terms used in the following description have been selected as common and universal in the relevant technical field, but other terms may exist depending on technological development and / or changes, conventions, preferences of the skilled technician, etc. Therefore, the terms used in the following description should not be understood as limiting the technical concept, but as illustrative terms to explain the embodiments.

[0020] In addition, there are terms arbitrarily selected by the applicant in specific cases, and their detailed meanings will be described in the relevant explanatory section. Therefore, the terms used in the description below must be understood not merely as their names, but based on their meanings and the content throughout the specification.

[0021] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art as described in this specification. Additionally, terms including ordinal numbers, such as "first" or "second," used in this specification may be used to describe various components, but said components should not be limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another.

[0022] When a part of a specification is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "part" or "module" as used in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware or software, or as a combination of hardware and software.

[0023] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification have been given similar reference numerals. Also, the reference numerals used in each drawing are for the purpose of explaining each drawing, and different reference numerals used in different drawings are not intended to indicate different elements. The present disclosure will be described in detail below with reference to the attached drawings.

[0024] In the present disclosure, functions related to 'Artificial Intelligence' are operated through a processor and memory. The processor may be composed of one or more processors. In this case, the one or more processors may be general-purpose processors such as CPUs, APs, and DSPs (Digital Signal Processors), graphics-dedicated processors such as GPUs and VPUs (Vision Processing Units), or AI-dedicated processors such as NPUs. The one or more processors control the processing of input data according to predefined operation rules or AI models stored in memory. Alternatively, if the one or more processors are AI-dedicated processors, the AI-dedicated processors may be designed with a hardware structure specialized for processing a specific AI model.

[0025] The predefined rules of operation or artificial intelligence models are characterized by being created through learning. Here, being created through learning means that a basic artificial intelligence model is trained using a number of training data by a learning algorithm, thereby creating predefined rules of operation or artificial intelligence models configured to perform desired characteristics (or objectives). Such learning may be performed on the device itself where the artificial intelligence according to the present disclosure is executed, or it may be performed through a separate server and / or system. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.

[0026] In the present disclosure, an 'artificial intelligence model' may be composed of a plurality of neural network layers. Each of the plurality of neural network layers has a plurality of weight values ​​and performs neural network operations through operations between the results of operations of a previous layer and the plurality of weights. The plurality of weights possessed by the plurality of neural network layers may be optimized by the learning results of the deep neural network model. For example, the plurality of weights may be updated so that the loss value or cost value obtained from the deep neural network model during the learning process is reduced or minimized. For example, the deep neural network model may include, but is not limited to, a CNN (Convolutional Neural Network), DNN (Deep Neural Network), RNN (Recurrent Neural Network), RBM (Restricted Boltzmann Machine), DBN (Deep Belief Network), BRDNN (Bidirectional Recurrent Deep Neural Network), or Deep Q-Networks.

[0027] FIG. 1 is a conceptual diagram showing a system for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure. FIG. 2 is a block diagram schematically showing the operation of a system for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure.

[0028] Referring to FIGS. 1 and 2, a system (1000) for projecting a dancer's formation and movement path may include a projection device (100), at least one sensor (200), and a control device (300). The system (1000) may project a formation and movement path of a plurality of dancers (10) onto a floor surface. The system (1000) may support practice by interacting based on the positions and choreographic movements of the dancers (10).

[0029] The projection device (100) can project a plurality of node displays (20) corresponding to a plurality of dancers (10) toward the floor surface. The projection device (100) can receive a control signal from a control device (300). The projection device (100) can determine the screen to be projected based on the received control signal.

[0030] The projection device (100) can project a plurality of node markers (20) based on a predefined first formation. For example, a first dancer (10_1) can be guided to position at a first node (20_1). A second dancer (10_2) can be guided to position at a second node (20_2). A plurality of dancers (10) can intuitively determine their positions and form a formation through the projected plurality of node markers (20).

[0031] In one embodiment of the present disclosure, the projection device (100) may be a laser projector that projects a plurality of node markings (20) using a laser light source. The laser projector can provide clear node markings even in a bright lighting environment. The laser projector can help dancers accurately position themselves by projecting nodes at precise locations.

[0032] For example, the projection device (100) may be a laser projector, a Liquid Crystal Display (LCD) projector, a Digital Light Processing (DLP) projector, a Light Emitting Diode (LED) projector, a Liquid Crystal on Silicon (LCoS) projector, a Cathode-Ray Tube (CRT) projector, or a pico projector. However, the present disclosure is not limited thereto.

[0033] At least one sensor (200) can detect position values ​​of multiple dancers (10). At least one sensor (200) can transmit the detected position values ​​to a control device (300). The control device (300) can determine the current positions of the dancers using the received position values.

[0034] At least one sensor (200) may include a sensor (200_1), a sensor (200_2), and a sensor (200_3). However, the number of at least one sensor (200) may not be limited thereto. When multiple sensors are used, another sensor can detect the location of a dancer even if the dancer moves out of the detection area of ​​a specific sensor. The system (1000) can accurately track the location of dancers over a wider area by using multiple sensors.

[0035] Sensors (200_1), (200_2), and (200_3) may be image sensors. The image sensors can capture the movements of the dancers (10) to extract location information. For example, the image sensors may be installed on the ceiling or wall to capture the entire practice space.

[0036] For example, at least one sensor (200) may be an image sensor, an infrared (IR) sensor, an ultrasonic sensor, a light detection and ranging (LiDAR) sensor, a radio detection and ranging (RADAR) sensor, a positioning measurement unit (PMU), or a radio frequency (RF) sensor. However, the present disclosure is not limited thereto.

[0037] The control device (300) can control the overall operation of the system (1000). The control device (300) can receive position values ​​from at least one sensor (200). The control device (300) can transmit a control signal to the projection device (100).

[0038] The control device (300) can transmit a first control signal to the projection device (100) to project a plurality of node displays (20) based on a predefined first formation. The control device (300) can control the screen to be projected by the projection device (100) based on position values ​​of the dancers (10) detected by at least one sensor (200). The control device (300) can implement an interaction between the actual position of the dancers and the target position through control based on the position values ​​of the dancers (10).

[0039] In one embodiment of the present disclosure, the control device (300) may be linked with a music playback device. The control device (300) may generate a first control signal to project node markings corresponding to a predefined first formation in synchronization with the timeline of the music being played. For example, the control device (300) may generate a control signal to change the formation in accordance with a specific beat or section of the music. Dancers may practice their movements in accordance with the generated control signal and the music.

[0040] Multiple dancers (10) may be users who practice choreography using the system (1000). Multiple node markings (20) may be visual markings projected onto the floor surface by a projection device (100). Multiple node markings (20) may indicate target points where each of the multiple dancers (10) is to be located.

[0041] As illustrated in FIG. 1, a plurality of dancers (10) may include a first dancer (10_1), a second dancer (10_2), a third dancer (10_3), a fourth dancer (10_4), and a fifth dancer (10_5). A plurality of node indicators (20) may include a first node (20_1), a second node (20_2), a third node (20_3), a fourth node (20_4), and a fifth node (20_5). The number of dancers and the number of node indicators may be variably set according to the choreography configuration.

[0042] FIG. 3 is a conceptual diagram showing a formation of dancers according to one embodiment of the present disclosure.

[0043] Referring to FIG. 3, the control device (300) can control the projection device (100) so that the node markings (20) change from a first formation (30) to a second formation (40) according to a predefined time. The first formation (30) may represent an initial formation that a plurality of dancers (10) must form at a specific time of the choreography. The control device (300) can generate a first control signal and transmit it to the projection device (100) to project a plurality of node markings (20) corresponding to the first formation (30) onto the floor at the first time.

[0044] The second formation (40) may represent a target formation that multiple dancers (10) must form at a point in time after the first formation (30). The control device (300) may control the projection of multiple node markings (20) corresponding to the second formation (40) onto the floor surface at a second point in time following the first point in time. The first formation (30) and the second formation (40) may differ in the number, arrangement, or shape of the dancers.

[0045] The control device (300) can project the movement path indicators of each dancer (10) onto the floor surface together during the process of changing from the first formation (30) to the second formation (40). The control device (300) can transmit a second control signal to the projection device (100) to project the movement path indicators from the first formation (30) to the second formation (40) at a second time point following the first time point. The movement path indicators can increase the efficiency of choreography practice by visually guiding the path of the dancers (10) to move to the next position.

[0046] In one embodiment of the present disclosure, the movement path display may be projected in a form connecting the node display of the first large (30) and the node display of the second large (40). For example, the movement path display may be a visual display including a dotted line, a solid line, an arrow, a footprint-shaped icon, a color-changing path, a light trajectory, and an animation effect. However, the present disclosure is not limited thereto.

[0047] In one embodiment of the present disclosure, the control device (300) can receive user input and adjust the projection speed of the movement line display. The control device (300) can adjust the projection speed of the movement line display changing from the first formation (30) to the second formation (40) to be faster or slower based on the user input. Through this, the dancers (10) can adjust the tempo of the choreography to match their practice level and proceed with the practice.

[0048] The control device (300) can receive user input. The control device (300) can adjust the projection speed of the movement path display changing from the first formation (30) to the second formation (40) based on the user input. For example, the user can set the projection speed of the movement path display to be slow or fast depending on the practice stage. The user can adjust the speed of choreography acquisition through the projection speed setting.

[0049] In one embodiment of the present disclosure, the movement path indicator may be projected as a dotted or solid line connecting the node indicator of the first large (30) and the node indicator of the second large (40). For example, the movement path indicator may be a dotted line, a solid line, an arrow, a footprint shape, a color change, a light trajectory, or an animation effect. However, the present disclosure is not limited thereto.

[0050] FIG. 4 may be a drawing showing a case where a dancer is not located on a corresponding node display according to one embodiment of the present disclosure. FIG. 5a and 5b may be drawings showing a change in a projection screen according to the positional relationship between a node and a dancer according to one embodiment of the present disclosure. Referring to FIG. 4, there may be a situation where the first dancer (10_1) is not located on the first node (20_1).

[0051] The control device (300) can determine whether at least one of the multiple dancers (10) is located on the multiple node markers (20) based on individual position values. The control device (300) can determine that at least one of the multiple dancers (10) is not located on the multiple node markers (20). Based on the determination, the control device (300) can transmit a third control signal to the projection device (100) to project an error mark toward the floor surface.

[0052] FIG. 5a may illustrate a case where multiple dancers (10) are normally positioned on multiple node markers (20) corresponding to each. For example, the first dancer (10_1) may be positioned at the first node (20_1). The second dancer (10_2) may be positioned at the second node (20_2). The third dancer (10_3) may be positioned at the third node (20_3). The fourth dancer (10_4) may be positioned at the fourth node (20_4). The fifth dancer (10_5) may be positioned at the fifth node (20_5). In this case, the control device (300) may not project a separate error marker.

[0053] Referring to FIG. 5b, the control device (300) may generate a third control signal to project an arrow (50) as an error indication, which indicates the direction from the dancer's current position corresponding to the error indication toward the node indication where the dancer should be located. For example, if the first dancer (10_1) moves away from the position of the first node (20_1), the control device (300) may project an arrow (50) pointing from the first dancer's (10_1) current position toward the first node (20_1). The arrow (50) may provide an intuitive direction for the first dancer (10_1) to move to the correct position.

[0054] The control device (300) can calculate the distance between the individual location value and the target location value of each of the multiple node indicators (20). The control device (300) can project an error indicator of a first color if the calculated distance is greater than a first threshold and less than a second threshold. The control device (300) can generate a third control signal to project an error indicator of a second color if the calculated distance is greater than or equal to the second threshold.

[0055] In one embodiment of the present disclosure, the control device (300) may generate a third control signal to project a numerical value for a calculated distance along with an error indication. For example, if the first dancer (10_1) is 50 cm away from the first node (20_1), the control device (300) may project the number '50' along with an arrow (50) or the first node (20_1) of a changed color. The dancer can quantitatively perceive the degree of positional error through the projected numerical value. The dancer can precisely correct the position based on the perceived error.

[0056] The control device (300) can transmit a feedback control signal to a personal communication device to provide vibration feedback via a vibration motor to the dancer among the plurality of dancers (10) corresponding to the error indication. The personal communication device may be a device worn by the dancer. The personal communication device may include a vibration motor. This vibration feedback may serve to immediately notify a specific dancer that a position error has occurred.

[0057] In one embodiment of the present disclosure, the control device (300) may determine the intensity or pattern of vibration feedback based on the distance between the individual position value and the position value of the node display. For example, the control device (300) may generate stronger vibrations as the distance from the target position increases. Alternatively, the control device (300) may generate a specific pattern of vibrations that combines short and long vibrations. The control device (300) may distinguish and indicate the degree of error through the specific pattern of vibrations. Such tactile feedback may help the dancer quickly recognize their position. Tactile feedback may help the dancer quickly correct their position. Through tactile feedback, the dancer may not rely solely on visual information.

[0058] FIG. 6 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure.

[0059] Referring to FIG. 6, the method of projecting the formation and movement path of a dancer can be performed by the system (1000).

[0060] In step S610, the control device (300) can transmit a first control signal (CS1) to the projection device (100) to project a plurality of node markings based on a previously defined first formation. The control device (300) can obtain information about the first formation from choreography data previously stored in a storage unit. The control device (300) can set target points where a plurality of dancers are to be positioned according to the obtained formation information. The control device (300) can generate a first control signal (CS1) to project node markings onto the set target points.

[0061] In one embodiment of the present disclosure, the control device (300) may include a storage unit for storing a plurality of choreography data. Each of the plurality of choreography data may include a plurality of formation and movement information according to the flow of time. The control device (300) may select any one of the plurality of choreography data according to user input. The control device (300) may generate a first control signal (CS1) based on the selected choreography data.

[0062] In one embodiment of the present disclosure, the system (1000) may be linked with a music playback device. The control device (300) may generate a first control signal (CS1) to project node markings corresponding to a predefined first formation in synchronization with the timeline of the music being played.

[0063] In step S620, the projection device (100) can project a plurality of node markings corresponding to a plurality of dancers toward the floor surface based on a first control signal (CS1). The projection device (100) can interpret the first control signal (CS1) received from the control device (300). The projection device (100) can optically form node markings at specific coordinates on the floor surface according to the interpreted signal. The node markings can help the dancers visually recognize their positions.

[0064] In one embodiment of the present disclosure, the projection device (100) may be a laser projector that projects a plurality of node displays using a laser light source. For example, the projection device (100) may be a laser projector, a Liquid Crystal Display (LCD) projector, a Digital Light Processing (DLP) projector, a Light Emitting Diode (LED) projector, a Liquid Crystal on Silicon (LCoS) projector, a Cathode-Ray Tube (CRT) projector, or a pico projector. However, the present disclosure is not limited thereto.

[0065] In step S630, at least one sensor (200) can detect position values ​​(LV) of multiple dancers. At least one sensor (200) can measure the real-time position of each of the multiple dancers moving within the practice space. At least one sensor (200) can convert the measured position into data in the form of coordinate values. For example, at least one sensor (200) may be an image sensor, an infrared (IR) sensor, an ultrasonic sensor, a Light Detection and Ranging (LiDAR) sensor, a Radio Detection and Ranging (RADAR) sensor, a Passive Marker Unit (PMU) sensor, or a Radio Frequency (RF) sensor. However, the present disclosure is not limited thereto.

[0066] In step S640, at least one sensor (200) can transmit the position values ​​(LV) of a plurality of detected dancers to the control device (300). At least one sensor (200) can transmit the position values ​​(LV) to the control device (300) using a wired or wireless communication method. The transmission of the position values ​​(LV) can be performed periodically or non-periodically.

[0067] In step S650, the control device (300) can receive position values ​​(LV) from at least one sensor (200). The control device (300) can determine the current positions of multiple dancers using the received position values ​​(LV). The control device (300) can perform a subsequent control operation by comparing the determined current positions with the target positions of the node markers.

[0068] FIG. 7 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure.

[0069] Referring to FIGS. 6 and FIGS. 7, the method of projecting the formation and movement path of a dancer can be performed by the system (1000).

[0070] In step S710, the control device (300) may transmit a first control signal (CS1) to the projection device (100) to project a plurality of node displays based on a first formation defined at a first time point. The control device (300) may load information about the first formation from choreography data stored in a storage unit. The first time point may be a time point corresponding to a specific timeline of music received from a music player.

[0071] In step S720, the projection device (100) can project a plurality of node markings corresponding to a plurality of dancers toward the floor surface based on a first control signal (CS1). The projection device (100) can project the node markings at an accurate location on the floor surface according to the coordinate values ​​included in the first control signal (CS1) received from the control device (300). The node markings can be projected in a specific color or shape so that the dancers can clearly recognize their positions.

[0072] In step S730, the control device (300) can transmit a second control signal (CS2) to the projection device (100) to project a movement path indicator from a predefined first formation to a predefined second formation at a second time point following the first time point. The control device (300) can calculate the movement path of each dancer based on the node display positions of the first formation and the node display positions of the second formation. The control device (300) can generate the second control signal (CS2) by visualizing the calculated movement path as a movement path indicator.

[0073] In one embodiment of the present disclosure, the control device (300) may transmit a first control signal (CS1) to the projection device (100) at a first time point. The control device (300) may transmit a second control signal (CS2) to the projection device (100) to project a movement line indication from a predefined first formation to a predefined second formation at a second time point following the first time point.

[0074] In one embodiment of the present disclosure, a control device (300) may receive user input. The control device (300) may adjust the projection speed of a motion line display changing from a first large size to a second large size based on user input. For example, the user may set the motion line display to be projected slowly, normally, or quickly through an input device. Accordingly, the control device (300) may change the generation parameters of a second control signal (CS2). However, the present disclosure is not limited thereto.

[0075] In step S740, the projection device (100) can project a plurality of node markings and movement path markings corresponding to a plurality of dancers onto the floor surface based on the second control signal (CS2). The projection device (100) can project a movement path marking extending from a first large node marking location to a second large node marking location onto the floor surface according to the second control signal (CS2). Through this, the dancers can intuitively understand their next location and movement path.

[0076] In one embodiment of the present disclosure, the movement path indicator may be projected as a dotted or solid line connecting a first large node indicator and a second large node indicator. For example, the movement path indicator may be a dotted line, a solid line, an arrow, a light trail, a footprint-shaped icon, a color gradient path, or an animation effect. However, the present disclosure is not limited thereto.

[0077] FIG. 8 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure.

[0078] Referring to FIGS. 6 to 8, the method of projecting the formation and movement path of a dancer can be performed by the components of the system (1000).

[0079] In step S810, the personal communication device (400) may transmit an identification code (ID) corresponding to each of the plurality of dancers. Each dancer may wear a personal communication device (400) having a unique identification code (ID). The personal communication device (400) may periodically or non-periodically transmit a signal containing its own identification code (ID) to the outside. For example, the personal communication device (400) may be a smartphone, a smartwatch, a wearable band, a dedicated communication tag, a Bluetooth beacon, an RFID (Radio-Frequency Identification) tag, or an UWB (Ultra-Wideband) tag. However, the present disclosure is not limited thereto.

[0080] In step S820, at least one sensor (200) can receive an identification code (ID) from a personal communication device (400). At least one sensor (200) is placed within a practice space and can receive signals transmitted from a plurality of personal communication devices (400). At least one sensor (200) can extract an identification code (ID) assigned to each dancer from the received signals.

[0081] In step S830, at least one sensor (200) can detect position values ​​(LV) of multiple dancers. For example, at least one sensor (200) may be an image sensor, an infrared (IR) sensor, a light detection and ranging (LiDAR) sensor, an ultrasonic sensor, an ultra-wideband (UWB) receiver, a Bluetooth receiver, or a three-dimensional position recognition system including multiple cameras. However, the present disclosure is not limited thereto. At least one sensor (200) can detect the physical coordinates of each dancer using these sensors. At least one sensor (200) can generate continuous position value (LV) data by tracking the movements of the dancers in real time.

[0082] In step S840, at least one sensor (200) can transmit position values ​​(LV) and identification codes (ID) of multiple dancers to the control device (300). At least one sensor (200) can match the identification code (ID) received in step S820 with the position value (LV) detected in step S830. At least one sensor (200) can transmit the matched data to the control device (300) via wired or wireless communication.

[0083] In step S850, the control device (300) can receive position values ​​(LV) and an identification code (ID) from the sensor (200). The control device (300) can acquire data transmitted from at least one sensor (200) through a data receiving interface. The control device (300) can store and process the received data in internal memory. For example, the control device (300) may be a personal computer (PC), a server computer, a notebook computer, a tablet PC, an embedded system, a cloud computing platform, or a dedicated hardware controller. However, the present disclosure is not limited thereto.

[0084] In step S860, the control device (300) can determine the individual location value of each of the plurality of dancers based on an identification code (ID) and location values ​​(LV). The control device (300) can identify a specific dancer through the received identification code (ID). The control device (300) can determine the location value (LV) matched with the identified dancer as the individual location value of that dancer.

[0085] In one embodiment of the present disclosure, the system (1000) may include a personal communication device (400) worn by each of a plurality of dancers. At least one sensor (200) may obtain an identification code corresponding to each of the plurality of dancers from the personal communication device (400). A control device (300) may determine the personal location value of each of the plurality of dancers based on the identification code and location values.

[0086] In one embodiment of the present disclosure, the personal communication device (400) may further include an Inertial Measurement Unit (IMU) comprising an acceleration sensor and a gyroscope sensor. The control device (300) may combine sensor data and position values ​​obtained from the Inertial Measurement Unit. The control device (300) may evaluate the movement dynamics of each of the plurality of dancers, such as jump height or rotation speed, using the combined data.

[0087] FIG. 9 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure.

[0088] Referring to FIG. 9 together with FIG. 6 to 8, the method of projecting the formation and movement path of a dancer can be performed by a control device (300).

[0089] In step S910, the control device (300) can determine whether or not at least one of the multiple dancers is located on the multiple node markers based on individual position values. The control device (300) can compare the real-time individual position value of each dancer with the target position value of the node marker assigned to the dancer. The control device (300) can calculate the distance between the two position values. If the calculated distance is within a preset tolerance range, the control device (300) can determine that the dancer is in the correct position.

[0090] In step S920, the control device (300) may transmit a third control signal to the projection device (100) to project an error indicator toward the floor surface based on the determination that at least one of the multiple dancers is not positioned on the multiple node indicators. The control device (300) may provide visual feedback for the dancer who has lost position. The dancer who has lost position may recognize and correct their position through the provided visual feedback. The error indicator may be projected onto the floor surface so that it is clearly within the dancer's field of vision.

[0091] In one embodiment of the present disclosure, the control device (300) can determine whether at least one of the plurality of dancers is located on the plurality of node markings based on individual position values. Based on the determination that at least one of the plurality of dancers is not located on the plurality of node markings, the control device (300) can transmit a third control signal to the projection device (100) to project an error marking toward the floor surface.

[0092] In one embodiment of the present disclosure, the control device (300) may generate a third control signal to project an arrow as an error indication, indicating the direction from the dancer's current position corresponding to the error indication toward the node indication where the dancer should be located. The arrow indication may help the dancer intuitively understand which direction to move. The size or color of the arrow may be expressed differently depending on the degree of positional error.

[0093] In one embodiment of the present disclosure, a control device (300) may calculate the distance between a personal location value and a target location value of each of a plurality of node indicators. The control device (300) may project an error indicator of a first color if the calculated distance is greater than a first threshold and less than a second threshold. The control device (300) may generate a third control signal to project an error indicator of a second color if the calculated distance is greater than or equal to the second threshold. For example, the first color and the second color may be yellow, red, blue, green, orange, purple, and white. However, the present disclosure is not limited thereto.

[0094] In one embodiment of the present disclosure, the personal communication device (400) may include a vibration motor. The control device (300) may transmit a feedback control signal to the personal communication device (400) to provide vibration feedback through the vibration motor to a dancer among a plurality of dancers who corresponds to an error indication. The dancer may immediately recognize their position error through visual feedback and tactile feedback. The control device (300) may provide different levels of feedback intensity by adjusting the intensity or pattern of vibration according to the position error distance.

[0095] In one embodiment of the present disclosure, the control device (300) may generate a third control signal to project a numerical value for a calculated distance along with an error indication. The dancer can quantitatively determine how far they are from a target position through the projected numerical value. The projected numerical value may help the dancer correct their position more precisely.

[0096] FIG. 10 is a drawing showing a method for outputting a choreography movement score from a choreography video according to one embodiment of the present disclosure.

[0097] Referring to FIG. 10, at least one sensor (200) can capture choreography movements of multiple dancers to obtain a choreography video. A control device (300) can receive a choreography video from at least one sensor (200) and output a choreography movement score.

[0098] For at least one sensor (200), details that overlap with those described in FIG. 1 may be omitted. In one embodiment of the present disclosure, at least one sensor (200) may include an image sensor. The image sensor can capture choreography movements of a plurality of dancers in real time. The captured choreography movements can be transmitted to a control device (300) in the form of choreography video data.

[0099] The control device (300) can acquire a choreography video from at least one sensor (200). The control device (300) can analyze the acquired choreography video to evaluate the choreography movements of each of the multiple dancers. The control device (300) can determine a score for the choreography movements based on the evaluation results. The control device (300) can transmit a fourth control signal to the projection device (100) to project the determined score toward the floor surface.

[0100] The control device (300) may use a first artificial intelligence model that takes a choreography video as input. The first artificial intelligence model can obtain pose values ​​for each of a plurality of dancers from the choreography video. For example, the first artificial intelligence model can extract a plurality of keypoints for each of the body parts of a plurality of dancers from the choreography video.

[0101] The control device (300) can determine the score of the choreography movement using a second artificial intelligence model that takes a pose value as input. The second artificial intelligence model can compare the acquired pose value with a reference pose value for a previously stored expert's choreography movement. The second artificial intelligence model can determine the score of the choreography movement based on the comparison result.

[0102] In one embodiment of the present disclosure, the second artificial intelligence model may utilize a time-series change in the relative positional relationship of key points among a plurality of dancers. The second artificial intelligence model may calculate a synchronization score by analyzing the time-series change. The second artificial intelligence model may determine the calculated synchronization score as the score of the final choreography movement.

[0103] In one embodiment of the present disclosure, the control device (300) can detect, based on a pose value, that a specific body part of a specific dancer among a plurality of dancers is inconsistent with a preset choreographic movement. When the control device (300) detects the inconsistency, it can generate information instructing the specific body part of the specific dancer to be corrected. The control device (300) can control the projection device (100) to project text or an icon instructing the correction toward the floor surface.

[0104] FIG. 11 is a drawing showing a method for obtaining pose values ​​from a choreography video according to one embodiment of the present disclosure.

[0105] Referring to FIG. 11 following FIG. 10, the first artificial intelligence model (343) can receive a choreography video as input. The first artificial intelligence model (343) can perform the function of obtaining pose values ​​for each of a plurality of dancers from the received choreography video. Here, the pose values ​​may be structured data representing the spatial location and posture of the dancer's body parts.

[0106] The first artificial intelligence model (343) can extract multiple keypoints for each body part of multiple dancers from a choreography video. The keypoints may be points corresponding to the dancer's major joints. For example, the keypoints may consist of two-dimensional or three-dimensional coordinate values ​​representing the positions of the shoulder, elbow, wrist, hip, knee, ankle, etc. The first artificial intelligence model (343) can generate a pose value representing the dancer's skeletal structure by connecting the extracted multiple keypoints.

[0107] The first artificial intelligence model (343) may be a deep learning-based model that has been trained to estimate human poses. For example, the first artificial intelligence model (343) may be an OpenPose, PoseNet, MediaPipe Pose, HRNet (High-Resolution Net), AlphaPose, Detectron2, or YOLO-Pose model. However, the present disclosure is not limited thereto. These models are trained on a vast amount of image and video datasets and can provide pose estimation performance with high accuracy for various poses and movements.

[0108] In one embodiment of the present disclosure, the first artificial intelligence model (343) can individually identify a plurality of dancers included in a choreography video and independently extract each pose value. Through this, the system (1000) can analyze not only the accuracy of each dancer's movements but also the relative positional relationships between the dancers or the level of synchronization of movements. The first artificial intelligence model (343) can assign a unique identifier to each dancer for each frame of the video and track changes in each dancer's pose value over time.

[0109] The pose value generated by the first artificial intelligence model (343) can be transmitted to the second artificial intelligence model within the control device (300). The second artificial intelligence model can compare the input pose value with a previously stored expert reference pose value. Additionally, the second artificial intelligence model can calculate a synchronization score using the time-series change of the relative positional relationship of key points between multiple dancers. The second artificial intelligence model can determine the calculated synchronization score as the score of the choreography movement.

[0110] FIG. 12 is a flowchart showing a method for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure.

[0111] Referring to FIGS. 6 to 12, the method of projecting the formation and movement path of a dancer can be performed by the components of the system (1000).

[0112] In step S1210, at least one sensor (200) can acquire a choreography video (DV) corresponding to a choreography movement. At least one sensor (200) can include an image sensor to capture the movements of multiple dancers. For example, the image sensor may be a Charge-Coupled Device (CCD) sensor, a Complementary Metal-Oxide-Semiconductor (CMOS) sensor, an Infrared (IR) sensor, a Depth camera, a Stereo camera, a 360-degree camera, or a High-Speed ​​camera. However, the present disclosure is not limited thereto.

[0113] In step S1220, at least one sensor (200) can transmit a choreography video (DV) to a control device (300). Data of the choreography video (DV) can be transmitted to the control device (300) via a wired or wireless communication method. The control device (300) can receive and process the choreography video (DV) in real time.

[0114] In step S1230, the control device (300) can acquire a choreography video (DV) from the sensor (200). The control device (300) can store the received choreography video (DV) in an internal storage unit or process it in the form of real-time streaming. The control device (300) can perform frame-by-frame processing of the choreography video (DV) for choreography analysis.

[0115] In step S1240, the control device (300) can obtain pose values ​​for each of a plurality of dancers using a first artificial intelligence model that takes a choreography video (DV) as input. The first artificial intelligence model may be a deep learning-based pose estimation model. The control device (300) can extract the body joint positions of each dancer into 2D or 3D coordinates through the first artificial intelligence model.

[0116] In one embodiment of the present disclosure, the first artificial intelligence model (343) can extract a plurality of keypoints for each body part of a plurality of dancers from a choreography video (DV). The plurality of keypoints may include major body joint points such as shoulders, elbows, wrists, pelvis, knees, ankles, etc. The set of extracted keypoints may constitute a pose value for each dancer.

[0117] In step S1250, the control device (300) can determine a score for a choreographic movement using a second artificial intelligence model that takes a pose value as input. The second artificial intelligence model can evaluate the accuracy, synchronization, etc. of the choreography by analyzing time-series data of the acquired pose value. The control device (300) can convert the evaluation result into a quantitative score.

[0118] In one embodiment of the present disclosure, the second artificial intelligence model (345) can determine a score for a choreography movement by comparing a reference pose value for a previously stored expert choreography movement with an acquired pose value. The control device (300) can calculate an error between the reference pose value and the dancer's pose value. The control device (300) can calculate a score based on the calculated error.

[0119] In one embodiment of the present disclosure, the second artificial intelligence model (345) can calculate a synchronization score using the time-series change of the relative positional relationship of key points among a plurality of dancers. The second artificial intelligence model (345) can determine the calculated synchronization score as a score of choreography movements. For example, a high synchronization score can be calculated if specific key points of all dancers trace similar trajectories in the same time frame.

[0120] In step S1260, the control device (300) may transmit a fourth control signal (CS4) to the projection device (100) to project the score of the choreography movement toward the floor surface. The projection device (100) may project the score onto the floor surface in a visual form, such as a number, graph, or gauge, according to the fourth control signal (CS4). Dancers can immediately check their choreography performance level through the projected score.

[0121] In one embodiment of the present disclosure, the control device (300) may detect, based on pose values, that a specific body part of a specific dancer among a plurality of dancers is inconsistent with a preset choreography movement. The control device (300) may project text or an icon toward the floor surface instructing the specific body part of the specific dancer to be corrected. For example, if the arm angle of a specific dancer differs from the reference choreography, text such as "arms higher" or an icon indicating the correct angle of the arms may be projected onto the floor surface around the position of the dancer.

[0122] FIG. 13 is a block diagram showing a system for projecting the formation and movement path of a dancer according to one embodiment of the present disclosure.

[0123] Referring to FIG. 13, a system (1000) for projecting a dancer's formation and movement path may include a projection device (100), at least one sensor (200), a control device (300), a personal communication device (400), a server device (500), and a user terminal (600). The system (1000) may provide an integrated environment in which each component interacts organically to support the dancer's practice. The components of the system (1000) may exchange data with each other via wired or wireless communication methods.

[0124] Regarding the projection device (100), at least one sensor (200), and control device (300), details that overlap with those described in FIG. 1, etc. may be omitted. The projection device (100) can project multiple node markings corresponding to multiple dancers toward the floor surface. For example, the projection device (100) can receive a control signal from the control device (300) and project node markings, movement path markings, or error markings, etc., onto the floor surface. At least one sensor (200) can detect position values ​​of multiple dancers. Additionally, at least one sensor (200) can obtain an identification code corresponding to each of the multiple dancers from a personal communication device (400). The control device (300) can transmit a first control signal to the projection device (100) to project multiple node markings based on a predefined first formation. The control device (300) can receive position values ​​from at least one sensor (200).

[0125] The personal communication device (400) may be a device worn by each of the multiple dancers. The personal communication device (400) may store a unique identification code. The personal communication device (400) may communicate with at least one sensor (200) to transmit the identification code. Through this, the control device (300) can identify the multiple dancers individually. Additionally, the control device (300) can accurately track the location of each.

[0126] The control device (300) can determine the individual location value of each of the multiple dancers based on identification codes and location values. For example, the control device (300) can combine identification codes and location values ​​obtained through at least one sensor (200). The control device (300) can determine the individual location value based on the combined information. This individual location value can be used as reference data to determine whether the dancer is accurately located at a designated node mark.

[0127] In one embodiment of the present disclosure, the personal communication device (400) may include a vibration motor. The control device (300) may transmit a feedback control signal to a dancer among a plurality of dancers who corresponds to an error indication. The feedback control signal may be transmitted to the personal communication device (400) worn by the dancer. The personal communication device (400) may drive the vibration motor according to the received feedback control signal. Through this, the personal communication device (400) may provide vibration feedback to the dancer.

[0128] In one embodiment of the present disclosure, the personal communication device (400) may further include an Inertial Measurement Unit (IMU) comprising an accelerometer and a gyroscope. The control device (300) may combine sensor data and position values ​​obtained from the Inertial Measurement Unit. The control device (300) may evaluate the movement dynamics of each of the plurality of dancers based on the combined data. For example, the control device (300) may evaluate the performance ability of the dancers by calculating quantitative data such as jump height or rotation speed.

[0129] For example, the personal communication device (400) may be a smart watch, a smart band, an RFID (Radio-Frequency Identification) tag, an UWB (Ultra-Wideband) tag, a Bluetooth beacon, a wearable sensor, or smart clothing. However, the present disclosure is not limited thereto.

[0130] The server device (500) can be connected to the control device (300) and the user terminal (600) via a network. The server device (500) can perform the role of storing and managing large amounts of data, such as multiple choreography data, music data, user profiles, or practice history. The server device (500) can perform complex data processing tasks, such as computation of an artificial intelligence model. Through this, the server device (500) can reduce the computational burden on the control device (300).

[0131] The user terminal (600) may be a device that provides a user interface through which the user can control the system (1000) and check practice results. The user can select choreography stored in the server device (500) through the user terminal (600). Additionally, the user can adjust the practice speed or set specific sections to repeat. The user terminal (600) can display practice results, such as dancers' position accuracy, choreography scores, or synchronization rates, in a visual form. Through this, the user can intuitively check the feedback.

[0132] For example, the user terminal (600) may be a smartphone, a tablet computer, a personal computer, a laptop computer, a Personal Digital Assistant (PDA), a kiosk, or a smart television. However, the present disclosure is not limited thereto.

[0133] FIG. 14 is a block diagram showing the detailed configuration of a control device according to one embodiment of the present disclosure.

[0134] Referring to FIG. 14, a control device (300) can control the overall operation of a system (1000) that projects the formation and movement path of a dancer. The control device (300) can receive position values ​​of the dancers from at least one sensor (200). In one embodiment of the present disclosure, at least one sensor (200) may include an image sensor that captures the choreography movements of a plurality of dancers. The control device (300) can obtain a choreography video corresponding to the choreography movements from the image sensor. The control device (300) can generate a control signal to control the projection device (100) based on the received position values ​​and predefined choreography data.

[0135] The control device (300) may include a processor (310), a user interface (320), a communication interface (330), and a memory (340). For example, the control device (300) may be a personal computer (PC), a laptop, a tablet PC, a smartphone, a server computer, a wearable device, or an embedded system. However, the present disclosure is not limited thereto.

[0136] The processor (310) can control various components of the control unit (300) and perform data processing. The processor (310) can implement functions of the system (1000) by executing instructions stored in memory (340). For example, the processor (310) may be a Central Processing Unit (CPU), a Microprocessor Unit (MPU), a Graphics Processing Unit (GPU), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), or a Neural Processing Unit (NPU). However, the present disclosure is not limited thereto.

[0137] The user interface (320) can receive input from the user. The user interface (320) can provide the user with the operating status or processing results of the system (1000). The user can select choreography data to practice through the user interface (320). The user can input commands such as adjusting the projection speed of the movement path display. For example, the user interface (320) may be a touchscreen, keyboard, mouse, joystick, trackball, voice recognition device, or gesture recognition device. However, the present disclosure is not limited thereto.

[0138] The communication interface (330) can perform the function of enabling the control device (300) to transmit and receive data with other external devices. The communication interface (330) can support wired or wireless communication methods. For example, the communication interface (330) can receive sensor data from at least one sensor (200). The communication interface (330) can transmit control signals to the projection device (100). The communication interface (330) can function as a channel for transmitting feedback control signals to the personal communication device (400).

[0139] The memory (340) can store data, instructions, and programs necessary for the operation of the control device (300). The memory (340) may include volatile memory or non-volatile memory. For example, the memory (340) may be Random Access Memory (RAM), flash memory, Hard Disk Drive (HDD), Solid State Drive (SSD), Read-Only Memory (ROM), Erasable Programmable Read-Only Memory (EPROM), or Magnetoresistive Random-Access Memory (MRAM). However, the present disclosure is not limited thereto.

[0140] The memory (340) can store a dancer positioning module (341), a projection control module (342), a first artificial intelligence model (343), and a second artificial intelligence model (344). The memory (340) can also function as a storage unit for storing multiple choreography data including multiple formation and movement information over time. The control device (300) can select any one of the multiple choreography data through user input. The control device (300) can generate a control signal based on the selected choreography data.

[0141] The dancer position determination module (341) can process raw data received from at least one sensor (200). The dancer position determination module (341) can determine the individual position value of each of the multiple dancers (10) through the processed data. The dancer position determination module (341) can determine the position of each dancer by matching the identification code obtained from the personal communication device (400) with the position values.

[0142] The projection control module (342) can generate control signals based on the individual position values ​​of the dancers received from the dancer position determination module (341) and choreography data stored in the memory (340). The projection control module (342) can generate control signals to project node displays according to a predefined formation, movement path displays according to changes in the formation, or error displays according to a dancer's position error. The projection control module (342) can also generate control signals to project information such as scores or correction instructions for choreography movements.

[0143] Regarding the first artificial intelligence model (343), details that overlap with those described in FIG. 11 are omitted. The first artificial intelligence model (343) can perform the function of receiving a choreography video obtained from an image sensor as input and obtaining pose values ​​for each of the multiple dancers (10). The first artificial intelligence model (343) may be a deep learning-based pose estimation model.

[0144] The first artificial intelligence model (343) can extract multiple keypoints for each body part of multiple dancers (10) from a choreography video. The extracted multiple keypoints may be coordinate information representing the joint positions of each dancer. The first artificial intelligence model (343) can output a set of these keypoints as a pose value.

[0145] The second artificial intelligence model (344) can determine the score of the choreography movement by using the pose value obtained from the first artificial intelligence model (343) as input. The second artificial intelligence model (344) can calculate a quantitative score by evaluating the accuracy of the dancer's movement, the level of synchronization among the dancers, etc. The second artificial intelligence model (344) can be implemented as a classification model, a regression model, or a time series data analysis model.

[0146] The second artificial intelligence model (344) can compare the reference pose value for a previously stored expert's choreography movement with the acquired pose value. The second artificial intelligence model (344) can determine the score of the choreography movement based on the comparison result. For example, the higher the similarity between the dancer's pose and the expert's reference pose, the higher the score can be calculated.

[0147] In one embodiment of the present disclosure, the second artificial intelligence model (344) may utilize a time-series change in the relative positional relationship of key points between a plurality of dancers (10). The second artificial intelligence model (344) may analyze this change to calculate a synchronization score. The second artificial intelligence model (344) may determine the calculated synchronization score as a score for a choreography movement. The control device (300) may transmit a control signal to the projection device (100) to project the determined score for the choreography movement toward the floor surface.

[0148] In one embodiment of the present disclosure, a system may be provided. The system may be a laser projector that projects a plurality of node displays using a laser light source.

[0149] In one embodiment of the present disclosure, the system may generate a first control signal to project node displays corresponding to a predefined first formation in synchronization with the timeline of the music being played, in conjunction with a music playback device.

[0150] In one embodiment of the present disclosure, the control device may determine the intensity or pattern of vibration feedback based on the distance between a personal position value and a position value of a node display.

[0151] In one embodiment of the present disclosure, the second artificial intelligence model can determine the score of a choreography movement by comparing a reference pose value for a previously stored expert choreography movement with an acquired pose value.

[0152] In one embodiment of the present disclosure, the first artificial intelligence model can extract a plurality of keypoints for each body part of a plurality of dancers from a choreography video, and the second artificial intelligence model can calculate a synchronization score using a time-series change in the relative positional relationship of the keypoints among the plurality of dancers, and determine the calculated synchronization score as a score of the choreography movement.

[0153] In one embodiment of the present disclosure, the control device may detect, based on a pose value, that a specific body part of a specific dancer among a plurality of dancers is inconsistent with a preset choreographic movement, and project text or an icon toward the floor surface instructing the specific body part of the specific dancer to be corrected.

[0154] In one embodiment of the present disclosure, the copper line indication may be projected as a dotted or solid line connecting a first large node indication and a second large node indication.

[0155] In one embodiment of the present disclosure, the control device may generate a third control signal to project a numeric value for a calculated distance along with an error indication.

[0156] In one embodiment of the present disclosure, the control device may include a storage unit for storing a plurality of choreography data, and each of the plurality of choreography data may include a plurality of formation and movement information according to the flow of time, and the control device may select one of the plurality of choreography data according to user input and generate a first control signal based on the selected choreography data.

[0157] In one embodiment of the present disclosure, the personal communication device may further include an inertial measurement unit (IMU) comprising an acceleration sensor and a gyroscope sensor, and the control unit may evaluate the motion dynamics of each of a plurality of dancers, such as jump height or rotation speed, by combining sensor data and position values ​​obtained from the inertial measurement unit.

[0158] The method of the present disclosure described above consists of a combination of steps presented as examples, but is not limited thereto. Within the spirit of the present disclosure, at least one of the described steps may be omitted, and one or more steps corresponding to other technical features explicitly or implicitly disclosed in the present disclosure may be added. Additionally, two or more steps may be combined into a single step, a single step may be separated into multiple sub-steps, and the order of execution of the steps may be changed. All such variations should be understood to fall within the scope of protection of the present disclosure.

[0159] The specific layout, icon design, color combination, font, etc. of the user interface presented in this disclosure are exemplary and may be modified in various ways within the scope that does not impair the core interaction principles or information provision methods of this disclosure. Furthermore, this disclosure may be implemented responsively to various operating system (OS) environments (e.g., iOS, Android, Windows, etc.) and display sizes (e.g., smartphones, tablets, desktop monitors).

[0160] A method according to one embodiment of the present disclosure may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0161] In the embodiments described above, components according to the technical concept of the present disclosure have been described using terms such as first, second, third, etc. However, terms such as first, second, third, etc. are used to distinguish components from one another and do not limit the technical concept of the present disclosure. Terms such as first, second, third, etc. do not imply an order or any numerical meaning.

[0162] The embodiments described above are specific embodiments for carrying out the present disclosure. It should be understood that the present disclosure includes not only the embodiments described above, but also embodiments that can be simply modified or easily modified using the embodiments described above. Accordingly, the scope of the present disclosure should not be limited to the embodiments described above, but should be defined by the claims set forth below, as well as equivalents to the claims of the present invention. Explanation of the symbols

[0163] 10: Multiple Dancers 10_1: The First Dancer 10_2: The Second Dancer 10_3: The Third Dancer 10_4: The Fourth Dancer 10_5: The 5th Dancer 100: Projection device 1000: System 20: Multiple nodes 20_1: Node 1 20_2: Node 2 20_3: Third Node 20_4: The 4th Node 20_5: Node 5 200: At least one sensor 200_1: Sensor 200_2: Sensor 200_3: Sensor 30: 1st Large Group 300: Control unit 310: Processor 320: User Interface 330: Communication interface 340: Memory 341: Dancer Positioning Module 342: Projection Control Module 343: The first artificial intelligence model 344: The Second Artificial Intelligence Model 40: 2nd Large Group 400: Personal communication device 50: Arrow 500: Server device 600: User terminal

Claims

Claim 1 A system for projecting a formation and movement path of a dancer, comprising: a projection device for projecting a plurality of node marks corresponding to a plurality of dancers toward a floor surface; at least one sensor for detecting position values ​​of the plurality of dancers; a control device for transmitting a first control signal to the projection device to project the plurality of node marks based on a predefined first formation and receiving the position values ​​from the at least one sensor; and a personal communication device worn by each of the plurality of dancers, wherein the at least one sensor obtains an identification code corresponding to each of the plurality of dancers from the personal communication device, and the control device determines a personal position value of each of the plurality of dancers based on the identification code and the position values, and the control device determines whether at least one of the plurality of dancers is located on the plurality of node marks based on the personal position value, and transmits a third control signal to the projection device to project an error mark toward the floor surface based on the determination that at least one of the plurality of dancers is not located on the plurality of node marks. Claim 2 In claim 1, the control device comprises: transmitting the first control signal to the projection device at a first time point, and transmitting the second control signal to the projection device at a second time point following the first time point, such that the projection of a movement line indication from the predefined first formation to the predefined second formation is projected. Claim 3 delete Claim 4 delete Claim 5 In claim 1, the personal communication device comprises a vibration motor, and the control device transmits a feedback control signal to the personal communication device to provide vibration feedback through the vibration motor to a dancer among the plurality of dancers corresponding to the error indication. Claim 6 A system according to claim 1, wherein the at least one sensor includes an image sensor that captures choreography movements of the plurality of dancers, and the control device comprises: acquiring a choreography video corresponding to the choreography movement from the image sensor, acquiring a pose value of each of the plurality of dancers using a first artificial intelligence model that takes the choreography video as input, determining a score of the choreography movement using a second artificial intelligence model that takes the pose value as input, and transmitting a fourth control signal to the projection device to project the score of the choreography movement toward the floor surface. Claim 7 In claim 1, the control device generates the third control signal to project the error indication an arrow indicating the direction from the dancer's current position corresponding to the error indication toward the node indication where the dancer should be located. Claim 8 A system according to claim 1, wherein the control device calculates the distance between the individual position value and the target position value of each of the plurality of node indicators, and generates the third control signal to project an error indicator of a first color when the calculated distance is greater than a first threshold and less than a second threshold, and to project an error indicator of a second color when the calculated distance is greater than or equal to the second threshold. Claim 9 In paragraph 2, the control device is a system that receives user input and adjusts the projection speed of the movement line display changing from the first large size to the second large size based on the user input. Claim 10 A method for projecting a formation and movement path of a dancer, comprising: a step of transmitting a first control signal to a projection device, by means of a control device, to project a plurality of node marks based on a predefined first formation; a step of projecting the plurality of node marks corresponding to a plurality of dancers toward a floor surface by the projection device, based on the first control signal; a step of detecting position values ​​of a plurality of dancers by at least one sensor; a step of receiving the position values ​​from the at least one sensor by means of a control device; a step of obtaining an identification code corresponding to each of the plurality of dancers from a personal communication device by means of the at least one sensor; a step of determining a personal position value of each of the plurality of dancers based on the identification code and the position values ​​by means of a control device; a step of determining whether at least one of the plurality of dancers is located on the plurality of node marks based on the personal position value by means of a control device; and a step of transmitting a third control signal to the projection device to project an error mark toward the floor surface based on the determination by the control device that at least one of the plurality of dancers is not located on the plurality of node marks.

Images