Method and system for providing posture and joint motion test service based on artificial intelligence

Abstract

The present invention relates to a method and a system for providing a posture and joint motion test service based on artificial intelligence. The method for providing a posture and joint motion test service, according to the present invention, may comprise a step for receiving, from a medical staff terminal, a selection of at least one photographing item to be photographed for a patient among a plurality of photographing items corresponding to respective plurality of photographing topics related to posture or joint motion.

Description

Method and system for providing artificial intelligence-based posture and joint movement examination service.

[0001] The present invention relates to a method and system for providing an artificial intelligence-based posture and joint motion examination service.

[0002] Musculoskeletal disorders refer to pain or damage occurring in the musculoskeletal system, including muscles, nerves, tendons, ligaments, bones, and surrounding tissues. Musculoskeletal disorders can affect various parts of the body, including the neck, back, arms, and legs.

[0003] According to a report by the World Health Organization (WHO), economic losses due to musculoskeletal disorders are the fourth highest among all diseases, and musculoskeletal disorders are chronic pain that affects not only daily life but also economic activities.

[0004] Meanwhile, as technology advances, electronic devices (e.g., smartphones, tablet PCs, etc.) have become more widespread, and as a result, our dependence on the Internet in many aspects of our daily lives is gradually increasing.

[0005] In this way, thanks to the development of various technologies including the Internet, consumption patterns that were previously highly dependent on offline channels have gradually shifted to online channels, and currently, online-centered consumption is increasing exponentially.

[0006] In line with these changing trends, even industries such as the medical industry, which are inherently offline, are increasingly providing medical services online.

[0007] Accordingly, recently, various medical services have been provided online, and patients, or users, can now consult with medical professionals about their illnesses with just a few clicks through an Internet-connected electronic device.

[0008] As such technology, Korean Patent No. 10-2193012 discloses technology related to a server and system that provides an online medical platform, and provides patients with information about medical service providers online.

[0009] In line with this trend, there is a need for a service that photographs the posture and joint movements of patients with musculoskeletal disorders, analyzes them using artificial intelligence, and provides the results online.

[0010] The present invention provides a method and system for providing a posture and joint motion examination service that can photograph the posture or joint motion of a musculoskeletal patient and provide the results analyzed through an artificial intelligence model.

[0011] Furthermore, the present invention provides a method and system for providing a posture and joint motion examination service that can provide a shooting process for sequentially taking pictures of a patient's posture or joint motion from a medical staff terminal.

[0012] Furthermore, the present invention provides a method and system for providing posture and joint motion examination services that can provide a shared environment for posture and joint motion examination services at the hospital level.

[0013] Furthermore, the present invention provides a method and system for providing a posture and joint movement examination service that can provide a treatment-purpose exercise program to a patient based on the authority of medical staff.

[0014] In order to solve the problem discussed above, a method for providing a posture and joint motion examination service according to the present invention may include a step of specifying a patient to be photographed based on information received from a medical staff terminal, a step of selecting from the medical staff terminal at least one photographing item to be photographed for the patient among a plurality of photographing items each corresponding to a plurality of photographing topics related to posture or joint motion, a step of specifying at least one photographing topic to be photographed for the patient among the plurality of photographing topics based on the selection of the at least one photographing item, a step of providing the medical staff terminal with a photographing process for sequentially performing a plurality of photographs in which a specific posture or a specific joint motion corresponding to the specified photographing topic is matched, a step of acquiring a plurality of images according to the plurality of photographs through the photographing process, and a step of transmitting the plurality of images to a server.

[0015] Furthermore, for each of the plurality of shooting topics, there are a plurality of subtopics in which shooting must be performed in relation to the posture or the joint movement, and a shooting order of the plurality of subtopics are matched, and the shooting process can sequentially perform the plurality of shootings in which each of the plurality of subtopics is matched according to the shooting order.

[0016] Furthermore, if the specified shooting topic includes a first subtopic and a second subtopic different from the first subtopic, the plurality of shootings may include a first shooting matched with the first subtopic and a second shooting matched with the second subtopic, and the shooting process may be provided to the medical staff terminal such that the second shooting is performed continuously after the first shooting is performed on the medical staff terminal.

[0017] Furthermore, while the first shooting is in progress on the medical terminal, the display unit of the medical terminal may display first guide information matching the first subtopic and first guide information guiding at least one of the first subtopic and the first shooting order, and after the first shooting is performed, in conjunction with the second shooting being performed, the display unit of the medical terminal may display second guide information matching the second subtopic and second guide information guiding at least one of the second subtopic and the second shooting order.

[0018] Furthermore, the plurality of images include a first image acquired in the first shooting and a second image acquired in the second shooting, and the method further includes a step of determining whether re-shooting is necessary for at least one of the plurality of images, a step of specifying one of the subtopics corresponding to the image requiring re-shooting if re-shooting is necessary for the at least one image as a result of the determination, and a step of providing a re-shooting process to the medical staff terminal so that re-shooting matching the specified subtopic is performed, and the image requiring re-shooting among the plurality of images can be updated with an image acquired through the re-shooting process.

[0019] Furthermore, when a first shooting topic and a second shooting topic different from the first shooting topic are specified among a plurality of shooting topics, the shooting process may be provided to the medical staff terminal so that, after the plurality of shootings corresponding to the first shooting topic are performed on the medical staff terminal, the plurality of shootings corresponding to the second shooting topic are performed continuously.

[0020] Furthermore, the method may further include a step of analyzing the specific posture or the specific joint motion of the patient based on the plurality of images, and a step of providing the analysis result for the specific posture or the specific joint motion of the patient to the medical staff terminal.

[0021] Furthermore, in the analyzing step, an artificial intelligence posture estimation model is used to extract key points corresponding to a plurality of preset joint points from the plurality of images, and a relative positional relationship between the key points is analyzed through an artificial intelligence motion analysis model, and based on the analysis of the positional relationship, the specific posture or the specific joint motion of the patient can be analyzed.

[0022] Furthermore, the medical staff terminal may further include a step of generating a payment event related to the analysis result provision service, a step of specifying a payment amount using the progress history of the photographing process performed over a certain period of time for the purpose of providing the analysis result based on the occurrence of the payment event, and a step of performing a payment process for the amount.

[0023] Meanwhile, a posture and joint motion examination service provision system according to the present invention includes a control unit that specifies a patient to be photographed based on information received from a medical terminal, and selects from the medical terminal at least one photographing item to be photographed for the patient among a plurality of photographing items each corresponding to a plurality of photographing topics related to posture or joint motion, and the control unit, based on the selection of the at least one photographing item, specifies at least one photographing topic to be photographed for the patient among the plurality of photographing topics, and provides the medical terminal with a photographing process for sequentially performing a plurality of photographs in which a specific posture or a specific joint motion corresponding to the specified photographing topic is matched, using the patient as a subject, and through the photographing process, acquires a plurality of images according to the plurality of photographs and transmits the plurality of images to a server.

[0024] Meanwhile, a program according to the present invention is a program that is executed by one or more processes in an electronic device and can be stored in a computer-readable recording medium, wherein the program may include commands that perform the steps of: specifying a patient to be photographed based on information received from a medical staff terminal; selecting from the medical staff terminal at least one photographing item to be photographed for the patient among a plurality of photographing items each corresponding to a plurality of photographing topics related to posture or joint motion; specifying, based on the selection of the at least one photographing item, at least one photographing topic to be photographed for the patient among the plurality of photographing topics; providing, to the medical staff terminal, a photographing process for sequentially performing a plurality of photographs in which a specific posture or a specific joint motion corresponding to the specified photographing topic is matched, using the patient as a subject; obtaining, through the photographing process, a plurality of images according to the plurality of photographs; and transmitting the plurality of images to a server.

[0025] As described above, the method and system for providing posture and joint motion examination service according to the present invention can specify a patient to be photographed based on information received from a medical staff terminal, select at least one photographing item to be photographed for the patient from among a plurality of photographing items each corresponding to a plurality of photographing topics related to posture or joint motion from the medical staff terminal, and, based on the selection of the at least one photographing item, specify at least one photographing topic to be photographed for the patient from among the plurality of photographing topics. The medical staff can select a topic necessary for analyzing the patient's posture or joint motion and perform a patient-tailored posture analysis.

[0026] Furthermore, the method and system for providing posture and joint motion examination service according to the present invention provides the medical staff terminal with a shooting process that sequentially performs a plurality of shots matching a specific posture or a specific joint motion corresponding to the specified shooting topic, using the patient as a subject, and through the shooting process, a plurality of images according to the plurality of shots can be acquired. Through this, the present invention can provide an analysis service that analyzes the joint motion of a musculoskeletal patient using artificial intelligence without expensive equipment, using a medical staff terminal carried by the medical staff.

[0027] Figure 1 is a conceptual diagram for explaining a posture and joint motion examination service provision system according to the present invention.

[0028] Figure 2 is a conceptual diagram for explaining multiple shooting items each corresponding to multiple shooting topics related to posture or joint motion.

[0029] Figure 3 is a conceptual diagram for explaining a method of managing medical staff accounts and patient accounts separately in the present invention.

[0030] Figure 4 is a flowchart for explaining a method for providing a posture and joint motion inspection service according to the present invention.

[0031] FIG. 5a, FIG. 5b, FIG. 5c, FIG. 5d, FIG. 5e, FIG. 5f, FIG. 5g, FIG. 5h, FIG. 6a, FIG. 6b, FIG. 6c and FIG. 6d are conceptual diagrams for explaining a method for providing a posture and joint motion inspection service according to the present invention.

[0032] FIG. 7a, FIG. 7b, FIG. 7c, FIG. 8a, FIG. 8b, FIG. 8c, FIG. 8d, and FIG. 8e are conceptual diagrams for explaining various functions provided using patient history information in the present invention.

[0033] FIG. 9a, FIG. 9b, FIG. 9c, and FIG. 9d are conceptual diagrams for explaining services provided to a patient through the results of analysis of the patient's posture or joint movement in the present invention.

[0034] Figure 10 is a conceptual diagram for explaining the payment process provided in the present invention.

[0035] Figures 11a and 11b are conceptual diagrams for explaining a method of prescribing an exercise program to a patient in the present invention.

[0036] FIG. 12, FIG. 13, FIG. 14a, FIG. 14b, and FIG. 14c are conceptual diagrams for explaining a method for performing analysis on a patient's posture or joint motion in the present invention.

[0037] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0038] Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by these terms. These terms are used solely to distinguish one component from another.

[0039] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0040] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0041] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0042] Figure 1 is a conceptual diagram illustrating a posture and joint motion inspection service provision system according to the present invention. Furthermore, Figure 2 is a conceptual diagram illustrating multiple photographing items, each corresponding to a plurality of photographing topics related to posture or joint motion.

[0043] Referring to FIG. 1, the posture and joint motion examination service provision system (100) according to the present invention can provide a plurality of shooting items (1, 2, 3, 4) each corresponding to a plurality of shooting topics to a medical staff terminal (10).

[0044] The plurality of shooting topics described in the present invention may be related to postures or joint movements. More specifically, among the plurality of shooting topics (first to fourth shooting topics), the first shooting topic may be related to "static posture," the second shooting topic may be related to "joint range of motion (shoulder)," the third shooting topic may be related to "joint range of motion (elbow)," and the fourth shooting topic may be related to "joint range of motion (torso).

[0045] Meanwhile, as illustrated in FIG. 2, for each of the plurality of shooting items (1, 2, 3, 4) corresponding to each of the plurality of shooting topics, at least one of the shooting target scene (or scenes), shooting method, and shooting order may be matched and present.

[0046] In the present invention, “matching (or corresponding to) a plurality of shooting items” may also be understood to mean matching (or corresponding to) a plurality of shooting topics.

[0047] The scene to be filmed may be configured to include multiple scenes corresponding to specific poses or specific joint movements, each corresponding to a plurality of filming topics.

[0048] Among the plurality of shooting items (1, 2, 3, 4), the first shooting item (1) may include a plurality of shooting target scenes that are matched with a specific pose corresponding to the first shooting topic (e.g., static pose). For example, the first shooting item (1) may include at least one shooting target scene matched with a front static pose scene (e.g., “static pose (front)” 1a), a left static pose scene (e.g., “static pose (left)” 1b), and a right static pose scene (e.g., “static pose (right)” 1c).

[0049] In addition, among the plurality of shooting items (1, 2, 3, 4), the third shooting item (3) may include a plurality of shooting target scenes that are matched with a specific joint motion corresponding to the third shooting topic (e.g., “joint range of motion (elbow)”). For example, the third shooting item (3) may include at least one shooting target scene from among a left elbow bending scene (e.g., “elbow bending (left)” 3a), a left elbow extension scene (e.g., “elbow extension (left)” 3b), a right elbow bending scene (e.g., “elbow bending (right)” 3c), and a right elbow extension scene (e.g., “elbow extension (right)” 3d).

[0050] That is, among the multiple shooting items (1, 2, 3, 4), the first shooting item (1) may have multiple shooting target scenes associated with a specific pose matched therewith, and each of the second to fourth shooting items (2, 3, 4) may have multiple shooting target scenes associated with a specific joint movement matched therewith.

[0051] Meanwhile, for each of the plurality of shooting items (1, 2, 3, 4), a matching shooting target scene may have a shooting method used to shoot the plurality of scenes. Here, the shooting method may include at least one of a first shooting method (e.g., photo shooting) and a second shooting method (e.g., video shooting).

[0052] For example, a plurality of shooting target scenes (1a to 1c) matching the first shooting item (1) can be shot using the first shooting method.

[0053] For another example, a plurality of shooting target scenes (3a to 3d) matching the third shooting item (3) can be shot using the second shooting method.

[0054] That is, a scene captured using the first shooting method may include images related to a “specific pose,” and a scene captured using the second shooting method may include images related to a “specific joint movement.”

[0055] Meanwhile, a shooting order in which multiple target scenes are shot, each of which is matched to a plurality of shooting items (1, 2, 3, 4), may be preset. This shooting order may be preset in the posture and joint motion inspection service provision system (100).

[0056] For example, the shooting order in which multiple scenes (1a to 1c) matching the first shooting item (1) among multiple shooting items (1, 2, 3, 4) are shot can be set so that the front static posture scene (1a) - left static posture scene (1b) - right static posture scene (1c) are shot sequentially.

[0057] For another example, the shooting order in which multiple scenes (3a to 3d) matching the third shooting item (3) are shot may be set to be shot sequentially as left elbow bending scene (3a) - left elbow extension scene (3b) - right elbow bending scene (3c) - right elbow extension scene (3d).

[0058] That is, in the present invention, a shooting process capable of sequentially shooting a plurality of shooting target scenes matched to each of a plurality of shooting items (1, 2, 3, 4) according to a preset shooting order can be provided to a medical staff terminal (10).

[0059] In this regard, when multiple shooting items are selected from the medical staff terminal (10), the multiple shooting items can be sequentially shot according to the shooting order set in the posture and joint movement examination service provision system (100).

[0060] For example, the preset shooting order for multiple shooting items may be set based on the shooting method. In this case, multiple target scenes shot using the first shooting method may be sequentially shot, and then multiple target scenes shot using the second shooting method may be sequentially shot.

[0061] As another example, the preset shooting order for multiple shooting items may be set to be shot in the order of first shooting item (1) - second shooting item (2) - third shooting item (3) - fourth shooting item (4). In this case, assuming that the second shooting item (2) and the fourth shooting item (4) are selected from the multiple shooting items (1, 2, 3, 4) from the medical staff terminal (10), multiple scenes matched to the second shooting item (2) may be shot sequentially according to the shooting order, and then multiple shooting target scenes matched to the fourth shooting item (4) may be shot sequentially according to the shooting order.

[0062] However, the preset shooting order for multiple shooting items is not limited to the cases described above. In the present invention, the preset shooting order for multiple shooting items can be set in various ways by the administrator of the posture and joint motion inspection service provision system (100) or the user using the posture and joint motion inspection service. For convenience of explanation, the above-described cases will be described below without distinction.

[0063] For example, as illustrated in FIG. 2, let us assume that the first shooting item (1) and the third shooting item (3) are selected from among the plurality of shooting items (1, 2, 3, 4) from the medical terminal (10). In the present invention, a shooting process for the plurality of shooting items can be provided to the medical terminal (10) such that the front static posture scene (1a) - left static posture scene (1b) - right static posture scene (1c) matched to the first shooting item (1) are sequentially shot, and then the left elbow bending motion (3a) - left elbow extension motion (3b) - right elbow bending motion (3c) - right elbow extension motion (3d) matched to the third shooting item (3) are sequentially shot.

[0064] Furthermore, the “medical staff” described in the present invention refers to a person working at a medical institution (e.g., hospital, H), and may include, for example, at least one of a doctor, a nurse, and a physical therapist.

[0065] For convenience of explanation, the present invention uses doctors and physical therapists as examples of medical staff. However, the definition of medical staff is not limited to these examples. Any user working at a medical institution providing posture and joint movement testing services may be considered a medical staff member according to the present invention.

[0066] Referring again to FIG. 1, the posture and joint motion inspection service provision system (100) according to the present invention may include at least one of a communication unit (110), a storage unit (120), and a control unit (130).

[0067] The communication unit (110) can be connected to a server and devices, etc. via a wireless or wired network, and can be configured to receive or transmit overall data and information required for the posture and joint motion inspection service provision system (100).

[0068] In addition, the communication unit (110) may be communicatively connected to at least one of the medical staff terminal (10) and the patient terminal (20), and may receive requests related to the posture and joint motion examination service from the medical staff terminal (10) and the patient terminal (20). For example, the communication unit (110) may receive a request for registering a specific patient account for registering a specific patient account in the posture and joint motion examination service from the medical staff terminal (10).

[0069] Here, the medical staff terminal (10) and the patient terminal (20) may include at least one of a mobile phone, a smart phone, a notebook computer, a laptop computer, a slate PC, a tablet PC, an ultrabook, a desktop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, and a wearable device (e.g., a smartwatch, a smart glass, a head mounted display (HMD)).

[0070] And, although not shown, the medical staff terminal (10) and the patient terminal (20) may include at least one of a display unit that outputs information and an input unit that receives information from the medical staff and the patient.

[0071] The display unit and input unit of the medical staff terminal (10) and patient terminal (20) may exist independently of each other, but may also exist as an integrated unit, such as a touch screen. In the case where the display unit and the input unit exist as an integrated unit, such as a touch screen, the input unit may be understood as a sensing unit that detects input (e.g., touch input or scroll input) through the display unit, and as a component of the display unit.

[0072] Hereinafter, without distinguishing whether the display unit and the input unit of the medical staff terminal (10) and the patient terminal (20) exist independently or as one unit, the configuration that performs the function of outputting information is called the display unit, and the configuration that performs the function of inputting information is called the input unit.

[0073] Furthermore, the communication unit (110) can support various communication methods according to the communication standards of the communicating device.

[0074] For example, the communication unit (110) may be configured to communicate with at least one of a medical staff terminal (10), a patient terminal (20), a server, and a device (including a cloud server) using at least one of WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), 5G (5th Generation Mobile Telecommunication), Bluetooth (Bluetooth™ Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra-Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies.

[0075] Meanwhile, the storage unit (120) may also be referred to as a database (DB) and may be configured to store various information related to the present invention. In the present invention, the storage unit (120) may be provided in the posture and joint movement examination service provision system (100) itself. In addition, at least a portion of the storage unit (120) may be configured as a cloud server (or cloud storage). That is, the storage unit (120) may be sufficient as long as it is a space where information required for the posture and joint movement examination service provision system (100) according to the present invention is stored, and it can be understood that there are no restrictions on physical space.

[0076] Furthermore, the storage unit (120) may store data and commands necessary for the operation of the posture and joint motion examination service providing system (100) according to the present invention. For example, the storage unit (120) may store learning data necessary for learning an artificial intelligence model used for analyzing a patient's posture and joint motion, and commands implemented to perform a patient's posture and joint motion analysis task may be stored.

[0077] Meanwhile, in the storage unit (120), information on at least one of the shooting target scene, shooting method, and shooting order included in the plurality of shooting items (1, 2, 3, 4) corresponding to each of the plurality of shooting topics may be matched and stored. For example, as illustrated in FIG. 2, in the storage unit (120), at least one of i) information on the plurality of scenes (1a to 1c) matched to the first shooting item (1), ii) shooting method information of the plurality of scenes (1a to 1c) matched to the first shooting item (1), and iii) shooting order information of the plurality of scenes (1a to 1c) matched to the first shooting item (1) may be matched and stored.

[0078] For another example, in the storage unit (120), at least one of i) information on a plurality of scenes (3a to 3d) matched to the third shooting item (3), ii) shooting method information of a plurality of scenes (3a to 3d) matched to the third shooting item (3), and iii) shooting order information of a plurality of scenes (3a to 3d) matched to the third shooting item (3) may be matched and present.

[0079] Additionally, the storage unit (120) may store information related to a preset shooting order for multiple shooting items. For example, the posture and joint motion examination service provision system (100) may use the information stored in the storage unit (120) to provide the medical staff terminal (10) with a shooting process that allows for sequential shooting of each of the multiple shooting items.

[0080] Furthermore, in the storage unit (120), information about a specific medical staff and information about a specific patient may be matched and stored. For example, in the storage unit (120), at least one of the following may be matched and present: i) information about a specific patient (or patient account), ii) information about a medical staff (or medical staff account) who photographed a specific patient, iii) information about a specific photographed item photographed of a specific patient, iv) information about an image (or photo) of a specific patient photographed in relation to a specific photographed item, v) information about the date and time when a specific photographed item was photographed, and vi) information about the results of an analysis of a specific patient's posture or joint movement.

[0081] Meanwhile, the control unit (130) may play a role in controlling the overall operation of the posture and joint motion inspection service provision system (100) related to the present invention. The control unit (130) may process signals, data, information, etc. input or output through the components discussed above, or may perform a series of data processing to provide or process appropriate information and functions to the user.

[0082] The control unit (130) can detect an object (U) from an image using an object detection algorithm based on the inclusion of an object corresponding to the entire patient body within a specific area. For example, the control unit (130) can use an algorithm (Weighted Box Fusion, WBF) that ensembles multiple bounding boxes.

[0083] In addition, the control unit (130) can train an artificial intelligence model using the learning data stored in the storage unit (120) to analyze the patient's posture and joint motion. In addition, the control unit (130) can analyze the patient's posture and joint motion included in the image captured by the medical staff terminal (10) using an artificial intelligence model specialized in posture and joint motion analysis, and provide the analyzed results to the medical staff terminal (10).

[0084] Furthermore, the control unit (130) can provide the medical staff terminal (10) with a shooting process that can sequentially shoot multiple scenes that match a specific posture or specific joint movement corresponding to a specific shooting topic by using information related to multiple shooting items (1, 2, 3, 4) stored in the storage unit (120).

[0085] Below, a more detailed description will be given of the method for managing medical staff accounts and patient accounts separately in the present invention. Figure 3 is a conceptual diagram illustrating the method for managing medical staff accounts and patient accounts separately in the present invention.

[0086] As illustrated in FIG. 3, the control unit (130) can manage medical staff accounts and patient accounts separately. In the following, for convenience of explanation, medical staff accounts will be described by assigning the same drawing codes as medical staff accounts, “U1,” “U2,” “U4,” and “U5,” and patient accounts will be described by assigning the same drawing codes as patients, “U3,” and “U6.”

[0087] The control unit (130) can manage medical staff accounts (U1, U2, U4, U6) by hospital (H1, H2) unit. More specifically, the control unit (130) can match medical staff accounts (U1, U2, U4, U6) with at least one hospital (or hospital information, H1, H2) where the medical staff works (or belongs to) and store the match in the storage unit (120).

[0088] For example, the control unit (130) can manage medical staff accounts (U1, U2) of medical staff (e.g., “therapist A” and “doctor A”) working at the first hospital (H1) by matching them with the first hospital (H1), and can manage medical staff accounts (U4, U5) of medical staff (e.g., “therapist B” and “doctor B”) working at the second hospital (H2) by matching them with the second hospital (H2).

[0089] Meanwhile, the medical staff account in the present invention can be divided into the first type and the second type according to the authority granted to the account.

[0090] A first type of medical staff account may be understood as a medical staff account that is granted at least one of the following: i) the authority to register patient accounts, ii) the authority to photograph patients registered to the account, and iii) the authority to check individual patient records through user authentication.

[0091] A second type of medical staff account may be understood as a medical staff account that is granted at least one of the following: i) the right to access the imaging records of all patients registered in the first type of medical staff account, ii) the right to modify the patient's joint points, iii) the right to check and share the analysis results of the patient's posture or joint movement, and iv) the right to independently prescribe an exercise program to the patient.

[0092] However, it is also possible that at least some of the privileges granted to the Type 1 medical staff account may be performed by the Type 2 medical staff account.

[0093] The control unit (130) can set the medical staff account to either the first type or the second type based on the medical staff's occupational information.

[0094] For example, if the occupation of the medical staff is a first type of occupation (e.g., “therapist”), the control unit (130) may set the type of the medical staff account to the first type. On the other hand, if the occupation of the medical staff is a second type of occupation (e.g., “doctor”), the control unit (130) may set the type of the medical staff account to the second type.

[0095] In this way, in the present invention, posture and joint movement examination services can be provided to patients according to different processes based on whether the type of medical staff account is the first type or the second type.

[0096] Meanwhile, as illustrated in FIG. 3, a patient account (U3, U6) may exist in the storage unit (120). At least one of the following may be matched in the patient account (U3, U6): i) symptom information about the patient's symptoms, ii) patient's shooting record information about specific shooting items, iii) patient's posture and joint movement analysis result information, iv) medical staff information about the medical staff in charge of the patient, and v) hospital information to which the medical staff belongs.

[0097] The control unit (130) may configure a patient account registration page for registering a patient account. For example, as illustrated in FIG. 5A, the control unit (130) may configure a patient account registration page (510) to allow input of at least one of: i) the patient's name, ii) the patient's date of birth, iii) the patient's gender, iv) the patient's mobile phone number, and v) the patient's email address.

[0098] That is, the control unit (130) can create a patient account even if the patient's occupational information or hospital information of the related hospital is not entered.

[0099] This patient account registration page (510) may be provided on at least one of the medical staff terminal (10) and the patient terminal (20).

[0100] For example, when a patient visits a hospital, the control unit (130) can provide a patient account registration page (510) to the medical staff terminal (10). The medical staff can create a patient account by entering the patient's information through the medical staff terminal (10).

[0101] For another example, a patient can directly create a patient account through a patient account registration page (510) provided on the patient terminal (20).

[0102] Below, the photographing process provided in the present invention will be described in more detail based on the configuration of the posture and joint motion inspection service provision system (100) discussed above. FIG. 4 is a flowchart for explaining a method for providing a posture and joint motion examination service according to the present invention, FIGS. 5a, 5b, 5c, 5d, 5e, 5f, 5g, 5h, 6a, 6b, 6c and 6d are conceptual diagrams for explaining a method for providing a posture and joint motion examination service according to the present invention, FIGS. 7a, 7b, 7c, 8a, 8b, 8c, 8d and 8e are conceptual diagrams for explaining various functions provided using patient history information in the present invention, FIGS. 9a, 9b, 9c and 9d are conceptual diagrams for explaining a service provided to a patient through a patient's posture or joint motion analysis result in the present invention, and FIG. 10 is a conceptual diagram for explaining a payment process provided in the present invention. Furthermore, FIGS. 11a and 11b are conceptual diagrams for explaining a method of prescribing an exercise program to a patient in the present invention, and FIGS. 12, 13, 14a, 14b, and 14c are conceptual diagrams for explaining a method of performing analysis on a patient's posture or joint movement in the present invention.

[0103] In the present invention, a process of specifying a patient to be photographed can be performed based on information received from a medical staff terminal (S410, see FIG. 4).

[0104] As illustrated in FIG. 5a, the control unit (130) can provide a patient management page (500) that can register and manage a patient account on a medical staff terminal (10) to which a specific medical staff account (U1) is logged in.

[0105] Here, a specific medical staff account (U1) can be understood as a first-type medical staff account. As previously explained, a first-type medical staff account can be understood as a medical staff account granted at least one of the following: i) the authority to register patient accounts, ii) the authority to photograph patients registered to the account, and iii) the authority to check individual patient records through user authentication.

[0106] The control unit (130) may provide a graphic object (501) linked to a patient account registration request to the patient management page (500). In addition, the control unit (130) may provide a patient account registration page (510) for registering a patient account for a specific patient to the medical staff terminal (10) based on the selection of the graphic object (501) included in the patient management page (500) from the medical staff terminal (10).

[0107] The patient account registration page (510) may be configured to receive various patient-related information. For example, the patient account registration page (510) may be configured to receive input for at least one of: i) the patient's name, ii) the patient's date of birth, iii) the patient's gender, iv) the patient's mobile phone number, and v) the patient's email address.

[0108] The control unit (130) can control the graphic object (511) included in the patient account registration page (510) to be displayed in an activated state when all patient information for a specific patient is input from the medical staff terminal (10). In addition, the control unit (130) can control the registration of a specific medical staff account (U1) or a specific patient account based on the selection of the activated graphic object (511) from the medical staff terminal (10).

[0109] Furthermore, when a specific patient account is registered to a specific medical staff account (U1), the control unit (130) can match the specific medical staff account (U1) and the specific patient account and store them in the storage unit (120).

[0110] Meanwhile, the control unit (130) may provide the medical staff terminal (10) with a patient account page including information related to a specific patient account. For example, as illustrated in 5b, the control unit (130) may provide the medical staff terminal (10) with a patient account page (520) including at least one of i) name information of the specific patient (ex: “Patient A”), ii) gender information of the specific patient (ex: “male”), iii) date of birth information of the specific patient (ex: “1980,10,20”), and mobile phone number information of the specific patient (ex: “010-13d-5678”), which are matched with a specific patient account (ex: “Patient A” U3).

[0111] The control unit (130) can control the patient account page (520) to include a graphic object (521) associated with a request to activate the photographing process. The control unit (130) can receive a request from a specific medical staff member (U1) to activate the photographing process based on the selection of the graphic object (521) included in the patient account page (520) from the medical staff terminal (10).

[0112] In addition, the graphic object (521) may be linked to a request for specifying a patient to be photographed. When a graphic object (521) included in a patient account page (520) is selected from a medical staff terminal (10), the control unit (130) may specify a patient to be photographed. For example, when the control unit (130) receives a selection of a graphic object (521) included in a patient account page (520), the control unit (130) may confirm whether the patient account page (520) including the graphic object (521) includes information related to a specific patient. In addition, the control unit (130) may specify a patient to be photographed (U3) among a plurality of patients matched to a specific medical staff account (U1) based on the confirmed information.

[0113] Furthermore, the graphic object (521) may be linked to a request for providing a plurality of shooting items, each corresponding to a plurality of shooting topics related to posture or joint motion. When a graphic object (521) included in a patient account page (520) is selected from the medical staff terminal (10), the control unit (130) may provide a plurality of shooting items, each corresponding to a plurality of shooting topics, to the medical staff terminal (10). For example, as illustrated in FIG. 5C, when the control unit (130) receives a selection of a graphic object (521) included in the patient account page (520), it may provide a plurality of shooting items (1, 2, 3, 4), each corresponding to a plurality of shooting topics, to the medical staff terminal (10).

[0114] Meanwhile, in the present invention, a process may be performed in which at least one shooting item to be shot for a patient among a plurality of shooting items each corresponding to a plurality of shooting topics related to posture or joint movement is selected from a medical staff terminal (S420, see FIG. 4).

[0115] Furthermore, in the present invention, a process of specifying at least one shooting topic for which shooting should be performed on a patient among a plurality of shooting topics may be performed based on selection of at least one shooting item (S430, see FIG. 4).

[0116] As illustrated in FIG. 5c, the control unit (130) can provide a plurality of shooting items (1, 2, 3, 4) corresponding to a plurality of shooting topics related to posture or joint motion to the medical staff terminal (10).

[0117] The control unit (130) can control the graphic object (531) provided to the medical staff terminal (10) to be displayed in an activated state when at least one of the multiple shooting items (1, 2, 3, 4) is selected on the medical staff terminal (10). In this case, the graphic object (531) can be configured to include text related to the number corresponding to the selected item (e.g., “shoot 2 items”, 531a).

[0118] The control unit (130) can receive selection of at least one shooting item for a specific patient (U3) from among a plurality of shooting items from the medical staff terminal (10). For example, the control unit (130) can receive selection of a shooting item for a specific patient (U3) based on the selection of the first shooting item (1) and the third shooting item (3) from among a plurality of shooting items (1, 2, 3, 4) from the medical staff terminal (10) and the selection of an activated graphic object (531).

[0119] In the present invention, “selecting a shooting item” can also be understood to mean selecting a shooting topic.

[0120] Furthermore, the control unit (130) can specify a shooting topic for which shooting should be performed for a specific patient (U3) among a plurality of shooting topics based on a selection received from the medical staff terminal (10). For example, the control unit (130) can confirm a shooting topic corresponding to each of the first shooting item (1) and the third shooting item (3) based on the fact that the shooting items selected from the medical staff terminal (10) are the first shooting item (1) and the third shooting item (3). Here, the first shooting item (1) can correspond to the first shooting topic (e.g., “static posture”), and the third shooting item (3) can correspond to the third shooting topic (e.g., “joint range of motion (elbow)”). Accordingly, the control unit (130) can specify the first shooting topic and the third shooting topic as shooting topics for which shooting should be performed for the specific patient (U3).

[0121] Meanwhile, in the present invention, a process of providing a medical staff terminal with a shooting process that sequentially performs multiple shots matching a specific posture or specific joint movement corresponding to a specific shooting topic, using a patient as a subject, can be performed (S440, see FIG. 4).

[0122] Furthermore, in the present invention, a process of acquiring multiple images according to the multiple shootings can be performed through a shooting process (S450, see FIG. 4).

[0123] In the present invention, a patient object included in a scene to be photographed (or a photographed image) may be described as a "subject." In the present invention, "subject" may refer to a patient or a body part of a patient included in a photographed image. In the present invention, "subject" and "patient" may be used interchangeably, and hereinafter, "subject" and "patient" will be described by assigning the same drawing reference numeral "U3" to them.

[0124] In each of the plurality of shooting topics described in the present invention, there may be matched multiple subtopics and a shooting order of the plurality of subtopics in which shooting should be performed in relation to a posture or joint movement. For example, as illustrated in FIG. 5D, among the plurality of shooting topics, each of the first shooting topics (e.g., “static posture”) may be matched multiple subtopics in which shooting should be performed in relation to a specific posture (e.g., “static posture (front),” “static posture (left),” “static posture (right)”) and a shooting order of the plurality of subtopics (e.g., “static posture (front) - static posture (left) - static posture (right)”).

[0125] For another example, among the multiple shooting topics, each of the third shooting topics (e.g., “joint range of motion (elbow)”) may have multiple subtopics (e.g., “elbow flexion, extension (left)”, “elbow flexion, extension (right)”) that must be shot in relation to a specific posture, and the shooting order of the multiple subtopics (e.g., “elbow flexion, extension (left) - elbow flexion, extension (right)”) may be matched.

[0126] In this regard, the shooting process may be performed sequentially to perform multiple shootings, each of which is matched to a plurality of subtopics, according to the shooting order of the plurality of subtopics.

[0127] The control unit (130) can provide a shooting process for sequentially performing multiple shots that are matched with a specific posture or specific joint movement corresponding to a specific shooting topic to the medical staff terminal (10).

[0128] For example, as illustrated in FIG. 5d, let us assume that a first shooting topic (e.g., “static posture”) is specified as a shooting topic for sequentially shooting a specific patient (U3) as a subject. The control unit (130) can provide the medical staff terminal (10) with a shooting process for sequentially shooting a plurality of scenes matched to a specific posture or a specific joint movement corresponding to the first shooting topic.

[0129] At this time, if a specific first shooting topic includes a first subtopic and a second subtopic different from the first subtopic, multiple shootings related to the first shooting topic may include a first shooting in which the first subtopic is matched and a second shooting in which the second subtopic is matched.

[0130] Accordingly, the shooting process for a specific first shooting topic can be provided to the medical staff terminal (10) so that the second shooting is performed continuously after the first shooting is performed at the medical staff terminal (10).

[0131] While filming for a specific filming topic is in progress, each of a plurality of scenes corresponding to the specific filming topic may include at least one of: i) guide information matching each of a plurality of subtopics, ii) subtopic guide information guiding a specific subtopic, and iii) filming order guide information guiding a filming order for a specific subtopic.

[0132] According to the shooting process of the first shooting topic (e.g., static posture), the first shooting of the front static posture scene (1a) among the multiple scenes (1a, 1b, 1c) corresponding to the first shooting topic may be performed first. For example, as illustrated in (a) of FIG. 5e, the control unit (130) may provide the front static posture scene (1a) to the medical staff terminal (10) so that the first shooting of the front static posture scene (1a) is performed first.

[0133] On the display unit of the medical staff terminal (10) in which the first shooting of the front static posture scene (1a) is in progress, at least one of the first guide information (ex: “Starting shooting a static posture photo. Please shoot according to the guidelines.”, 541a) matching the first subtopic (ex: static posture (front)), the first subtopic guidance information guiding the first subtopic (ex: “static posture (front)” 541b), and the first guidance information guiding the shooting order of the first subtopic (ex: “1 / 3” 541c) may be displayed.

[0134] The medical staff (U1) can perform the first photographing of the subject (U3) in a specific posture (e.g., frontal static posture) according to the guide lines using the first guide information (541a). Furthermore, the medical staff (U1) can intuitively recognize the first subtopic that will be the subject of the photographing of the subject (U3) using the first subtopic guide information (541b). Furthermore, the first guide information (541c) can intuitively recognize the photographing order of the first subtopic and the number of remaining scenes to be photographed.

[0135] The control unit (130) may receive a first shooting request for the frontal static posture scene (1a) based on the selection of a graphic object (541d) linked to the first shooting of the frontal static posture scene (1a) from the medical staff terminal (10). Then, the control unit (130) may control the first shooting of the frontal static posture scene (1a) to be performed in response to the received request.

[0136] The control unit (130) can control the second shooting to be performed continuously after the first shooting of the front static posture scene (1a). For example, as illustrated in (b) of FIG. 5e, the control unit (130) can provide the left static posture scene (1b) to the medical staff terminal (10) so that the second shooting of the left static posture scene (1b) is performed continuously.

[0137] After the first shooting of the front static posture scene (1a) is performed, in conjunction with the second shooting of the left static posture scene (1b), at least one of second guide information (ex: “Start shooting static posture photo. Please shoot according to the guideline.”, 542a) matching the second subtopic (“static posture (left)”), second subtopic guidance information guiding the second subtopic (ex: “static posture (left)” 542b), and second guidance information guiding the shooting order of the second subtopic (ex: “2 / 3” 541c) may be displayed on the display unit of the medical staff terminal (10).

[0138] The medical team (U1) can perform a second photograph of a subject (U3) in a specific posture (e.g., left static posture) according to the guide lines using the second guide information (542a). Furthermore, the medical team (U1) can intuitively recognize the second subtopic that will be the subject of the photographing of the subject (U3) using the second subtopic guide information (542b). Furthermore, the second guide information (542c) can intuitively recognize the photographing order of the second subtopic and the number of remaining scenes to be photographed.

[0139] The control unit (130) may receive a second shooting request for the left static posture scene (1b) based on the selection of a graphic object (542d) linked to the second shooting of the left static posture scene (1b) from the medical staff terminal (10). In addition, the control unit (130) may control the second shooting of the left static posture scene (1a) to be performed in response to the received request.

[0140] The control unit (130) can control the third shooting to be performed continuously after the second shooting of the left static posture scene (1b). For example, as illustrated in (c) of FIG. 5e, the control unit (130) can provide the right static posture scene (1c) to the medical staff terminal (10) so that the third shooting of the right static posture scene (1c) is performed continuously.

[0141] After the second shooting of the left static posture scene (1b) is performed, in conjunction with the third shooting of the right static posture scene (1c), at least one of the third guide information (ex: “Start shooting static posture photos. Please shoot according to the guidelines.”, 543a) matching the third subtopic (“static posture (right)”), third subtopic guidance information (ex: “static posture (left)” 543b) guiding the third subtopic, and second guidance information (ex: “3 / 3” 541c) guiding the shooting order of the third subtopic may be displayed on the display unit of the medical staff terminal (10).

[0142] The medical team (U1) can perform a third photograph of a subject (U3) in a specific posture (e.g., right static posture) according to the guide lines using the third guide information (543a). Furthermore, the medical team (U1) can intuitively recognize the third subtopic that will be the subject of the photograph of the subject (U3) using the third subtopic guide information (543b). Furthermore, the third guide information (543c) can intuitively recognize the photographing order of the third subtopic and the number of remaining scenes to be photographed.

[0143] The control unit (130) may receive a third shooting request for the right static posture scene (1c) based on the selection of a graphic object (543d) linked to the third shooting of the right static posture scene (1c) from the medical staff terminal (10). Then, the control unit (130) may control the third shooting of the right static posture scene (1c) to be performed in response to the received request.

[0144] When the third shooting of the right static posture scene (1c) is completed, the control unit (130) can acquire (or receive) multiple images according to the multiple shooting of the multiple scenes (1a, 1b, 1c) corresponding to the first shooting topic. Here, the multiple images can include at least one of a first image acquired in the first shooting, a second image acquired in the second shooting, and a third image acquired in the third shooting.

[0145] Furthermore, the control unit (130) can detect a subject (or patient) from the received multiple images using an object detection algorithm. In addition, the control unit (130) can analyze the patient's posture or joint motion included in each of the multiple images using an artificial intelligence model specialized in analyzing posture or joint motion, and extract the patient's joint points included in each of the multiple images. The analysis of the patient's posture or joint motion can be performed on a server (or artificial intelligence server). When an image is acquired according to a shooting process, the control unit (130) can transmit the acquired image to the server (or artificial intelligence server). The server (or artificial intelligence server) can extract joint points corresponding to the patient's joints from a plurality of images based on at least one of a posture estimation model and a motion analysis model learned using learning data. Such a server may be an external server communicatively connected to the system (100) according to the present invention or may correspond to at least a part of the system (100) according to the present invention. Details of analyzing the patient's posture or joint motion from the image at the server will be described later. When the extraction of the joint points is completed, the control unit (130) can display a graphic object corresponding to the extracted joint points by overlapping or rendering the graphic object on the patient's subject. For example, as shown in FIGS. 5E and 5F, the control unit (130) can display a graphic object corresponding to a joint point on a subject (U3) of a specific patient included in each of a plurality of images (551, 552, 553) and provide the graphic object to the medical staff terminal (10). In this case, the joint points displayed on the subject (U3) of the specific patient are Each specific pose matched to each of the images (551, 552, 553) can be extracted and displayed differently.

[0146] That is, the control unit (130) can extract joint points of a patient (U3) in different postures according to a specific shooting topic corresponding to each of a plurality of images (551, 552, 553), and display the extracted joint points for each different posture on the subject (U3) of the patient included in each of the plurality of images (551, 552, 553) and provide the extracted joint points to the medical staff terminal (10). Through this, a specific medical staff member (U1) can intuitively recognize which joint point included in a specific image represents a joint point for a specific posture.

[0147] Meanwhile, the control unit (130) can determine whether re-shooting is necessary for at least one image among a plurality of images.

[0148] In the present invention, whether or not re-shooting is necessary may be preset based on various criteria. For example, the preset re-shooting conditions may include at least one of: i) when the patient cannot be identified in the captured image; ii) when the patient's body lines cannot be identified in the captured image; iii) when the patient is not wearing clothing of a color that contrasts with the background in the captured image; iv) when the artificial intelligence analysis of the patient's posture or joint movement in the captured image fails; and v) when the patient is photographed not according to the guidelines. However, whether or not to re-shoot the patient may also be determined by the medical staff who photographed the patient.

[0149] The control unit (130) may provide a re-capture process that allows the medical staff terminal (10) to perform re-capture of the image when at least one image among the plurality of images satisfies the preset re-capture conditions. Alternatively, when none of the plurality of images satisfies the preset re-capture conditions, the control unit (130) may continue or terminate the capture depending on whether a next capture target topic exists. For example, as illustrated in FIGS. 5d and 5f , the control unit (130) may determine whether to proceed with or terminate the capture based on the selection of a graphic object (561) associated with a capture progress (or termination) request from the medical staff terminal (10). At this time, the control unit (130) may provide the capture process to the medical staff terminal (10) such that after a plurality of captures corresponding to the first capture topic are performed, a plurality of captures corresponding to the second capture topic are performed continuously based on the fact that the second capture topic is specified as the capture topic to be captured next to the first capture topic. On the other hand, the control unit (130) can control multiple shootings corresponding to the first shooting topic to be terminated based on the fact that there is no shooting topic to be shot after the first shooting topic.

[0150] As illustrated in FIG. 5F, the control unit (130) can determine whether re-capturing is necessary for at least one of the plurality of images (551, 552, 553). If re-capturing is necessary for at least one image as a result of the determination, the control unit (130) can specify any one sub-topic corresponding to the image requiring re-capturing. For example, let's assume that the first image (551) captured through the first capture among the plurality of images (551, 552, 553) is determined to require re-capturing. The control unit (130) can specify a sub-topic corresponding to the first image (551). The control unit (130) can specify that the sub-topic corresponding to the first image (551) corresponds to the first sub-topic (e.g., "static pose (front)") matching the first capture based on the fact that the sub-topic corresponding to the first image (551) was captured through the first capture.

[0151] The control unit (130) can provide the medical staff terminal with a re-capture process so that re-capture of the first image (551) matched with the first sub-topic can be performed. For example, as illustrated in FIG. 5e, the control unit (130) can control the display unit of the medical staff terminal (10) to switch to the first capture target scene (1a) for re-capture of the first image (551) based on the determination that the first image (551) is a re-capture target image.

[0152] Meanwhile, when re-shooting of the image to be re-shot is completed at the medical staff terminal (10), the control unit (130) can determine again whether to re-shoot the acquired re-shot image.

[0153] Here, “re-evaluating whether to reshoot” can be understood as verifying whether reshooting is necessary again for the acquired reshot image.

[0154] As an example, if the control unit (130) performs re-verification on the acquired re-captured image and the re-captured image satisfies the preset re-capture conditions, the control unit (130) can control the display unit of the medical staff terminal (10) to switch to a scene corresponding to the re-captured image.

[0155] As another example, if the control unit (130) performs re-verification on the acquired re-captured image and determines that the re-captured image does not satisfy the re-capture conditions, the control unit (130) may provide the medical staff terminal (10) with a shooting process that can sequentially perform multiple shootings of multiple scenes corresponding to the next shooting topic. On the other hand, if the next shooting topic does not exist, all shooting processes may be terminated.

[0156] Meanwhile, among the multiple videos, videos that require reshooting can be updated with videos acquired through the reshooting process.

[0157] When re-capturing of at least one re-capturing target image among a plurality of images is completed, the control unit (130) can update the re-capturing target image with an image acquired through the re-capturing process. For example, as illustrated in FIG. 5g, let us assume that a third image (C) among a plurality of images (A, B, C) that have been captured according to the capturing process is the re-capturing target image. When re-capturing of the third image (C) is completed from the medical staff terminal (10), the control unit (130) can update the third image (C) with a fourth image (D) that has been re-capturing completed.

[0158] Furthermore, the control unit (130) can store the updated information through the re-shooting process in the storage unit (120) by matching it with a specific medical staff account and a specific patient account.

[0159] Meanwhile, according to various embodiments according to the re-capture process discussed above, if at least one image among a plurality of images satisfies a preset re-capture condition, the control unit (130) may display a graphic object indicating that the image is a re-capture target in an area of ​​the image to be re-captured. For example, as illustrated in FIG. 5f, let us assume that among the plurality of images (551, 552, 553), an image (551) corresponding to a front static posture scene (1a) and an image (553) corresponding to a right static posture scene (1c) are determined as images to be re-captured. The control unit (130) may display a graphic object (551a, 553a) indicating that the image is a re-capture target in an area of ​​the images (551, 553) corresponding to the re-capture targets.

[0160] For another example, graphic objects (551a, 553a) may also be displayed depending on whether the medical staff selects re-capture. The control unit (130) may provide graphic objects (551b, 553b) linked to the re-capture selection in one area of ​​each of the plurality of images (551, 552, 553). In addition, the control unit (130) may display graphic objects (551a, 553a) indicating that the selected image (551, 553) is a target for re-capture in one area of ​​the selected image (551, 553) based on the selection of the graphic objects (551b, 553) from the medical staff terminal (10).

[0161] Medical staff can intuitively recognize images that require re-capture among multiple images through graphic objects (551a, 553a).

[0162] Furthermore, when a re-capture request for an image to be recaptured is received from the medical staff terminal (10), the control unit (130) can control the display unit of the medical staff terminal (10) to switch to a scene corresponding to the image to be recaptured. For example, as illustrated in FIGS. 5e and 5f, the control unit (130) can control the display unit of the medical staff terminal (10) to provide the right static posture scene (1c) corresponding to the image to be recaptured (553) to the medical staff terminal (10) based on the selection of a graphic object (552c) associated with a re-capture request for an image (553) corresponding to the right static posture scene (1c) among a plurality of images (551, 552, 553) from the medical staff terminal (10). The medical staff can capture an image of the patient when the patient enters the guideline.

[0163] Not limited thereto, whether or not to reshoot may be determined by the control unit (130) while multiple shots are being taken according to the shooting process. For example, as illustrated in FIG. 5h, when shooting of a left static posture scene (1b) is completed on the medical staff terminal (10), the control unit (130) may determine whether or not to reshoot the completed image. In addition, based on whether the image satisfies the preset reshooting conditions, the control unit (130) may control the display unit of the medical staff terminal (10) so that the left static posture scene (1b) for reshooting and guidance information (ex: “It does not meet the guidelines. Please proceed with reshooting.”) are provided to the medical staff terminal (10).

[0164] Meanwhile, when a first shooting topic and a second shooting topic different from the first shooting topic are specified among multiple shooting topics, the control unit (130) can provide a shooting process to the medical staff terminal (10) so that multiple shootings corresponding to the first shooting topic are performed and then multiple shootings corresponding to the second shooting topic are performed consecutively.

[0165] That is, when multiple shooting topics are specified, after multiple shootings are performed for multiple scenes (1a, 1b, 1c) corresponding to the first shooting topic, a shooting process that can perform multiple shootings corresponding to the second shooting topic can be provided to the medical staff terminal (10).

[0166] In the following, for the convenience of explanation, the second shooting topic will be explained assuming “joint range of motion (elbow).”

[0167] The control unit (130) can control the display unit of the medical staff terminal (10) so that when multiple shootings corresponding to the first shooting topic (among the first shooting topic and the second shooting topic) are all performed on the medical staff terminal (10), multiple shootings corresponding to the second shooting topic (ex: joint range of motion (elbow)) are performed continuously.

[0168] According to the shooting process of the second shooting topic, the first shooting of the left elbow flexion and extension scene (301) among the multiple scenes (301, 302) corresponding to the second shooting topic may be performed first. For example, as illustrated in (a) of FIG. 6A, the control unit (130) may provide the left elbow flexion and extension scene (301) to the medical staff terminal (10) so that the first shooting of the right elbow flexion and extension scene (301) is performed first.

[0169] On the display unit of the medical staff terminal (10) where the first shooting for the right elbow flexion and extension scene (301) is in progress, at least one of the first guide information (ex: “Start shooting the elbow. After starting shooting according to the guideline, press the end button. Please guide to move slowly at a consistent speed”, 601a) matching the first subtopic (ex: “Joint range of motion: elbow - flexion, extension (right)”), the first subtopic guidance information guiding the first subtopic (ex: “Joint range of motion: elbow - flexion, extension (left)”) 601b), and the first guidance information guiding the shooting order of the first subtopic (ex: “1 / 2” 601c) may be displayed.

[0170] The medical staff (U1) can perform the first photographing of the subject (U3) in a specific posture (e.g., bending the right elbow and facing away) according to the guide lines using the first guide information (601a). In addition, the medical staff (U1) can intuitively recognize the first subtopic that will be the subject of the photographing of the subject (U3) using the first subtopic guide information (601b). Furthermore, the first guide information (601c) can intuitively recognize the photographing order of the first subtopic and the number of remaining scenes to be photographed.

[0171] The control unit (130) may receive a first shooting request for the right elbow flexion and extension scene (301) based on the selection of a graphic object (601d) associated with the first shooting of the right elbow flexion and extension scene (301) from the medical staff terminal (10). Then, the control unit (130) may control the first shooting of the right elbow flexion and extension scene (301) to be performed in response to the received request.

[0172] The control unit (130) can control the second shooting to be performed continuously after the first shooting of the right elbow flexion and extension scene (301) is performed. For example, as illustrated in (b) of FIG. 6a, the control unit (130) can provide the left elbow flexion and extension scene (302) to the medical staff terminal (10) so that the second shooting of the left elbow flexion and extension scene (302) is performed continuously.

[0173] After the first shooting of the right elbow flexion and extension scene (301) is performed, in conjunction with the second shooting of the left elbow flexion and extension scene (302), at least one of second guide information (ex: “Start shooting the elbow. After starting shooting according to the guideline, press the end button. Please guide to move slowly at a consistent speed”, 602a) matching the second subtopic (ex: “Joint range of motion: elbow - flexion, extension (left)”), second subtopic guidance information guiding the second subtopic (ex: “Joint range of motion: elbow - flexion, extension (left)”) 602b), and first guidance information guiding the shooting order of the second subtopic (ex: “2 / 2” 602c) may be displayed on the display unit of the medical staff terminal (10).

[0174] The medical staff (U1) can perform a second photograph of the subject (U3) in a specific posture (e.g., bending the left elbow and facing away) according to the guide lines using the second guide information (602a). In addition, the medical staff (U1) can intuitively recognize the second subtopic that will be the subject of the photographing of the subject (U3) using the second subtopic guide information (602b). Furthermore, the second guide information (602c) can intuitively recognize the photographing order of the second subtopic and the number of remaining scenes to be photographed.

[0175] The control unit (130) may receive a second shooting request for the left elbow flexion and extension scene (302) based on the selection of a graphic object (602d) associated with the second shooting of the left elbow flexion and extension scene (302) from the medical staff terminal (10). Then, the control unit (130) may control the second shooting of the left elbow flexion and extension scene (302) to be performed in response to the received request.

[0176] When the second shooting of the left elbow flexion and extension scene (302) is completed, the control unit (130) can acquire multiple images according to the multiple shooting of multiple scenes (301, 302) corresponding to the second shooting topic. At this time, the control unit (130) can determine whether to reshoot the acquired multiple images.

[0177] As a result of the determination, if at least one image among the plurality of images satisfies the preset re-capture conditions, the control unit (130) may provide a re-capture process that can perform re-capture of the image at the medical staff terminal (10). Alternatively, if none of the plurality of images satisfies the preset re-capture conditions, the control unit (130) may continue or terminate the capture depending on whether a next capture target topic exists. For example, as illustrated in FIGS. 5D and 6D , the control unit (130) may determine whether to proceed with or terminate the capture based on the selection of a graphic object (611) associated with a capture progress (or termination) request from the medical staff terminal (10). At this time, the control unit (130) may control the capture of the plurality of captures corresponding to the second capture topic to be terminated based on the absence of a capture topic to be captured next to the second capture topic.

[0178] Meanwhile, the multiple images acquired through the second shooting can be understood as images divided into frames according to specific joint movements.

[0179] Specifically, the plurality of images captured through the second shooting method may be images in which one image is divided into multiple frames according to a specific joint motion. For example, as illustrated in FIG. 6b, the control unit (130) may divide the image into frames according to multiple joint motions (e.g., left elbow bending and left elbow pinning) in an image of a left elbow bending and extension scene (301), thereby generating a first image (e.g., “elbow bending (left)” 301a) and a second image (e.g., “elbow extension (left)” 301b). For another example, the control unit (130) may divide the image into frames according to multiple joint movements (e.g., right elbow bending and right elbow pinning) in an image of a right elbow bending and extension scene (302), thereby generating a first image (e.g., “elbow bending (right)” 302a) and a second image (e.g., “elbow extension (right)” 302b).

[0180] Furthermore, the control unit (130) can detect a subject (or patient) from a plurality of received images using an object detection algorithm. Furthermore, the control unit (130) can analyze the patient's posture or joint motion contained in each of the plurality of images using an artificial intelligence model specialized in posture or joint motion analysis, and extract the patient's joint points contained in each of the plurality of images.

[0181] When the extraction of joint points is completed, the control unit (130) can display graphic objects corresponding to the extracted joint points by overlapping or rendering them on the patient's subject. For example, as illustrated in FIGS. 6c and 6d , the control unit (130) can display graphic objects corresponding to joint points on a specific patient's subject (U3) included in each of the plurality of images (301a, 301b, 302a, 302b) and provide the display to the medical staff terminal (10). In this case, the joint points displayed on the specific patient's subject (U3) can be extracted and displayed differently for each specific posture matched to each of the plurality of images (301a, 301b, 302a, 302b).

[0182] That is, the control unit (130) can extract joint points of a patient (U3) in different postures according to a specific shooting topic corresponding to each of a plurality of images (301a, 301b, 302a, 302b), and display the extracted joint points for each different posture on the subject (U3) of the patient included in each of the plurality of images (301a, 301b, 302a, 302b) and provide the extracted joint points to the medical staff terminal (10). Through this, a specific medical staff member (U1) can intuitively recognize which joint point included in a specific image represents a joint point for a specific posture.

[0183] Meanwhile, in the present invention, a process of transmitting multiple images to a server can be performed (S460, see FIG. 4).

[0184] The control unit (130) can transmit multiple images acquired through the shooting process to the server so that the images are matched with the patient's patient information and medical staff information and stored on the server. Here, the server can be understood as a server that provides the posture and joint motion examination service according to the present invention. As illustrated in FIG. 5f, the control unit (130) can transmit multiple images (551, 552, 553) resulting from multiple shooting of multiple scenes (1a, 1b, 1c) corresponding to the first shooting topic to the server (200).

[0185] For another example, as illustrated in FIGS. 6c and 6d, the control unit (130) can transmit a plurality of images (301a, 301b, 302a, 302b) obtained by capturing a plurality of scenes (301, 302) corresponding to the second shooting topic to the server (200). As illustrated in FIG. 12, an image of a patient captured by a medical staff terminal (10) can be transmitted to a server (or artificial intelligence server, 200) that performs analysis of the patient's posture or joint motion through the system (100) according to the present invention.

[0186] The server (200) can perform analysis of a patient's posture or joint movement from an image based on an artificial intelligence model (also called a posture estimation model or a motion analysis model) learned from learning data.

[0187] It may be configured to include at least one of a keypoint extraction unit (211), an artificial intelligence motion analysis unit (212), a rule-based motion analysis unit (213), and a control unit (220) of a server (200), and the keypoint extraction unit (211), the artificial intelligence motion analysis unit (212), or the rule-based motion analysis unit (213) may correspond to the above-described artificial intelligence model (artificial intelligence posture estimation model or artificial intelligence motion analysis model).

[0188] The server (200) can extract keypoints corresponding to the patient's joint points from the image based on an artificial intelligence model. For example, the server (200) can extract at least one keypoint based on a posture estimation model (52) learned using learning data related to the joint points.

[0189] In this case, the server (200) may extract at least one of a visible joint point or an invisible joint point based on the visibility of the joint point based on the artificial intelligence model. For example, if a specific joint point is not visible in the image, the server (200) may predict and extract the visible joint point and the key point corresponding to the specific joint point based on the artificial intelligence model.

[0190] Furthermore, the server (200) can analyze the relative positional relationship between key points from the extracted key points using an artificial intelligence model, and based on the analysis of the positional relationship, analyze the posture or joint movement for the movement performed by the patient.

[0191] Here, “relative position between keypoints” can be understood as the position of another keypoint (e.g., a second keypoint, “P2”) with respect to a specific keypoint (e.g., a first keypoint, “P1”) among at least two keypoints (see reference numerals “P1” and “P2” in FIG. 13).

[0192] The analysis results performed on the server (200) may be very diverse. The server (200) may perform analysis on at least one of the range of motion of a joint, the distance of motion, the movement speed (or acceleration) of a joint, the body balance, the body alignment state (EX: leg axis alignment state, spinal alignment state, etc.) of a subject (corresponding to a patient) included in the analysis target image. In addition, the server (200) may estimate and analyze information on at least one of i) the position of a joint point, ii) the range of motion of a joint point, iii) the movement path of a joint point, iv) the connection relationship between joint points, and v) the symmetry relationship of a joint point with respect to the subject (U).

[0193] The server (200) can extract relative positional relationships between associated key points matched to a specific prescribed exercise from a plurality of consecutive frames related to a specific prescribed exercise, and can obtain (or calculate) a patient's joint range of motion for the specific prescribed exercise using the extracted relative positional relationships. The server (200) can extract key points from each of a first analysis target frame (a frame formed temporally before) and a second analysis target frame (a frame formed temporally after). The server (200) can perform an analysis of the patient's posture or joint motion based on at least one of the positional relationships between key points extracted from the first analysis target frame and the positional relationships between key points extracted from the second analysis target frame.

[0194] Meanwhile, the server (200) can analyze the relative positional relationship between key points based on rule information related to prescribed exercise. Here, the rule information can be understood as information in which rules are defined in advance for analyzing the relative positional relationship between key points. The server (200) can analyze the patient's posture or joint movement by determining whether the relative positional relationship between key points satisfies the rule information.

[0195] Furthermore, the server (200) may perform an analysis of the patient's posture and joint motion by considering at least one of the patient's age information, gender information, height information, weight information, surgical history information, and musculoskeletal disease information with reference to the user DB (reference numeral 30 in FIG. 12). The multiple images transmitted to the server may be matched and stored together with the patient information and medical staff information of the patient. More specifically, the server may match and store multiple images including a specific patient with information about a specific medical staff and information about a specific patient. For example, the server may match and store at least one of i) information about a specific patient (or patient account), ii) information about a medical staff (or medical staff account) who photographed a specific patient, iii) information about a specific photographed item photographed for a specific patient, iv) information about an image (or photo) of a specific patient photographed in relation to a specific photographed item, v) information about the date and time when a specific photographed item was photographed, and vi) information about the results of an analysis of the posture or joint motion of a specific patient. This matching information can also be used as historical information about a specific patient.

[0196] As illustrated in FIG. 14A, a learning data set (400) may be configured to include data related to a subject (U) extracted from a learning target image (300). The server (200) may configure the learning data set (400) by extracting data about the subject (U) from the learning target image. In this case, the learning target image (300) may correspond to at least one of images collected from an external server, input from a user, or received from a medical staff terminal. That is, the artificial intelligence server (200) may perform learning on an artificial intelligence model (an artificial intelligence posture estimation model or an artificial intelligence motion analysis model) using an image that is the target of analysis of a patient's posture or joint motion.

[0197] The learning data set (400) may be composed of a plurality of sub-data sets (401 to 403). In the present invention, the learning data set (400) may be understood as a data set corresponding to a higher-order concept, and the sub-data sets (401 to 403) may be understood as data sets corresponding to lower-order concepts.

[0198] As illustrated in (a) of FIG. 14b, the learning data set (400) may be composed of a plurality of data groups (410 to 460) each corresponding to a plurality of different information attributes.

[0199] The server (200) can control an artificial intelligence model to determine group-specific associations between multiple data groups (410 to 460) based on associations between multiple information attributes (410a to 450a) and perform learning on a learning data set (400) and group-specific associations.

[0200] As illustrated in FIG. 14c, the first data group (410) includes position information (411, 412) of a plurality of learning target joint points (P1, P2), and the second data group (420) may include data values ​​indicating whether the learning target joint points (P1, P2) are visible in the image, which may be listed in the same order as the position information included in the first data group (420). The third data group (430) may include data values ​​indicating the shooting direction in which the subject (U) included in the image was captured, and the fourth data group (440) may include a code matching a posture or joint movement performed by the subject (U) included in the learning target image. In addition, the fifth data group (450) may include the size (Size) of the bounding box (301) for the subject (U) included in the learning target image, and the sixth data group may include image identification information.

[0201] The server (200) can train an artificial intelligence model using a learning data set (400) composed of the first to sixth data groups (410 to 460) described above. Furthermore, the server (200) can use the trained artificial intelligence model to analyze a patient's posture or joint motion from an image. Meanwhile, the present invention can provide various functions related to the posture and joint motion examination service according to the present invention by using matching information in which patient information and medical staff information are matched.

[0202] As illustrated in FIG. 7a, the control unit (130) can provide a graphic object (701) linked to a request to view a photographing record for a specific patient (U3) on a patient account page (700) including patient information of a specific patient (U3).

[0203] The control unit (130) may provide a photographing record for a specific patient (U3) based on the selection of a graphic object (701) included in the patient account page (700) from the medical staff terminal (10). For example, as illustrated in FIG. 7b, the photographing record (710) may include information (e.g., static posture and joint range of motion (3 items) | 2023.07.24 13:46 | Kim OO) in the form of [photographing posture][photographing date and time][photographer]. Additionally, the shooting record may provide a first image set (711) and a second image set (712) shot on a specific date and time (e.g., “17:20 on October 18, 2023”). Here, the first image set (711) may include a plurality of images shot with a plurality of scenes corresponding to a first shooting topic (e.g., static posture), and the second image set (712) may include a plurality of images shot with a plurality of scenes corresponding to a second shooting topic (e.g., joint range of motion (elbow)).

[0204] The control unit (130) may provide a page corresponding to the selected image to the medical staff terminal (10) based on selection of at least one image from among a plurality of images included in the second image set (712) from the terminal (10) of a specific medical staff account (U1). As illustrated in (a) of FIGS. 7b and 7c, the control unit (130) may provide a first image page (750) to the medical staff terminal (10) based on selection of the first image (“bending (left)”) included in the second image set (712).

[0205] The first image page (750) may provide at least one graphic object (752, 753) related to the output of the list together with the first image (751).

[0206] For example, as illustrated in (a) and (b) of FIG. 7c, when a first graphic object (752) is selected on a medical staff terminal (10), the control unit (130) can control a list (752a) of a plurality of images included in a first image set (711) to be displayed on the medical staff terminal (10). When any one of the plurality of images included in the list (752a) is selected, the control unit (130) can control the display to be switched to an image corresponding to the selected item.

[0207] For another example, as illustrated in (c) of FIG. 7c, when a second graphic object (753) is selected on the medical staff terminal (10), the control unit (130) can provide a list (753a) including at least one first image captured on a different date and time from the first image (751) output on the medical staff terminal (10).

[0208] Meanwhile, the present invention can provide a user environment in which a patient account can be managed through a website and various functions related to posture and joint motion examination services can be utilized.

[0209] As illustrated in FIG. 8a, the control unit (130) can provide a service page (800) including various functions related to the posture and joint motion examination service to the medical staff terminal (10).

[0210] The control unit (130) can display a graphic object (801) linked to a function capable of managing a patient (or patient account) registered to a specific medical staff account (U1) on one area of ​​the service page (800). In addition, the control unit (130) can provide a list (810) including at least one patient registered to a specific medical staff account (U1) on one area of ​​the service page (800) based on the selection of the graphic object (801) linked to the patient management function from the medical staff terminal (10).

[0211] The control unit (130) may provide patient information and photographing records of a specific patient (U3) on an area of ​​a service page (800) based on the selection of a graphic object (811) corresponding to a specific patient (U3) among a plurality of patients included in a list (810). For example, as illustrated in FIG. 8b, the control unit (130) may control the service page (800) to display patient information (830) of a specific patient (U3) and photographing records (840) of the specific patient (U3).

[0212] In one area of ​​the service page (800), a graphic object (831) linked to a function that allows modification of patient information (830) of a specific patient account (U3) may be displayed. For example, a specific medical professional (U1) may select the graphic object (831) to modify patient information (830) of a specific patient account (U3).

[0213] Additionally, in one area of ​​the service page (800), a graphic object (841) linked to a function that can check the results of posture or joint movement analysis of a specific patient (U3) may be displayed.

[0214] As described above, the control unit (130) can analyze a specific posture or specific joint movement of the patient based on multiple images.

[0215] The control unit (130) can provide analysis results for a specific posture or specific joint motion of a patient to the medical staff terminal (10). For example, as illustrated in FIG. 9c, when a graphic object (841) is selected from the medical staff terminal (10), the control unit (130) can provide analysis results (910) for a posture or joint motion of a specific patient (U3).

[0216] Furthermore, in one area of ​​the service page (800), a graphic object (842) linked to a function that allows checking the shooting record (840) of a specific patient (U3) by shooting date and time may be displayed. For example, when the graphic object (842) is selected from the medical staff terminal (10), the control unit (130) may provide a list that allows checking the shooting record of a specific patient (U3) by shooting date and time.

[0217] Meanwhile, the present invention can provide a function that can compare analysis results for multiple postures or joint movements captured at different points in time (or dates or times).

[0218] As illustrated in FIGS. 8c and 8d, the control unit (130) can provide a first image page (850) including information about the first image (843) based on the selection of the first image (843) from among a plurality of images included in the photographing record (840) of a specific patient (U3) from the medical staff terminal (10).

[0219] The control unit (130) can provide a graphic object (852a) linked to a list output function including images linked to different dates and times on an area of ​​the first image page (850) so as to enable comparison between a first image (851) taken of a specific patient (U3) on a specific date and time and an image taken of a specific patient (U3) on a different date and time from the first image (851).

[0220] The control unit (130) may provide a function to compare a first image (851) captured at a first point in time with an image captured at a second point in time different from the first point in time, based on the selection of a graphic object (852a). For example, as shown in FIGS. 8C and 8D , assume that a second point in time (e.g., “16:16, October 18, 2023”) is selected among multiple points in time included in the list. The control unit (130) may control a first image (751) captured at the first point in time and a second image (852) captured at the second point in time to be displayed together in one area of ​​the first image page (850).

[0221] Furthermore, the control unit (130) can provide recommended shooting item information for performing shooting on a specific patient (U3) to the medical staff terminal (10) using the history information of the specific patient (U3). For example, as illustrated in FIG. 8e, when at least one item among a plurality of items (1, 2, 3, 4) is selected from the medical staff terminal (10), the control unit (130) can provide recommended shooting item information (870) related to shooting on a specific patient (U3) using the history information of the specific patient (U3). In this case, the recommended shooting item information (870) is provided even when another medical staff performs shooting on a specific patient (U3), thereby intuitively recognizing which shooting item among the plurality of shooting items (1, 2, 3, 4) the specific patient (U3) mainly shot, and proceeding with shooting on the specific patient (U3) based on the recommended shooting item.

[0222] Meanwhile, the present invention can provide a user environment that allows for the modification of a patient's joint points included in an image. In this case, it can be understood that the modification of joint points is performed on a terminal logged into a second type of medical professional account (U2).

[0223] A second type of medical staff account may be understood as a medical staff account that is granted at least one of the following: i) the right to access the imaging records of all patients registered in the first type of medical staff account, ii) the right to modify the patient's joint points, iii) the right to check and share the analysis results of the patient's posture or joint movement, and iv) the right to independently prescribe an exercise program to the patient.

[0224] As illustrated in FIG. 9a, the control unit (130) may provide a graphic object (901a) linked to a function capable of modifying joint points of a specific patient in one area of ​​the first image page (900).

[0225] In addition, the control unit (130) can control the joint point modification function to be activated when a graphic object (911) is selected from the terminal of the second type of medical staff account (U2). For example, as illustrated in FIG. 9b, the control unit (130) can activate the joint point modification function together with guidance information (e.g., “You can modify the joint point by dragging and dropping.”, 901b). The second type of medical staff account (U2) can modify the graphic object overlapped on the area corresponding to the joint point according to the guidance information (901b).

[0226] Furthermore, the control unit (130) can control the real-time change in the position of the joint point to be reflected when the joint point of the subject (U3) is modified in the terminal of the second type of medical staff account (U2). In addition, when a graphic object (901c) linked to the storage function is selected, the modified joint point in the second type of medical staff account (U2) can be matched with a specific medical staff account (U1) and stored.

[0227] Furthermore, the present invention can provide a diagnosis based on the results of analysis of a patient's posture or joint motion. For example, as illustrated in FIGS. 9C and 9D , the control unit (130) can, based on the results of analysis of a patient's posture or joint motion (910), store a diagnosis (920) for a specific patient (U3) created from a second type of medical staff account (U2) by matching it with the specific patient account, and provide it on the terminal of the specific patient (U3).

[0228] Meanwhile, the present invention can provide various services based on paid plan subscriptions. For example, as illustrated in FIG. 10, the control unit (130) can provide a service page (1010) related to the analysis results provision service.

[0229] When a payment event related to the analysis result provision service of the service page (1010) occurs from a medical staff terminal (10) to which a specific medical staff account (U1) is logged in, the control unit (130) can specify the payment amount by using the progress history of the shooting process performed over a certain period of time for the purpose of providing the analysis result based on the occurrence of the payment event.

[0230] Furthermore, the control unit (130) may provide the medical staff terminal (10) with the payment target amount for the progress history of the photographing process performed over a certain period of time, so that a payment process for a specified amount may be performed from the medical staff terminal (10). As an example, the payment amount for which payment is performed in the payment process may be calculated by adding up the number of photographs taken in a first period (e.g., January) and billing the cost in a second period (e.g., February).

[0231] As illustrated in FIG. 11a, the control unit (130) can provide an exercise prescription page (1100) including a prescription function related to a patient's exercise on a medical staff terminal (10) logged in with a specific medical staff account (U1).

[0232] The control unit (130) can provide an exercise prescription page (1100) for each patient account on the medical staff terminal (10) so that a prescription can be made for a specific patient account among the patient accounts matched to a specific medical staff account (U1).

[0233] For example, in the present invention, let's assume that a first patient account (e.g., "Wooyoung Kim" patient account) and a second patient account (e.g., "Sohee Kim" patient account) are matched to a specific medical staff account (U1). The control unit (130) may, based on receiving an exercise prescription request for the first patient account (e.g., "Wooyoung Kim" patient account) from the medical staff terminal (10), provide an exercise prescription page (1100) corresponding to the first patient account on the medical staff terminal (10).

[0234] The control unit (130) may display information on at least some of a plurality of exercise items registered in the exercise therapy provision service on the exercise prescription page (1100), or may display information on at least one exercise program registered in the exercise therapy provision service.

[0235] Specifically, the control unit (130) can display information on at least one of a personal exercise program linked to a specific medical staff account (U1), a shared exercise program shared to a specific medical staff account (U1), and a recommended exercise program provided by an exercise therapy service on the exercise prescription page (1100).

[0236] In this case, based on the differences in the personal exercise program and the shared exercise program linked to each medical staff account, the control unit (130) can display information about the different personal exercise programs or the different shared exercise programs on the exercise prescription page (1100) provided to each medical staff account.

[0237] The control unit (130) can receive selection information (or selection event) of a specific medical staff account (U1) from the medical staff terminal (10) based on which of the exercise programs displayed on the exercise prescription page (1100) is selected.

[0238] For example, as illustrated in FIG. 11a, let us assume that information and icons (e.g., “Add” or “Select” or “Save”) corresponding to a personalized exercise program linked to a specific medical professional account (U1) are displayed on the exercise prescription page (1100). The control unit (130) can receive selection information about the exercise program based on selection of information about the exercise program or an icon corresponding to the exercise program on the exercise prescription page (1100).

[0239] Furthermore, the control unit (130) can assign the selected exercise program to a patient account based on receiving prescription information including the selected exercise program from the medical staff terminal (10).

[0240] A specific patient (U3) can receive exercise treatment according to an exercise program assigned to the patient account by using a patient terminal (20) logged in with a patient account.

[0241] For example, as illustrated in FIG. 11b, the control unit (130) can provide an image corresponding to an exercise program assigned to a patient account on a patient terminal (20) logged in with a patient account so that a specific patient (U3) can follow the exercise treatment while watching the image. That is, the control unit (130) can check the exercise program assigned to the patient account and the exercise items included in the exercise program, and provide an image corresponding to the exercise items on the patient terminal (20).

[0242] As described above, the method and system for providing posture and joint motion examination service according to the present invention can specify a patient to be photographed based on information received from a medical staff terminal, select at least one photographing item to be photographed for the patient from among a plurality of photographing items each corresponding to a plurality of photographing topics related to posture or joint motion from the medical staff terminal, and, based on the selection of the at least one photographing item, specify at least one photographing topic to be photographed for the patient from among the plurality of photographing topics. The medical staff can select a topic necessary for analyzing the patient's posture or joint motion and perform a patient-tailored posture analysis.

[0243] Furthermore, the method and system for providing posture and joint motion examination service according to the present invention provides the medical staff terminal with a shooting process that sequentially performs a plurality of shots matching a specific posture or a specific joint motion corresponding to the specified shooting topic, using the patient as a subject, and through the shooting process, a plurality of images according to the plurality of shots can be acquired. Through this, the present invention can provide an analysis service that analyzes the joint motion of a musculoskeletal patient using artificial intelligence without expensive equipment, using a medical staff terminal carried by the medical staff.

[0244] Meanwhile, the present invention discussed above can be implemented as a program that is executed by one or more processes on a computer and can be stored on a medium (or recording medium) that can be read by the computer.

[0245] Furthermore, the present invention discussed above can be implemented as computer-readable code or instructions on a program-recorded medium. In other words, the present invention can be provided in the form of a program.

[0246] Meanwhile, computer-readable media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid-state disk drives (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.

[0247] Furthermore, the computer-readable medium may include a storage device and may be a server or cloud storage device accessible via communication. In this case, the computer may download the program according to the present invention from the server or cloud storage device via wired or wireless communication.

[0248] Furthermore, in the present invention, the computer described above is an electronic device equipped with a processor, i.e., a CPU (Central Processing Unit), and there is no particular limitation on its type.

[0249] Meanwhile, the detailed description above should not be construed as limiting in any respect and should be considered illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are intended to be included within the scope of the present invention.

Claims

1. A step of identifying a patient to be photographed based on information received from a medical staff terminal; A step of selecting, from the medical staff terminal, at least one shooting item to be shot for the patient among a plurality of shooting items each corresponding to a plurality of shooting topics related to posture or joint movement; A step of specifying at least one shooting topic among the plurality of shooting topics for which shooting should be performed on the patient based on the selection of at least one shooting item; A step of providing a shooting process for sequentially performing multiple shots, each of which is matched with a specific posture or specific joint movement corresponding to the specific shooting topic, using the patient as a subject, to the medical staff terminal; Through the above shooting process, a step of obtaining a plurality of images according to the plurality of shootings; and A method for providing an artificial intelligence-based posture and joint movement examination service, characterized by including a step of transmitting the plurality of images to a server.

2. In paragraph 1, For each of the above multiple shooting topics, There are a plurality of subtopics that must be photographed in relation to the above posture or the above joint movement, and the photographing order of the plurality of subtopics is matched and exists, The above shooting process is, A method for providing an artificial intelligence-based posture and joint movement examination service, characterized in that the plurality of shots are sequentially performed according to the above shooting order, each of the plurality of subtopics being matched.

3. In paragraph 2, If the above-mentioned specific shooting topic includes a first subtopic and a second subtopic different from the first subtopic, The above multiple shots are, Including a first shooting matched with the first subtopic and a second shooting matched with the second subtopic, The above shooting process is, A method for providing an artificial intelligence-based posture and joint movement examination service, characterized in that the second shooting is performed continuously after the first shooting is performed on the medical staff terminal.

4. In paragraph 3, While the first shooting is in progress at the medical staff terminal, the display unit of the medical staff terminal, First guide information matching the first subtopic and first guide information guiding at least one of the first subtopic and the first shooting order are displayed, After the first shooting is performed, in conjunction with the second shooting being performed, the display unit of the medical staff terminal, A method for providing an artificial intelligence-based posture and joint movement examination service, characterized in that second guide information matching the second subtopic and second guide information guiding at least one of the second subtopic and the second shooting order are displayed.

5. In paragraph 2, The above multiple images are, Including a first image obtained in the first shooting and a second image obtained in the second shooting, A step of determining whether re-shooting is necessary for at least one of the above multiple images; and As a result of the judgment, if re-shooting is required for at least one of the above images, a step of specifying one of the above subtopics corresponding to the image requiring re-shooting; and It further includes a step of providing a re-shooting process to the medical staff terminal so that the re-shooting is performed in which the above-mentioned specific subtopic is matched; A method for providing an artificial intelligence-based posture and joint movement examination service, characterized in that among the plurality of images, the image requiring re-shooting is updated with an image obtained through the re-shooting process.

6. In paragraph 2, When a first shooting topic and a second shooting topic different from the first shooting topic are specified among multiple shooting topics, The above shooting process is, A method for providing an artificial intelligence-based posture and joint movement examination service, characterized in that the medical staff terminal is provided with the plurality of shots corresponding to the first shooting topic so that the plurality of shots corresponding to the second shooting topic are performed continuously after the plurality of shots corresponding to the first shooting topic are performed on the medical staff terminal.

7. In paragraph 1, A step of analyzing the specific posture or the specific joint movement of the patient based on the plurality of images; and A method for providing an artificial intelligence-based posture and joint motion examination service, characterized in that it further comprises a step of providing the analysis results for the specific posture or the specific joint motion of the patient to the medical staff terminal.

8. In paragraph 7, In the above analysis step, Using an artificial intelligence pose estimation model, key points corresponding to each of the preset joint points are extracted from the plurality of images, A method for providing an artificial intelligence-based posture and joint motion examination service, characterized in that the relative positional relationship between the key points is analyzed through an artificial intelligence motion analysis model, and the specific posture or specific joint motion of the patient is analyzed based on the analysis of the positional relationship.

9. In paragraph 7, A step in which a payment event related to the analysis result provision service occurs at the medical staff terminal; and A step of specifying a payment amount using the progress history of the photographing process performed over a certain period of time to provide the analysis result based on the occurrence of the payment event; and A method for providing an artificial intelligence-based posture and joint motion examination service, characterized in that it further comprises a step of performing a payment process for the above amount.

10. Based on the information received from the medical staff terminal, identify the patient to be photographed, A control unit is included to select, from the medical staff terminal, at least one shooting item to be shot for the patient among a plurality of shooting items each corresponding to a plurality of shooting topics related to posture or joint movement, The above control unit, Based on the selection of at least one shooting item, at least one shooting topic among the plurality of shooting topics is specified for which shooting should be performed on the patient, A shooting process is provided to the medical staff terminal to sequentially perform multiple shots matching a specific posture or specific joint movement corresponding to the specific shooting topic, using the patient as the subject. Through the above shooting process, multiple images are acquired according to the multiple shootings, An artificial intelligence-based posture and joint movement examination service providing system characterized by transmitting the above multiple images to a server.

11. A program that is executed by one or more processes in an electronic device and stored in a computer-readable recording medium, The above program is, A step of identifying a patient to be photographed based on information received from a medical staff terminal; A step of selecting, from the medical staff terminal, at least one shooting item to be shot for the patient among a plurality of shooting items each corresponding to a plurality of shooting topics related to posture or joint movement; A step of specifying at least one shooting topic among the plurality of shooting topics for which shooting should be performed on the patient based on the selection of at least one shooting item; A step of providing a shooting process for sequentially performing multiple shots, each of which is matched with a specific posture or specific joint movement corresponding to the specific shooting topic, using the patient as a subject, to the medical staff terminal; Through the above shooting process, a step of obtaining a plurality of images according to the plurality of shootings; and A program stored on a computer-readable recording medium, characterized in that it includes commands for performing a step of transmitting the above plurality of images to a server.

Images