Server for providing image-based chart and operating method thereof

Abstract

A method for providing an image-based chart according to an embodiment of the present invention corresponds to a method for providing a chart on the basis of an image by a server and may comprise the steps of: receiving image data of a subject from an image device; extracting state information of the subject on the basis of the image data; converting the state information into chart information corresponding to a preconfigured template; and providing the converted chart information to a user terminal according to the template.

Description

Server providing image-based charts and its operation method

[0001] The present invention relates to a server providing an image-based chart and an operating method thereof.

[0002] Typically, dental clinics manage a variety of dental tasks, from patient visits and registration to current symptoms, treatment, billing, insurance claims, and hospital management. To achieve this, dental clinics often use dedicated dental work programs to provide patients with electronic charts.

[0003] However, providing these electronic charts presents a complex problem: users must manually enter information on the day's treatment, information on upcoming treatments, appointment information, the subject's medical condition, and dental information. This complicates the process. This can lead to inconvenience in using electronic charts and lower work efficiency.

[0004] The present invention aims to provide an image-based chart providing server and method thereof, which extracts features such as dental disease and loss status based on various images taken of a subject's teeth and automatically provides the extracted features in an electronic chart.

[0005] In addition, the present invention aims to provide a server and method for providing an image-based chart that enables systematic treatment and customer management while increasing convenience of use by allowing a practitioner to intuitively check the characteristics of a patient's teeth, such as disease and missing information, when using a dental work program.

[0006] According to an embodiment of the present invention, a method for operating a server providing an image-based chart may include a step of receiving image data of a subject from an image device; a step of extracting status information of the subject based on the image data; a step of converting the status information into chart information corresponding to a preset template; and a step of providing the converted chart information to a user terminal according to the template.

[0007] In one embodiment, the step of extracting the condition information of the subject may extract the condition information of the subject based on feature points included in the image data.

[0008] In one embodiment, the template may include an electronic chart for displaying information about the condition of the subject's teeth.

[0009] In one embodiment, the electronic chart may include a drawing representing the condition of the subject's teeth, and may be configured to display the chart information in the form of at least one of a shape, a color, and text corresponding to the condition of the subject.

[0010] In one embodiment, the image data may include at least one of panoramic image data for the subject and oral scan image data for the subject.

[0011] In one embodiment, the chart information includes treatment information corresponding to the condition information of the subject, and the treatment information may be provided in a preset medical record format.

[0012] In one embodiment, the method may further include generating next appointment information for the subject based on the treatment information.

[0013] A server providing an image-based chart according to one embodiment of the present invention comprises: a memory; and a processor connected to the memory and configured to execute commands included in the memory, wherein the processor is configured to perform the steps of: receiving image data of a subject from an image device; extracting status information of the subject based on the image data; converting the status information into chart information corresponding to a preset template; and providing the converted chart information to a user terminal according to the template.

[0014] According to the image-based chart providing server of the present invention and its operating method, it is possible to extract features such as dental disease, loss status, etc. based on various images taken of the teeth of a subject, and automatically provide the extracted features in an electronic chart.

[0015] In addition, according to the image-based chart providing server of the present invention and its operating method, when using a dental work program, the practitioner can intuitively check the characteristics of the teeth, such as the subject's disease and missing information, thereby increasing the convenience of use and enabling systematic treatment and customer management.

[0016] In order to more fully understand the drawings cited in the detailed description of the present invention, a brief description of each drawing is provided.

[0017] FIG. 1 is a diagram showing a network environment in which an image-based chart providing server according to one embodiment of the present invention communicates.

[0018] FIG. 2 is a block diagram showing the configuration of a server providing an image-based chart according to one embodiment of the present invention.

[0019] FIG. 3 is a diagram for exemplarily explaining how a server providing an image-based chart according to one embodiment of the present invention analyzes image data.

[0020] FIG. 4 is a diagram for exemplarily explaining how a server providing an image-based chart according to one embodiment of the present invention analyzes image data.

[0021] FIG. 5 is a diagram for exemplarily explaining that a server providing an image-based chart according to one embodiment of the present invention provides chart information.

[0022] FIG. 6 is a diagram for exemplarily explaining that a server providing an image-based chart according to one embodiment of the present invention provides chart information.

[0023] FIG. 7 is a flowchart illustrating a method for providing an image-based chart according to one embodiment of the present invention.

[0024] FIG. 8 is a block diagram showing the hardware configuration of a server providing an image-based chart according to one embodiment of the present invention.

[0025] Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. It should be understood that the present invention is not limited to specific embodiments, but rather encompasses various modifications, equivalents, and / or alternatives of the embodiments of the present invention. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0026] In this document, the expressions “has”, “may have”, “includes”, or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), but do not exclude the presence of additional features.

[0027] In this document, the expressions "A or B," "at least one of A and / or B," or "one or more of A and / or B" can include all possible combinations of the listed items. For example, "A or B," "at least one of A and B," or "at least one of A or B" can all refer to cases where (1) at least one A is included, (2) at least one B is included, or (3) at least one A and at least one B are included.

[0028] The terms "first," "second," "first," or "second" used herein may describe various components, regardless of order and / or importance, and are used only to distinguish one component from another, without limiting the components. For example, without departing from the scope of the rights set forth in this document, the first component may be renamed the second component, and similarly, the second component may be renamed the first component.

[0029] The expression "configured to" as used herein can be used interchangeably with, for example, "suitable for", "having the capacity to", "designed to", "adapted to", "made to", or "capable of". The term "configured to" does not necessarily mean "specifically designed to".

[0030] In this document, the words "command", "instruction", "control information", "message", "information", "data", "packet", "data packet", "intent" and / or "signal" transmitted and received between the first electronic device(s) and the second electronic device(s) may include or refer to human-perceivable ideas or specific electrical expressions (e.g., digital codes / analog physical quantities) regardless of their expressions. It will be apparent to those skilled in the art to which the invention disclosed in this document pertains that the exemplary expressions listed above may be interpreted in various ways depending on the context in which they are used. In this document, "is greater than B" not only simply means "is greater than B" but also includes the meaning of "is equal to or greater than B."

[0031] The terms used in this document are used only to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include the plural expression unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by those of ordinary skill in the art described in this document. Terms defined in general dictionaries among the terms used in this document may be interpreted as having the same or similar meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined in this document. In some cases, even if a term is defined in this document, it cannot be interpreted to exclude the embodiments of this document.

[0032] FIG. 1 is a diagram showing a network environment in which an image-based chart providing server (150) communicates according to one embodiment of the present invention.

[0033] Referring to FIG. 1, a server (server of FIG. 1) (150) providing an image-based chart according to one embodiment of the present invention can communicate with an image device (110) and a user terminal (130) via a network.

[0034] In FIG. 1, the imaging device (110) may be a photographing device used by dental professionals (e.g., dentists, dental hygienists, etc.). In this case, the imaging device (110) may be configured as a terminal used by dental professionals or as a separate device. For example, the imaging device (110) may include a panoramic imaging device, a scanner imaging device, etc. In addition, the user terminal (130) may be a terminal used by dental professionals.

[0035] Meanwhile, in FIG. 1, only a video device (110) and a user terminal (130) are shown, but the present invention is not limited thereto, and the number of video devices or user terminals may be configured in various ways.

[0036] For reference, the first electronic device (110) and the second electronic device (130) may be implemented as computers capable of accessing remote servers or terminals via a network. For example, the computers may include notebooks, desktops, laptops, etc. equipped with a web browser. In addition, the first electronic device (110) and the second electronic device (130) may be implemented as terminals capable of accessing remote servers or terminals via a network. For example, the first electronic device (110) and the second electronic device (130) are wireless communication devices that ensure portability and mobility, and may include all types of handheld-based wireless communication devices such as navigation, PCS (Personal Communication System), GSM (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminals, smartphones, smartpads, tablet PCs, etc.

[0037] The server (150) may be communicatively coupled with at least one first electronic device (110). The server (150) may be communicatively coupled with at least one second electronic device (130). In addition, communication may be established between the first electronic device (110) and the second electronic device (130) via a network. For example, the first electronic device (110) and the second electronic device (130) may exchange data within an app or web service-based program in which the server (150) is implemented.

[0038] A server (150) according to an embodiment of the present invention may be implemented as a computer device or multiple computer devices that provide commands, code files, contents, services, etc. The server (150) may be implemented in the form of a self-manufactured web page or application (APP) operated by an individual or a company, and in this case, data may be exchanged between the server (150) and the first electronic device (110) by a user accessing the web page or application through the first electronic device (110).

[0039] The server (150) is a server that provides charts based on images and can receive image data of the subject from the image device (110). At this time, the image data may include an image or image data of the subject's teeth captured by the image device (110).

[0040] The server (150) can extract information about the subject's condition based on image data. For example, the subject's condition information may include information about the condition of the teeth (e.g., normal, restorative, root canal, implant, missing, etc.), diagnosis of dental diseases, diagnosis of periodontal diseases, TMJ, and other specific findings. In this case, the server (150) can analyze the subject's image data to extract characteristic points.

[0041] The server (150) can convert the subject's condition information into chart information corresponding to a preset template. Here, the preset template may include an electronic chart format used in dentistry. That is, the server (150) can obtain condition information based on the extracted feature points of the subject and convert this condition information into an electronic chart format.

[0042] The server (150) can provide the converted chart information to the user terminal (130) according to the template. That is, the server (150) can extract feature points from the subject's image data and, based on this, provide status information corresponding to the subject in the form of an electronic chart.

[0043]

[0044] Figure 2 is a block diagram schematically showing the detailed configuration of the server illustrated in Figure 1.

[0045] As illustrated in FIG. 2, the server (150) may include a bus (210), a display (220), a communication circuit (230), a database (240), a memory (250), an I / O interface (260), and a processor (270). In other embodiments, the server (150) may omit at least one of the above components or may additionally include other components.

[0046] For reference, the components (210, 220, 230, 240, 250, 260, 270) of the server (150) illustrated in FIG. 2 are merely exemplary components for explaining a document creation support method according to an embodiment of the present invention. That is, it is clear that the server (150) according to an embodiment of the present invention may additionally include other components in addition to the illustrated components.

[0047] The bus (210) can electrically connect the components (220 to 270) to each other. The bus (210) can include circuitry for communication (e.g., control messages and / or data) between the components (220 to 270).

[0048] The display (220) can display text, images, videos, icons, or symbols that constitute various contents. The display (220) can include a touch screen and can receive touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body.

[0049] For example, the display (220) may include a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical systems (MEMS) display, or an electronic paper display. The display (220) may be implemented as included in the server (150), or may be implemented separately from the server (150) but operatively connected to the server (150).

[0050] The communication circuit (230) can establish a communication channel with the server (150) and external devices. The communication circuit (230) can access the network (280) via wireless or wired communication and communicate with the external devices. For example, the communication circuit (230) can transmit and receive necessary data with the first electronic device (110) and the second electronic device (130). The communication circuit (230) can communicate with the aforementioned imaging device (110) and user terminal (130) via the network in a wired or wireless manner. That is, the communication circuit (230) can transmit and receive various data related to the subject's condition information or electronic charts with the imaging device (110) and the user terminal (130).

[0051] The database (240) may be implemented on the memory (250) or on a separate storage medium. The database (240) may store all of the contents and details of data transmitted and received with the first electronic device (110) and the second electronic device (130). The database (240) may store various data related to providing an image-based electronic chart. For example, the database (240) may store data such as the subject's image data, status information, chart information, treatment information, and reservation information. For example, the database (240) may operate in a cloud manner.

[0052] Meanwhile, a server (150) according to one embodiment of the present invention may include a database (240) internally or be connected to a database (240) provided externally via a network.

[0053] According to various embodiments, the data stored in the database (240) is sensitive user information, and thus may be distributed and stored on a blockchain network to enhance the security of its use. When the database (240) is distributed and stored on a blockchain network, the history of transmission, modification, deletion, and addition of information contained in the database (240) can be more securely managed on the blockchain network.

[0054] The memory (250) may include volatile and / or non-volatile memory. The memory (250) may store commands or data related to at least one other component of the server (150). For example, the memory (250) may store an application for providing electronic chart information based on image data.

[0055] The I / O interface (260) can perform a role of transmitting commands or data input from a user or other external device to other components of the server (150). The I / O interface (260) can be implemented in hardware or software, and can be used as a concept encompassing a user interface (UI) and a terminal for communication with other external devices.

[0056] The processor (270) may include at least one of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processor (270) is electrically connected to the memory (250), the display (220), and the communication circuit (230) via the bus (210), and during operation, may execute operations or data processing related to control and / or communication of other components according to commands, programs, or software stored in the memory (250). Therefore, the execution of the commands, application programs, or software may be understood as the operation of the processor (270).

[0057] The processor (270) is connected to the memory (250) and can execute commands contained in the memory (250). The processor (270) can control the overall operation of the memory (250) and the communication circuit (230) to execute various applications related to providing image-based charts.

[0058] The processor (270) may receive image data of the subject from the imaging device (110). At this time, the image data may include an image or image data of the subject's teeth captured by the imaging device (110). For example, the image data may include at least one of panoramic image data and oral scan image data of the subject.

[0059] The processor (270) can extract information on the subject's condition based on image data. For example, the subject's condition information can include information on tooth condition recognition (e.g., normal, restorative, root canal, implant, missing, etc.), dental disease diagnosis, periodontal disease diagnosis, TMJ, and other special findings. In addition, the subject's condition information can include information for confirming the tooth position and front, back, left, and right sides, as well as tooth color and range.

[0060] Additionally, when extracting the condition information of the subject, the processor (270) may extract the condition information of the subject based on the feature points included in the image data. In this case, the processor (270) may analyze the image data of the subject to extract the feature points and obtain information such as the condition, disease, location, color, and size of the teeth corresponding to the feature points.

[0061] The processor (270) can convert the subject's condition information into chart information corresponding to a preset template. Here, the preset template may include an electronic chart format used in dentistry to display information regarding the subject's dental condition. In other words, the processor (270) can obtain condition information based on the extracted feature points of the subject and convert this condition information into an electronic chart format.

[0062] Additionally, the format of the electronic chart converted by the processor (270) may include a drawing representing the condition of the subject's teeth, and may be configured to display chart information in the form of at least one of a shape, color, and text corresponding to the condition of the subject. This will be described with examples in FIGS. 5 and 6.

[0063] The processor (270) can provide the converted chart information to the user terminal (130) according to the template. That is, the processor (270) can extract feature points from the subject's image data and, based on the extracted feature points, provide status information corresponding to the subject in the form of an electronic chart.

[0064] Additionally, the chart information provided by the processor (270) may include treatment information corresponding to the subject's condition information. For example, the treatment information corresponding to the subject's condition information may include information regarding treatment methods, treatment schedules, processes, etc. that can be implemented based on the subject's dental condition. In this case, the treatment information may be provided in a preset medical record format. Therefore, the step of the dental professional manually entering the treatment information can be omitted, providing convenience of use and ensuring accurate information.

[0065] The processor (270) can automatically generate the subject's next appointment information based on the treatment information. At this time, the subject's next appointment information can be generated based on the next treatment sequence according to the treatment process (plan) according to the subject's dental condition.

[0066] Additionally, appointment information can be generated automatically based on treatment information, taking into account treatment schedules. For example, appointment information can be automatically registered based on treatment details, treatment timing, required time, etc., corresponding to the next treatment sequence. In this case, appointment information can also be automatically provided in electronic chart format or presented on a separate appointment registration screen.

[0067] The network (280) may include at least one of a telecommunications network, a computer network, the Internet, or a telephone network. A wireless communication protocol for accessing the network (280) may use, for example, at least one of LTE (Long-Term Evolution), LTE-A (LTE Advanced), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), UMTS (Universal Mobile Telecommunications System), WiBro (Wireless Broadband), GSM (Global System for Mobile communications), or 5G standard communication protocols. However, this is merely exemplary, and various wired and wireless communication technologies applicable in the relevant technical field may be utilized depending on the embodiment to which the present invention is applied.

[0068] In this way, according to the image-based chart providing server (150) of the present invention, it is possible to extract features such as dental disease, loss status, etc. based on various images taken of the teeth of the subject, and automatically provide the extracted features in an electronic chart.

[0069] In addition, according to the server (150) that provides the image-based chart of the present invention, when using a dental work program, the practitioner can intuitively check the characteristics of the teeth, such as the subject's disease and missing information, thereby increasing the convenience of use and enabling systematic treatment and customer management.

[0070]

[0071] FIG. 3 is a diagram for exemplarily explaining how a server providing an image-based chart according to one embodiment of the present invention analyzes image data.

[0072] Referring to FIG. 3, a server (150) providing an image-based chart according to one embodiment of the present invention may receive image data from an image device (110). At this time, as illustrated in FIG. 3, the image data may include image data captured by a panoramic image device.

[0073] Referring to (a) of FIG. 3, a server (150) providing an image-based chart according to one embodiment of the present invention analyzes panoramic image data based on AI. In this case, as illustrated in (a) of FIG. 3, feature points of the subject's teeth are extracted using an object detection technique.

[0074] For example, a server (150) providing an image-based chart according to one embodiment of the present invention can identify a tooth number based on feature points of image data and obtain information on the condition of a subject by extracting abnormalities such as those in the temporomandibular joint (TMJ), maxilla, mandible, etc. In this case, each feature point can be represented by a different shape, color, size, etc.

[0075] Referring to (b) of FIG. 3, a server (150) providing an image-based chart according to one embodiment of the present invention analyzes panoramic image data based on AI. In this case, as illustrated in (b) of FIG. 3, feature points of the subject's teeth are extracted using a segmentation technique.

[0076] For example, the server (150) providing an image-based chart according to one embodiment of the present invention can recognize the condition of a tooth based on the characteristic points of the image data and indicate whether it is normal, undergoing restorative treatment, undergoing root canal treatment, undergoing implant treatment, or undergoing a defect, or can diagnose a tooth-related disease or periodontal disease. In addition, the server (150) providing an image-based chart can diagnose TMJ and other special findings and display them on an electronic chart picture. In this case, the server (150) providing an image-based chart can display each part such as the maxilla, mandible, temporomandibular joint, and teeth with different shapes or colors, and can display abnormal parts with separate colors or shapes.

[0077]

[0078] FIG. 4 is a diagram for exemplarily explaining how a server providing an image-based chart according to one embodiment of the present invention analyzes image data.

[0079] Referring to FIG. 4, a server (150) providing an image-based chart according to one embodiment of the present invention may receive image data from an image device (110). At this time, as illustrated in FIG. 4, the image data may include image data captured by an oral scanning image device.

[0080] As illustrated in FIG. 4, the server (150) providing an image-based chart according to one embodiment of the present invention can analyze oral scan image data based on AI. In this case, the server (150) providing an image-based chart can identify tooth positions, front, back, left, right sides, etc., and can also identify tooth color, range, etc. based on the image data.

[0081] In addition, the server (150) providing an image-based chart can display feature points according to the condition of the teeth in separate shades, as shown in Fig. 4. In addition, the server (150) providing an image-based chart can display information on the condition of the teeth (e.g., disease, etc.) corresponding to the feature points in a separate pop-up.

[0082]

[0083] FIG. 5 is a diagram for exemplarily explaining that a server providing an image-based chart according to one embodiment of the present invention provides chart information.

[0084] Referring to FIG. 5, a server (150) providing an image-based chart according to one embodiment of the present invention can convert status information on a subject's teeth extracted based on image data and display it on an electronic chart.

[0085] As illustrated in FIG. 5, a server (150) providing an image-based chart according to one embodiment of the present invention can display a diagram of the oral structure of a subject. In this case, information regarding the condition of the teeth can be provided in an electronic chart based on the condition information of the subject automatically extracted based on image data.

[0086] For example, in FIG. 5, the server (150) providing an image-based chart may display status information extracted based on image data in a separate color (e.g., yellow, green, blue, etc.) and provide information about the corresponding disease in text. In addition, the server (150) providing an image-based chart may also display the shape of a tooth differently depending on the condition of the tooth.

[0087]

[0088] FIG. 6 is a diagram for exemplarily explaining that a server providing an image-based chart according to one embodiment of the present invention provides chart information.

[0089] Referring to FIG. 6, a server (150) providing an image-based chart according to one embodiment of the present invention can convert status information on a subject's teeth extracted based on image data and display it on an electronic chart.

[0090] As illustrated in FIG. 6, a server (150) providing an image-based chart according to one embodiment of the present invention can display a dental drawing together with an X-ray image of the subject's oral structure and teeth. In this case, information regarding the condition of the teeth can be provided in an electronic chart based on the condition information of the subject automatically extracted based on the image data.

[0091] For example, in FIG. 6, the server (150) providing an image-based chart displays status information extracted based on image data in a graphical format on a drawing. In this case, the server (150) providing an image-based chart can automatically graphically display oral cavity-related status information, such as the zygomatic arch or hyoid bone, based on the subject's current status on an electronic chart.

[0092]

[0093] FIG. 7 is a flowchart illustrating a method for providing an image-based chart according to one embodiment of the present invention.

[0094] Referring to FIG. 7, a method for providing an image-based chart according to an embodiment of the present invention may include a step of receiving image data of a subject from an image device (S110), a step of extracting status information of the subject based on the image data (S120), a step of converting the status information into chart information corresponding to a preset template (S130), and a step of providing the converted chart information to a user terminal according to the template (S140).

[0095] In step S110, image data of the subject may be received from the image device (110). At this time, the image data may include an image or image data of the subject's teeth captured by the image device (110). For example, the image data may include at least one of panoramic image data and oral scan image data of the subject.

[0096] In step S120, condition information of the subject can be extracted based on the image data. For example, the condition information of the subject can include information on tooth condition recognition (e.g., normal, restorative, root canal, implant, missing, etc.), diagnosis of dental diseases, diagnosis of periodontal disease, TMJ, and other special findings. Furthermore, the condition information of the subject can include information for confirming tooth position and confirming front, back, left, and right sides, as well as tooth color and range.

[0097] Additionally, in step S120, when extracting the subject's condition information, the subject's condition information can be extracted based on the feature points included in the image data. In this case, the subject's image data is analyzed to extract the feature points, and information such as the condition, disease, location, color, and size of the teeth corresponding to the feature points can be obtained.

[0098] In step S130, the subject's condition information can be converted into chart information corresponding to a preset template. Here, the preset template may include an electronic chart format used in dentistry to display information regarding the subject's dental condition. In other words, condition information can be acquired based on the extracted feature points of the subject, and this condition information can be converted into an electronic chart format.

[0099] Additionally, the format of the electronic chart converted in step S130 may include a drawing representing the condition of the subject's teeth, and may be configured to display chart information in the form of at least one of a shape, color, and text corresponding to the condition of the subject.

[0100] In step S140, the converted chart information can be provided to the user terminal (130) according to the template. That is, in step S140, feature points can be extracted from the subject's image data, and based on this, status information corresponding to the subject can be provided in the form of an electronic chart.

[0101] Additionally, the chart information provided in step S140 may include treatment information corresponding to the subject's condition information. For example, treatment information corresponding to the subject's condition information may include information regarding treatment methods, treatment schedules, processes, etc. that can be implemented based on the subject's dental condition. In this case, the treatment information may be provided in a preset medical record format. Therefore, the step of the dental professional manually entering the treatment information can be omitted, providing convenience and ensuring accurate information.

[0102] Additionally, according to an image-based chart provision method according to one embodiment of the present invention, the subject's next appointment information can be automatically generated based on treatment information. In this case, the subject's next appointment information can be generated based on the next treatment sequence according to a treatment process (plan) based on the subject's dental condition.

[0103] Additionally, appointment information can be generated automatically based on treatment information, taking into account treatment schedules. For example, appointment information can be automatically registered based on treatment details, treatment timing, required time, etc., corresponding to the next treatment sequence. In this case, appointment information can also be automatically provided in electronic chart format or presented on a separate appointment registration screen.

[0104] In this way, according to the image-based chart providing method of the present invention, it is possible to extract features such as dental disease and loss status based on various images taken of the teeth of a subject, and automatically provide the extracted features in an electronic chart.

[0105] In addition, according to the image-based chart provision method of the present invention, when using a dental work program, the practitioner can intuitively check the characteristics of the teeth, such as the subject's disease and missing information, thereby increasing the convenience of use and enabling systematic treatment and customer management.

[0106]

[0107] FIG. 8 is a block diagram showing the hardware configuration of a server providing an image-based chart according to one embodiment of the present invention.

[0108] Referring to FIG. 8, a computing system (1000) according to one embodiment disclosed in the present document may include an MCU (1010), a memory (1020), an input / output I / F (1030), and a communication I / F (1040).

[0109] The MCU (1010) may be a processor that executes various programs (e.g., an image data collection program, a status information extraction program, a chart information conversion program, etc.) for providing an image-based chart provision service stored in a memory (1020), processes various data such as the user's image data, status information, chart information, treatment information, and reservation information through these programs, and performs the functions of the server (150) shown in the aforementioned FIG. 2.

[0110] The memory (1020) can store various programs related to providing image-based charts. In addition, the memory (1020) can store various data such as user image data, status information, chart information, treatment information, and reservation information received from a client (e.g., an image device (110), a user terminal (130), etc.).

[0111] Such memories (1020) may be provided in multiple numbers as needed. The memories (1020) may be volatile memories or non-volatile memories. As volatile memories (1020), RAM, DRAM, SRAM, etc. may be used. As non-volatile memories (1020), ROM, PROM, EAROM, EPROM, EEPROM, flash memories, etc. may be used. The examples of the memories (1020) listed above are merely examples and are not limited to these examples.

[0112] The input / output I / F (1030) can provide an interface that enables data transmission and reception between an input device (not shown) such as a keyboard, mouse, or touch panel, and an output device (not shown) such as a display and the MCU (1010).

[0113] The communication I / F (1040) is a component capable of transmitting and receiving various data with the server, and may be any device capable of supporting wired or wireless communication. For example, programs for managing various data related to image-based chart provision services or various data can be transmitted and received from a separately provided external server via the communication I / F (1040).

[0114] In this way, a computer program according to one embodiment disclosed in this document may be implemented as a module that is recorded in a memory (1020) and processed by an MCU (1010) to perform each function illustrated in FIG. 2, for example.

[0115] Although all components constituting the embodiments of the present invention have been described as being combined or operating in combination, the present invention is not necessarily limited to such embodiments. That is, within the scope of the present invention, all components may be selectively combined and operated one or more times.

[0116] Meanwhile, the various embodiments described herein may be implemented by hardware, middleware, microcode, software, and / or a combination thereof. For example, the various embodiments may be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, other electronic units designed to perform the functions presented herein, or a combination thereof.

[0117] Additionally, for example, various embodiments may be embodied or encoded in a computer-readable medium containing instructions. Instructions embodied or encoded in the computer-readable medium may cause a programmable processor or other processor to perform a method when the instructions are executed, for example. The computer-readable medium includes a computer storage medium, which may be any available medium that can be accessed by a computer. For example, such a computer-readable medium may include a RAM, a ROM, an EEPROM, a CD-ROM or other optical disk storage medium, a magnetic disk storage medium, or other magnetic storage devices.

[0118] Such hardware, software, firmware, etc. may be implemented within the same device or within separate devices to support the various operations and functions described herein. Additionally, components, units, modules, components, etc. described as “units” in the present invention may be implemented together or individually as separate but interoperable logic devices. The depiction of different features for modules, units, etc. is intended to highlight different functional embodiments and does not necessarily imply that they must be realized by separate hardware or software components. Rather, the functionality associated with one or more modules or units may be performed by separate hardware or software components, or integrated into common or separate hardware or software components.

[0119] Although operations are depicted in the drawings in a particular order, this should not be construed as requiring that these operations be performed in the particular order depicted, or in any sequential order, or that all depicted operations be performed to achieve the desired results. In certain circumstances, multitasking and parallel processing may be advantageous. Furthermore, the distinction between various components in the embodiments described above should not be construed as requiring such distinction in all embodiments, and it should be understood that the components depicted may generally be integrated together into a single software product or packaged into multiple software products.

[0120] The electronic device, server, or external device according to the various embodiments of the present document described above may include, for example, at least one of a smartphone, a tablet PC, a mobile phone, a video phone, a desktop PC, a laptop PC, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device.

[0121] According to various embodiments, the wearable device may include at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted device (HMD)), a fabric or clothing-integrated type (e.g., an electronic garment), a body-attached type (e.g., a skin pad or tattoo), or a bio-implant type (e.g., an implantable circuit).

[0122] In some embodiments, the electronic device or external device may be a home appliance. The home appliance may include, for example, at least one of a television, a digital video disk player (DVD player), an audio device, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a TV box, a game console, an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

[0123] In another embodiment, the electronic device, external device, or wearable device may include at least one of various medical devices (e.g., various portable medical measuring devices (such as a blood glucose meter, a heart rate meter, a blood pressure meter, or a body temperature meter), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), a camera, or an ultrasound machine), a navigation device, a satellite navigation system (Global Navigation Satellite System (GNSS)), an event data recorder (EDR), a flight data recorder (FDR), an automobile infotainment device, a home robot, or an internet of things device (e.g., a light bulb, various sensors, an electric or gas meter, a sprinkler device, a fire alarm, a thermostat, a streetlight, an exercise machine, a hot water tank, a heater, a boiler, or the like).

[0124]

[0125] As described above, the best practice embodiments have been disclosed in the drawings and specifications. While specific terminology has been used herein, it is solely for the purpose of describing the present invention and is not intended to limit the scope of the invention as defined in the claims. Therefore, those skilled in the art will understand that various modifications and equivalent embodiments are possible. Therefore, the true technical protection scope of the present invention should be defined by the technical spirit of the appended claims.

Claims

1. In the method of providing a chart based on an image by the server, A step of receiving image data of a subject from an image device; A step of extracting condition information of the subject based on the image data; A step of converting the above status information into chart information corresponding to a preset template; and Including a step of providing the converted chart information to a user terminal according to the template, How to provide image-based charts.

2. In claim 1, The step of extracting the condition information of the above subject is: Extracting the condition information of the subject based on the feature points included in the image data, How to provide image-based charts.

3. In claim 1, The above template is, Including an electronic chart for displaying information on the dental condition of the subject; How to provide image-based charts.

4. In claim 3, The above electronic chart, Including a drawing showing the condition of the subject's teeth, configured to display the chart information in the form of at least one of shape, color, and text corresponding to the condition of the subject; How to provide image-based charts.

5. Memory; and A processor connected to the memory and configured to execute instructions contained in the memory, The above processor, A step of receiving image data of a subject from an image device; A step of extracting condition information of the subject based on the image data; A step of converting the above status information into chart information corresponding to a preset template; and configured to perform a step of providing the above-mentioned converted chart information to a user terminal according to the above-mentioned template, A server that provides image-based charts.

Images