Surgical operation process content generation method and device, electronic equipment and medium

Abstract

The invention provides a surgical operation process content generation method and device, electronic equipment and a medium, and relates to the technical field of artificial intelligence, in particular to a deep learning technology. The method comprises the following steps: acquiring an operation item demand, body information and a to-be-operated body part picture of a user; generating a surgical operation process text customized by the user according to the surgical project requirement, the body information and the body part picture; generating a surgical operation process picture customized by the user according to the surgical project requirement, the body information and the body part picture; according to the surgical operation process text and the surgical operation process picture, surgical operation process image-text content customized by the user is generated. According to the method and the device, personalized surgical operation process image-text content customized for the user can be generated based on the personal condition of the user, so that the user experience is improved, and the conversion rate from online content to offline service is increased.

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence technology, specifically to deep learning technology, and more particularly to a method, device, electronic device and medium for generating surgical operation process content. Background Art

[0002] In the related art, the content of medical or cosmetic surgery operation process is mostly in the form of static text pictures or explanation videos, such as popular science, cases, diaries, posts, etc. However, the content of medical or cosmetic surgery operation process in the related art is fixed, and it is impossible to generate customized medical or cosmetic surgery operation process content for users, resulting in poor user experience and reducing the conversion rate of online content to offline services. Summary of the invention

[0003] Provided are a method, device, electronic device and storage medium for generating surgical operation process content.

[0004] According to a first aspect, a method for generating surgical operation process content is provided, comprising: obtaining a user's surgical project requirements, physical information, and a picture of a body part to be operated on; generating a surgical operation process text customized for the user based on the surgical project requirements, the physical information, and the picture of the body part; generating a surgical operation process picture customized for the user based on the surgical project requirements, the physical information, and the picture of the body part; and generating surgical operation process graphic content customized for the user based on the surgical operation process text and the surgical operation process picture.

[0005] According to a second aspect, a device for generating surgical operation process content is provided, comprising: an acquisition module for acquiring a user's surgical project requirements, physical information and pictures of body parts to be operated on; a first generation module for generating a surgical operation process text customized for the user based on the surgical project requirements, the physical information and the pictures of the body parts; a second generation module for generating a surgical operation process picture customized for the user based on the surgical project requirements, the physical information and the pictures of the body parts; and a third generation module for generating surgical operation process graphic content customized for the user based on the surgical operation process text and the surgical operation process picture.

[0006] According to a third aspect, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method for generating surgical operation process content described in the first aspect of the present disclosure.

[0007] According to a fourth aspect, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method for generating surgical operation process content according to the first aspect of the present disclosure.

[0008] According to a fifth aspect, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the steps of the method for generating surgical operation process content according to the first aspect of the present disclosure.

[0009] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0011] Figure 1 is a flowchart of a method for generating surgical operation process content according to the first embodiment of the present disclosure;

[0012] Figure 2 is a flowchart of a method for generating surgical operation process content according to a second embodiment of the present disclosure;

[0013] Figure 3 is a schematic diagram of the principle of a method for generating surgical operation process content according to a third embodiment of the present disclosure;

[0014] Figure 4 is a block diagram of a device for generating surgical operation flow content according to a first embodiment of the present disclosure;

[0015] Figure 5 is a block diagram of a device for generating surgical operation process content according to a second embodiment of the present disclosure;

[0016] Figure 6 The block diagram is a block diagram of an electronic device for implementing the method of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0017] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0018] Artificial Intelligence (AI) is a technical science that studies and develops theories, methods, technologies and application systems for simulating, extending and expanding human intelligence. At present, AI technology has the advantages of high automation, high precision and low cost, and has been widely used.

[0019] Deep Learning (DL) is a new research direction in the field of Machine Learning (ML). It learns the inherent laws and representation levels of sample data. The information obtained in the learning process is of great help in the interpretation of data such as text, images and sounds. Its ultimate goal is to enable machines to have analytical learning capabilities like humans and to recognize data such as text, images and sounds. In terms of specific research content, it mainly includes neural network systems based on convolution operations, namely convolutional neural networks; autoencoding neural networks based on multi-layer neurons; deep belief networks that are pre-trained in the form of multi-layer autoencoding neural networks and then further optimize the weights of neural networks in combination with identification information. Deep learning has achieved many results in search technology, data mining, machine learning, machine translation, natural language processing, multimedia learning, speech, recommendation and personalization technology, and other related fields. Deep learning enables machines to imitate human activities such as audio-visual and thinking, solves many complex pattern recognition problems, and makes great progress in artificial intelligence related technologies.

[0020] The following describes the method, device, electronic device and storage medium for generating surgical operation process content according to the embodiments of the present disclosure in conjunction with the accompanying drawings.

[0021] Figure 1 It is a flowchart of a method for generating surgical operation process content according to the first embodiment of the present disclosure.

[0022] like Figure 1 As shown, the method for generating the surgical operation process content of the embodiment of the present disclosure may specifically include the following steps:

[0023] S101, obtaining the user's surgical project requirements, body information, and pictures of the body parts to be operated on.

[0024] Specifically, the execution subject of the method for generating the surgical operation process content of the embodiment of the present disclosure may be the generation device of the surgical operation process content provided by the embodiment of the present disclosure, and the generation device of the surgical operation process content may be a hardware device with data information processing capabilities and / or the necessary software required to drive the hardware device to work. Optionally, the execution subject may include a workstation, a server, a computer, a user terminal and other devices. Among them, the user terminal includes but is not limited to a mobile phone, a computer, an intelligent voice interaction device, a smart home appliance, a vehicle-mounted terminal, etc.

[0025] In the disclosed embodiment, the user is a patient who is to undergo medical surgery or an individual who is to undergo cosmetic surgery. The surgical project requirements are the body part of the user who is to undergo surgery and the desired purpose of the surgery, such as scar removal on the arm. The physical information may specifically include but is not limited to age, gender, height, weight, blood pressure, blood type, and skin quality. A picture of the body part to be operated on, such as a real picture of an arm to be operated on for scar removal.

[0026] Among them, the preset user interaction interface can be used to guide the user to input the surgical project requirements, physical information and pictures of the body parts to be operated on, or the doctor can guide the user to verbally describe or input the surgical project requirements, physical information and pictures of the body parts to be operated on through dialogue.

[0027] It should be noted here that the physical information guided by the user to input can be relevant physical information determined based on the surgical project requirements input by the user. That is, corresponding to different surgical project requirements, the user only needs to enter the physical information related to the surgical project requirements, and there is no need to enter physical information that is irrelevant to the surgical project requirements, thereby ensuring the safety of the operation while protecting the user's personal information security.

[0028] In addition, to protect user privacy, the model can be used to detect image information of body part pictures input (or uploaded) by users. When it is detected that there is private information in the body part picture that is not suitable or does not need to be displayed, the body part picture is intercepted and a prompt message is output.

[0029] S102, generating a surgical operation procedure text customized for the user according to the surgical project requirements, body information and body part pictures.

[0030] In the disclosed embodiment, a surgical procedure text can be generated using a preset strategy based on the user's surgical project requirements, body information, and body part images obtained in step S101. Since the surgical procedure text is generated based on the user's personal situation, the surgical procedure text is equivalent to a personalized surgical procedure text customized for the user. It should be noted that the surgical procedure text customized for the user can be generated by model generation or other methods.

[0031] S103, generating a surgical operation process picture customized for the user according to the surgical project requirements, body information and body part pictures.

[0032] In the disclosed embodiment, a surgical operation flow picture can be generated using a preset strategy based on the user's surgical project requirements, body information, and body part pictures obtained in step S101. Since the surgical operation flow picture is generated based on the user's personal situation, the surgical operation flow picture is equivalent to a personalized surgical operation flow picture customized for the user. It should be noted here that the surgical operation flow picture customized for the user can be generated by model generation and other methods. The surgical operation flow picture at least includes a body part picture after the operation.

[0033] S104, generating a surgical operation process graphic content customized for the user based on the surgical operation process text and the surgical operation process picture.

[0034] In the disclosed embodiment, the surgical operation process text generated in step S102 and the surgical operation process picture generated in step S103 are integrated and typeset to generate surgical operation process graphic content. Since the surgical operation process text and the surgical operation process picture are personalized text and pictures customized for users, the integrated surgical operation process graphic content is also equivalent to personalized surgical operation process graphic content customized for users, which can help users more intuitively understand the surgical process and pre- and post-operative changes when applied to their own bodies, reduce users' fear of surgery, improve user experience, and increase the conversion rate of online content to offline services.

[0035] In summary, the method for generating surgical operation process content of the disclosed embodiment obtains the user's surgical project requirements, body information and body part pictures to be operated on, generates a surgical operation process text customized for the user according to the surgical project requirements, body information and body part pictures, generates a surgical operation process picture customized for the user according to the surgical project requirements, body information and body part pictures, and generates a surgical operation process graphic content customized for the user according to the surgical operation process text and the surgical operation process pictures. The disclosed embodiment generates surgical operation process graphic content based on the user's surgical project requirements, body information and body part pictures to be operated on, that is, generates personalized surgical operation process graphic content customized for the user based on the user's personal situation, which can help the user more intuitively understand the surgical process and pre- and post-operative changes when applied to his or her own body, reduce the user's fear of surgery, improve user experience, and increase the conversion rate of online content to offline services.

[0036] Figure 2 It is a flowchart of a method for generating surgical operation process content according to the second embodiment of the present disclosure.

[0037] like Figure 2 As shown, in Figure 1 Based on the illustrated embodiment, the method for generating surgical operation process content in the embodiment of the present disclosure may specifically include the following steps:

[0038] S201, obtaining the user's surgical project requirements, physical information, and pictures of the body parts to be operated on.

[0039] In the embodiment of the present disclosure, step S201 is the same as step S101 in the above embodiment and will not be described again here.

[0040] In the above embodiment, step S102 of “generating a surgical procedure text customized for the user according to surgical project requirements, body information and body part images” may specifically include the following step S202 .

[0041] S202, inputting the surgical project requirements, body information and body part pictures into the language model to obtain the surgical operation process text.

[0042] In the disclosed embodiment, the user's surgical project requirements and physical information obtained in step S201 can be input into the language model. The language model analyzes the project requirement details of the surgical site through multimodal text and image understanding capabilities, and generates a detailed customized surgical operation process text.

[0043] The language model may specifically include but is not limited to the fourth generation generative pre-trained transformer model (Generative Pre-Trained Transformer-4, GPT-4 for short). The GPT-4 model is the fourth generation of the GPT series of AI language models. It is an Internet-based deep learning model that can be trained with available data and used for text generation.

[0044] It should be noted here that the language model can be obtained by training the language model to be trained based on the medical or medical aesthetics professional content text and the corresponding surgical operation process sample text, that is, the model parameters of the language model are fine-tuned through the medical or medical aesthetics professional content text and the corresponding labels (i.e. the surgical operation process sample text), so that the trained language model can learn professional surgical operation procedures and related technical knowledge. Among them, the medical or medical aesthetics professional content text may specifically include but is not limited to at least one of the following: medical textbooks, medical academic papers, and suggestions from medical aesthetics experts, etc.

[0045] In the above embodiment, step S103 of “generating a surgical operation process picture customized for the user according to the surgical project requirements, body information and body part pictures” may specifically include the following steps S203-S204.

[0046] S203, generating surgical operation process prompts customized for the user according to surgical project requirements, body information and body part pictures.

[0047] In the disclosed embodiment, the surgical project requirements, physical information, and body part pictures can be input into the language model to obtain multiple surgical operation process prompts. Specifically, the surgical project requirements, physical information, and body part pictures of the user obtained in step S201 can be input into the language model. The language model analyzes the project requirement details of the surgical site through multimodal text and picture understanding capabilities, and generates multiple surgical operation process prompts in steps. The language model in this step is the same as the language model in step S202, and will not be repeated here.

[0048] S204, generating a surgical operation process picture according to the surgical operation process prompt words.

[0049] In the disclosed embodiment, the plurality of surgical operation process prompt words generated in step S203 may be input into the picture diffusion model, and the picture diffusion model outputs the surgical operation process picture.

[0050] It should be noted here that the image diffusion model can be obtained by training a stable diffusion model to be trained based on surgical sample images in the medical or aesthetic field and the corresponding surgical operation process sample prompt words, that is, the model parameters of the stable diffusion model are fine-tuned through surgical sample images in the medical or aesthetic field and the corresponding labels (that is, surgical operation process sample prompt words), so that the trained image diffusion model can learn the image generation knowledge in the medical or aesthetic field to generate exquisite and realistic images of body parts.

[0051] Among them, the Stable Diffusion model is a text-to-image generation model based on the Latent Diffusion Model, which can generate high-quality, high-resolution and highly realistic images based on any text input.

[0052] In the above embodiment, step S104 of “generating user-customized surgical operation process graphic content based on the surgical operation process text and the surgical operation process picture” may specifically include the following step S205.

[0053] S205, integrating and typeset the surgical operation process text and the surgical operation process picture to obtain the surgical operation process graphic content.

[0054] In the disclosed embodiment, the surgical operation process text and the surgical operation process picture can be compared, the surgical operation process text and the surgical operation process picture corresponding to the same step can be integrated together, and the surgical operation process graphic content can be generated after reasonable typesetting.

[0055] In summary, the method for generating surgical operation process content of the disclosed embodiment obtains the user's surgical project requirements, body information and pictures of body parts to be operated on, generates a surgical operation process text customized for the user based on the surgical project requirements, body information, pictures of body parts and a large language model, generates a surgical operation process prompt word customized for the user based on the surgical project requirements, body information, pictures of body parts and a large language model, generates a surgical operation process picture based on the surgical operation process prompt words and a picture diffusion model, and generates a surgical operation process graphic content customized for the user based on the surgical operation process text and the surgical operation process picture. The disclosed embodiment generates surgical operation process graphic content based on the user's surgical project requirements, body information and pictures of body parts to be operated on, that is, generates personalized surgical operation process graphic content customized for the user based on the user's personal situation, which can help the user more intuitively understand the surgical process and changes before and after the operation when applied to his or her own body, reduce the user's fear of surgery, improve user experience, and increase the conversion rate of online content to offline services. The surgical operation process text and surgical operation process pictures are generated based on the large language model and the image diffusion model. Through the learning ability of the model, personalized surgical operation process text and surgical operation process pictures customized for users can be generated quickly and accurately, and then personalized surgical operation process graphic content customized for users can be generated.

[0056] In order to clearly illustrate the method for generating the surgical operation process content of the embodiment of the present disclosure, Figure 3 Describe in detail. Figure 3 is a schematic diagram of the principle of the method for generating the surgical operation process content according to an embodiment of the present disclosure, such as Figure 3As shown, the method for generating the surgical operation process content of the embodiment of the present disclosure includes: training and fine-tuning the basic language model according to the medical or medical beauty professional content texts such as medical textbooks, medical academic papers and suggestions of medical beauty experts and the corresponding surgical operation process sample texts, so as to obtain a professional language model suitable for the medical or medical beauty field. According to the surgical sample pictures in the medical or medical beauty field and the corresponding surgical operation process sample prompt words, the stable diffusion model is trained to obtain a picture diffusion model suitable for the medical or medical beauty field. The professional language model in the medical or medical beauty field analyzes the project requirements of the part to be operated on through multimodal text and picture understanding according to the surgical project requirements, body information and pictures of the body parts to be operated input by the user, generates a detailed surgical operation process text customized for the user, and generates multiple personalized surgical operation process prompt words (Prompt) customized for the user step by step. The picture diffusion model generates a surgical operation process picture customized for the user according to the multiple surgical operation process prompt words (Prompt) input. The surgical operation process text and surgical operation process pictures customized for the user are integrated and typeset to obtain the surgical operation process graphic content customized for the user.

[0057] Figure 4 4 is a block diagram of a device for generating surgical operation process content according to the first embodiment of the present disclosure.

[0058] like Figure 4 As shown, the device 400 for generating surgical operation process content according to the embodiment of the present disclosure includes: an acquisition module 401, a first generation module 402, a second generation module 403 and a third generation module 404. Among them:

[0059] The acquisition module 401 is used to acquire the user's surgical project requirements, body information, and pictures of the body parts to be operated on.

[0060] The first generating module 402 is used to generate a surgical operation flow text customized for the user according to the surgical project requirements, body information and body part pictures.

[0061] The second generating module 403 is used to generate a surgical operation process picture customized for the user according to the surgical project requirements, body information and body part pictures.

[0062] The third generating module 404 is used to generate the surgical operation process graphic content customized for the user according to the surgical operation process text and the surgical operation process picture.

[0063] It should be noted that the above explanation of the embodiment of the method for generating the surgical operation process content is also applicable to the device for generating the surgical operation process content of the embodiment of the present disclosure, and the specific process will not be repeated here.

[0064] In summary, the device for generating surgical operation process content of the disclosed embodiment obtains the user's surgical project requirements, body information and body part pictures to be operated on, generates a surgical operation process text customized for the user according to the surgical project requirements, body information and body part pictures, generates a surgical operation process picture customized for the user according to the surgical project requirements, body information and body part pictures, and generates a surgical operation process graphic content customized for the user according to the surgical operation process text and the surgical operation process pictures. The disclosed embodiment generates surgical operation process graphic content based on the user's surgical project requirements, body information and body part pictures to be operated on, that is, generates personalized surgical operation process graphic content customized for the user based on the user's personal situation, which can help the user more intuitively understand the surgical process and changes before and after the operation when applied to his or her own body, reduce the user's fear of surgery, improve user experience, and increase the conversion rate of online content to offline services.

[0065] Figure 5 4 is a block diagram of a device for generating surgical operation process content according to a second embodiment of the present disclosure.

[0066] like Figure 5 As shown, the device 500 for generating surgical operation process content according to the embodiment of the present disclosure includes: an acquisition module 501, a first generation module 502, a second generation module 503 and a third generation module 504.

[0067] Among them, the acquisition module 501 has the same structure and function as the acquisition module 401 in the previous embodiment, the first generation module 502 has the same structure and function as the first generation module 402 in the previous embodiment, the second generation module 503 has the same structure and function as the second generation module 403 in the previous embodiment, and the third generation module 504 has the same structure and function as the third generation module 404 in the previous embodiment.

[0068] Furthermore, the first generation module 502 includes: a generation unit 5021, which is used to input the surgical project requirements, body information and body part pictures into the language model to obtain the surgical operation process text.

[0069] Furthermore, the second generating module 503 is further used to: generate surgical operation process prompt words customized for the user according to the surgical project requirements, body information and body part pictures; and generate surgical operation process pictures according to the surgical operation process prompt words.

[0070] Furthermore, the second generation module 503 is further used to: input the surgical project requirements, body information and body part pictures into the language model to obtain surgical operation process prompt words.

[0071] Furthermore, the language macro model is obtained by training the language macro model to be trained based on medical or medical aesthetics professional content texts and corresponding surgical operation process sample texts.

[0072] Furthermore, the medical or aesthetic professional content text includes at least one of the following: medical textbooks, medical academic papers, and advice from aesthetic experts.

[0073] Furthermore, the second generation module 503 is further used to: input the surgical operation process prompt words into the image diffusion model to obtain the surgical operation process image.

[0074] Furthermore, the image diffusion model is obtained by training the stable diffusion model based on the surgical sample images and the corresponding surgical operation process sample prompt words.

[0075] Furthermore, the third generation module 504 is further used to integrate and typeset the surgical operation process text and the surgical operation process picture to obtain the surgical operation process graphic content.

[0076] It should be noted that the above explanation of the embodiment of the method for generating the surgical operation process content is also applicable to the device for generating the surgical operation process content of the embodiment of the present disclosure, and the specific process will not be repeated here.

[0077] In summary, the device for generating surgical operation process content of the disclosed embodiment obtains the user's surgical project requirements, body information and pictures of body parts to be operated on, generates a surgical operation process text customized for the user according to the surgical project requirements, body information, pictures of body parts and a large language model, generates surgical operation process prompt words customized for the user according to the surgical project requirements, body information, pictures of body parts and a large language model, generates surgical operation process pictures according to the surgical operation process prompt words and a picture diffusion model, and generates surgical operation process graphic content customized for the user according to the surgical operation process text and the surgical operation process pictures. The disclosed embodiment generates surgical operation process graphic content based on the user's surgical project requirements, body information and pictures of body parts to be operated on, that is, generates personalized surgical operation process graphic content customized for the user based on the user's personal situation, which can help the user more intuitively understand the surgical process and changes before and after the operation when applied to his or her own body, reduce the user's fear of surgery, improve user experience, and increase the conversion rate of online content to offline services. The surgical operation process text and surgical operation process pictures are generated based on the large language model and the image diffusion model. Through the learning ability of the model, personalized surgical operation process text and surgical operation process pictures customized for users can be generated quickly and accurately, and then personalized surgical operation process graphic content customized for users can be generated.

[0078] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0079] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0080] Figure 6 A schematic block diagram of an example electronic device 600 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0081] like Figure 6 As shown, the electronic device 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 602 or a computer program loaded from a storage unit 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 can also be stored. The computing unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0082] Multiple components in the electronic device 600 are connected to the I / O interface 605, including: an input unit 606, such as a keyboard, a mouse, etc.; an output unit 607, such as various types of displays, speakers, etc.; a storage unit 608, such as a disk, an optical disk, etc.; and a communication unit 609, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 609 allows the electronic device 600 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0083] The computing unit 601 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 601 performs the various methods and processes described above, such as Figures 1 to 3 The method for generating the content of the surgical procedure process shown. For example, in some embodiments, the method for generating the content of the surgical procedure process can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 608. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 600 via ROM602 and / or communication unit 609. When the computer program is loaded into RAM603 and executed by the computing unit 601, one or more steps of the semantic parsing method described above can be performed. Alternatively, in other embodiments, the computing unit 601 can be configured to execute the method for generating the content of the surgical procedure process by any other appropriate means (for example, by means of firmware).

[0084] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0085] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0086] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0087] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0088] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), the Internet, and a blockchain network.

[0089] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server for a distributed system, or a server combined with a blockchain.

[0090] According to an embodiment of the present disclosure, the present disclosure also provides a computer program product, including a computer program, wherein the computer program, when executed by a processor, implements the steps of the method for generating surgical operation process content according to the above embodiment of the present disclosure.

[0091] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0092] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for generating surgical operation process content, comprising: Obtain the user's surgical project requirements, physical information, and pictures of the body parts to be operated on; Generate a surgical procedure text customized for the user according to the surgical project requirements, the body information and the body part pictures; Generate a surgical operation process picture customized for the user according to the surgical project requirements, the body information and the body part picture; as well as According to the surgical operation process text and the surgical operation process picture, a surgical operation process graphic content customized for the user is generated.

2. The generation method according to claim 1, wherein: Generating a surgical procedure text customized for the user according to the surgical project requirements, the body information and the body part picture includes: The surgical project requirements, the body information and the body part pictures are input into the language model to obtain the surgical operation process text.

3. The generation method according to claim 1, wherein: Generating a surgical operation process picture customized for the user according to the surgical project requirements, the body information and the body part picture includes: Generate a surgical procedure prompt word customized for the user according to the surgical project requirements, the body information and the body part picture; and The surgical operation process picture is generated according to the surgical operation process prompt words.

4. The generation method according to claim 3, wherein: Generating a surgical procedure prompt word customized for the user according to the surgical project requirements, the body information and the body part picture includes: The surgical project requirements, the body information and the body part pictures are input into the language model to obtain the surgical operation process prompt words.

5. The generation method according to claim 2 or 4, wherein: The language macro model is obtained by training the language macro model to be trained based on medical or medical aesthetics professional content texts and corresponding surgical operation process sample texts.

6. The generation method according to claim 5, wherein: The medical or aesthetic professional content text includes at least one of the following: Medical textbooks, medical academic papers and advice from medical aesthetics experts.

7. The generation method according to claim 3, wherein: The step of generating the surgical operation process picture according to the surgical operation process prompt word includes: The surgical operation process prompt words are input into the image diffusion model to obtain the surgical operation process picture.

8. The generation method according to claim 7, wherein: The image diffusion model is obtained by training a stable diffusion model based on surgical sample images and corresponding surgical procedure sample prompt words.

9. The generation method according to claim 1, wherein: Generating the surgical operation process graphic content customized for the user according to the surgical operation process text and the surgical operation process picture includes: The surgical operation process text and the surgical operation process picture are integrated and typeset to obtain the surgical operation process graphic content.

10. A device for generating surgical operation process content, comprising: The acquisition module is used to obtain the user's surgical project requirements, body information and pictures of the body parts to be operated on; A first generating module, used to generate a surgical operation flow text customized for the user according to the surgical project requirements, the body information and the body part picture; A second generating module is used to generate a surgical operation process picture customized for the user according to the surgical project requirements, the body information and the body part picture; as well as The third generating module is used to generate the surgical operation process graphic content customized for the user according to the surgical operation process text and the surgical operation process picture.

11. The generating device according to claim 10, wherein: The first generating module comprises: A generating unit is used to input the surgical project requirements, the body information and the body part pictures into the language model to obtain the surgical operation process text.

12. The generating device according to claim 10, wherein: The second generating module is further used for: Generate a surgical procedure prompt word customized for the user according to the surgical project requirements, the body information and the body part picture; and The surgical operation process picture is generated according to the surgical operation process prompt words.

13. The generating device according to claim 12, wherein: The second generating module is further used for: The surgical project requirements, the body information and the body part pictures are input into the language model to obtain the surgical operation process prompt words.

14. The generating device according to claim 11 or 13, wherein: The language macro model is obtained by training the language macro model to be trained based on medical or medical aesthetics professional content texts and corresponding surgical operation process sample texts.

15. The generating device according to claim 14, wherein: The medical or aesthetic professional content text includes at least one of the following: Medical textbooks, medical academic papers and advice from medical aesthetics experts.

16. The generating device according to claim 12, wherein: The second generating module is further used for: The surgical operation process prompt words are input into the image diffusion model to obtain the surgical operation process picture.

17. The generating device according to claim 16, wherein: The image diffusion model is obtained by training a stable diffusion model based on surgical sample images and corresponding surgical procedure sample prompt words.

18. The generating device according to claim 10, wherein: The third generation module is further used for: The surgical operation process text and the surgical operation process picture are integrated and typeset to obtain the surgical operation process graphic content.

19. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 9.

20. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-9.

21. A computer program product comprising a computer program, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 9.

Images