Method, system, and computer readable storage medium for adjustment of a physician console

Abstract

The present specification provides a method, system and computer readable storage medium for adjusting a surgeon console. Based on the method, before a target user starts the surgeon console for surgical operation, the current physical features of the target user can be automatically and accurately obtained based on first image data containing the target user's body; and the first pose data of the surgeon console matched with the physical features of the target user can be determined based on the current physical features of the target user; and then the pose of the corresponding components such as observation components, operation components, seat components and the like in the surgeon console can be automatically adjusted based on the first pose data, so that the pose of each component in the surgeon console is in a comfortable pose state for the target user. Further, the target user can perform surgical operation more efficiently and comfortably based on the adjusted surgeon console, reduce the fatigue of the target user during the surgical process, and make the target user obtain a better use experience.

Description

TECHNICAL FIELD

[0001] The present specification belongs to the technical field of medical instruments, and particularly relates to a method, system and computer readable storage medium for adjusting a surgeon console. BACKGROUND

[0002] With the development and popularization of surgical robot technology, more and more surgeons currently choose to use a surgeon console to perform specific surgical operations.

[0003] However, based on the existing method, when a surgeon uses a surgeon console to perform a surgical operation, the surgeon is often fatigued during the operation due to an inappropriate or mismatched pose of the surgeon console, thereby affecting the surgeon's operation.

[0004] At present, no effective solution has been proposed for the above problems. SUMMARY

[0005] The present specification provides a method, system and computer readable storage medium for adjusting a surgeon console, which can automatically adjust the poses of corresponding components such as observation components, operation components, seat components, etc. in the surgeon console before starting the surgeon console to perform a surgical operation, so that the poses of the components in the surgeon console are in a comfortable pose state for the target user, reducing the fatigue of the target user when using the surgeon console to perform a surgical operation, and allowing the target user to obtain a better use experience.

[0006] The present specification provides a method for adjusting a surgeon console, which includes: collecting and obtaining the current physical features of a target user according to first image data containing the body of the target user; determining first pose data about the surgeon console that matches the physical features of the target user according to the current physical features of the target user; and adjusting the poses of corresponding components in the surgeon console according to the first pose data.

[0007] The present specification also provides another method for adjusting a surgeon console, which includes: obtaining eye state features and / or face state features of a target user in a current time period at intervals of a preset time period; determining the fatigue degree of the target user in the current time period according to the eye state features and / or face state features of the target user in the current time period; and adjusting the surgeon console accordingly according to the fatigue degree of the target user in the current time period.

[0008] The specification also provides a doctor console adjustment system, comprising at least a first acquisition end and a processor, the doctor console adjustment system being connected to a doctor console, the first acquisition end being configured to acquire first image data containing a target user's body and obtain the target user's current physical features based on the first image data, and the processor being configured to determine first pose data of the doctor console matching the target user's body based on the target user's current physical features, and adjust the pose of corresponding components in the doctor console based on the first pose data.

[0009] The specification also provides a computer readable storage medium having computer instructions stored thereon, the instructions being executed to implement the relevant steps of the doctor console adjustment method.

[0010] Based on the doctor console adjustment method, system and computer readable storage medium provided by the specification, before the target user starts operating the doctor console, the target user's current physical features can be automatically and accurately obtained by acquiring first image data containing the target user's body, and first pose data of the doctor console matching the target user's body can be determined based on ergonomics technology based on the target user's current physical features. Then, the pose of corresponding components such as observation components, operation components, seat components, etc. in the doctor console can be automatically adjusted based on the first pose data, so that the pose of each component in the doctor console is in a comfortable pose state for the target user. Thus, the target user can perform surgical operations more efficiently and comfortably based on the adjusted doctor console, effectively reducing the target user's fatigue during the operation process, and providing the target user with a better user experience.

[0011] Further, during the target user's operation using the doctor console, the target user's fatigue degree during the current time period can be determined by obtaining and based on the target user's eye state features and / or face state features during the current time period every time interval of a preset time period, and different fatigue conditions can be distinguished based on the target user's fatigue degree during the current time period, and a matching processing mode can be selected to adjust the pose of the doctor console accordingly.

[0012] Specifically, in a case where the fatigue degree of the target user in the current time period is determined to be less than or equal to the preset first fatigue degree threshold, it can be determined that the pose of the surgeon console is not adjusted temporarily, and the preset time period is kept unchanged, and the fatigue degree of the target user is continued to be monitored based on the original preset time period and at the original monitoring frequency. In a case where the fatigue degree of the target user in the current time period is determined to be greater than the preset first fatigue degree threshold and less than or equal to the preset second fatigue degree threshold, it can be determined that the pose of the surgeon console is not adjusted temporarily, and the preset time period is adjusted by shortening the preset time period, and the fatigue degree of the target user is continued to be monitored based on the adjusted preset time period and at a higher monitoring frequency. In a case where the fatigue degree of the target user in the current time period is determined to be greater than the preset second fatigue degree threshold, it is determined that the pose of the surgeon console is adjusted. Further, the second pose data of the surgeon console matched with the fatigue state of the target user in the current time period can be determined first, and the pose of the surgeon console is fine-tuned according to the second pose data to relieve the fatigue of the target user in the current time period in time. Thus, the target user can obtain better use experience, and the influence of the fatigue of the target user on the operation of the surgeon console can be effectively reduced. BRIEF DESCRIPTION OF DRAWINGS

[0013] In order to more clearly illustrate the embodiments of the present specification, the drawings required in the embodiments will be briefly introduced as follows. The drawings described below are only some embodiments described in the present specification, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0014] Figure 1 FIG. 1 is a flow diagram of a method for adjusting a surgeon console according to an embodiment of the present specification;

[0015] Figure 2 FIG. 2 is a schematic diagram of a surgical system in which a surgeon console is located and to which a method for adjusting the surgeon console according to an embodiment of the present specification is applied;

[0016] Figure 3 FIG. 3 is a schematic diagram of a surgeon console to which a method for adjusting the surgeon console according to an embodiment of the present specification is applied;

[0017] Figure 4 FIG. 4 is a schematic diagram of an observation assembly in a surgeon console;

[0018] Figure 5 FIG. 5 is a schematic diagram of an operation assembly in a surgeon console;

[0019] Figure 6 FIG. 6 is a schematic diagram of a seat assembly in a surgeon console;

[0020] Figure 7is a structural schematic diagram of a patient operating table in a surgical system;

[0021] Figure 8 is a structural schematic diagram of an auxiliary device in a surgical system;

[0022] Figure 9 is a scene schematic diagram of applying a first acquisition end of an auxiliary device in a scene example;

[0023] Figure 10 is a process schematic diagram of adjusting a surgeon console according to first pose data in a scene example;

[0024] Figure 11 is a scene schematic diagram of adjusting a surgeon console according to first pose data in a scene example;

[0025] Figure 12 is a process schematic diagram of determining second pose data for fine-tuning in a scene example;

[0026] Figure 13 is a scene schematic diagram of adjusting a surgeon console according to second pose data in a scene example;

[0027] Figure 14 is a process schematic diagram of an adjustment method of a surgeon console provided by another embodiment of the present specification;

[0028] Figure 15 is a structural composition schematic diagram of an adjustment system of a surgeon console provided by an embodiment of the present specification;

[0029] Figure 16 is a structural composition schematic diagram of an adjustment system of a surgeon console provided by an embodiment of the present specification;

[0030] Figure 17 is a structural composition schematic diagram of an adjustment system of a surgeon console provided by another embodiment of the present specification. DETAILED DESCRIPTION

[0031] In order to enable persons skilled in the art to better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present specification. Obviously, the described embodiments are only some of the embodiments of the present specification, not all the embodiments. Based on the embodiments in the present specification, all other embodiments obtained by persons skilled in the art without creative labor should be within the protection scope of the present specification.

[0032] Reference Figure 1As shown in the embodiments of this specification, a method for adjusting a doctor's console is provided. In specific implementation, this method may include the following:

[0033] S101: Collect and obtain the current body features of the target user based on the first image data containing the target user's body;

[0034] S102: Based on the target user's current body shape characteristics, determine the first pose data of the doctor's console that matches the target user's body shape;

[0035] S103: Adjust the pose of the corresponding component in the doctor's console based on the first pose data.

[0036] In some embodiments, see Figure 2 and Figure 3 As shown, the above adjustment method for the doctor's console can be specifically applied to the doctor's console (or doctor's control terminal) side of the surgical system.

[0037] The aforementioned doctor's console faces the target user (e.g., the doctor). The target user can use the doctor's console to control the patient's operating table (or patient operating terminal) to perform specific surgical procedures on the patient.

[0038] See Figure 2 As shown, in addition to the doctor's console and the patient's operating table, the above-mentioned surgical system may further include medical equipment such as auxiliary equipment, tool carts, and imaging carts.

[0039] It should be noted that, in practice, besides being applicable to doctor's consoles, the above-described adjustment methods for doctor's consoles can also be applied to other medical devices such as surgical robots, depending on the specific application scenario and processing requirements. This manual does not limit this application.

[0040] For details, please refer to Figure 3 As shown, the aforementioned doctor's console may include at least observation components, operating components, and a seat assembly. These observation components, operating components, and seat assembly support adjustments based on dimensions such as position and / or angle.

[0041] See Figure 4 As shown, the aforementioned observation components may include at least a monitor. Specifically, the monitor may be an AR-based monitor. This monitor can be used to display image data during the surgical procedure to the target user.

[0042] Specifically, the aforementioned observation component may also be equipped with observation component rotation adjustment joints, observation component position adjustment joints, etc. The observation component position adjustment joints support the overall movement of the observation component in directions such as up / down, left / right, and forward / backward. The observation component rotation adjustment joints support the overall angular rotation of the observation component. Accordingly, based on these adjustment joints, the observation component can be effectively adjusted based on dimensions such as position and / or angle to meet the diverse observation needs of the target user, allowing the target user to obtain a relatively better observation experience.

[0043] See Figure 5 As shown, the aforementioned operating components may include at least a main operating terminal, a foot pedal panel, and handrails. The main operating terminal is connected to the slave robotic arm of the patient's operating table and is used to control surgical instruments or endoscopes mounted on the slave robotic arm to perform corresponding surgical operations. The handrails provide support for the user during the surgical procedure. The foot pedal panel allows the user to switch between the slave robotic arms controlled by the main operating terminal.

[0044] Specifically, the aforementioned operating components may also include foot pedal adjustment joints, armrest adjustment joints, and main operating end adjustment joints. The foot pedal adjustment joints adjust the position and orientation of the foot pedals, the armrest adjustment joints adjust the position and orientation of the armrests, and the main operating end adjustment joints adjust the position and orientation of the main operating end. Based on these adjustment joints, the operating components can be effectively adjusted according to dimensions such as position and / or angle to meet the diverse operating needs of the target user.

[0045] See Figure 6 As shown, the aforementioned chair assembly may include at least a chair and a base. Specifically, when the target user uses the doctor's console, they can sit in the chair and control the robotic arms of the patient's operating table to perform specific surgical procedures via the main control terminal and foot pedal panel.

[0046] Specifically, the aforementioned seat assembly may also be equipped with seat height adjustment joints, seat position adjustment joints, etc. Furthermore, the aforementioned seat assembly may also be equipped with seat rotation angle adjustment joints, etc. Based on these adjustment joints, the seat assembly can be effectively adjusted based on dimensions such as position and / or angle to coordinate with the operating components, adjusting the distance between the seat assembly and the operating components; simultaneously adjusting the relative distance between the target user's body and the head support structure of the seat, making the target user more comfortable and providing a better user experience when using the doctor's console.

[0047] See Figure 2 As shown, the doctor's control console can be connected to the patient's operating table in the medical system via wired or wireless means. The patient's operating table faces the patient to be operated on.

[0048] For details, please refer to Figure 7 As shown, at least multiple robotic arms are arranged on the patient's operating table. For example, robotic arm 1, robotic arm 2, robotic arm 3, robotic arm 4, and robotic arm 5. Furthermore, the aforementioned operating table may also include structures such as a base and a top plate. Moreover, surgical instruments, endoscopes, and other related equipment required for the surgery can be mounted on the aforementioned robotic arms. For example, robotic arm 1 can mount surgical instruments, and robotic arm 5 can mount an endoscope.

[0049] Specifically, the aforementioned endoscopes may include binocular endoscopes, etc. The aforementioned surgical instruments may include any of the following: duckbill forceps, rat-tooth forceps, powerful duckbill forceps, etc.

[0050] During the actual surgical procedure, the target user can use the main control terminal of the doctor's console to control the endoscope attached to the robotic arm to be inserted into the surgical environment (e.g., into the patient's abdominal cavity) to collect image data in real time or at regular intervals, and display the collected image data on the monitor of the doctor's console.

[0051] It should be noted that this instruction manual primarily uses an endoscope to collect image data during the surgical procedure. In practice, depending on the specific circumstances and processing requirements, other devices such as cameras or webcams may be used to replace the endoscope in collecting image data during the surgical procedure.

[0052] See Figure 8 As shown, the aforementioned assistive device is equipped with a first acquisition terminal, which is connected to the doctor's control console. This first acquisition terminal supports at least binocular vision functionality. For example, the first acquisition terminal may include a binocular camera, capable of acquiring image data containing the target user's body based on binocular vision mechanisms.

[0053] Furthermore, the aforementioned first acquisition terminal can also support infrared thermal imaging functionality. For example, the first acquisition terminal can also be equipped with an infrared thermal imager or a temperature sensor, which can acquire thermal imaging data containing the target user's body based on the infrared thermal imaging mechanism.

[0054] Specifically, when deploying auxiliary equipment, it can be placed in a location that meets the requirements. At such a location, the primary acquisition device of the auxiliary equipment can capture a complete image of the target user's body while seated.

[0055] In addition, a second acquisition end can be installed inside the observation component. For example, a high-precision camera can be installed inside the observation component, near the monitor, as a second acquisition end, so that image data containing local images of the target user's face and / or eyes while using the doctor's console can be acquired through the second acquisition end.

[0056] Based on the adjustment method of the doctor's console provided in this manual, before the target user starts the doctor's console to perform surgical operations after sitting in the chair, first image data containing the target user's body can be acquired through the first acquisition end of the auxiliary device; then, based on the first image data, the target user's current body features are extracted. Next, a preset ergonomic simulation model can be used to process the target user's current body features to determine the posture data that matches the target user's body shape and allows the target user to feel comfortable and less fatigued when using the doctor's console, which serves as the first posture data of the doctor's console. Subsequently, based on the first posture data, the position and angle of each component of the doctor's console can be automatically adjusted by adjusting the corresponding joints, so that the target user can feel more comfortable when using the doctor's console from the beginning and reduce fatigue during subsequent operations.

[0057] During surgical procedures performed by the target user using the doctor's console, second image data containing the target user's eyes and / or face at preset time intervals can be acquired via a second acquisition terminal. Based on this second image data, the target user's eye and / or facial features for the current time interval are extracted. Then, a preset fatigue classification model can be used to determine the target user's fatigue level by processing these features. Furthermore, based on the target user's fatigue level, different fatigue conditions can be differentiated, and corresponding adjustments can be made to effectively monitor the target user's fatigue level while using the doctor's console. This allows for timely and targeted relief of the user's fatigue, preventing operational fatigue from affecting the surgical process and providing a better user experience.

[0058] In some embodiments, the target user may specifically include the user currently initiating and using the doctor's console. The target user's current physical characteristics may specifically include the physical characteristics of the target user while naturally seated in the chair of the doctor's console.

[0059] Specifically, the aforementioned physical characteristics may include one or more of the following: the degree of curvature and / or joint angle of the cervical spine, the degree of curvature and / or joint angle of the thoracic spine, the degree of curvature and / or joint angle of the lumbar spine, the degree of curvature and / or joint angle of the arms, the degree of curvature and / or joint angle of the legs, etc.

[0060] It should be noted that by utilizing the above-mentioned body features, we can fully consider the curvature of different human tissue structures and the posture details such as joint angles. Furthermore, by combining ergonomic principles, we can more precisely characterize and analyze the target user's current posture and the specific impact of the current posture on fatigue when using the doctor's console. This allows us to more accurately determine the primary posture data for the target user, which will make the target user feel as comfortable as possible and reduce fatigue when using the doctor's console.

[0061] Of course, it should be noted that the physical features listed above are only illustrative. In actual implementation, depending on the specific application scenario and processing requirements, other types of physical features, such as the degree of head curvature and / or deflection angle, can also be collected. This specification does not limit this.

[0062] In some embodiments, the above-mentioned acquisition includes first image data of the target user's body, which may specifically include the following:

[0063] S1: Detect whether a startup command for the doctor's console initiated by the target user has been received;

[0064] S2: Upon confirming that a start command initiated by the target user has been received, first image data containing the target user's body is acquired.

[0065] In practice, once the target user is seated in the doctor's console chair, they can initiate a startup command for the doctor's console by turning on the startup switch or speaking the startup command.

[0066] The doctor's console receives and responds to the start command, controlling the first acquisition terminal to capture a photograph containing the target user's body as the first image data. Then, a feature processing model can be used to process the first image data to extract the desired current body features of the target user.

[0067] In some embodiments, see Figure 9 As shown, the current body features of the target user can also be obtained based on the principle of binocular vision. Specifically, the frontal facial features of the target user at a specified location can be scanned and measured by a binocular camera in a first acquisition end with a known spatial distance, to obtain the body feature size parameters; then, based on the body size parameters, the coordinate parameters of key parts of the target user's body (e.g., spine, thoracic vertebrae, lumbar vertebrae, arms, etc.) can be determined by performing human-machine parameter calculations, so as to obtain the required current body features of the target user.

[0068] In some embodiments, the above-mentioned determination of the first pose data of the doctor's console that matches the target user's body shape based on the target user's current body shape characteristics may specifically include the following: processing the target user's current body shape characteristics using a preset ergonomic simulation model to obtain corresponding simulation results; and determining the first pose data of the doctor's console that matches the target user's body shape based on the simulation results.

[0069] Specifically, the aforementioned pre-defined ergonomic simulation model can be understood as an algorithm model built based on ergonomic theory.

[0070] Based on this preset ergonomic simulation model, the model can simulate the user experience of the doctor's console under different postures based on the current body characteristics of the target user and ergonomic theory. Based on the corresponding algorithm rules, it can select one or more groups of doctor's console postures with higher user experience scores and the corresponding user experience scores as the simulation results.

[0071] In practice, based on the simulation results, the pose state of the doctor console with the highest user experience score can be selected from multiple sets of doctor console pose states as the first pose data that matches the target user's body shape.

[0072] It can also query the target user's historical usage records based on the target user's user identifier; then, from multiple sets of doctor console pose states, select the set of doctor console pose states that is most similar to the target user's historical usage records as the first pose data.

[0073] It can also display the pose states of multiple doctor consoles in the simulation results to the target user; receive and respond to the selection operation of the target user, and determine the pose state of the doctor console selected by the target user as the first pose data.

[0074] In some embodiments, see Figure 10 As shown, the above adjustment of the pose of the corresponding component in the doctor's console based on the first pose data can include the following in specific implementation:

[0075] S1: Obtain the current pose data of each component in the doctor's console;

[0076] S2: Based on the first pose data and the current pose data of each component in the doctor's console, determine the pose adjustment data of each component in the doctor's console;

[0077] S3: Adjust the position and angle of the corresponding components in the doctor's console based on the pose adjustment data of each component in the doctor's console.

[0078] In practice, the current pose data (e.g., current position and / or current angle) of each component in the doctor's console can be collected by sensors deployed on each component. Alternatively, the current pose data of each component can be determined using the encoder parameters of each component in the doctor's console.

[0079] Next, the target direction and target position of the joints for each component in the doctor's console can be determined by comparing the first pose data with the current pose data of each component in the doctor's console. This serves as the pose adjustment data for each component in the doctor's console.

[0080] In addition, when determining the specific posture adjustment data of each component in the doctor's console, the shape and size of each component in the doctor's console, as well as the current posture data of the target user's key parts, can be combined to determine a more suitable posture adjustment data.

[0081] Finally, based on the position and pose adjustment data of each component in the doctor's console, the corresponding movements of the adjustment joints of the components in the doctor's console can be controlled to adjust the position and angle of the corresponding components in the doctor's console, so that the position and pose of each component in the doctor's console are in a comfortable position and pose for the target user.

[0082] Specifically, for example, see Figure 11 As shown, taking the adjustment of the seat assembly in the doctor's console as an example, if only based on the target user's current leg angle θ1, the optimal position of the seat height adjustment joint can be determined as H1.

[0083] However, by simultaneously considering the target user's current thigh-to-upper-body angle θ2 and the external dimensions of the observation components on the doctor's console, the optimal position for the seat height adjustment joint can be determined as H2, serving as the final posture adjustment data. Based on H2, the seat height adjustment joint can then be adjusted, making the adjusted seat more comfortable and convenient for the target user when using the doctor's console, effectively reducing user fatigue.

[0084] In some embodiments, after adjusting the poses of the corresponding components in the doctor's console based on the first pose data, and after determining that the poses of each component in the doctor's console are in a comfortable pose state for the target user, a prompt message indicating that the adjustment is complete can be generated and delivered to the target user via voice playback or image display. The target user can then use the doctor's console normally to perform specific surgical operations.

[0085] In some embodiments, after adjusting the pose of the corresponding component in the doctor's console based on the first pose data, the method may further include the following:

[0086] S1: At preset time intervals, obtain the eye and / or facial features of the target user during the current time period.

[0087] S2: Determine the fatigue level of the target user in the current time period based on the target user's eye and / or facial features in the current time period;

[0088] S3: Adjust the doctor's console accordingly based on the target user's current fatigue level.

[0089] The aforementioned preset time period can be understood as the time interval for periodically monitoring the fatigue level of the target user. Specifically, the preset time period can be set to 5 minutes.

[0090] In practice, a suitable preset time period can be determined in advance by sorting and statistically analyzing the historical experience records of a large number of users when using the doctor's console.

[0091] The aforementioned eye condition characteristics may specifically include one or more of the following: eye opening, blinking frequency, eyeball flexibility, pupil state, etc.

[0092] The aforementioned facial features may specifically include one or more of the following: the degree of mouth opening, the shape of the eyebrows, the folds on the forehead, etc.

[0093] In some embodiments, the above-mentioned acquisition of the target user's eye state features and / or facial state features in the current time period may specifically include: acquiring second image data containing the target user's eyes and / or face in the current time period; and extracting the target user's eye state features and / or facial state features in the current time period from the second image data in the current time period.

[0094] In practice, a second acquisition device can capture a photo containing a complete eye image and / or face image of the target user, which serves as the second image data. Then, a feature processing model can be used to process the second image data to extract the desired eye and / or face state features of the target user for the current time period.

[0095] In practice, the eye state features of the target user in the current time period can also be collected in detail in the following way: control the second acquisition end to scan and analyze the eye area of ​​the target user, and collect the eye state features in the current time period through processing such as dividing the candidate eye area, locating the human eye, and extracting the human eye contour.

[0096] In some embodiments, the determination of the target user's fatigue level based on the target user's eye and / or facial features during the current time period may include the following:

[0097] S1: Use a pre-set fatigue state prediction model to process the eye state features and / or facial state features of the target user in the current time period to obtain the corresponding prediction results.

[0098] S2: Based on the prediction results, determine the fatigue level of the target user in the current time period.

[0099] Specifically, the aforementioned pre-set fatigue state prediction model can be understood as a pre-trained prediction model that can determine the corresponding fatigue level based on the target user's eye state features and / or facial state features.

[0100] Before implementation, a preset fatigue state prediction model can be trained as follows: collect a large number of users' eye state features and / or facial state features as sample data; label the fatigue level corresponding to the sample data to obtain labeled sample data; use the labeled sample data to train the initial prediction model to obtain a preset fatigue state prediction model that meets the accuracy requirements.

[0101] In some embodiments, the continuous usage time of the target user using the doctor's console can be accumulated, and the target user's eye and / or facial features during the current time period, as well as the continuous usage time, can be comprehensively utilized to more accurately determine the target user's fatigue level.

[0102] In some embodiments, fatigue level thresholds (e.g., a preset first fatigue level threshold and a preset second fatigue level threshold) can be established in advance by learning and statistically analyzing historical experience records of a large number of users using the doctor's console. Furthermore, corresponding processing methods can be configured for different fatigue conditions. This allows for targeted processing based on the target's fatigue level in the current time period.

[0103] In some embodiments, the above-mentioned adjustment of the doctor's console according to the fatigue level of the target user in the current time period may include: determining not to adjust the posture of the doctor's console when the fatigue level of the target user in the current time period is less than or equal to a preset first fatigue level threshold; and obtaining the eye state features and / or facial state features of the target user in the next time period at preset time intervals.

[0104] Specifically, if the fatigue level of the target user in the current time period is less than or equal to the preset first fatigue level threshold, it can be determined that the target user has not yet started to feel fatigued. In this case, there is no need to adjust the doctor's console or change the preset time period. The target user's fatigue level can continue to be monitored according to the original preset time period.

[0105] In some embodiments, the above-mentioned adjustment of the doctor's console according to the fatigue level of the target user in the current time period may include: determining not to adjust the posture of the doctor's console when it is determined that the fatigue level of the target user in the current time period is greater than a preset first fatigue level threshold and less than or equal to a preset second fatigue level threshold; adjusting a preset time period and, after the adjusted preset time period, obtaining the eye state features and / or facial state features of the target user in the next time period.

[0106] Specifically, if the target user's fatigue level in the current time period is greater than the preset first fatigue level threshold and less than or equal to the preset second fatigue level threshold, it can be determined that the target user has begun to experience fatigue, but is not yet extremely fatigued. In this case, the doctor's console does not need to be adjusted. However, the preset time period can be shortened in a targeted manner. Based on the adjusted preset time period, the target user's fatigue level can be monitored at a higher monitoring frequency to track the target user's fatigue level in more real time and promptly detect when the target user has reached the critical state of extreme fatigue, requiring adjustment of the doctor's console.

[0107] In practice, the adjustment coefficient of the preset time period can be adjusted based on the fatigue level of the target user at the current time period to obtain a more reasonable preset time period. For example, when the fatigue level is high, the adjustment coefficient can be adjusted to a relatively small value, resulting in a relatively short preset time period and increasing the monitoring frequency. Conversely, when the fatigue level is low, the adjustment coefficient can be adjusted to a relatively large value, resulting in a relatively long preset time period and decreasing the monitoring frequency.

[0108] Specifically, fatigue levels can be divided into five levels (denoted as X1, X2, X3, X4, and X5), with different adjustment coefficients (e.g., 'a') set for each level, and the adjustment coefficient decreasing as the level progresses. For example, for the first level (X1), which corresponds to a fatigue level less than or equal to a preset first fatigue threshold, the adjustment coefficient a1 can be 1. For the fifth level (X5), which corresponds to a fatigue level greater than a preset second fatigue threshold, the adjustment coefficient a5 can be 0.5. Similarly, the adjustment coefficients a2, a3, and a4 corresponding to X2, X3, and X4 can be 0.9, 0.8, and 0.6, respectively.

[0109] In some embodiments, the above-mentioned adjustment of the doctor's console according to the fatigue level of the target user in the current time period may specifically include: determining to adjust the pose of the doctor's console when it is determined that the fatigue level of the target user in the current time period is greater than a preset second fatigue level threshold; determining second pose data of the doctor's console that matches the fatigue state of the target user in the current time period, and adjusting the pose of the doctor's console according to the second pose data.

[0110] Specifically, if the fatigue level of the target user in the current time period is determined to be greater than the preset second fatigue level threshold, it can be determined that the target user is currently extremely fatigued. In this case, in order to avoid the impact of fatigue on the target user's surgical operation, the doctor's console can be fine-tuned based on the second pose data to provide targeted relief for the target user's current fatigue position, thereby effectively alleviating the target user's fatigue state.

[0111] In some embodiments, see Figure 12 As shown, the second pose data of the doctor's console that is determined above and matches the fatigue state of the target user in the current time period can, in specific implementation, include the following:

[0112] S1: Acquire third-party image data and / or thermal imaging data containing the target user's body;

[0113] S2: Determine the fatigue location of the target user in the current time period based on third image data and / or thermal imaging data;

[0114] S3: Based on the fatigue location of the target user in the current time period, determine the second pose data of the doctor's console that matches the fatigue state of the target user in the current time period.

[0115] Specifically, the first acquisition terminal can acquire image data containing the target user's body as third image data, or acquire infrared thermal imaging data containing the target user's body as thermal imaging data.

[0116] In some embodiments, determining the fatigue location of the target user in the current time period based on the third image data and / or thermal imaging data may specifically include: determining the temperature anomaly location based on a preset reference template and thermal imaging data; and determining the temperature anomaly location as the fatigue location of the target user in the current time period based on the shape features reflected by the third image data.

[0117] Specifically, the aforementioned preset reference template can be obtained by clustering thermal imaging data of a large number of users using the doctor's console in a normal, fatigue-free state.

[0118] In addition, the aforementioned preset reference template can also be obtained based on the thermal imaging data collected by the first acquisition terminal before the target user starts using the doctor's console to perform surgical operations.

[0119] In practice, thermal imaging data can be compared with a preset reference template to identify temperature anomalies. Then, based on these anomalies, the data can be located in the third image data to pinpoint the fatigue location of the target user during the current time period.

[0120] Furthermore, based on the fatigue location of the target user during the current time period, and using ergonomics, a target component that helps alleviate fatigue at that fatigue location can be determined on the doctor's console, along with the pose data of that target component, as second pose data of the doctor's console that matches the fatigue state of the target user during the current time period.

[0121] Specifically, when determining the second pose data, the appropriate second pose data can be determined from the corresponding range of the first pose data, based on the target user's fatigue position during the current time period and the target user's body characteristics.

[0122] In addition, it can receive the position to be adjusted actively indicated by the target user; then, it can combine the target user's fatigue position in the current time period and the position to be adjusted actively indicated by the target user to determine the appropriate second pose data.

[0123] Next, based on the second pose data, the corresponding adjustment joint and its corresponding adjustment parameters can be determined. Then, by adjusting the corresponding adjustment joint according to the adjustment parameters, the pose of relevant components in the doctor's console can be fine-tuned.

[0124] This allows for targeted relief of fatigue accumulated at the target user's current fatigue location, reducing the user's fatigue and effectively minimizing the impact of operational fatigue on surgical procedures, thus ensuring the safety and reliability of the surgical operation.

[0125] Specifically, for example, see Figure 13As shown, based on the third image data acquired by the first acquisition end using the principle of binocular vision, the target user's physical characteristics, such as the degree of curvature or joint angles of the cervical spine, thoracic spine, lumbar spine, arms, and legs, can be determined. Based on these physical characteristics, an abnormal position that does not conform to ergonomics is identified as the cervical spine tilt angle θ3. Simultaneously, based on the thermal imaging data obtained by the first acquisition end using infrared thermal imaging technology to scan the target user's surface skin temperature, abnormal temperature locations A and B can be determined. Furthermore, by combining the above results, the fatigue location for the current time period and the corresponding second pose data can be determined. Further, based on the aforementioned second pose data, it can be determined that corresponding adjustments need to be made to the armrest adjustment joints and the rotation / position joints of the observation component on the doctor's console to correct the target user's current working posture and promptly relieve the fatigue felt by the target user.

[0126] In some embodiments, after adjusting the doctor's console pose based on the second pose data, the fatigue level of the target user can be monitored at a higher monitoring frequency to determine whether the target user's fatigue has been effectively improved. If it is determined that the target user's fatigue level has not been effectively improved, the second pose data can be re-determined so that the doctor's console pose can be adjusted again. Conversely, if it is determined that the target user's fatigue level has been effectively improved, the initial default preset time period can be restored, and the target user's fatigue level can continue to be monitored according to the preset time period.

[0127] In some embodiments, the method may further include the following: receiving feedback data from target users regarding their experience using the doctor's console; and adjusting at least one of the following based on the feedback data: a preset ergonomic simulation model, a preset time period, a preset fatigue state prediction model, a preset first fatigue threshold, a preset second fatigue threshold, a preset reference template, etc., to make the adjustment of the doctor's console more effective and reasonable, so that the target users can have a better user experience when using the doctor's console.

[0128] As can be seen from the above, based on the doctor console adjustment method provided in the embodiments of this specification, before the target user starts the doctor console to perform surgical operations, the current body shape characteristics of the target user can be obtained by first collecting and based on the first image data containing the target user's body; and based on the current body shape characteristics of the target user, the first pose data of the doctor console that matches the body shape of the target user is determined based on ergonomic technology; then, based on the first pose data, the poses of corresponding components in the doctor console, such as the observation component, the operation component, and the seat component, are automatically adjusted so that the poses of each component in the doctor console are in a comfortable pose state for the target user. Thus, the target user can perform surgical operations more efficiently and comfortably based on the doctor console adjusted above, effectively reducing the fatigue of the target user during the surgical process and enabling the target user to obtain a better user experience.

[0129] Furthermore, during the surgical procedure performed by the target user using the doctor's console, the system can determine the target user's fatigue level at preset time intervals by acquiring and analyzing the target user's eye and / or facial features during that time period. Based on the target user's fatigue level, the system can differentiate between different fatigue conditions and select the appropriate method to adjust the position and posture of the doctor's console accordingly.

[0130] Specifically, if the target user's fatigue level during the current time period is determined to be less than or equal to a preset first fatigue threshold, the doctor's console posture can be temporarily left unchanged, and the preset time period can be maintained. Based on the original preset time period, the target user's fatigue level can continue to be monitored at the original monitoring frequency. If the target user's fatigue level during the current time period is determined to be greater than the preset first fatigue threshold but less than or equal to a preset second fatigue threshold, the doctor's console posture can be temporarily left unchanged, but the preset time period can be shortened. Based on the adjusted preset time period, the target user's fatigue level can then be monitored at a higher monitoring frequency. If the target user's fatigue level during the current time period is determined to be greater than the preset second fatigue threshold, the doctor's console posture can be adjusted. Furthermore, second posture data for the doctor's console that matches the target user's fatigue state during the current time period can be determined. Then, the doctor's console posture can be fine-tuned based on this second posture data to alleviate the target user's fatigue in a timely manner. This allows the target user to have a better user experience and effectively reduces the impact of fatigue while operating the doctor's console on the surgical procedure.

[0131] See Figure 14 As shown in the embodiments of this specification, another method for adjusting the doctor's console is also provided. Specifically, this method may include the following:

[0132] S1401: At preset time intervals, obtain the eye state features and / or facial state features of the target user during the current time period.

[0133] S1402: Determine the fatigue level of the target user in the current time period based on the target user's eye and / or facial features in the current time period.

[0134] S1403: Adjust the doctor's console accordingly based on the target user's current fatigue level.

[0135] In some embodiments, adjusting the doctor's console pose according to the target user's fatigue level in the current time period can specifically include the following: If the target user's fatigue level in the current time period is less than or equal to a preset first fatigue threshold, determine not to adjust the doctor's console pose; at preset time intervals, acquire the target user's eye and / or facial features for the next time period. If the target user's fatigue level in the current time period is greater than the preset first fatigue threshold but less than or equal to a preset second fatigue threshold, determine not to adjust the doctor's console pose; adjust the preset time period, and at adjusted preset time intervals, acquire the target user's eye and / or facial features for the next time period. If the target user's fatigue level in the current time period is greater than the preset second fatigue threshold, determine to adjust the doctor's console pose; determine second pose data for the doctor's console that matches the target user's fatigue level in the current time period, and adjust the doctor's console pose based on the second pose data.

[0136] This specification also provides a computer device, including a processor and a memory for storing processor-executable instructions. In specific implementation, the processor can perform the following steps according to the instructions: acquiring and obtaining the current body features of the target user based on first image data containing the target user's body; determining first pose data of the doctor's console that matches the target user's body based on the current body features of the target user; and adjusting the pose of the corresponding components in the doctor's console based on the first pose data.

[0137] See Figure 15As shown in the embodiments of this specification, an adjustment system for a doctor's console is also provided. The adjustment system for the doctor's console may include at least: a first acquisition terminal 1501 and a processor 1502. The adjustment system for the doctor's console is connected to the doctor's console. Specifically, the first acquisition terminal 1501 can be used to acquire and obtain the current body features of the target user based on first image data containing the target user's body. Specifically, the processor 1502 can be used to determine, based on the current body features of the target user, a first pose data of the doctor's console that matches the target user's body shape; and adjust the pose of corresponding components in the doctor's console based on the first pose data.

[0138] Furthermore, the adjustment system of the aforementioned doctor console may also include a second acquisition terminal 1503, which can be used to acquire the eye state characteristics and / or facial state characteristics of the target user at preset time intervals; the processor 1502 can be used to determine the fatigue level of the target user at the current time interval based on the eye state characteristics and / or facial state characteristics of the target user at the current time interval; and to make corresponding adjustments to the doctor console based on the fatigue level of the target user at the current time interval.

[0139] In addition, the adjustment system of the aforementioned doctor's console may also include a memory 1504, which may be used to store the relevant instruction program on which the processor 1502 is based.

[0140] In this embodiment, the first acquisition end 1501 may specifically include an acquisition device that supports binocular vision and infrared thermal imaging functions. The second acquisition end 1503 may specifically include an acquisition device that supports the acquisition of fine features such as facial state features and / or eye state features.

[0141] In this embodiment, the processor 1503 can be implemented in any suitable manner. For example, the processor can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers, etc. This specification is not limiting.

[0142] In this embodiment, the memory 1504 may include multiple layers. In a digital system, anything that can store binary data can be a memory. In an integrated circuit, a circuit with storage function but no physical form is also called a memory, such as RAM, FIFO, etc. In a system, a storage device with a physical form is also called a memory, such as a memory stick, TF card, etc.

[0143] This specification also provides a computer-readable storage medium based on the above-described adjustment method for the doctor's console. The computer-readable storage medium stores computer program instructions that, when executed, perform the following: acquiring and obtaining the current body features of the target user based on first image data containing the target user's body; determining, based on the current body features of the target user, first pose data of the doctor's console that matches the target user's body shape; and adjusting the pose of the corresponding components in the doctor's console based on the first pose data.

[0144] This specification also provides another computer-readable storage medium based on the above-described adjustment method for the doctor's console. The computer-readable storage medium stores computer program instructions that, when executed, perform the following: at preset time intervals, acquire the eye and / or facial features of the target user during the current time period; determine the fatigue level of the target user during the current time period based on the eye and / or facial features; and adjust the doctor's console accordingly based on the fatigue level of the target user during the current time period.

[0145] In this embodiment, the storage medium includes, but is not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), cache, hard disk drive (HDD), or memory card. The memory can be used to store computer program instructions. The network communication unit can be an interface configured according to standards specified in the communication protocol for network connection communication.

[0146] In this embodiment, the specific functions and effects implemented by the program instructions stored in the computer-readable storage medium can be explained in comparison with other embodiments, and will not be repeated here.

[0147] See Figure 16 As shown, at the software level, this embodiment of the specification also provides an adjustment device for a doctor's console, which may specifically include the following structural modules:

[0148] The acquisition module 1601 can be used to collect and obtain the current body features of the target user based on the first image data containing the target user's body.

[0149] The determination module 1602 can be used to determine the first pose data of the doctor's console that matches the target user's body shape based on the target user's current body shape characteristics.

[0150] The adjustment module 1603 can be used to adjust the position and pose of the corresponding components in the doctor's console based on the first pose data.

[0151] In some embodiments, when the acquisition module 1601 is specifically implemented, it can acquire first image data containing the target user's body in the following manner: detect whether a start command initiated by the target user for the doctor's console is received; if it is determined that a start command initiated by the target user has been received, acquire first image data containing the target user's body.

[0152] In some embodiments, the physical features may specifically include at least one of the following: the degree of curvature and / or joint angle of the cervical spine, the degree of curvature and / or joint angle of the thoracic spine, the degree of curvature and / or joint angle of the lumbar spine, the degree of curvature and / or joint angle of the arm, the degree of curvature and / or joint angle of the leg, etc.

[0153] In some embodiments, when the determination module 1602 is specifically implemented, it can determine the first pose data of the doctor's console that matches the target user's body shape based on the target user's current body shape characteristics in the following manner: process the target user's current body shape characteristics using a preset ergonomic simulation model to obtain the corresponding simulation results; and determine the first pose data of the doctor's console that matches the target user's body shape based on the simulation results.

[0154] In some embodiments, when the adjustment module 1603 is specifically implemented, it can adjust the pose of the corresponding component in the doctor's console according to the first pose data in the following manner: obtain the current pose data of each component in the doctor's console; determine the pose adjustment data of each component in the doctor's console according to the first pose data and the current pose data of each component in the doctor's console; and adjust the position and angle of the corresponding component in the doctor's console according to the pose adjustment data of each component in the doctor's console.

[0155] In some embodiments, see Figure 17 As shown, the adjustment device of the aforementioned doctor's console may further include a monitoring module 1604 and a fine-tuning module 1605. Specifically, the monitoring module 1604 can be used to acquire the eye and / or facial features of the target user at preset time intervals; and determine the fatigue level of the target user at the current time interval based on these features. Specifically, the fine-tuning module 1605 can be used to make corresponding adjustments to the doctor's console based on the fatigue level of the target user at the current time interval.

[0156] In some embodiments, when the monitoring module 1604 is specifically implemented, it can obtain the eye state features and / or facial state features of the target user in the current time period in the following manner: collecting second image data containing the eyes and / or face of the target user in the current time period; extracting the eye state features and / or facial state features of the target user in the current time period from the second image data of the current time period.

[0157] In some embodiments, when the monitoring module 1604 is specifically implemented, it can determine the fatigue level of the target user in the current time period based on the eye state characteristics and / or facial state characteristics of the target user in the current time period in the following manner: using a preset fatigue state prediction model to process the eye state characteristics and / or facial state characteristics of the target user in the current time period to obtain the corresponding prediction results; and determining the fatigue level of the target user in the current time period based on the prediction results.

[0158] In some embodiments, when the fine-tuning module 1605 is specifically implemented, it can adjust the doctor's console according to the fatigue level of the target user in the current time period in the following manner: if it is determined that the fatigue level of the target user in the current time period is less than or equal to a preset first fatigue level threshold, it is determined not to adjust the position of the doctor's console; at preset time intervals, the eye state features and / or facial state features of the target user in the next time period are obtained.

[0159] In some embodiments, when the fine-tuning module 1605 is specifically implemented, it can adjust the doctor's console according to the fatigue level of the target user in the current time period in the following manner: if it is determined that the fatigue level of the target user in the current time period is greater than a preset first fatigue level threshold and less than or equal to a preset second fatigue level threshold, it is determined not to adjust the pose of the doctor's console; adjust the preset time period, and at intervals of the adjusted preset time period, obtain the eye state features and / or facial state features of the target user in the next time period.

[0160] In some embodiments, when the fine-tuning module 1605 is specifically implemented, it can adjust the doctor's console according to the fatigue level of the target user in the current time period in the following manner: when it is determined that the fatigue level of the target user in the current time period is greater than a preset second fatigue level threshold, the pose of the doctor's console is adjusted; second pose data of the doctor's console that matches the fatigue state of the target user in the current time period is determined, and the pose of the doctor's console is adjusted according to the second pose data.

[0161] In some embodiments, when the fine-tuning module 1605 is specifically implemented, it can determine the second pose data of the doctor's console that matches the fatigue state of the target user in the current time period in the following manner: acquiring third image data and / or thermal imaging data containing the target user's body; determining the fatigue location of the target user in the current time period based on the third image data and / or thermal imaging data; and determining the second pose data of the doctor's console that matches the fatigue state of the target user in the current time period based on the fatigue location of the target user in the current time period.

[0162] In some embodiments, when the fine-tuning module 1605 is specifically implemented, it can determine the fatigue location of the target user in the current time period based on the third image data and / or thermal imaging data in the following manner: based on the preset reference template and thermal imaging data, the temperature abnormality location is determined in the third image data; and the temperature abnormality location is determined as the fatigue location of the target user in the current time period.

[0163] This manual also provides an alternative adjustment device for the doctor's console, which may include the following structural modules:

[0164] The acquisition module can be used to acquire the eye and / or facial features of a target user at preset time intervals.

[0165] The determination module can be used to determine the fatigue level of a target user based on the target user's eye and / or facial features during the current time period.

[0166] The fine-tuning module can be used to adjust the doctor's console according to the fatigue level of the target user at the current time.

[0167] It should be noted that the units, devices, or modules described in the above embodiments can be implemented by computer chips or physical entities, or by products with certain functions. For ease of description, the above devices are described by dividing them into various modules according to their functions. Of course, in implementing this specification, the functions of each module can be implemented in one or more software and / or hardware, or the module that implements the same function can be implemented by a combination of multiple sub-modules or sub-units, etc. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection between the devices or units shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or units can be electrical, mechanical, or other forms.

[0168] As can be seen from the above, based on the adjustment device of the doctor's console provided in the embodiments of this specification, before the target user starts the doctor's console to perform surgical operations, it can first collect and obtain the target user's current body shape characteristics based on the first image data containing the target user's body; and based on the target user's current body shape characteristics, determine the first pose data of the doctor's console that matches the target user's body shape; then, based on the first pose data, automatically adjust the poses of corresponding components in the doctor's console, such as the observation component, the operation component, and the seat component, so that the poses of each component in the doctor's console are in a comfortable pose state for the target user. Therefore, the target user can perform surgical operations more efficiently and comfortably based on the adjusted doctor's console, reducing the target user's fatigue during the surgical process and providing a better user experience.

[0169] While this specification provides the steps of operation for the methods described in the embodiments or flowcharts, more or fewer steps may be included based on conventional or non-inventive means. The order of steps listed in the embodiments is merely one possible order of execution among many steps and does not represent the only possible order. In actual device or client product execution, the methods shown in the embodiments or drawings may be executed sequentially or in parallel (e.g., in a parallel processor or multi-threaded processing environment, or even a distributed data processing environment). The terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, product, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, product, or apparatus. Without further limitations, the presence of other identical or equivalent elements in a process, method, product, or apparatus that includes said elements is not excluded. The terms "first," "second," etc., are used to denote names and do not indicate any particular order.

[0170] Those skilled in the art will also know that, besides implementing the controller using purely computer-readable program code, the same functions can be achieved by logically programming the method steps, making the controller function as logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers (PLCs), and embedded microcontrollers. Therefore, such a controller can be considered a hardware component, and the devices within it used to implement various functions can also be considered structures within that hardware component. Alternatively, the devices used to implement various functions can be considered as both software modules implementing the method and structures within a hardware component.

[0171] This specification can be described in the general context of computer-executable instructions that are executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, classes, etc., that perform a specific task or implement a specific abstract data type. This specification can also be practiced in distributed computing environments, where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer-readable storage media, including storage devices.

[0172] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that this specification can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions of this specification can essentially be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, mobile terminal, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments of this specification.

[0173] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to interchangeably. Each embodiment focuses on its differences from other embodiments. This specification can be used in numerous general-purpose or special-purpose computer system environments or configurations. Examples include: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable electronic devices, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices, etc.

[0174] Although this specification has been described by way of examples, those skilled in the art will recognize that many variations and modifications are possible without departing from the spirit of this specification, and it is intended that the appended claims cover such variations and modifications without departing from the spirit of this specification.

Claims

1. A method for adjusting a doctor's control console, characterized in that, include: Before launching the doctor's console to perform the surgical procedure, the target user's current physical characteristics are acquired based on the first image data containing the target user's body. The shape features are used to reflect the degree of curvature and / or joint angles of different human tissues and structures; Based on the target user's current body shape characteristics, determine the first pose data of the doctor's console that matches the target user's body shape; Based on the first pose data, adjust the pose of the corresponding components in the doctor's console; During the surgical procedure using the doctor's console, at preset time intervals, the system acquires and determines the target user's fatigue level based on the target user's eye and / or facial features at that time interval. Based on the target user's current fatigue level, different fatigue conditions are distinguished, and the corresponding treatment method is selected to adjust the doctor's console posture accordingly.

2. The method for adjusting the doctor's console according to claim 1, characterized in that, Acquire first image data containing the target user's body, including: Check if a launch command for the doctor's console has been received from the target user; Upon confirming receipt of a startup command initiated by the target user, first image data containing the target user's body is acquired.

3. The method for adjusting the doctor's console according to claim 1, characterized in that, The physical features include at least one of the following: the degree of curvature and / or joint angle of the cervical spine, the degree of curvature and / or joint angle of the thoracic spine, the degree of curvature and / or joint angle of the lumbar spine, the degree of curvature and / or joint angle of the arm, and the degree of curvature and / or joint angle of the leg.

4. The method for adjusting the doctor's console according to claim 1, characterized in that, Based on the target user's current body shape characteristics, determine the first pose data of the doctor's console that matches the target user's body shape, including: The target user's current body features are processed using a pre-set ergonomic simulation model to obtain the corresponding simulation results; Based on the simulation results, the first pose data of the doctor's console that matches the shape of the target user is determined.

5. The method for adjusting the doctor's console according to claim 1, characterized in that, Based on the first pose data, adjust the pose of the corresponding components in the doctor's console, including: Obtain the current pose data of each component in the doctor's console; Based on the first pose data and the current pose data of each component in the doctor's console, the pose adjustment data of each component in the doctor's console is determined. Adjust the position and angle of the corresponding components in the doctor's console based on the pose adjustment data of each component.

6. The method for adjusting the doctor's console according to claim 1, characterized in that, After adjusting the pose of the corresponding components in the doctor's console based on the first pose data, the method further includes: At preset time intervals, obtain the eye and / or facial features of the target user during the current time period. Determine the target user's fatigue level based on their eye and / or facial features during the current time period. Adjust the doctor's console accordingly based on the target user's current level of fatigue.

7. The method for adjusting the doctor's console according to claim 6, characterized in that, Obtain the target user's eye and / or facial features for the current time period, including: Collect second image data containing the target user's eyes and / or face during the current time period; From the second image data of the current time period, extract the eye state features and / or facial state features of the target user for the current time period.

8. The method for adjusting the doctor's console according to claim 6, characterized in that, Based on the target user's eye and / or facial features during the current time period, determine the target user's fatigue level during the current time period, including: The eye and / or facial features of the target user in the current time period are processed using a pre-set fatigue state prediction model to obtain the corresponding prediction results. Based on the prediction results, the fatigue level of the target user in the current time period is determined.

9. The method for adjusting the doctor's console according to claim 6, characterized in that, Based on the target user's current fatigue level, the doctor's console will be adjusted accordingly, including: If the fatigue level of the target user in the current time period is less than or equal to the preset first fatigue level threshold, the doctor's console posture is not adjusted; at preset time intervals, the eye state features and / or facial state features of the target user in the next time period are obtained.

10. The method for adjusting the doctor's console according to claim 6, characterized in that, Based on the target user's current fatigue level, the doctor's console will be adjusted accordingly, including: If the fatigue level of the target user in the current time period is determined to be greater than the preset first fatigue level threshold and less than or equal to the preset second fatigue level threshold, the doctor's console pose is not adjusted; the preset time period is adjusted, and the eye state features and / or facial state features of the target user in the next time period are obtained at intervals after the adjustment.

11. The method for adjusting the doctor's console according to claim 6, characterized in that, Based on the target user's current fatigue level, the doctor's console will be adjusted accordingly, including: If the fatigue level of the target user in the current time period is determined to be greater than the preset second fatigue level threshold, the pose of the doctor's console is adjusted; second pose data of the doctor's console that matches the fatigue state of the target user in the current time period is determined, and the pose of the doctor's console is adjusted according to the second pose data.

12. The method for adjusting the doctor's console according to claim 11, characterized in that, Determine the second pose data of the doctor's console that matches the fatigue state of the target user at the current time period, including: Collect third-party image data and / or thermal imaging data containing the target user's body; Based on third-party image data and / or thermal imaging data, determine the fatigue location of the target user in the current time period; Based on the target user's fatigue location during the current time period, determine the second pose data of the doctor's console that matches the target user's fatigue state during the current time period.

13. A method for adjusting a doctor's control console, characterized in that, include: At preset time intervals, obtain the eye and / or facial features of the target user during the current time period. Determine the target user's fatigue level based on their eye and / or facial features during the current time period. Adjust the doctor's console accordingly based on the target user's current fatigue level. Furthermore, the method further includes: before activating the doctor's console to perform surgical operations, acquiring and obtaining the current physical characteristics of the target user based on first image data containing the target user's body; The body features are used to reflect the degree of curvature and / or joint angle of different human tissues; based on the target user's current body features, determine the first pose data of the doctor's console that matches the target user's body shape; based on the first pose data, adjust the position and pose of the corresponding components in the doctor's console.

14. An adjustment system for a doctor's console, characterized in that, It includes at least a first acquisition end and a processor. The adjustment system of the doctor's console is connected to the doctor's console. The first acquisition end is used to acquire and obtain the current body features of the target user based on the first image data containing the target user's body before starting the doctor's console to perform surgical operations. The processor is used to determine the first pose data of the doctor's console that matches the target user's current body shape based on the target user's current body shape characteristics; and to adjust the pose of the corresponding components in the doctor's console based on the first pose data. Furthermore, the adjustment system of the doctor's console is also used to determine the fatigue level of the target user at preset time intervals during the surgical operation using the doctor's console, based on the target user's eye state characteristics and / or facial state characteristics at the current time interval. Based on the target user's current fatigue level, different fatigue conditions are distinguished, and the corresponding treatment method is selected to adjust the doctor's console posture accordingly.

15. A computer-readable storage medium, characterized in that, It stores computer instructions that, when executed by a processor, implement the steps of the method according to any one of claims 1 to 12 or 13.

Images