Display device, control method of display device, electronic apparatus, and storage medium

Abstract

The invention discloses a display device, a control method of the display device, electronic equipment and a storage medium. The device comprises a display component and a sensing component, the controller is used for receiving a to-be-completed task sequence through the display screen and displaying the to-be-completed task sequence through the display screen, and the to-be-completed task sequence comprises at least one subtask; setting task durations corresponding to the subtasks; determining a target sub-task and a target task duration corresponding to the processing instruction in the to-be-completed task sequence; when the target object is sensed in the sensing range of the sensing assembly, monitoring a first duration of the target object in the sensing range; determining residual duration according to the first duration and the target task duration; the monitoring module is also used for monitoring a second duration when the residual duration is greater than the preset residual duration and the target object is not sensed in the sensing range; and when the second duration is greater than the preset interruption duration, generating prompt information. In the embodiment of the invention, the time required for completing the task can be reminded in real time.

Description

Technical Field

[0001] The present application belongs to the field of screen control technology, and in particular, relates to a display device, a control method for a display device, an electronic device, and a storage medium. Background Art

[0002] With the rapid development of modern technology, screen display technology has become an indispensable part of our daily life. From smartphones and tablets to TVs and public display systems, screens are everywhere. However, despite the remarkable progress of screen technology, it still has some inherent limitations and challenges, which are particularly evident in certain application scenarios.

[0003] Take the hairdressing industry as an example. Traditional haircut services usually rely on manual timekeeping and verbal communication between customers and barbers. In this model, customers' perception of service time mainly depends on the barber's notification and their own estimation. This makes it impossible for customers to accurately estimate the remaining time, which may affect the arrangement of other matters. In addition, in the case of large flow of people, barbers may not be able to accurately grasp the time, resulting in service delays or hasty completion.

[0004] Therefore, it becomes particularly important to remind users of time changes in real time through a display device. Summary of the invention

[0005] The present application aims to solve at least one of the technical problems existing in the prior art, and to provide a display device, a control method for a display device, an electronic device and a storage medium, which can remind in real time the time required to complete a task.

[0006] In a first aspect, the present application provides a display device, comprising: The display assembly comprises an assembly body and a display screen, wherein the display screen is embedded in the assembly body; A sensing component connected to the display component, the sensing component is used to sense a target object within a sensing range; A controller is connected to the display component and the sensing component, and is used to receive a sequence of tasks to be completed through the display screen, and display the sequence of tasks to be completed through the display screen, wherein the sequence of tasks to be completed includes at least one subtask; for each subtask, a task duration corresponding to the subtask is set; a processing instruction is received through the display screen, and a target subtask corresponding to the processing instruction and a target task duration corresponding to the target subtask are determined in the sequence of tasks to be completed; when a target object is sensed within the sensing range of the sensing component, a first duration during which the target object is in the sensing range is monitored; a remaining duration is determined based on the first duration and the target task duration, and the remaining duration is displayed through the display screen; and when the remaining duration is greater than a preset remaining duration and the target object is not sensed within the sensing range of the sensing component, a second duration during which the target object is not in the sensing range is monitored; when the second duration is greater than a preset interruption duration, a prompt message is generated.

[0007] According to some embodiments of the present application, the sensing component includes a visual acquisition module, a transmitting module and a receiving module, the transmitting module is used to send an infrared transmission signal, and the receiving module is used to receive an infrared reflection signal, wherein the infrared reflection signal is obtained by reflecting the infrared transmission signal from the target object; the visual acquisition module is used to capture a motion image of the target object.

[0008] According to some embodiments of the present application, the display device also includes a sound playback component, which is disposed on the component body; the controller is also used to generate an audio playback signal and send the audio playback signal to the sound playback component so that the sound playback component plays audio.

[0009] In a second aspect, an embodiment of the present application provides a control method for a display device, which is applied to the display device as described in the first aspect, and the control method includes: Receiving a sequence of tasks to be completed through the display screen, and displaying the sequence of tasks to be completed through the display screen, wherein the sequence of tasks to be completed includes at least one subtask; For each subtask, set the task duration corresponding to the subtask; Receiving a processing instruction through the display screen, and determining a target subtask corresponding to the processing instruction and a target task duration corresponding to the target subtask in the sequence of tasks to be completed; When a target object is sensed within a sensing range of the sensing component, monitoring a first duration of time during which the target object is within the sensing range; Determine a first remaining time according to the first duration and the target task duration, and display the first remaining time on the display screen; When the first remaining time is greater than a preset remaining time and the target object is not sensed within the sensing range of the sensing component, monitoring a second continuous time during which the target object is not within the sensing range; When the second duration is greater than the preset interruption duration, a prompt message is generated.

[0010] According to some embodiments of the present application, after determining a first remaining duration according to the duration and the target task duration, and displaying the first remaining duration on the display screen, the method further includes: Determine the total task duration to complete the sequence of tasks to be completed, and determine the final tasks and non-final tasks in the sequence of tasks to be completed; When the first remaining time is less than or equal to the preset remaining time, generating task completion information; When no extension instruction is received within the preset duration, and the target subtask is the non-end task, determining the next to-be-completed task of the target subtask in the to-be-completed task sequence, and determining the to-be-completed task duration corresponding to the to-be-completed task, wherein the preset duration is less than the first remaining duration; Recording a third duration of time that the target object is within the sensing range; The total task duration is adjusted according to the third duration and the duration of the task to be completed.

[0011] According to some embodiments of the present application, after generating task completion information when the first remaining time is less than or equal to a preset remaining time, the method further includes: When an extension instruction is received within a preset time period, determining an extension time period corresponding to the extension instruction; The extended duration is added to the remaining duration to obtain the target duration.

[0012] According to some embodiments of the present application, adjusting the total task duration according to the third duration and the duration of the task to be completed includes: Determine a second remaining duration according to the third duration and the duration of the task to be completed; When the to-be-completed task is the final task, all subtasks before the to-be-completed task are determined according to the to-be-completed task sequence to obtain a completed task set; Counting the time consumed to complete all subtasks in the completed task set, and determining the cumulative consumed time according to the third duration and the consumed time; Calculate the time difference between the accumulated consumed time and the total task time; When the duration difference is greater than or equal to a preset difference threshold, the duration of the task to be completed is shortened to adjust the total task duration.

[0013] According to some embodiments of the present application, the sensing component further includes a visual acquisition module; and the method further includes: Collecting the action image of the target object through the visual acquisition module; Performing gesture detection on the action image according to a preset image processing algorithm to obtain a target gesture area; Extracting features of the target gesture area based on a preset convolutional neural network to obtain gesture features; Determining a gesture instruction corresponding to the gesture feature in a preset gesture feature library; The gesture instruction is sent to the display screen so that the display screen displays instruction information corresponding to the gesture instruction.

[0014] In a third aspect, the present application provides an electronic device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the control method of the display device as described in the second aspect is implemented.

[0015] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to execute the control method of the display device described in the second aspect.

[0016] According to the control method of the display device provided by the embodiment of the present application, there are at least the following beneficial effects: the display device includes a display component and a sensing component, the controller is connected to the display component and the sensing component, the controller is used to receive a sequence of tasks to be completed through a display screen, that is, the tasks to be completed input by the user, and display the sequence of tasks to be completed through the display screen, thereby realizing a visual display of the sequence of tasks to be completed, and the sequence of tasks to be completed includes at least one subtask to be completed. For each subtask, a task duration corresponding to the subtask is set to realize advance planning of the task duration, so that the user can reasonably arrange the time required for different tasks, and then receive a processing instruction through the display screen, and determine the target subtask corresponding to the processing instruction in the sequence of tasks to be completed, that is, the target subtask that needs to be completed currently, and determine the target task duration corresponding to the target subtask, so that the user can preliminarily determine the target task duration for completing the target subtask, which is convenient for subsequent arrangement of other matters. When the target object is sensed within the sensing range of the sensing component, it means that the target object is processing the target subtask. At this time, the first duration of the target object being in the sensing range is monitored, that is, the duration of the target object processing the target subtask, and then the remaining time to complete the target subtask is determined based on the first duration and the target task duration, and the remaining time is displayed on the display screen, thereby realizing the real-time display of the duration of executing the target subtask, which is convenient for the target object to reasonably plan and arrange time, so that the target object can accurately grasp the changes in time. When the remaining time is greater than the preset remaining time, and the target object is not sensed within the sensing range of the sensing component, it means that the current target subtask is not completed, and the target object is not processing the target subtask. At this time, it is necessary to monitor the second duration of the target object not being in the sensing range, that is, the duration of the target object leaving. When the second duration is greater than the preset interruption duration, it means that the target object has been away for too long, and a prompt message needs to be generated to prompt the target object that it has been away for too long. The embodiment of the present application realizes reasonable planning of the execution time of subtasks in a task sequence to be completed through the mutual cooperation of the display component and the sensing component, and can remind the user in real time the time required to complete the task, so that the user can accurately estimate the remaining time and it is convenient for the user to reasonably arrange the subsequent time.

[0017] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained through the structures particularly pointed out in the description and the drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings are used to provide further understanding of the technical solution of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the technical solution of the present application and do not constitute a limitation on the technical solution of the present application.

[0019] Figure 1 is a schematic diagram of a display device provided by an embodiment of the present application; Figure 2 is a screen diagram of a display screen provided by an embodiment of the present application; Figure 3 It is a schematic diagram of a display component showing a sequence of tasks to be completed provided by an embodiment of the present application; Figure 4 is a flow chart of a method for controlling a display device provided by an embodiment of the present application; Figure 5 is a flow chart of a method for controlling a display device provided by another embodiment of the present application; Figure 6 is a flow chart of a method for controlling a display device provided by another embodiment of the present application; Figure 7 yes Figure 5 The specific method flow chart of step S205 in FIG. Figure 8 is a flow chart of a method for controlling a display device provided by another embodiment of the present application; Fig. 9 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0021] It should be noted that although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than that in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0022] With the rapid development of modern technology, screen display technology has become an indispensable part of our daily life. From smartphones and tablets to TVs and public display systems, screens are everywhere. However, despite the remarkable progress of screen technology, it still has some inherent limitations and challenges, which are particularly evident in certain application scenarios.

[0023] Take the hairdressing industry as an example. Traditional haircut services usually rely on manual timekeeping and verbal communication between customers and barbers. In this model, customers' perception of service time mainly depends on the barber's notification and their own estimation. This leads to customers being unable to accurately estimate the remaining time, which may affect the customer's arrangement of other matters; and in the case of large traffic, the barber may not be able to accurately grasp the time, resulting in problems such as service delays or hasty completion. In addition, if customers do not know the waiting time, they may feel anxious and impatient.

[0024] Therefore, it becomes particularly important to remind users of time changes in real time through a display device.

[0025] In order to solve the above problems, the present embodiment provides a control method for a display device, wherein the display device includes a display component and a sensing component, and a controller is connected to the display component and the sensing component. The controller is used to receive a sequence of tasks to be completed through a display screen, that is, tasks to be completed input by a user, and display the sequence of tasks to be completed through the display screen, thereby realizing a visual display of the sequence of tasks to be completed, and the sequence of tasks to be completed includes at least one subtask to be completed. For each subtask, a task duration corresponding to the subtask is set to realize advance planning of the task duration, so that the user can reasonably arrange the time required for different tasks, and then receive a processing instruction through the display screen, and determine the target subtask corresponding to the processing instruction in the sequence of tasks to be completed, that is, the target subtask that needs to be completed currently, and determine the target task duration corresponding to the target subtask, so that the user can preliminarily determine the target task duration for completing the target subtask, which is convenient for subsequent arrangement of other matters. When the target object is sensed within the sensing range of the sensing component, it means that the target object is processing the target subtask. At this time, the first duration of the target object being in the sensing range is monitored, that is, the duration of the target object processing the target subtask, and then the remaining time to complete the target subtask is determined based on the first duration and the target task duration, and the remaining time is displayed on the display screen, thereby realizing the real-time display of the duration of executing the target subtask, which is convenient for the target object to reasonably plan and arrange time, so that the target object can accurately grasp the changes in time. When the remaining time is greater than the preset remaining time, and the target object is not sensed within the sensing range of the sensing component, it means that the current target subtask is not completed, and the target object is not processing the target subtask. At this time, it is necessary to monitor the second duration of the target object not being in the sensing range, that is, the duration of the target object leaving. When the second duration is greater than the preset interruption duration, it means that the target object has been away for too long, and a prompt message needs to be generated to prompt the target object that it has been away for too long. The embodiment of the present application realizes reasonable planning of the execution time of subtasks in a task sequence to be completed through the mutual cooperation of the display component and the sensing component, and can remind the user in real time the time required to complete the task, so that the user can accurately estimate the remaining time and it is convenient for the user to reasonably arrange the subsequent time.

[0026] The embodiments of the present application are further described below in conjunction with the accompanying drawings.

[0027] refer to Figure 1 , Figure 1 It is a schematic diagram of a display device provided by an embodiment of the present application.

[0028] In some embodiments, the display device includes a display component, a sensing component and a controller. The display component includes a component body 100 and a display screen 200, wherein the display screen 200 is embedded in the component body; the sensing component is connected to the display component, and the sensing component 300 is used to sense a target object within a sensing range.

[0029] It is worth noting that the component body 100 of the display component can be a mirror body, a box body, etc., and different types of component bodies 100 can be selected according to different application scenarios. Taking the beauty and hairdressing scene as an example, the component body 100 at this time can be a mirror body. Taking the work and study scene as an example, the component body 100 at this time can be a box body. The embodiment of the present application does not specifically limit the selection of the component body 100.

[0030] In some embodiments, the sensing component 300 includes a visual acquisition module, a transmitting module and a receiving module. The transmitting module is used to send an infrared transmission signal, and the receiving module is used to receive an infrared reflection signal, wherein the infrared reflection signal is obtained by reflecting the infrared transmission signal from the target object. The cooperation of the transmitting module and the receiving module realizes accurate detection of the target object, and the propagation speed of the infrared signal is extremely fast, and the target object can be detected in real time or near real time. The visual acquisition module is used to collect the action image of the target object, thereby realizing the real-time acquisition of the action of the target object, which is convenient for the subsequent analysis of the action emitted by the target object.

[0031] It should be noted that the intensity and frequency of the infrared emission signal in the embodiment of the present application can be adjusted as needed to adapt to different detection distances and accuracy requirements.

[0032] It can be understood that the visual acquisition module in the embodiment of the present application includes but is not limited to industrial cameras, digital cameras, line scan cameras, etc., and the embodiment of the present application does not make specific limitations.

[0033] refer to Figure 2 , Figure 2 It is a screen diagram of a display screen 200 provided in one embodiment of the present application.

[0034] In some embodiments, the user can input a sequence of tasks to be completed, that is, the tasks that the user wants to perform, by touching the display screen 200. Specifically, the display screen 200 of the embodiment of the present application can be provided with a keyboard input area, that is, the user can input multiple subtasks through the keyboard on the display screen 200, and sort the multiple subtasks to obtain a sequence of tasks to be completed; the display screen 200 can also be provided with multiple task options, and the user selects the corresponding subtasks by clicking on different task options on the display screen 200, and then sorts and organizes the subtasks to obtain a sequence of tasks to be completed. The embodiment of the present application does not specifically limit the screen display mode of the display screen 200.

[0035] Specifically, Figure 2 The display screen 200 may also be provided with a plurality of task options for display. Figure 2 It can be seen that the display screen 200 includes two areas, one area is the "selected subtask" area, where the target object can sort the selected subtasks, and the other area is the "option" area, where the target object can select the subtasks to be completed. Taking the haircut scene as an example, four task options are set on the display screen 200, namely, a shampoo button, a haircut button, a hairblow button, and a care button. The barber can select different subtasks by clicking different buttons on the display screen 200, and sort the selected subtasks to obtain a to-be-completed task sequence of shampooing-hairblow-haircut-care, and then perform corresponding operations according to the sequence.

[0036] refer to Figure 3 , Figure 3 This is a schematic diagram of a display component provided by an embodiment of the present application showing a sequence of tasks to be completed.

[0037] In some embodiments, the controller is connected to the display component and the sensing component 300, and the controller is used to receive the sequence of tasks to be completed through the display screen 200, that is, the tasks to be completed input by the user, and display the sequence of tasks to be completed through the display screen 200, so as to realize the visual display of the sequence of tasks to be completed, and the sequence of tasks to be completed includes at least one subtask to be completed. For each subtask, the task duration corresponding to the subtask is set to realize the advance planning of the task duration, so that the user can reasonably arrange the time required for different tasks, and then receive the processing instruction through the display screen 200, and determine the target subtask corresponding to the processing instruction in the sequence of tasks to be completed, that is, the target subtask that needs to be completed currently, and determine the target task duration corresponding to the target subtask, so that the user can preliminarily determine the target task duration for completing the target subtask, which is convenient for the subsequent arrangement of other matters. When the target object is sensed within the sensing range of the sensing component 300, it means that the target object is processing the target subtask. At this time, the first duration of the target object being in the sensing range is monitored, that is, the duration of the target object processing the target subtask, and then the remaining time to complete the target subtask is determined based on the first duration and the target task duration, and the remaining time is displayed through the display screen 200, thereby realizing the real-time display of the duration of executing the target subtask, which is convenient for the target object to reasonably plan and arrange time, so that the target object can accurately grasp the change of time. When the remaining time is greater than the preset remaining time, and the target object is not sensed within the sensing range of the sensing component 300, it means that the current target subtask is not completed, and the target object is not processing the target subtask. At this time, it is necessary to monitor the second duration of the target object not being in the sensing range, that is, the duration of the target object leaving. When the second duration is greater than the preset interruption duration, it means that the target object has left for too long, and a prompt message needs to be generated to prompt the target object to leave for too long. The embodiment of the present application realizes reasonable planning of the execution time of subtasks in the task sequence to be completed through the mutual cooperation of the display component and the sensing component 300, and can remind the user in real time the time required to complete the task, so that the user can accurately estimate the remaining time and facilitate the user to reasonably arrange the subsequent time.

[0038] In some embodiments, the display device also includes a sound playback component, which is disposed on the component body 100; the controller is also used to generate an audio playback signal and send the audio playback signal to the sound playback component so that the sound playback component plays audio, thereby being able to remind the user or target object through the sound playback component that the current task is not completed, or to play music through the sound playback component to soothe the mood of the user or target object and avoid anxiety and irritability caused by long waiting of the user.

[0039] It should be noted that the sound playing component in the embodiment of the present application may be provided with one or more. Specifically, when there are multiple sound playing components, the sound playing components may be symmetrically arranged on both sides of the component body 100; when there is one sound playing component, the sound playing component may be arranged on any side of the component body 100.

[0040] Based on the above display device, a control method of the display device according to an embodiment of the present application is proposed below.

[0041] refer to Figure 4 , Figure 4 is a flow chart of a control method for a display device provided by an embodiment of the present application, which is applicable but not limited to Figure 1 A controller of a display device and a control method of the display device include but are not limited to steps S101 to S107.

[0042] Step S101: receiving a sequence of tasks to be completed through the display screen 200, and displaying the sequence of tasks to be completed through the display screen 200, wherein the sequence of tasks to be completed includes at least one subtask.

[0043] In step S101 of some embodiments, a sequence of tasks to be completed is received through the display screen 200, and the sequence of tasks to be completed is displayed through the display screen 200, thereby achieving a visual display of the sequence of tasks to be completed. A clear task flow can be provided through the display screen 200, and errors caused by misunderstanding or missing task instructions can be reduced. The display screen 200 can also update task information in real time to ensure the accuracy and timeliness of the task sequence.

[0044] It is worth noting that the sequence of tasks to be completed in the embodiment of the present application can be obtained by the target object triggering the corresponding button on the display screen 200. Specifically, the display screen 200 in the embodiment of the present application can be provided with a keyboard input area or multiple task options, and the target object can create subtasks by inputting corresponding letters on the keyboard, and then sorting the multiple subtasks to obtain the sequence of tasks to be completed; or select the subtask corresponding to the task option by selecting the task option, and then sorting the multiple subtasks to obtain the sequence of tasks to be completed, and the embodiment of the present application does not make specific restrictions.

[0045] Step S102: For each subtask, set the task duration corresponding to the subtask.

[0046] In step S102 of some embodiments, since the duration of each subtask may be different, for each subtask, the embodiment of the present application will set a task duration corresponding to the subtask. By assigning a specific duration to each subtask, the time required for each task can be accurately managed, reducing unnecessary waiting and idle time.

[0047] Specifically, taking the hairdressing scene as an example, the hairdressing scene includes three subtasks in total, namely shampooing, blowing hair and cutting hair. At this time, the duration corresponding to the shampooing task can be set to fifteen minutes, the duration corresponding to the blowing hair task can be set to twenty minutes, the duration corresponding to the hair cutting task can be set to thirty minutes, and so on. The embodiments of the present application do not make specific restrictions.

[0048] Step S103: receiving a processing instruction through the display screen 200, and determining a target subtask corresponding to the processing instruction and a target task duration corresponding to the target subtask in the sequence of tasks to be completed.

[0049] In step S103 of some embodiments, a processing instruction is received through the display screen 200, and a target subtask corresponding to the processing instruction is determined in the sequence of tasks to be completed, that is, the target subtask that needs to be processed, and the target task duration corresponding to the target subtask is determined, so that the target subtask that currently needs to be processed and the estimated duration to complete the target subtask can be determined.

[0050] It should be noted that the processing instruction is generated by the target object by triggering the relevant module on the display screen 200, or by inputting relevant information on the display screen 200. Specifically, the target object can send the processing instruction by clicking the subtask module on the display screen 200, or by inputting relevant information in the keyboard input area on the display screen 200, and the embodiment of the present application does not make specific restrictions.

[0051] Step S104: when a target object is sensed within the sensing range of the sensing component 300 , a first duration of the target object being within the sensing range is monitored.

[0052] In step S104 of some embodiments, when a target object is sensed within the sensing range of the sensing component 300, it indicates that the target object is processing a target subtask within the sensing range. At this time, the first duration of the target object being in the sensing range is monitored, thereby recording the duration of the target object processing the target subtask.

[0053] Step S105 : determining a first remaining time according to the first duration and the target task duration, and displaying the first remaining time on the display screen 200 .

[0054] In step S105 of some embodiments, a first remaining time is determined based on the first duration and the target task duration, i.e., the remaining time to complete the target subtask is estimated, and the first remaining time is displayed on the display screen 200. By monitoring the task progress in real time, progress delays can be discovered in time, so that corresponding measures can be taken to improve overall work efficiency.

[0055] Step S106: When the first remaining time is greater than the preset remaining time and the target object is not sensed within the sensing range of the sensing component 300, a second continuous time during which the target object is not within the sensing range is monitored.

[0056] In step S106 of some embodiments, when the first remaining time is greater than the preset remaining time and the target object is not sensed within the sensing range of the sensing component 300, it means that the current target subtask is not completed and the target object is not processing the target subtask. At this time, it is necessary to monitor the second continuous time when the target object is not in the sensing range, that is, the time when the target object leaves, to ensure that the target subtask is completed on time.

[0057] It should be noted that the preset remaining time in the embodiment of the present application can be set according to the needs of the target object, for example, five minutes, ten minutes, three minutes, etc., and the embodiment of the present application does not make specific restrictions.

[0058] Step S107: When the second duration is greater than the preset interruption duration, a prompt message is generated.

[0059] In step S107 of some embodiments, when the second duration is greater than the preset interruption duration, it indicates that the target object has been away for too long, and prompt information needs to be generated to prompt that the target object has been away for too long.

[0060] It should be noted that the preset interruption duration in the embodiment of the present application can be set according to the needs of the user. For example, the preset interruption duration can be set to five minutes, ten minutes, twenty minutes, etc., and the embodiment of the present application does not make any specific restrictions.

[0061] It is understandable that the prompt information in the embodiment of the present application can be voice prompt information, text prompt information or light prompt information, etc. When the prompt information is text prompt information or light prompt information, it can be directly displayed on the display screen 200 of the display component; when the prompt information is voice prompt information, it can be played through the sound playing component of the display device, and the embodiment of the present application does not make specific restrictions.

[0062] Reference Figure 5 , Figure 5 This is a flowchart of a method for controlling a display device provided in another embodiment of the present application. Figure 5 Including but not limited to steps S201 to S205.

[0063] It should be noted that steps S201 to S205 occur after the first remaining time is determined according to the duration and the target task duration, and the first remaining time is displayed on the display screen 200 .

[0064] Step S201: determining the total task duration for completing the sequence of tasks to be completed, and determining the final tasks and non-final tasks in the sequence of tasks to be completed.

[0065] Step S202: When the first remaining time is less than or equal to the preset remaining time, task completion information is generated.

[0066] Step S203: When no extension instruction is received within the preset duration and the target subtask is a non-end task, the next to-be-completed task of the target subtask is determined in the to-be-completed task sequence, and the to-be-completed task duration corresponding to the to-be-completed task is determined.

[0067] It should be noted that the preset duration is shorter than the first remaining duration.

[0068] Step S204: Recording a third duration of time that the target object is within the sensing range.

[0069] Step S205: adjusting the total task duration according to the third duration and the duration of the task to be completed.

[0070] In some embodiments, in steps S201 to S205, after determining the first remaining duration according to the duration and the target task duration, the embodiment of the present application will also determine the total task duration to complete the sequence of tasks to be completed, that is, the total task duration to complete all subtasks in the sequence of tasks to be completed, and determine the ending task and non-ending task in the sequence of tasks to be completed, wherein the ending task is the last subtask in the sequence of tasks to be completed, and the non-ending task is a task other than the last subtask in the sequence of tasks to be completed. Then, the first remaining duration and the preset remaining duration are determined. When the first remaining duration is less than or equal to the preset remaining duration, it means that the remaining time of the target subtask is small, which is equivalent to the target subtask being in a completed state, and task completion information is generated. When no extension instruction is received within the preset duration, it means that the target subtask can be completed on time. If the target subtask is a non-ending task, it means that other subtasks need to be completed later. In the embodiment of the present application, if no extension instruction is received and the target subtask is a non-ending task, the next task to be completed of the target subtask will be determined in the sequence of tasks to be completed, so that the subtasks can be processed in the order of the subtasks in the sequence of tasks to be completed. , ensure a smooth transition between tasks, and determine the duration of the tasks to be completed corresponding to the tasks to be completed, maintain work continuity and efficiency, so that all relevant personnel can see the progress of the tasks and the next plan, improve transparency, and then record the third duration of the target object in the sensing range through the sensing component 300 to achieve real-time sensing of the target object, so as to determine whether the target object is performing the tasks to be completed, and finally adjust the total task duration according to the third duration and the duration of the tasks to be completed to avoid a large difference between the total duration of completing all subtasks and the set total task duration, ensure that the task can be completed within the planned total duration, and maintain the progress of the project or workflow.

[0071] It should be noted that the preset remaining time in the embodiment of the present application can be set according to the needs of the target object, wherein the preset remaining time is used to characterize the maximum remaining time allowed in the process of executing the subtask. If the remaining time is equal to the preset remaining time, it can be equivalent to completing the subtask. The setting of the preset remaining time is not specifically limited in the embodiment of the present application. And the preset time in the embodiment of the present application can be set according to the needs of the target object, and it can be less than the first remaining time. For example, it can be set to five minutes, three minutes, eight minutes, etc., and the embodiment of the present application does not make specific restrictions.

[0072] Reference Figure 6 , Figure 6 It is a flowchart of a method for controlling a display device provided by another embodiment of the present application. The method for controlling a display device includes but is not limited to steps S301 to S302.

[0073] It should be noted that step S301 to step S302 occur after the first remaining time is less than or equal to the preset remaining time and the task completion information is generated.

[0074] Step S301: when an extension instruction is received within a preset time period, an extension time period corresponding to the extension instruction is determined.

[0075] Step S302: Add the extended duration to the remaining duration to obtain the target duration.

[0076] In steps S301 to S302 of some embodiments, after the task completion information is generated, if an extension instruction is received within the preset duration, it means that the target subtask has not been completed on time and needs to be extended. At this time, the extended duration corresponding to the extension instruction is determined, that is, the additional duration required to complete the target subtask, and then the extended duration is added to the remaining duration to obtain the target duration, thereby extending the remaining duration, ensuring that the target object can complete the target subtask within a certain duration, achieving reasonable time planning, and being able to flexibly adjust the schedule according to the actual situation of the task to adapt to unforeseen workload or complexity.

[0077] It is worth noting that the extension instruction in the embodiment of the present application is obtained by the target object inputting information through the display screen 200, or by recognizing the gesture of the target object through the visual acquisition module, and the embodiment of the present application does not make specific restrictions.

[0078] It is understandable that the target object can generate an extension instruction through the display screen 200 or through a specific gesture, and by extending the remaining time, the target object can be provided with extra time, reducing the stress and anxiety caused by time constraints. The extra time can also ensure that the staff has enough time to focus on the task and improve the quality of work.

[0079] Specifically, taking the haircut scenario as an example, when the barber is performing the haircut subtask, the estimated haircut time is 20 minutes, and only five minutes are left for the haircut subtask. Since the customer has too much hair, the haircut time is longer than the estimated time. At this time, the barber can input the desired extension time through the display screen 200, for example, five minutes, ten minutes, etc. Taking the extension of five minutes as an example, the remaining time of the haircut subtask is updated to ten minutes on the display screen 200.

[0080] Reference Figure 7 , Figure 7 yes Figure 5 The specific method flow chart of step S205 in FIG. 1 , step S205 includes but is not limited to steps S401 to S405.

[0081] Step S401: Determine a second remaining duration according to the third duration and the duration of the task to be completed.

[0082] Step S402: When the task to be completed is the final task, all subtasks before the task to be completed are determined according to the sequence of tasks to be completed to obtain a set of completed tasks.

[0083] Step S403: Count the time consumed to complete all subtasks in the completed task set, and determine the cumulative consumed time according to the third duration and the consumed time.

[0084] Step S404: Calculate the duration difference between the accumulated consumed time and the total task duration.

[0085] Step S405: When the duration difference is greater than or equal to a preset difference threshold, shorten the duration of the task to be completed to adjust the total task duration.

[0086] In steps S401 to S405 of some embodiments, in the process of adjusting the total task duration according to the third duration and the duration of the task to be completed, the second remaining duration of the task to be completed is first determined according to the third duration and the duration of the task to be completed, and then the task type of the task to be completed is judged, that is, whether the task to be completed is an end task or a non-end task. When the task to be completed is an end task, it means that the task to be completed is the last subtask in the sequence of tasks to be completed. At this time, all subtasks before the task to be completed are determined according to the sequence of tasks to be completed, that is, all subtasks that have been completed, to obtain a completed task set, and to realize the collection of all completed subtasks. Afterwards, the time consumed to complete all subtasks in the completed task set is counted, that is, the time consumed to execute all subtasks in the completed task set. Duration, and determine the cumulative consumed time from the start of executing the subtask to the current progress of the task to be completed based on the third continuous duration and the consumed time. Finally, calculate the time difference between the cumulative consumed time and the total task duration, and compare the time difference with the preset difference threshold. When the time difference is greater than or equal to the preset difference threshold, it means that the current time difference exceeds the maximum excess time required to complete the sequence of tasks to be completed. In order to avoid completing the sequence of tasks to be completed within the planned duration, the embodiment of the present application will shorten the duration of the task to be completed to adjust the total task duration. Specifically, the embodiment of the present application will generate task prompt information to remind the target object to improve efficiency and avoid the total time to complete all subtasks being too different from the set total task duration, so as to ensure that the task can be completed within the planned total duration and maintain the progress of the project or workflow.

[0087] It should be noted that the preset difference threshold in the embodiment of the present application is the maximum excess time that can be accepted for completing the entire sequence of tasks to be completed. The preset difference threshold can be set according to the needs of the user, for example, to thirty minutes, forty minutes, twenty minutes, etc., and the embodiment of the present application does not make any specific restrictions.

[0088] It can be understood that the embodiment of the present application adjusts the total task duration by determining the difference between the cumulative consumed time and the total task duration, thereby being able to avoid project delays and waste of human and material resources due to improper time management by identifying potential delay risks in advance and taking measures.

[0089] Reference Figure 8 , Figure 8 It is a flowchart of a method for controlling a display device provided by another embodiment of the present application. The method for controlling a display device includes but is not limited to steps S501 to S505.

[0090] It should be noted that the sensing component 300 also includes a visual acquisition module.

[0091] Step S501: Capture the action image of the target object through the visual acquisition module.

[0092] Step S502: performing gesture detection on the action image according to a preset image processing algorithm to obtain a target gesture area.

[0093] Step S503: extracting features of the target gesture area based on a preset convolutional neural network to obtain gesture features.

[0094] Step S504: determining a gesture instruction corresponding to the gesture feature in a preset gesture feature library.

[0095] Step S505: sending a gesture instruction to the display screen 200 so that the display screen 200 displays instruction information corresponding to the gesture instruction.

[0096] In steps S501 to S505 of some embodiments, the embodiments of the present application may also collect the action image of the target object through the visual acquisition module, and then perform gesture detection on the action image according to the preset image processing algorithm. Specifically, the embodiments of the present application perform background segmentation on the action image, separate the foreground gesture area through background subtraction technology, and then track the contour of the continuous image frames of the foreground gesture area for the separated foreground finger area, so as to identify the change of gesture over time, and then segment the gesture area from the image through clustering, threshold segmentation and other methods to obtain the target gesture area. Afterwards, feature extraction is performed on the target gesture area based on the preset convolutional neural network. Specifically, features are extracted through the convolution layer and pooling layer of the convolutional neural network to obtain multiple feature vectors, and then the multiple feature vectors are fused to obtain a more comprehensive feature identification, obtain gesture features, and realize accurate recognition of gesture features, so as to facilitate subsequent other operations based on gesture features. A gesture instruction corresponding to the gesture feature is determined in a preset gesture feature library, wherein the gesture feature library contains a mapping relationship between a series of predefined gesture features and corresponding gesture instructions. For example, when the target object makes an upward sliding gesture, the corresponding gesture instruction is an instruction to increase the volume; when the target object makes a downward sliding gesture, the corresponding gesture instruction is an instruction to lower the volume, and so on. Thus, different gesture instructions can be determined for different gesture features to achieve personalized gesture recognition. Finally, the gesture instruction is sent to the display screen 200, so that the display screen 200 can display the instruction information corresponding to the gesture instruction, realize real-time display of the instruction information, and provide a richer multimodal interactive experience.

[0097] It should be noted that the image processing algorithm in the embodiment of the present application may be a filtering algorithm, an edge detection algorithm, a contour tracking algorithm, etc., and the embodiment of the present application does not impose any specific restrictions.

[0098] It is worth noting that the gesture feature library in the embodiment of the present application contains a series of mapping relationships between predefined gesture features and corresponding gesture instructions. By comparing the captured real-time gesture features with the features in the library, the system can identify the specific gesture made by the user. Once the gesture is recognized, the gesture feature library can associate the gesture with a preset instruction or operation, such as opening an application, switching menus, or executing a command.

[0099] In order to specifically illustrate the control method of the display device according to the embodiment of the present application, a specific example is given below.

[0100] Example 1: Example 1 is a detailed description of a method for controlling a display device in a haircut scenario.

[0101] In some embodiments, the display device includes a display component and a sensing component 300, wherein the display component includes a mirror body and a display screen 200, and the sensing component 300 includes a visual acquisition module, a transmitting module, and a receiving module. In addition, a plurality of haircut buttons are provided on the display screen 200, for example, a haircut button, a hair dyeing button, a hair washing button, a hair perm button, a styling button, etc., and the preset remaining time is set to two minutes, and the preset interruption time is set to five minutes.

[0102] The barber communicates with the customer about the haircut needs. For example, the haircut needs are shampooing, haircutting and perming. That is, the haircut needs include three subtasks, namely, the shampooing subtask, the haircutting subtask and the perming subtask. After obtaining the customer's haircut needs, the barber selects a shampooing button corresponding to shampooing, a haircutting button corresponding to haircutting and a perming button corresponding to perming on the display screen 200, sorts the three subtasks on the display screen 200, and obtains a sequence of tasks to be completed. For each subtask, the task duration corresponding to the subtask is set. For example, the task duration of the shampooing subtask is set to 20 minutes, the task duration of the haircutting subtask is set to 20 minutes, and the task duration of the perming subtask is set to 2 hours. Since the customer will move to other areas for hair washing, the target object chooses to start timing from the hair cutting subtask through the display screen 200, determines the hair cutting subtask as the target subtask, and then senses the first duration of the target object being in the sensing range through the sensing component 300. Taking the first duration of ten minutes as an example, the first remaining duration of the target subtask is determined to be ten minutes, and the first remaining duration is displayed through the display screen 200. Since the mirror body is set toward the customer and the barber, the customer and the barber can pay attention to the changes in time in real time, and can better collaborate and coordinate work without the customer and the barber having to repeatedly lower their heads or raise their heads to check the time.

[0103] During the haircut process, the barber is called away by other customers, resulting in the barber not being sensed within the sensing range of the sensing component 300. At this time, the first remaining time is ten minutes, which is greater than the preset remaining time, and the barber is not sensed within the sensing range of the sensing component 300. The embodiment of the present application will monitor the second duration of time that the target object is not within the sensing range. Taking the second duration of six minutes as an example, if the second duration is greater than the preset interruption time, a prompt message will be generated to remind the barber to return to the current haircut subtask. By real-time monitoring of the task progress, the progress delay can be discovered in time, so that corresponding measures can be taken to improve the overall work efficiency. In addition, the customer can accurately obtain the specific time of completing the haircut, which is convenient for the customer to arrange other matters later.

[0104] See also Fig. 9 , Fig. 9 The hardware structure of an electronic device of an embodiment is shown, and the electronic device includes: The processor 1001 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application; The memory 1002 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 1002 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 1002, and the processor 1001 calls and executes the control method of the display device in the embodiment of this application; Input / output interface 1003, used to implement information input and output; Communication interface 1004, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.); A bus 1005 , which transmits information between various components of the device (e.g., the processor 1001 , the memory 1002 , the input / output interface 1003 , and the communication interface 1004 ); The processor 1001 , the memory 1002 , the input / output interface 1003 and the communication interface 1004 are connected to each other in communication within the device via the bus 1005 .

[0105] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are executed by a processor or controller, for example, by a processor in the above-mentioned system embodiment, so that the above-mentioned processor can execute the control method of the display device in the above-mentioned embodiment.

[0106] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0107] It can be understood by those skilled in the art that Figure 1-9The technical solutions shown in the figure do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than those shown in the figure, or a combination of certain steps, or different steps.

[0108] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0109] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0110] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0111] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0112] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0113] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit. If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method of each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (RandomAccess Memory, referred to as RAM), disk or optical disk and other media that can store programs.

[0114] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.

Claims

1. A display device, characterized in that: include: The display component comprises a component body and a display screen, wherein the display screen is embedded in the component body; A sensing component connected to the display component, the sensing component is used to sense a target object within a sensing range; A controller is connected to the display component and the sensing component, and is used to receive a sequence of tasks to be completed through the display screen, and display the sequence of tasks to be completed through the display screen, wherein the sequence of tasks to be completed includes at least one subtask; for each subtask, a task duration corresponding to the subtask is set; a processing instruction is received through the display screen, and a target subtask corresponding to the processing instruction and a target task duration corresponding to the target subtask are determined in the sequence of tasks to be completed; when a target object is sensed within the sensing range of the sensing component, a first duration during which the target object is in the sensing range is monitored; a remaining duration is determined based on the first duration and the target task duration, and the remaining duration is displayed through the display screen; and when the remaining duration is greater than a preset remaining duration and the target object is not sensed within the sensing range of the sensing component, a second duration during which the target object is not in the sensing range is monitored; when the second duration is greater than a preset interruption duration, a prompt message is generated.

2. The display device according to claim 1, characterized in that The sensing component includes a visual acquisition module, a transmitting module and a receiving module. The transmitting module is used to send an infrared transmission signal, and the receiving module is used to receive an infrared reflection signal, wherein the infrared reflection signal is obtained by reflecting the infrared transmission signal from the target object; the visual acquisition module is used to collect an action image of the target object.

3. The display device according to claim 1, characterized in that The display device also includes a sound playing component, which is arranged on the component body; the controller is also used to generate an audio playing signal and send the audio playing signal to the sound playing component to enable the sound playing component to play audio.

4. A method for controlling a display device, characterized in that: Applied to the display device according to any one of claims 1 to 3, the control method comprises: Receiving a sequence of tasks to be completed through the display screen, and displaying the sequence of tasks to be completed through the display screen, wherein the sequence of tasks to be completed includes at least one subtask; For each subtask, set the task duration corresponding to the subtask; Receiving a processing instruction through the display screen, and determining a target subtask corresponding to the processing instruction and a target task duration corresponding to the target subtask in the sequence of tasks to be completed; When a target object is sensed within a sensing range of the sensing component, monitoring a first duration of time during which the target object is within the sensing range; Determine a first remaining time according to the first duration and the target task duration, and display the first remaining time on the display screen; When the first remaining time is greater than a preset remaining time and the target object is not sensed within the sensing range of the sensing component, monitoring a second continuous time during which the target object is not within the sensing range; When the second duration is greater than the preset interruption duration, a prompt message is generated.

5. The control method of the display device according to claim 4, characterized in that: After determining a first remaining time according to the duration and the target task duration, and displaying the first remaining time on the display screen, the method further includes: Determine the total task duration to complete the sequence of tasks to be completed, and determine the final tasks and non-final tasks in the sequence of tasks to be completed; When the first remaining time is less than or equal to the preset remaining time, generating task completion information; When no extension instruction is received within the preset duration, and the target subtask is the non-end task, determining the next to-be-completed task of the target subtask in the to-be-completed task sequence, and determining the to-be-completed task duration corresponding to the to-be-completed task, wherein the preset duration is less than the first remaining duration; Recording a third duration of time that the target object is within the sensing range; The total task duration is adjusted according to the third duration and the duration of the task to be completed.

6. The control method of the display device according to claim 5, characterized in that: When the first remaining time is less than or equal to a preset remaining time, after generating task completion information, the method further includes: When an extension instruction is received within a preset time period, determining an extension time period corresponding to the extension instruction; The extended duration is added to the remaining duration to obtain the target duration.

7. The control method of the display device according to claim 5, characterized in that: The adjusting the total task duration according to the third duration and the duration of the task to be completed includes: Determine a second remaining duration according to the third duration and the duration of the task to be completed; When the to-be-completed task is the final task, all subtasks before the to-be-completed task are determined according to the to-be-completed task sequence to obtain a completed task set; Counting the time consumed to complete all subtasks in the completed task set, and determining the cumulative consumed time according to the third duration and the consumed time; Calculate the time difference between the accumulated consumed time and the total task time; When the duration difference is greater than or equal to a preset difference threshold, the duration of the task to be completed is shortened to adjust the total task duration.

8. The control method of the display device according to claim 4, characterized in that: The sensing component further includes a visual acquisition module; the method further includes: Collecting the action image of the target object through the visual acquisition module; Performing gesture detection on the action image according to a preset image processing algorithm to obtain a target gesture area; Extracting features of the target gesture area based on a preset convolutional neural network to obtain gesture features; Determining a gesture instruction corresponding to the gesture feature in a preset gesture feature library; The gesture instruction is sent to the display screen so that the display screen displays instruction information corresponding to the gesture instruction.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the control method of the display device according to any one of claims 4 to 8 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to execute the control method of the display device according to any one of claims 4 to 8.

Images