Display device, control method for display device, electronic device and storage medium
By using the display and sensing components of the display device, the progress of the task can be monitored and displayed in real time, solving the problem that customers cannot accurately estimate the remaining time and improving the efficiency and experience of hairdressing services.
Patent Information
- Application Number
- CN202411228514.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-03
- Publication Date
- 2026-01-06
- Estimated Expiration
- 2044-09-03
AI Technical Summary
In traditional hairdressing services, customers cannot accurately estimate the remaining time, leading to service delays or rushed completion. Furthermore, when there is a large flow of customers, hairdressers cannot accurately manage the time, affecting the customer experience.
A display device is provided, comprising a display component and a sensing component. The display screen receives a sequence of tasks to be completed, the task duration is set, and the sensing component monitors the position and movement of a target object, displays the remaining time in real time, and generates prompt information.
It enables reasonable planning of task duration and real-time reminders, allowing customers to accurately estimate remaining time, reduce anxiety, and improve work efficiency and customer experience.
Smart Images

Figure CN119322647B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of screen control technology, and particularly relates to a display device, a control method for the display device, an electronic device, and a storage medium. Background Technology
[0002] With the rapid development of modern technology, screen display technology has become an indispensable part of our daily lives. From smartphones and tablets to televisions and public display systems, screens are ubiquitous. However, despite the significant progress made in screen technology, it still has some inherent limitations and challenges, which are particularly evident in certain application scenarios.
[0003] Taking the hairdressing industry as an example, traditional hairdressing services typically rely on manual timing and verbal communication between the customer and the hairdresser. In this model, the customer's perception of service time depends mainly on the hairdresser's instructions and their own estimation. This leads to customers being unable to accurately estimate the remaining time, potentially affecting their ability to schedule other activities; and in high-traffic situations, hairdressers may be unable to accurately manage time, resulting in service delays or rushed completion.
[0004] Therefore, it is particularly important to be able to display the time changes to the user in real time. Summary of the Invention
[0005] This application aims to at least solve one of the technical problems existing in the prior art, and to provide a display device, a control method for the display device, an electronic device, and a storage medium that can provide real-time reminders of the time required to complete a task.
[0006] In a first aspect, this application provides a display device, comprising:
[0007] The display component includes a component body and a display screen, wherein the display screen is embedded in the component body;
[0008] A sensing component, connected to the display component, is used to sense a target object within a sensing range;
[0009] A controller, connected to the display component and the sensing component, is configured to receive a sequence of tasks to be completed via the display screen and display the sequence of tasks to be completed via the display screen, wherein the sequence of tasks to be completed includes at least one subtask; for each subtask, a task duration corresponding to the subtask is set; a processing instruction is received via the display screen, and a target subtask corresponding to the processing instruction and a target task duration corresponding to the target subtask are determined in the sequence of tasks to be completed; when a target object is sensed within the sensing range of the sensing component, a first duration for which the target object is within the sensing range is monitored; a remaining duration is determined based on the first duration and the target task duration, and the remaining duration is displayed via the display screen; the controller is further configured to monitor a second duration for which the target object is not within the sensing range when the remaining duration is greater than a preset remaining duration and no target object is sensed within the sensing range of the sensing component; and when the second duration is greater than a preset interruption duration, a prompt message is generated.
[0010] According to some embodiments of this application, the sensing component includes a visual acquisition module, a transmitting module, and a receiving module. The transmitting module is used to send infrared transmission signals, and the receiving module is used to receive infrared reflection signals, wherein the infrared reflection signals are obtained by the target object reflecting the infrared transmission signals; the visual acquisition module is used to acquire motion images of the target object.
[0011] According to some embodiments of this application, the display device further includes a sound playback component disposed on the component body; the controller is further configured to generate an audio playback signal and send the audio playback signal to the sound playback component so that the sound playback component plays audio.
[0012] Secondly, embodiments of this application provide a control method for a display device, applied to the display device as described in the first aspect, the control method comprising:
[0013] The system receives and displays a sequence of tasks to be completed on the display screen, wherein the sequence of tasks to be completed includes at least one subtask.
[0014] For each subtask, set the task duration corresponding to the subtask;
[0015] The system receives processing instructions through the display screen and determines the target subtask corresponding to the processing instructions and the target task duration corresponding to the target subtask in the sequence of tasks to be completed.
[0016] When a target object is sensed within the sensing range of the sensing component, the duration for which the target object remains within the sensing range is monitored.
[0017] A first remaining time is determined based on the first duration and the target task duration, and the first remaining time is displayed on the display screen.
[0018] When the first remaining duration is longer than the preset remaining duration, and no target object is detected within the sensing range of the sensing component, a second duration is monitored for when the target object is not within the sensing range;
[0019] When the second duration exceeds the preset interruption duration, a prompt message is generated.
[0020] According to some embodiments of this application, after determining a first remaining time based on the duration and the target task duration, and displaying the first remaining time on the display screen, the method further includes:
[0021] Determine the total task duration for completing the sequence of tasks to be completed, and identify the final and non-final tasks in the sequence of tasks to be completed;
[0022] When the first remaining time is less than or equal to the preset remaining time, task end information is generated;
[0023] If no extension instruction is received within the preset time period, and the target subtask is the non-ending task, the next task to be completed for the target subtask is determined in the sequence of tasks to be completed, and the duration of the task to be completed corresponding to the task to be completed is determined, wherein the preset time period is less than the first remaining time period.
[0024] Record the third duration during which the target object is within the sensing range;
[0025] The total task duration is adjusted based on the third duration and the duration of the task to be completed.
[0026] According to some embodiments of this application, after generating task completion information when the first remaining time is less than or equal to a preset remaining time, the method further includes:
[0027] When an extension instruction is received within a preset time period, the extension time corresponding to the extension instruction is determined;
[0028] The extended duration is added to the remaining duration to obtain the target duration.
[0029] According to some embodiments of this application, adjusting the total task duration based on the third duration and the duration of the task to be completed includes:
[0030] The second remaining duration is determined based on the third duration and the duration of the task to be completed;
[0031] When the task to be completed is the final task, all sub-tasks preceding the task to be completed are determined according to the sequence of tasks to be completed, and a set of completed tasks is obtained.
[0032] The time consumed to complete all subtasks in the completed task set is calculated, and the cumulative time consumed is determined based on the third duration and the consumed time.
[0033] Calculate the time difference between the cumulative time consumed and the total task time;
[0034] When the duration difference is greater than or equal to a preset difference threshold, the duration of the task to be completed is shortened to adjust the total task duration.
[0035] According to some embodiments of this application, the sensing component further includes a visual acquisition module; the method further includes:
[0036] The visual acquisition module acquires motion images of the target object.
[0037] The motion image is subjected to gesture detection according to a preset image processing algorithm to obtain the target gesture region;
[0038] The target gesture region is used to extract features based on a pre-defined convolutional neural network to obtain gesture features;
[0039] Determine the gesture command corresponding to the gesture feature from the preset gesture feature library;
[0040] Send the gesture command to the display screen so that the display screen displays the command information corresponding to the gesture command.
[0041] Thirdly, this application provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the control method of the display device as described in the second aspect.
[0042] Fourthly, this application provides a computer-readable storage medium storing computer-executable instructions for performing the control method of the display device described in the second aspect.
[0043] The control method for the display device provided in the embodiments of this application has at least the following beneficial effects: The display device includes a display component and a sensing component. A controller is connected to the display component and the sensing component. The controller is used to receive a sequence of tasks to be completed, i.e., tasks input by the user, through the display screen, and to display the sequence of tasks to be completed, thereby realizing a visual display of the sequence of tasks to be completed. The sequence of tasks to be completed includes at least one sub-task to be completed. For each sub-task, a task duration corresponding to the sub-task is set to realize advance planning of task duration, which facilitates the user to reasonably arrange the time required for different tasks. Then, a processing instruction is received through the display screen, and the target sub-task corresponding to the processing instruction is determined in the sequence of tasks to be completed, i.e., the target sub-task that needs to be completed now, and the target task duration corresponding to the target sub-task is determined, so that the user can initially determine the target task duration to complete the target sub-task, which is convenient for subsequent arrangement of other tasks. When a target object is detected within the sensing range of the sensing component, it indicates that the target object is processing a target subtask. The system monitors the first duration the target object remains within the sensing range, representing the duration of the target subtask processing. Based on this first duration and the target task duration, the remaining time to complete the subtask is determined and displayed on the screen. This real-time display of the subtask's execution time allows the target object to plan and manage its time effectively, accurately tracking time changes. If the remaining time exceeds a preset remaining time, and the target object is not detected within the sensing range, it indicates that the subtask is incomplete and the target object is not processing it. In this case, the system monitors a second duration the target object is not within the sensing range, representing the duration the target object has been absent. If this second duration exceeds a preset interruption time, it indicates that the target object has been absent for too long, and a prompt message is generated to alert the target object that its absence has been prolonged. This application embodiment achieves reasonable planning of the execution time of subtasks in the sequence of tasks to be completed through the cooperation of the display component and the sensing component, and can remind the user in real time of the time required to complete the task, so that the user can accurately estimate the remaining time and make it easier for the user to reasonably arrange the subsequent time.
[0044] Other features and advantages of this application will be set forth in the following description and will be apparent in part from the description or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the description and the accompanying drawings. Attached Figure Description
[0045] The accompanying drawings are used to provide a further understanding of the technical solutions of this application and constitute a part of the specification. They are used together with the embodiments of this application to explain the technical solutions of this application and do not constitute a limitation on the technical solutions of this application.
[0046] Figure 1 This is a schematic diagram of a display device provided in one embodiment of this application;
[0047] Figure 2 This is a schematic diagram of a display screen provided in one embodiment of this application;
[0048] Figure 3 This is a schematic diagram of a display component showing a sequence of tasks to be completed according to an embodiment of this application;
[0049] Figure 4 This is a flowchart of a control method for a display device provided in one embodiment of this application;
[0050] Figure 5 This is a flowchart of a control method for a display device provided in another embodiment of this application;
[0051] Figure 6 This is a flowchart of a control method for a display device provided in another embodiment of this application;
[0052] Figure 7 yes Figure 5 The flowchart of the specific method for step S205 in the text;
[0053] Figure 8 This is a flowchart of a control method for a display device provided in another embodiment of this application;
[0054] Figure 9 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation
[0055] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0056] It should be noted that although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than that shown in the flowchart. The terms "first," "second," etc., in the specification, claims, and the aforementioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.
[0057] With the rapid development of modern technology, screen display technology has become an indispensable part of our daily lives. From smartphones and tablets to televisions and public display systems, screens are ubiquitous. However, despite the significant progress made in screen technology, it still has some inherent limitations and challenges, which are particularly evident in certain application scenarios.
[0058] Taking the hairdressing industry as an example, traditional hairdressing services typically rely on manual timing and verbal communication between the customer and the hairdresser. In this model, the customer's perception of service time depends primarily on the hairdresser's instructions and their own estimation. This leads to customers being unable to accurately estimate remaining time, potentially affecting their ability to schedule other activities. Furthermore, in high-traffic situations, hairdressers may be unable to accurately manage time, resulting in service delays or rushed completion. Additionally, if customers are unaware of their waiting time, they may experience anxiety and impatience.
[0059] Therefore, it is particularly important to be able to display the time changes to the user in real time.
[0060] To address the aforementioned issues, this embodiment provides a control method for a display device. The display device includes a display component and a sensing component. A controller is connected to the display component and the sensing component. The controller receives a sequence of tasks to be completed (i.e., tasks input by the user) through the display screen and displays the sequence of tasks to be completed, thereby achieving a visual representation of the sequence. The sequence of tasks to be completed includes at least one subtask to be completed. For each subtask, a task duration is set to allow for advance planning of task durations, facilitating the user's reasonable allocation of time for different tasks. The controller then receives processing instructions through the display screen and identifies the target subtask corresponding to the processing instructions in the sequence of tasks to be completed—that is, the target subtask currently to be completed—and determines the target task duration corresponding to the target subtask. This allows the user to initially determine the target task duration for completing the target subtask, facilitating the subsequent arrangement of other tasks. When a target object is detected within the sensing range of the sensing component, it indicates that the target object is processing a target subtask. The system monitors the first duration the target object remains within the sensing range, representing the duration of the target subtask processing. Based on this first duration and the target task duration, the remaining time to complete the subtask is determined and displayed on the screen. This real-time display of the subtask's execution time allows the target object to plan and manage its time effectively, accurately tracking time changes. If the remaining time exceeds a preset remaining time, and the target object is not detected within the sensing range, it indicates that the subtask is incomplete and the target object is not processing it. In this case, the system monitors a second duration the target object is not within the sensing range, representing the duration the target object has been absent. If this second duration exceeds a preset interruption time, it indicates that the target object has been absent for too long, and a prompt message is generated to alert the target object that its absence has been prolonged. This application embodiment achieves reasonable planning of the execution time of subtasks in the sequence of tasks to be completed through the cooperation of the display component and the sensing component, and can remind the user in real time of the time required to complete the task, so that the user can accurately estimate the remaining time and make it easier for the user to reasonably arrange the subsequent time.
[0061] The embodiments of this application will be further described below with reference to the accompanying drawings.
[0062] refer to Figure 1 , Figure 1 This is a schematic diagram of a display device provided in one embodiment of this application.
[0063] In some embodiments, the display device includes a display component, a sensing component, and a controller. The display component includes a component body 100 and a display screen 200, the display screen 200 being embedded in the component body; the sensing component is connected to the display component and is used to sense a target object within a sensing range.
[0064] It is worth noting that the component body 100 of the display component can be a mirror, a box, etc., and different categories of component body 100 can be selected according to different application scenarios. Taking the beauty and hairdressing scenario as an example, the component body 100 can be a mirror. Taking the work and study scenario as an example, the component body 100 can be a box. This application embodiment does not impose specific restrictions on the selection of the component body 100.
[0065] In some embodiments, the sensing component 300 includes a visual acquisition module, a transmitting module, and a receiving module. The transmitting module transmits infrared emission signals, and the receiving module receives infrared reflection signals. The infrared reflection signals are obtained by the reflection of infrared emission signals by the target object. The cooperation between the transmitting and receiving modules enables accurate detection of the target object. Furthermore, the infrared signal propagates extremely quickly, allowing for real-time or near-real-time detection of the target object. The visual acquisition module acquires motion images of the target object, thereby achieving real-time acquisition of the target object's actions, facilitating subsequent analysis of the actions performed by the target object.
[0066] It should be noted that the intensity and frequency of the infrared emission signal in the embodiments of this application can be adjusted as needed to adapt to different detection distances and accuracy requirements.
[0067] It is understood that the visual acquisition module in the embodiments of this application includes, but is not limited to, industrial cameras, digital cameras, line scan cameras, etc., and the embodiments of this application do not impose specific limitations.
[0068] refer to Figure 2 , Figure 2 This is a schematic diagram of a display screen 200 provided in one embodiment of this application.
[0069] In some embodiments, a user can input a sequence of tasks to be completed, i.e., the tasks the user wants to perform, via the touch display screen 200. Specifically, the display screen 200 in this embodiment may be provided with a keyboard input area, that is, the user can input multiple sub-tasks via the keyboard on the display screen 200 and sort the multiple sub-tasks to obtain a sequence of tasks to be completed; the display screen 200 may also be provided with multiple task options, and the user can select the corresponding sub-task by clicking on different task options on the display screen 200, and then sort and organize the sub-tasks to obtain a sequence of tasks to be completed. This embodiment does not impose specific limitations on the screen display method of the display screen 200.
[0070] Specifically, Figure 2 The display screen 200 can also be configured to display multiple task options, by Figure 2As can be seen, the display screen 200 includes two areas: one area is the "Selected Subtasks" area, where the target object can sort the selected subtasks; the other area is the "Options" area, where the target object can select the subtasks to be completed. Taking a hairdressing scenario as an example, the display screen 200 has four task options: shampoo button, haircut button, hair dryer button, and conditioning button. The hairdresser can select different subtasks by clicking different buttons on the display screen 200 and sort the selected subtasks to obtain a sequence of tasks to be completed: shampoo-dryer-cut-conditioner. Subsequent operations are then performed according to this sequence.
[0071] refer to Figure 3 , Figure 3 This is a schematic diagram of a display component providing an embodiment of this application, showing a sequence of tasks to be completed.
[0072] In some embodiments, the controller is connected to the display component and the sensing component 300. The controller receives a sequence of tasks to be completed, i.e., the tasks input by the user, through the display screen 200, and displays the sequence of tasks to be completed, thereby achieving a visual display of the sequence of tasks to be completed. The sequence of tasks to be completed includes at least one sub-task to be completed. For each sub-task, a task duration corresponding to the sub-task is set to realize advance planning of task duration, which makes it easier for the user to reasonably arrange the time required for different tasks. Then, the controller receives processing instructions through the display screen 200, and determines the target sub-task corresponding to the processing instructions in the sequence of tasks to be completed, i.e., the target sub-task that needs to be completed at present, and determines the target task duration corresponding to the target sub-task, so that the user can initially determine the target task duration to complete the target sub-task, which is convenient for subsequent scheduling of other tasks. When a target object is detected within the sensing range of the sensing component 300, it indicates that the target object is processing a target subtask. At this time, the first duration of the target object's presence within the sensing range is monitored, representing the duration of the target object processing the target subtask. Based on the first duration and the target task duration, the remaining time to complete the target subtask is determined and displayed on the display screen 200. This provides real-time display of the target subtask's execution time, allowing the target object to plan and manage its time effectively and accurately track time changes. If the remaining time exceeds a preset remaining time, and the target object is not detected within the sensing range of the sensing component 300, it indicates that the current target subtask is incomplete and the target object is not processing it. In this case, a second duration of the target object's absence from the sensing range needs to be monitored, representing the duration the target object has been away. If the second duration exceeds a preset interruption time, it indicates that the target object has been away for too long, and a prompt message needs to be generated to alert the target object that its absence time has been too long. This application embodiment achieves reasonable planning of the execution time of subtasks in the task sequence to be completed through the cooperation of the display component and the sensing component 300, and can remind the user in real time of the time required to complete the task, so that the user can accurately estimate the remaining time and make it easier for the user to reasonably arrange the subsequent time.
[0073] In some embodiments, the display device further includes a sound playback component disposed on the component body 100; the controller is also configured to generate an audio playback signal and send the audio playback signal to the sound playback component so that the sound playback component plays audio, thereby enabling the sound playback component to prompt the user or target object that the current task has not been completed, or to play music through the sound playback component to soothe the user or target object's mood and avoid anxiety and irritability caused by the user waiting for a long time.
[0074] It should be noted that there may be one or more sound playback components in the embodiments of this application. Specifically, when there are multiple sound playback components, they may be symmetrically arranged on both sides of the component body 100; when there is only one sound playback component, it may be arranged on any side of the component body 100.
[0075] Based on the above-described display device, the following is a control method for the display device according to an embodiment of this application.
[0076] refer to Figure 4 , Figure 4 This is a flowchart of a control method for a display device provided in one embodiment of this application, which is applied to, but not limited to, applications of... Figure 1 The controller of the display device and the control method of the display device include, but are not limited to, steps S101 to S107.
[0077] Step S101: Receive the sequence of tasks to be completed through the display screen 200 and display the sequence of tasks to be completed through the display screen 200, wherein the sequence of tasks to be completed includes at least one sub-task.
[0078] In step S101 of some embodiments, the sequence of tasks to be completed is received through the display screen 200 and displayed through the display screen 200, thereby realizing the visual display of the sequence of tasks to be completed. The display screen 200 can provide a clear task flow, reduce errors caused by misunderstanding or omission of task instructions, and the display screen 200 can update task information in real time to ensure the accuracy and timeliness of the task sequence.
[0079] It is worth noting that the sequence of tasks to be completed in this embodiment can be obtained by the target object triggering corresponding buttons on the display screen 200. Specifically, the display screen 200 in this embodiment can be provided with a keyboard input area or multiple task options. The target object can create sub-tasks by entering corresponding letters on the keyboard, and then sort the multiple sub-tasks to obtain the sequence of tasks to be completed; or it can select the sub-task corresponding to the task option by selecting the task option, and then sort the multiple sub-tasks to obtain the sequence of tasks to be completed. This embodiment does not impose specific limitations.
[0080] Step S102: For each subtask, set the task duration corresponding to the subtask.
[0081] In step S102 of some embodiments, since the time spent on each subtask may be different, the embodiments of this application will set the task duration corresponding to each subtask. By allocating a specific duration to each subtask, the time required for each task can be accurately managed, reducing unnecessary waiting and idle time.
[0082] Specifically, taking a hair styling scenario as an example, the hair styling scenario includes three sub-tasks: shampooing, blow-drying, and cutting. The duration for the shampooing task can be set to 15 minutes, the duration for the blow-drying task to 20 minutes, the duration for the cutting task to 30 minutes, and so on. This application embodiment does not impose specific limitations.
[0083] Step S103: Receive the processing instruction through the display screen 200, and determine the target subtask corresponding to the processing instruction and the target task duration corresponding to the target subtask in the task sequence to be completed.
[0084] In step S103 of some embodiments, a processing instruction is received through the display screen 200, and the target subtask corresponding to the processing instruction is determined in the sequence of tasks to be completed, that is, the target subtask that needs to be processed, and the target task duration corresponding to the target subtask is determined, so as to determine the target subtask that needs to be processed now and the estimated time to complete the target subtask.
[0085] It should be noted that the processing instructions are generated by the target object by triggering relevant modules on the display screen 200 or by inputting relevant information on the display screen 200. Specifically, the target object can send processing instructions by clicking on a sub-task module on the display screen 200, or by inputting relevant information in the keyboard input area on the display screen 200. This application embodiment does not impose specific limitations.
[0086] Step S104: When a target object is sensed within the sensing range of the sensing component 300, monitor the first duration during which the target object remains within the sensing range.
[0087] In step S104 of some embodiments, when a target object is sensed within the sensing range of the sensing component 300, it indicates that the target object is processing a target sub-task within the sensing range. At this time, the first duration of the target object being within the sensing range is monitored, thereby recording the duration of the target object processing the target sub-task.
[0088] Step S105: Determine the first remaining time based on the first duration and the target task duration, and display the first remaining time on the display screen 200.
[0089] In step S105 of some embodiments, a first remaining time is determined based on a first duration and a target task duration, that is, the estimated remaining time to complete the target sub-task, and the first remaining time is displayed on the display screen 200. By monitoring the task progress in real time, progress delays can be detected in a timely manner, thereby taking corresponding measures to improve overall work efficiency.
[0090] Step S106: When the first remaining time is longer than the preset remaining time, and no target object is detected within the sensing range of the sensing component 300, the second duration during which the target object is not within the sensing range is monitored.
[0091] In step S106 of some embodiments, when the first remaining time is longer than the preset remaining time and the target object is not detected within the sensing range of the sensing component 300, it indicates that the current target sub-task has not been completed and the target object is not processing the target sub-task. At this time, it is necessary to monitor the second duration during which the target object is not within the sensing range, i.e. the duration during which the target object leaves, to ensure that the target sub-task is completed on time.
[0092] It should be noted that the preset remaining time in this application embodiment can be set according to the needs of the target object, such as five minutes, ten minutes, three minutes, etc. This application embodiment does not impose specific limitations.
[0093] Step S107: When the second duration exceeds the preset interruption duration, a prompt message is generated.
[0094] In step S107 of some embodiments, when the second duration is longer than the preset interruption duration, it indicates that the target object has been gone for too long and a prompt message needs to be generated to indicate that the target object has been gone for too long.
[0095] It should be noted that the preset interruption duration in this application embodiment can be set according to the user's needs. For example, the preset interruption duration can be set to five minutes, ten minutes, twenty minutes, etc. This application embodiment does not impose any specific limitations.
[0096] It is understood that the prompt information in this application embodiment can be voice prompt information, text prompt information, or light prompt information, etc. When the prompt information is text prompt information or light prompt information, it can be directly displayed through the display screen 200 of the display component; when the prompt information is voice prompt information, it can be played through the sound playback component of the display device. This application embodiment does not impose specific limitations.
[0097] Reference Figure 5 , Figure 5 This is a flowchart of a control method for a display device provided in another embodiment of this application. Figure 5 This includes, but is not limited to, steps S201 to S205.
[0098] It should be noted that steps S201 to S205 occur after the first remaining time is determined based on the duration and the target task duration, and the first remaining time is displayed on the display screen 200.
[0099] Step S201: Determine the total task duration for completing the sequence of tasks to be completed, and determine the final and non-final tasks in the sequence of tasks to be completed.
[0100] Step S202: When the first remaining time is less than or equal to the preset remaining time, generate task end information.
[0101] Step S203: If no extension instruction is received within the preset time period, and the target subtask is not the end task, determine the next task to be completed in the task sequence and determine the duration of the task to be completed corresponding to the task to be completed.
[0102] It should be noted that the preset duration is less than the first remaining duration.
[0103] Step S204: Record the third duration during which the target object is within the sensing range.
[0104] Step S205: Adjust the total task duration based on the third duration and the duration of the task to be completed.
[0105] In steps S201 to S205 of some embodiments, after determining the first remaining time based on the duration and the target task duration, this embodiment further determines the total task duration for completing the sequence of tasks to be completed, i.e., the total task duration for completing all sub-tasks in the sequence of tasks to be completed, and determines the final task and non-final tasks in the sequence of tasks to be completed. The final task is the last sub-task in the sequence of tasks to be completed, and the non-final tasks are tasks other than the last sub-task in the sequence of tasks to be completed. Then, the first remaining time is compared with a preset remaining time. If the first remaining time is less than or equal to the preset remaining time, it indicates that the remaining time for the target sub-task is short, equivalent to the target sub-task being in a completed state, and task completion information is generated. If no extension instruction is received within the preset time, it indicates that the target sub-task can be completed on time. If the target sub-task is a non-final task, it indicates that other sub-tasks still need to be completed. This embodiment will determine the next task to be completed in the sequence of tasks to be completed when no extension instruction is received and the target sub-task is a non-final task, thereby enabling processing according to the order of the sub-tasks in the sequence of tasks to be completed. To ensure a smooth transition between tasks and determine the duration of each pending task, maintain work continuity and efficiency, and ensure that all relevant personnel can see the task progress and the next steps, thereby improving transparency, the sensor component 300 records the third duration during which the target object is within the sensing range, enabling real-time sensing of the target object and determining whether it is performing a pending task. Finally, the total task duration is adjusted based on the third duration and the pending task duration to avoid a significant difference between the total time for completing all sub-tasks and the set total task duration, ensuring that tasks can be completed within the planned total time and maintaining the progress of the project or workflow.
[0106] It should be noted that the preset remaining time in this embodiment can be set according to the needs of the target object. The preset remaining time represents the maximum allowed remaining time during the execution of the subtask. If the remaining time equals the preset remaining time, it can be considered that the subtask has been completed. This embodiment does not impose specific restrictions on the setting of the preset remaining time. Furthermore, the preset time in this embodiment can be set according to the needs of the target object, as long as it is less than the first remaining time. For example, it can be set to five minutes, three minutes, eight minutes, etc. This embodiment does not impose specific restrictions.
[0107] Reference Figure 6 , Figure 6 This is a flowchart of a control method for a display device provided in another embodiment of this application. The control method for the display device includes, but is not limited to, steps S301 to S302.
[0108] It should be noted that steps S301 to S302 occur after the task end information is generated when the first remaining time is less than or equal to the preset remaining time.
[0109] Step S301: When an extension instruction is received within the preset duration, determine the extension duration corresponding to the extension instruction.
[0110] Step S302: Add the extended duration to the remaining duration to obtain the target duration.
[0111] In steps S301 to S302 of some embodiments, after generating task completion information, if an extension instruction is received within a preset time period, it indicates that the target subtask has not been completed on time and needs to be extended. At this time, the extension time corresponding to the extension instruction is determined, that is, the additional time required to complete the target subtask. The extension time is then added to the remaining time to obtain the target time, thereby extending the remaining time and ensuring that the target object can complete the target subtask within a certain time period. This achieves reasonable time planning and allows for flexible adjustment of the time arrangement according to the actual task situation, adapting to unforeseen workload or complexity.
[0112] It is worth noting that the extension command in this application embodiment is obtained by the target object inputting information through the display screen 200, or by recognizing the gesture of the target object through the visual acquisition module. This application embodiment does not impose specific limitations.
[0113] Understandably, the target audience can generate extension instructions via the display screen 200 or through specific gestures. Extending the remaining time provides the target audience with extra time, reducing stress and anxiety caused by time constraints. Furthermore, the extra time ensures that staff have sufficient time to focus on the task, improving work quality.
[0114] Specifically, taking a haircutting scenario as an example, during the hairdresser's execution of the haircutting sub-task, the estimated haircutting time is twenty minutes. At this point, only five minutes remain in the haircutting sub-task. Due to the customer's large amount of hair, the haircutting time is longer than estimated. In this case, the hairdresser can input the desired extension time through the display screen 200, such as extending by five minutes, extending by ten minutes, etc. Taking an extension of five minutes as an example, the remaining time of the haircutting sub-task on the display screen 200 will be updated to ten minutes.
[0115] Reference Figure 7 , Figure 7 yes Figure 5 The flowchart of the specific method of step S205 is as follows: step S205 includes, but is not limited to, steps S401 to S405.
[0116] Step S401: Determine the second remaining duration based on the third duration and the duration of the task to be completed.
[0117] Step S402: When the task to be completed is the final task, determine all subtasks before the task to be completed based on the sequence of tasks to be completed, and obtain the set of completed tasks.
[0118] Step S403: Calculate the time consumed by all subtasks in the completed task set, and determine the cumulative time consumed based on the third duration and the consumed time.
[0119] Step S404: Calculate the difference between the cumulative time consumed and the total task time.
[0120] Step S405: When the time difference is greater than or equal to the preset difference threshold, shorten the time of the task to be completed to adjust the total task time.
[0121] In steps S401 to S405 of some embodiments, during the process of adjusting the total task duration based on the third duration and the duration of the task to be completed, the second remaining duration of the task to be completed is first determined based on the third duration and the duration of the task to be completed. Then, the task type of the task to be completed is determined, i.e., whether the task to be completed is a final task or a non-final task. If the task to be completed is a final task, it means that the task to be completed is the last subtask in the sequence of tasks to be completed. At this time, all subtasks before the task to be completed are determined based on the sequence of tasks to be completed, i.e., all subtasks that have been completed, thus obtaining a set of completed tasks. This achieves the collection of all completed subtasks. Afterward, the time consumed to complete all subtasks in the set of completed tasks is calculated, i.e., the time consumed to execute all subtasks in the set of completed tasks. The duration is calculated, and the cumulative consumption time from the start of subtask execution to the current progress of the task to be completed is determined based on the third duration and the consumption time. Finally, the duration difference between the cumulative consumption time and the total task duration is calculated, and the duration difference is compared with a preset difference threshold. When the duration difference is greater than or equal to the preset difference threshold, it means that the current duration difference exceeds the maximum excess time required to complete the sequence of tasks to be completed. In order to avoid completing the sequence of tasks to be completed within the planned time, this application embodiment will shorten the duration of tasks to be completed to adjust the total task duration. Specifically, this application embodiment will generate task prompt information to remind the target object to improve efficiency, avoid the total time to complete all subtasks from differing too much from the set total task duration, ensure that the task can be completed within the planned total time, and maintain the progress of the project or workflow.
[0122] It should be noted that the preset difference threshold in this application embodiment is the maximum excess time that can be received to complete the entire sequence of tasks to be completed. The preset difference threshold can be set by the user according to their needs, such as 30 minutes, 40 minutes, 20 minutes, etc. This application embodiment does not impose any specific restrictions.
[0123] It is understood that the embodiments of this application adjust the total task duration by determining the difference between the cumulative consumption time and the total task duration, thereby enabling the identification of potential delay risks in advance and taking measures to avoid project delays and the waste of human and material resources due to improper time management.
[0124] Reference Figure 8 , Figure 8 This is a flowchart of a control method for a display device provided in another embodiment of this application. The control method for the display device includes, but is not limited to, steps S501 to S505.
[0125] It should be noted that the sensing component 300 also includes a visual acquisition module.
[0126] Step S501: Acquire motion images of the target object through the vision acquisition module.
[0127] Step S502: Perform gesture detection on the action image according to the preset image processing algorithm to obtain the target gesture region.
[0128] Step S503: Extract features from the target gesture region based on a preset convolutional neural network to obtain gesture features.
[0129] Step S504: Determine the gesture command corresponding to the gesture feature from the preset gesture feature library.
[0130] Step S505: Send a gesture command to the display screen 200 so that the display screen 200 displays the command information corresponding to the gesture command.
[0131] In steps S501 to S505 of some embodiments, this application embodiment can also acquire action images of the target object through a visual acquisition module, and then perform gesture detection on the action images according to a preset image processing algorithm. Specifically, this application embodiment performs background segmentation on the action images, separates the foreground gesture region through background subtraction technology, and then performs contour tracking on continuous image frames of the separated foreground finger region to identify the changes in gesture over time. Afterwards, the gesture region is segmented from the image through methods such as clustering and threshold segmentation to obtain the target gesture region. Then, feature extraction is performed on the target gesture region based on a preset convolutional neural network. Specifically, features are extracted through the convolutional and pooling layers of the convolutional neural network to obtain multiple feature vectors, and then the multiple feature vectors are fused to obtain a more comprehensive feature identifier, thereby obtaining gesture features and realizing accurate recognition of gesture features, which facilitates subsequent operations based on gesture features. The system determines the corresponding gesture command from a pre-defined gesture feature library. This library contains a series of predefined mapping relationships between gesture features and their corresponding gesture commands. For example, when the target object makes an upward swipe gesture, the corresponding gesture command is to increase the volume; when the target object makes a downward swipe gesture, the corresponding gesture command is to decrease the volume, and so on. This allows for the determination of different gesture commands for different gesture features, achieving personalized gesture recognition. Finally, the gesture command is sent to the display screen 200 so that the display screen 200 can display the command information corresponding to the gesture command, enabling real-time display of command information and providing a richer multimodal interactive experience.
[0132] It should be noted that the image processing algorithm in the embodiments of this application can be a filtering algorithm, an edge detection algorithm, a contour tracking algorithm, etc., and the embodiments of this application do not impose specific limitations.
[0133] It is worth noting that the gesture feature library in this application embodiment contains a series of predefined mapping relationships between gesture features and corresponding gesture commands. By comparing the captured real-time gesture features with the features in the library, the system can identify specific gestures performed by the user. Once a gesture is recognized, the gesture feature library can associate the gesture with preset commands or operations, such as opening an application, switching menus, or executing commands.
[0134] To illustrate the control method of the display device in the embodiments of this application, specific examples are provided below.
[0135] Example 1:
[0136] Example 1 provides a detailed explanation of the control method for the display device in a hairdressing scenario.
[0137] In some embodiments, the display device includes a display component and a sensing component 300. The display component includes a mirror and a display screen 200, and the sensing component 300 includes a visual acquisition module, a transmitting module, and a receiving module. The display screen 200 is equipped with multiple hair-cutting buttons, such as a haircut button, a hair dyeing button, a shampoo button, a perm button, a styling button, etc., with a preset remaining time of two minutes and a preset interruption time of five minutes.
[0138] The hairdresser communicates with the customer about their haircut needs. Taking shampooing, cutting, and perming as an example, the haircut needs include three sub-tasks: shampooing, cutting, and perming. After receiving the customer's needs, the hairdresser selects the shampoo button, the cutting button, and the perming button on the display screen 200. The three sub-tasks are then sorted on the display screen 200 to obtain a sequence of tasks to be completed. For each sub-task, a time limit is set; for example, the shampooing sub-task might be set to 20 minutes, the cutting sub-task to 20 minutes, and the perming sub-task to 2 hours. Since customers may move to other areas for shampooing, the target person selects the haircut sub-task as the starting timer via the display screen 200, confirming the haircut sub-task as the target sub-task. Then, the sensing component 300 senses the target person's first duration within the sensing range. Taking a first duration of ten minutes as an example, the first remaining time of the target sub-task is determined to be ten minutes, and the first remaining time is displayed on the display screen 200. Since the mirror is set to face the customer and hairdresser, the customer and hairdresser can monitor the time changes in real time, which can better facilitate collaboration and coordination, without the need for the customer and hairdresser to repeatedly look down or up to check the time.
[0139] During a haircut, if the hairdresser is called away by another customer, resulting in the hairdresser not being detected within the sensing range of the sensing component 300, and the first remaining time is ten minutes (longer than the preset remaining time), and the hairdresser is still not detected within the sensing range of the sensing component 300, this embodiment will monitor a second duration for which the target object is not within the sensing range. For example, if the second duration is six minutes, and this duration exceeds the preset interruption time, a prompt message will be generated to remind the hairdresser to return to the current haircutting sub-task. By monitoring the task progress in real time, delays can be detected promptly, allowing for appropriate measures to be taken and improving overall work efficiency. Furthermore, customers can accurately obtain the specific time their haircut will be completed, facilitating their subsequent arrangements for other matters.
[0140] Please see Figure 9 , Figure 9 This illustration shows the hardware structure of an electronic device according to one embodiment. The electronic device includes:
[0141] The processor 1001 can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this application.
[0142] The memory 1002 can be implemented as a read-only memory (ROM), static storage device, dynamic storage device, or random access memory (RAM). The memory 1002 can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 1002 and is called by the processor 1001 to execute the control method of the display device in the embodiments of this application.
[0143] Input / output interface 1003 is used to implement information input and output;
[0144] The communication interface 1004 is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).
[0145] Bus 1005 transmits information between various components of the device (e.g., processor 1001, memory 1002, input / output interface 1003, and communication interface 1004);
[0146] The processor 1001, memory 1002, input / output interface 1003 and communication interface 1004 are connected to each other within the device via bus 1005.
[0147] Furthermore, one embodiment of this application provides a computer-readable storage medium storing computer-executable instructions that are executed by a processor or controller, for example, by a processor in the above system embodiment, causing the processor to perform the control method of the display device in the above embodiment.
[0148] The embodiments described in this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. As those skilled in the art will know, with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.
[0149] It will be understood by those skilled in the art that Figure 1-9 The technical solutions shown do not constitute a limitation on the embodiments of this application, and may include more or fewer steps than shown, or combine certain steps, or different steps.
[0150] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.
[0151] Those skilled in the art will understand that all or some of the steps in the methods disclosed above, as well as the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, or suitable combinations thereof.
[0152] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0153] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.
[0154] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0155] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes multiple instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing programs, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0156] The preferred embodiments of the present application have been described above with reference to the accompanying drawings, but this does not limit the scope of the claims of the present application. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and substance of the embodiments of the present application shall be within the scope of the claims of the present application.
Claims
1. A display device, characterized by comprising: The display device comprises: a display assembly comprising an assembly body and a display screen embedded in the assembly body; an induction assembly connected to the display assembly, the induction assembly being configured to induce a target object within an induction range; a controller connected to the display assembly and the induction assembly, the controller being configured to receive a task sequence to be completed via the display screen and display the task sequence to be completed via the display screen, wherein the task sequence to be completed comprises a plurality of sub-tasks, for each sub-task, a task duration corresponding to the sub-task is set, a processing instruction is received via the display screen, a target sub-task corresponding to the processing instruction in the task sequence to be completed and a target task duration corresponding to the target sub-task are determined, when a target object is induced within the induction range of the induction assembly, a first duration in which the target object is in the induction range is monitored, a remaining duration is determined according to the first duration and the target task duration, and the remaining duration is displayed via the display screen, and when the remaining duration is greater than a preset remaining duration and no target object is induced within the induction range of the induction assembly, a second duration in which the target object is not in the induction range is monitored, and when the second duration is greater than a preset interruption duration, a prompt information is generated; the controller is further configured to, after determining a first remaining duration according to the first duration and the target task duration and displaying the first remaining duration via the display screen: determine a total task duration for completing the task sequence to be completed and determine an ending task and a non-ending task in the task sequence to be completed; generate a task end information when the first remaining duration is less than or equal to a preset remaining duration; when no extension instruction is received within a preset duration and the target sub-task is the non-ending task, determine a next task to be completed in the task sequence to be completed and a task duration corresponding to the task to be completed, wherein the preset duration is less than the first remaining duration; record a third duration in which the target object is in the induction range; adjust the total task duration according to the third duration and the task duration to be completed.
2. The display device according to claim 1, wherein The induction assembly comprises a visual acquisition module, a transmitting module and a receiving module, the transmitting module is configured to transmit an infrared transmitting signal, and the receiving module is configured to receive an infrared reflecting signal, wherein the infrared reflecting signal is obtained by reflecting the infrared transmitting signal by a target object, and the visual acquisition module is configured to acquire an action image of the target object.
3. The display device according to claim 1, wherein The display device further comprises a sound playing assembly arranged in the assembly body, and the controller is further configured to generate an audio playing signal and send the audio playing signal to the sound playing assembly to make the sound playing assembly play audio.
4. A control method of a display device, characterized by, The control method is applied to the display device of any one of claims 1 to 3. receiving a to-be-completed task sequence through the display screen and displaying the to-be-completed task sequence through the display screen, wherein the to-be-completed task sequence comprises a plurality of subtasks; for each subtask, setting a task duration corresponding to the subtask; receiving a processing instruction through the display screen, determining a target subtask corresponding to the processing instruction in the to-be-completed task sequence, and determining a target task duration corresponding to the target subtask; when a target object is sensed within the sensing range of the sensing assembly, monitoring a first duration for which the target object is in the sensing range; determining a first remaining duration according to the first duration and the target task duration, and displaying the first remaining duration through the display screen; when the first remaining duration is greater than a preset remaining duration and no target object is sensed within the sensing range of the sensing assembly, monitoring a second duration for which the target object is not in the sensing range; when the second duration is greater than a preset interruption duration, generating a prompt information; after determining a first remaining duration according to the duration and the target task duration and displaying the first remaining duration through the display screen, the method further comprises: determining a total task duration for completing the to-be-completed task sequence, and determining an ending task and a non-ending task in the to-be-completed task sequence; when the first remaining duration is less than or equal to a preset remaining duration, generating a task end information; when no extension instruction is received within a preset duration and the target subtask is the non-ending task, determining a next to-be-completed task of the target subtask in the to-be-completed task sequence, and determining a to-be-completed task duration corresponding to the to-be-completed task, wherein the preset duration is less than the first remaining duration; recording a third duration for which the target object is in the sensing range; adjusting the total task duration according to the third duration and the to-be-completed task duration.
5. The control method of a display device according to claim 4, wherein after generating a task end information when the first remaining duration is less than or equal to a preset remaining duration, the method further comprises: when an extension instruction is received within a preset duration, determining an extension duration corresponding to the extension instruction; adding the extension duration to the remaining duration to obtain a target duration.
6. The control method of a display device according to claim 4, wherein the adjusting the total task duration according to the third duration and the to-be-completed task duration comprises: determining a second remaining duration according to the third duration and the to-be-completed task duration; when the to-be-completed task is the ending task, determining all subtasks before the to-be-completed task according to the to-be-completed task sequence to obtain a completed task set; counting a consumed duration for completing all subtasks in the completed task set, and determining an accumulated consumed duration according to the third duration and the consumed duration; calculating a duration difference value between the accumulated consumed duration and the total task duration; when the duration difference value is greater than or equal to a preset difference threshold, shortening the to-be-completed task duration to adjust the total task duration.
7. The control method of a display device according to claim 4, wherein the sensing assembly further comprises a visual acquisition module; the method further comprises: An action image of a target object is collected by the visual collection module; A target gesture region is obtained by performing gesture detection on the action image according to a preset image processing algorithm; Gesture features are obtained by performing feature extraction on the target gesture region based on a preset convolutional neural network; A gesture instruction corresponding to the gesture features is determined in a preset gesture feature library; The gesture instruction is sent to the display screen, so that the display screen displays instruction information corresponding to the gesture instruction.
8. An electronic device, comprising: The display device comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor executes the computer program to implement the control method of the display device according to any one of claims 4 to 7. The computer readable storage medium stores computer executable instructions for executing the control method of the display device according to any one of claims 4 to 7.
9. A computer-readable storage medium, characterized in that,
Citation Information
Patent Citations
Information interaction method, display terminal and storage medium
CN114374876A