A device control method, apparatus, storage medium, and electronic device

Abstract

The application relates to a device control method and device, a storage medium and an electronic device, and relates to the technical field of intelligent interaction. The method comprises the following steps: based on the interaction action of a user in a target region and / or a target position in a terminal device, a target device corresponding to the target region and / or the target position is controlled to adjust to a target state. Compared with the related art, the application can control the state adjustment of the device in the target region and / or the target position in the terminal device based on the interaction action of the user in the target region and / or the target position, so that the target device is adjusted to the target state. Therefore, the application can realize the state control of the target device corresponding to the target region and / or the target position through the interaction action of the user in the target region and / or the target position, and the adjustment does not need to rely on a central control device, thereby meeting the use requirements in different scenes.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, specifically to a device control method, apparatus, storage medium, and electronic device. Background Technology

[0002] In related technologies, users need to adjust the status of different devices in the terminal device through the central control device of the terminal device, which cannot meet the usage needs in different scenarios. Summary of the Invention

[0003] In view of this, this application provides a device control method, apparatus, storage medium and electronic device, the main purpose of which is to improve the technical problem in the related art that users need to adjust the status of different devices in the terminal device through the central control device of the terminal device, which cannot meet the usage needs in different scenarios.

[0004] In a first aspect, this application provides a device control method, comprising: Based on the user's interactive actions in the target area and / or target location within the terminal device, the target device corresponding to the target area and / or target location is controlled to adjust to the target state.

[0005] Optionally, the interactive action includes an interactive action applied by the user to the area where the target device is located, and / or an interactive action applied by the user to a target location of the target device.

[0006] Optionally, the interaction action is a contact-based interaction action.

[0007] Optionally, controlling the target device corresponding to the target area and / or target location to adjust to the target state based on the user's interactive actions in the target area and / or target location within the terminal device includes: Based on the interactive action, determine the status information of the first target device corresponding to the target area and / or target location; Based on the status information of the first target device, control the first target device to adjust to the first target state.

[0008] Optionally, controlling the first target device to adjust to a first target state based on the state information of the first target device includes: When the first target device is in the on state, control the first target device to adjust to the off state; When the first target device is in a closed state, control the first target device to be adjusted to an open state.

[0009] Optionally, the method further includes: When the first target device is a refrigerator, in response to the target duration of the refrigerator being turned on, a first interactive prompt message is output, which is used to indicate that the refrigerator is in the on state.

[0010] Optionally, the output of the first interactive prompt information includes: The first interactive prompt message is read aloud via voice; and / or, The first interactive prompt information is displayed through a virtual avatar and / or target window.

[0011] Optionally, determining the state information of the first target device based on the user's target gesture on the first target device includes: Based on the patting gesture made by the user towards the first target device, the status information of the first target device is determined.

[0012] Optionally, the method further includes: Based on the user's approach to the first target device, the second target device is controlled to adjust to the target state and / or display the second interactive prompt information corresponding to the second target device.

[0013] Optionally, based on the user's approach to the first target device, control the second target device to adjust its state, including: Based on the user's approach to the first target device, and according to the user's seating position and the device position of the first target device, the target seat in which the user is sitting is controlled to move closer to the first target device.

[0014] Optionally, controlling the target seat where the user is sitting to move closer to the first target device based on the seating position and the device position of the first target device includes: When the seating position is in front of the device position, control the target seat to move backward and / or control the backrest of the target seat to tilt backward; When the seating position is behind the device position, the user's seat is moved forward.

[0015] Optionally, the method further includes: In response to the user completing the interaction, the second target device is controlled to restore its state. In response to the first target device completing state adjustment, the second target device is controlled to perform state recovery; In response to the user's target command, the second target device is controlled to perform state recovery.

[0016] Optionally, the method further includes: When the terminal device is in motion and the user is the primary driver, the second target device is controlled to maintain its state based on the user's approach to the first target device.

[0017] Optionally, the target device includes a first target device and / or a second target device, the first target device including a refrigerator and / or a display device, and the second target device including at least one of the front seat, second row seat and third row seat of the terminal device; wherein, the first target device is disposed between the front seat and second row seat of the terminal device.

[0018] Secondly, this application provides a device control apparatus, comprising: The control module is configured to adjust the target device corresponding to the target area and / or target location to the target state based on the user's interactive actions in the target area and / or target location within the terminal device.

[0019] Thirdly, this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the device control method described in the first aspect.

[0020] Fourthly, this application provides an electronic device, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor executes the computer program to implement the device control method described in the first aspect.

[0021] Fifthly, this application provides a vehicle or robot, including the control device described in the second aspect, or the electronic device described in the fourth aspect.

[0022] By employing the above technical solutions, this application provides a device control method, apparatus, storage medium, and electronic device, comprising: controlling a target device corresponding to a target area and / or target location to adjust to a target state based on user interaction actions within a target area and / or target location in a terminal device. Compared with related technologies, this application can control the state adjustment of the device in the target area and / or target location based on user interaction actions within the terminal device, thereby adjusting the target device to the target state. This allows the application to achieve state control of the target device corresponding to the target area and / or target location through user interaction actions, without relying on a central control device for adjustment, thus meeting the usage needs in different scenarios.

[0023] The above description is only an overview of the technical solution of this application. In order to better understand the technical means of this application and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of this application more obvious and understandable, the following are specific embodiments of this application. Attached Figure Description

[0024] The accompanying drawings, which are included to provide a further understanding of this disclosure and form part of this disclosure, illustrate exemplary embodiments of the present disclosure and are used to explain the disclosure, but do not constitute an undue limitation of the disclosure. In the drawings: Figure 1 A schematic flowchart of a device control method provided in an embodiment of this disclosure is shown; Figure 2 A schematic flowchart of a device control method provided in an embodiment of this disclosure is shown; Figure 3 A schematic diagram of the structure of a device control apparatus provided in an embodiment of this disclosure is shown; Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure is shown. Detailed Implementation

[0025] To better understand the above-mentioned objectives, features, and advantages of this application, the solution of this application will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described in these embodiments can be combined with each other.

[0026] To address the technical problem in related technologies where users need to adjust the status of different devices within a terminal device through a central control device, which fails to meet the usage needs of various scenarios, this embodiment provides a device control method, such as... Figure 1 As shown, the method includes: Step 101: Based on the user's interactive actions in the target area and / or target location within the terminal device, control the target device corresponding to the target area and / or target location to adjust to the target state.

[0027] It should be noted that the execution subject of the embodiments of this application can be a terminal device, wherein the terminal device can be a human-carrying terminal device, for example, the terminal device can include, but is not limited to, a vehicle, a human-carrying robot, a humanoid robot, etc.; wherein, when the terminal device is a vehicle, the vehicle can be a vehicle of different drive types, such as an electric vehicle, a fuel vehicle, etc.; the vehicle can also be a vehicle of different models, such as a sedan, a commercial vehicle, etc.

[0028] In some examples, the target area can be a region within the terminal device that can control the target device; the target area may include, but is not limited to, the region within the terminal device where the target device is located, the surface or content region of the target device, the region associated with the target device, etc., without specific limitations.

[0029] In this embodiment, the target location can be the location of a controllable target device in the terminal device; it may include, but is not limited to, the location of the target device in the terminal device, the control position on the surface or inside of the target device, the location associated with the target device, the target location in the target area, etc., and is not specifically limited here.

[0030] For example, the interactive action can be an action that the user can perform in the target area and / or target location to interact with the target device. For instance, if the target area is the surface area of ​​the target device and the interactive action is a touch action, then when the user touches the surface area of ​​the target device, the target device corresponding to the target area and / or target location can be controlled to adjust to the target state, and so on. No further examples will be given here.

[0031] In this embodiment, the target device can be a device in the terminal device that can interact with the user; for example, when the terminal device is a vehicle, the target device may include, but is not limited to, a refrigerator, display device (front row display device, and / or rear row display device, and / or position-adjustable display device (sliding adjustment), and / or display device set on the top of the terminal device, etc.), air conditioning vents, ambient lights, seats, etc., which are not specifically limited here.

[0032] As an optional approach, the target state can be the state that the target device needs to be adjusted to. For example, if the target device is a refrigerator, the target state can include, but is not limited to, cooling state, heating state, heat preservation state, refrigerator door open state, refrigerator door closed state, etc. If the target device is a seat, the target state can include, but is not limited to, seat back reclined state, seat raised state, state under different seat modes, etc., and so on. No further examples will be given here.

[0033] Optionally, the interaction action includes an interaction action performed by the user in the area where the target device is located, and / or an interaction action performed by the user at a target location on the target device.

[0034] In some examples, interactive actions may include, but are not limited to, interactive actions applied to the area where the target device is located in the terminal device, interactive actions applied to the surface area or content area of ​​the target device, interactive actions applied to the area associated with the target device, etc.; interactive actions may also include, but are not limited to, interactive actions applied to the location of the target device in the terminal device, interactive actions applied to the control location on the surface or inside of the target device, interactive actions applied to the location associated with the target device, interactive actions applied to the target location in the target area, etc., without specific limitations.

[0035] For example, when the interaction action is an interaction action applied by the user to the area where the target device is located, the user can control the target device to adjust to the target state by applying the interaction action to the area where the target device is located; when the interaction action is an interaction action applied by the user to the target location of the target device, the user can control the target device to adjust to the target state by applying the interaction action to the target location in the target area, and so on, without further examples here.

[0036] As an optional approach, the interactive actions in the embodiments of this application can be contact-based interactive actions; for example, they can include, but are not limited to, tapping, patting, touching, swiping, etc., without specific limitations; it should be noted that the interactive actions can also include non-contact interactive actions, for example, they can include, but are not limited to, waving, arm movement, etc.

[0037] For example, when the target area is the area where the target device is located, the interaction action can be a contact interaction action applied by the user to the area where the target device is located. That is, when the contact interaction action is a tapping action, the user can control the target device to adjust to the target state by applying a tapping action to the area where the target device is located. When the target area is the surface area of ​​the target device, the interaction action can be a contact interaction action applied by the user to the surface area of ​​the target device. That is, when the contact interaction action is a tapping action, the user can control the target device to adjust to the target state by applying a tapping action to the surface area of ​​the target device, and so on. Examples will not be given here.

[0038] For example, when the target location is the location of the target device, the interaction action can be a touch interaction action applied by the user to the location of the target device. That is, when the touch interaction action is a touch action, the user can control the target device to adjust to the target state by applying a touch action to the location of the target device. When the target location is a target location within a target area, the interaction action can be a touch interaction action applied by the user to the target location within the target area. That is, when the touch interaction action is a swipe action, the user can control the target device to adjust to the target state by applying a swipe action to the target location within the target area, and so on. Examples will not be given here.

[0039] Compared with related technologies, this embodiment can control the state adjustment of the device in the target area and / or target location based on the user's interactive actions in the target area and / or target location of the terminal device, thereby adjusting the target device to the target state. This embodiment can realize the state control of the target device corresponding to the target area and / or target location through the user's interactive actions in the target area and / or target location, without relying on the central control device for adjustment, thus meeting the usage needs in different scenarios.

[0040] Optionally, when performing the action of "controlling the target device corresponding to the target area and / or target location to adjust to the target state based on the user's interactive actions in the target area and / or target location within the terminal device", the following methods can be used, but are not limited to them, such as... Figure 2 As shown, the method includes: Step 201: Based on the interactive actions, determine the status information of the first target device corresponding to the target area and / or target location.

[0041] Optionally, the target device includes a first target device and / or a second target device. The first target device includes a refrigerator and / or a display device, and the second target device includes at least one of the front seat, second-row seat, and third-row seat of the terminal device. The first target device is disposed between the front seat and the second-row seat of the terminal device.

[0042] In this application embodiment, the first target device can be a device in the target device that the user needs to interact with based on interactive actions; for example, if the user makes an interactive action in the target area and / or target location, it is necessary to determine the device state of the target area and / or the first target device corresponding to the target area.

[0043] For example, if the first target device in the target device is an ambient light and the target area is the control area in front of the ambient light, then it is necessary to determine the state of the ambient light. If the device state of the ambient light is on, the ambient light can be controlled to switch from the on state to the target state based on the interactive actions (such as touch actions, swipe actions, etc.) performed by the user in the control area in front of the ambient light.

[0044] For example, if the first target device in the target device is a refrigerator and the target area is the island area of ​​the refrigerator, then it is necessary to determine the state of the refrigerator; if the refrigerator door is open, then the ambient light can be controlled to switch from the on state to the target state based on the user's interactive actions (such as patting, touching, sliding, tapping, etc.) in the island area of ​​the refrigerator.

[0045] Step 202: Based on the status information of the first target device, control the first target device to adjust to the first target state.

[0046] As an alternative approach, the first target state can be a target state determined based on the state information of the first device. For example, if the target device is a refrigerator, and the refrigerator's state information is that the refrigerator door is open, then the target state can be determined to be that the refrigerator door is closed. If the refrigerator's state information is that it is in a cooling state, then the target state can be determined to be that it is in a heat preservation state, and so on. No further examples will be given here.

[0047] As an alternative approach, the first target state can also be a target state determined based on the interaction action. For example, if the target device is a refrigerator, and the interaction action is a movement towards the opening direction of the refrigerator door, then the target state can be determined as the refrigerator door open state based on the movement towards the opening direction of the refrigerator door; if the interaction action is a movement towards the closing direction of the refrigerator door, then the target state can be determined as the refrigerator door closed state based on the movement towards the closing direction of the refrigerator door, and so on. No further examples will be given here.

[0048] Optionally, when executing "controlling the first target device to adjust to the first target state based on the status information of the first target device", the following methods may be used, but not limited to these, including: when the first target device is in the on state, controlling the first target device to adjust to the off state; when the first target device is in the off state, controlling the first target device to adjust to the on state.

[0049] In this embodiment of the application, the first target device corresponding to the target area and / or target location can be controlled to switch its on / off state based on the user's interactive actions in the target area and / or target location within the terminal device.

[0050] As an alternative approach, if the target area is the refrigerator island area and the interaction action is a tapping action, then when the user taps the refrigerator island area, if the refrigerator is in the open state, the refrigerator can be controlled to close; if the refrigerator is in the closed state, the refrigerator can be controlled to open.

[0051] As an alternative approach, if the target area is a control area within a certain distance in front of the ambient light and the interaction action is a hand swipe, then when the user swipes their hand across the control area within a certain distance in front of the ambient light, if the ambient light is on, the ambient light can be turned off; if the ambient light is off, the ambient light can be turned on.

[0052] As an alternative approach, if the target device is a display screen located behind the seat, and the target area is the back of the seat with the display screen and the interaction action is a tapping action, then the display screen located behind the seat can be turned on or off when the user taps the back of the seat with the display screen.

[0053] As an alternative approach, if the target device is a display screen located in the front row, and the target area is the central control area of ​​the terminal device where the front display screen is located, and the interaction action is a tapping action, then the display screen located in the front row can be turned on or off by the user tapping the central control area of ​​the terminal device where the front display screen is located.

[0054] As an alternative approach, if the target location is the back shell or edge of the second row of screens in the terminal device and the interaction action is a tapping action, then if the second row of screens is in an on state when the user taps the back shell or edge of the second row of screens, the second row of screens can be turned off; if the second row of screens is in an off state, the second row of screens can be turned on.

[0055] As an alternative approach, if the target device is a foldable display screen located on the top, and the interaction action is a tapping action, then when the user taps the target position or target area corresponding to the foldable display screen located on the top, the foldable display screen located on the top can also be controlled to open or close. Here, closing can be folding up or turning off, and opening can be unfolding or working, without being specifically limited here.

[0056] Optionally, this embodiment may also employ the following method, but not limited thereto: when the first target device is a refrigerator, in response to the target duration of the refrigerator being turned on, outputting a first interactive prompt message, the first interactive prompt message being used to indicate that the refrigerator is in the on state.

[0057] For example, if the first target device is a refrigerator, and the refrigerator is in an open state (the refrigerator door is open), then it is necessary to determine the duration of the refrigerator's operation. If the refrigerator is open for a target duration, the first interactive prompt message corresponding to the refrigerator door opening content is output to prompt the user that the refrigerator is in an open state.

[0058] For example, the first interactive prompt information can be information that the terminal device outputs after the refrigerator has been turned on for a target duration, which requires interaction with the occupants; for example, it can include, but is not limited to, prompt information to turn off the refrigerator, recommendation information to adjust the refrigerator to the off state, request information to adjust the refrigerator to the off state, etc.; that is, the user can interact with the first interactive prompt information to determine whether the refrigerator needs to be turned off.

[0059] It should be noted that the refrigerator can be opened by the user through interactive actions in the target area and / or target location, or by the user through voice commands or central control commands. The specific opening method of the refrigerator is not limited in the embodiments of this application.

[0060] Optionally, when performing the "output prompt message" operation, the following methods may be used, but not limited to these: broadcasting the first interactive prompt message via voice; and / or displaying the first interactive prompt message through a virtual avatar and / or a target window.

[0061] In the embodiments of this application, the virtual image may include, but is not limited to, a virtual image displayed on the screen of a terminal device, a virtual image projected by a terminal device through a projection device, a virtual image displayed through other terminal devices, etc.; correspondingly, the target window may include, but is not limited to, a window in the screen of the terminal device (e.g., a capsule area), a window displayed through other terminal devices, etc., and is not specifically limited here.

[0062] For example, if the refrigerator remains on for a target duration, the system can interact with the user through voice prompts, virtual avatars displayed on the screen, or target windows on the screen (such as capsule areas), to prompt or recommend that the user turn off the refrigerator.

[0063] Optionally, this embodiment may also employ the following methods, but not limited thereto: responding to a closing command corresponding to the refrigerator, controlling the refrigerator to close, wherein the closing command includes at least one of a voice command, a touch operation command, and a target gesture.

[0064] For example, the shutdown command can be a voice shutdown command (which may include, but is not limited to, voice input directly by the user to the terminal device, or voice input by the user through other terminal devices, such as headphones, wearable devices (smart glasses, watches, bracelets, etc.), etc.), or an action shutdown command (which may include, but is not limited to, gestures, body movements, facial movements, head movements, etc.), or a touch operation command (which may include, but is not limited to, touch operation commands directly input by the user to the terminal device, or touch operation commands input by the user through other terminal devices, wherein other terminal devices may include, but are not limited to, headphones, wearable devices (smart glasses, watches, bracelets, etc.), smart pens, etc.). It should be noted that the specific form of the shutdown command is not limited in this embodiment of the application.

[0065] As an alternative, when the terminal device broadcasts the first interactive prompt, the user can control the refrigerator to close by replying with a voice command. Correspondingly, when the terminal device displays the first interactive prompt through a virtual avatar and / or target window, the user can control the refrigerator to close by inputting a touch operation command. However, this is not the only option, and will not be listed here.

[0066] Optionally, when performing the "determine the status information of the first target device based on the target gesture made by the user on the first target device", the following methods may be used, but are not limited to: determining the status information of the first target device based on the patting gesture made by the user on the first target device.

[0067] In this embodiment, the user can perform a tapping action in the target area and / or target location to determine the status information of the first target device, and then control the first target device to adjust to the first target state based on the status information; for example, when the target area is the area where the refrigerator is located (refrigerator island area, refrigerator door area, refrigerator top area, etc.), the user can perform a tapping action in the refrigerator island area to determine the status information of the refrigerator, and then control the refrigerator to close when the refrigerator is in the open state; and control the refrigerator to open when the refrigerator is in the closed state.

[0068] As an alternative, when the target area is the back of the second row of screens, the user can tap the back of the second row of screens to determine the status information of the second row of screens, thereby controlling the second row of screens to turn off when they are on, and controlling the second row of screens to turn on when they are off.

[0069] Optionally, this embodiment may also employ the following methods, but not limited thereto: based on the user's approach action to the first target device, controlling the second target device to adjust to the target state and / or displaying the second interactive prompt information corresponding to the second target device.

[0070] In this embodiment of the application, the second target device can be a seat in the terminal device; specifically, the second target device can include the seat where the user is located and a seat associated with the user's seat; for example, when the user's seat is a front passenger seat, the second target device can include the front passenger seat and a seat associated with the front passenger seat, such as the right seat in the second row; correspondingly, when the user's seat is a driver's seat, the second target device can include the driver's seat and a seat associated with the driver's seat, such as the left seat in the second row, and so on, without further examples here.

[0071] In this embodiment, when the user approaches the target area (i.e., before making an interactive action), a proximity action to the first target device can be triggered. For example, if the user is a front passenger and the target area is the island area of ​​the refrigerator located slightly behind the middle of the front passenger seat, the user needs to approach the refrigerator if they need to make an interactive action in the island area. If the target area is the back area of ​​the second-row screen located in the middle of the second row, the user needs to approach the second-row screen if they need to make an interactive action in the back area of ​​the second-row screen, and so on. No further examples will be given here.

[0072] As an alternative approach, when a user makes an interactive action, a movement towards the first target device can also be triggered. For example, if the user is a front passenger and the target area is the island area of ​​the refrigerator located slightly behind the middle of the front passenger seat, if the user makes an interactive action in the island area of ​​the refrigerator, a movement towards the refrigerator can also be triggered. If the target area is the back area of ​​the second-row screen located in the middle of the second row, if the user makes an interactive action in the back area of ​​the second-row screen, a movement towards the second-row screen can also be triggered, and so on. No further examples will be given here.

[0073] As an alternative approach, a proximity action towards the primary target device can be triggered after the user makes an interaction. For example, if the user is a front passenger and the target area is the island area of ​​the refrigerator between the middle and rear seats of the driver and front passenger, if the user has already made an interaction in the refrigerator island area, it can be determined whether the user intends to interact with the refrigerator further, such as whether the user needs to take an item out of the refrigerator, which can trigger a proximity action towards the refrigerator. Similarly, if the target area is the back area of ​​the second-row screen in the middle of the second row, if the user has already made an interaction in the back area of ​​the second-row screen, it can be determined whether the user intends to interact with the second-row screen further, such as whether the user needs to make other adjustments to the second-row screen after turning it on (such as adjusting the playback content, playing sound, etc.), which can trigger a proximity action towards the second-row screen, and so on. Further examples will not be provided here.

[0074] In some examples, when the user is seated in front of the device, the approach action may include, but is not limited to, at least one of turning the head back, reaching the hand back, and leaning the body back; when the user is seated behind the device, it is based on the user reaching the hand forward and / or leaning the body forward.

[0075] For example, after a user makes an interactive action, a proximity action to the first target device can also be triggered. For instance, if the user is a front passenger and the target area is the island area of ​​the refrigerator located slightly behind the middle of the front passenger seat, if the user makes an interactive action in the refrigerator island area, the front passenger seat and / or the right seat of the second row can be moved backward, or the back of the front passenger seat can be tilted back, etc. Interactive prompts can also be displayed to control the front passenger seat and / or the right seat of the second row to move backward (e.g., "Would you like me to adjust the front passenger seat and / or the right seat of the second row back?") or to control the back of the front passenger seat to tilt back (e.g., "Would you like me to tilt the back of the front passenger seat back?"), etc., without specific limitations.

[0076] Optionally, when performing "controlling the second target device to adjust its state based on the user's approach to the first target device", the following methods may be used, but are not limited to: based on the user's approach to the first target device, and according to the user's seating position and the device position of the first target device, controlling the target seat in which the user is sitting to move closer to the first target device.

[0077] In some examples, when a user moves closer to the first device, the user's seating position can be determined, and the target seat corresponding to the seating position can be moved closer to the first target device based on the seating position and the device position of the first target device.

[0078] For example, if the user is a front passenger and the target area is the island area of ​​the refrigerator between the middle and rear positions of the front and front passenger seats, then the user's seating position can be determined as the front passenger position, and the refrigerator (i.e., the first target device in this application embodiment) is located between the front row and the second row. Then, the front passenger seat can be controlled to move closer to the second row, for example, by moving the front passenger seat backward.

[0079] For example, if the user is a user on the left side of the second row and the target area is the back area of ​​the second row screen in the middle of the second row, then the user's seating position can be determined to be on the left side of the second row, and the position of the second row screen (i.e. the first target device in this embodiment) is between the front row and the second row. Then the left side seat of the second row can be controlled to move closer to the front row. For example, the left side seat of the second row can be moved forward.

[0080] Optionally, when performing the action of "controlling the target seat of the user to move closer to the first target device based on the seating position and the device position of the first target device", the following methods may be used, but are not limited to: when the seating position is in front of the device position, controlling the target seat to move backward and / or controlling the back of the target seat to tilt; when the seating position is behind the device position, controlling the seat of the user to move forward.

[0081] For example, if the user is a front passenger and the target area is the island area of ​​the refrigerator between the middle and rear positions of the main and front passenger seats, then the user's seating position can be determined as the front passenger position, and the refrigerator (i.e., the first target device in this application embodiment) is located between the front and second rows. Then, the front passenger seat can be moved back and / or the back of the front passenger seat can be tilted back, etc.

[0082] For example, if the user is the left side of the second row and the target area is the back area of ​​the second row screen in the middle of the second row, then the user's seating position can be determined to be the left side of the second row, and the position of the second row screen (i.e. the first target device in this embodiment) is between the front row and the second row, then the left side seat of the second row can be controlled to move forward.

[0083] Optionally, this embodiment may also employ the following methods, but not limited to these, including any one of the following: controlling the second target device to restore its state in response to the user completing an interactive action; controlling the second target device to restore its state in response to the first target device completing a state adjustment; or controlling the second target device to restore its state in response to the user's target instruction.

[0084] For example, the second target device can restore the state after the user completes the interaction; it can also restore the state after the first target device completes the state adjustment; or it can restore the state based on the user's target control command. There are no specific limitations here. The target control command can include, but is not limited to, voice control commands, action control commands, touch operation commands, etc., to meet the usage needs in different scenarios.

[0085] Optionally, this embodiment may also employ the following methods, but not limited thereto: when the terminal device is in a driving state and the user is the primary driver, control the second target device to maintain its state based on the user's approach to the first target device.

[0086] It should be noted that when the terminal device is in motion and the user is the primary driver, in order to ensure the driving safety of the terminal device, the second target device is controlled to maintain its state when the primary driver approaches the first target device; for example, if the second target device is the primary driver's seat, then the primary driver's seat is controlled to maintain its state when the primary driver approaches the first target device.

[0087] In some examples, embodiments of this application may include, but are not limited to, the following embodiments: Example 1: A device control method, comprising: controlling the target device corresponding to the target area and / or target location to adjust to a target state based on the user's interactive actions in the target area and / or target location within the terminal device.

[0088] Example 2: Interactive actions include interactive actions applied by the user to the area where the target device is located, and / or interactive actions applied by the user to the target location of the target device.

[0089] Example 3: The interaction action is a contact-based interaction action.

[0090] Example 4: Based on interactive actions, determine the status information of the first target device corresponding to the target area and / or target location; based on the status information of the first target device, control the first target device to adjust to the first target state.

[0091] Example 5: When the first target device is in the on state, control the first target device to be adjusted to the off state; when the first target device is in the off state, control the first target device to be adjusted to the on state.

[0092] Example 6: When the first target device is a refrigerator, in response to the target duration of the refrigerator being turned on, a first interactive prompt message is output, which is used to indicate that the refrigerator is in the on state.

[0093] Example 7: The first interactive prompt is broadcast via voice; and / or the first interactive prompt is displayed through a virtual avatar and / or a target window.

[0094] Example 8: Determine the status information of the first target device based on the patting gesture made by the user on the first target device.

[0095] Example 9: Based on the user's approach action to the first target device, control the second target device to adjust to the target state and / or display the second interactive prompt information corresponding to the second target device.

[0096] Example 10: Based on the user's approach action to the first target device, and according to the user's seating position and the device position of the first target device, control the target seat in which the user is sitting to move closer to the first target device.

[0097] Example 11: When the seating position is in front of the device position, control the target seat to move backward and / or control the back of the target seat to tilt backward; when the seating position is behind the device position, control the user's seat to move forward.

[0098] Example 12: In response to the user completing an interactive action, control the second target device to restore its state; in response to the first target device completing a state adjustment, control the second target device to restore its state; in response to the user's target command, control the second target device to restore its state.

[0099] Example 13: When the terminal device is in motion and the user is the primary driver, the second target device is controlled to maintain its state based on the user's approach to the first target device.

[0100] Example 14: The target device includes a first target device and / or a second target device. The first target device includes a refrigerator and / or a display device. The second target device includes at least one of the front seat, second row seat and third row seat of the terminal device. The first target device is disposed between the front seat and the second row seat of the terminal device.

[0101] It should be noted that the device control method involved in the above embodiments may include at least one of Embodiments 1 to 14. For example, Embodiment 1 can be implemented as an independent embodiment, Embodiment 1+2 can be implemented as an independent embodiment, Embodiment 1+3 can be implemented as an independent embodiment, Embodiment 1+2+3 can be implemented as an independent embodiment, Embodiment 1+4 can be implemented as an independent embodiment, Embodiment 1+2+4 can be implemented as an independent embodiment, Embodiment 1+3+4 can be implemented as an independent embodiment, Embodiment 1+2+3+4 can be implemented as an independent embodiment, Embodiment 1+4+5 can be implemented as an independent embodiment, Embodiment 1+2+4+5 can be implemented as an independent embodiment, Embodiment 1+3+4+5+6 can be implemented as an independent embodiment, Embodiment 1+3+4+5+6 can be implemented as an independent embodiment, Embodiment 1+2+3+4+5+6 can be implemented as an independent embodiment, etc., and so on. These are not exhaustive examples.

[0102] Compared with related technologies, this embodiment can control the state adjustment of the device in the target area and / or target location based on the user's interactive actions in the target area and / or target location of the terminal device, thereby adjusting the target device to the target state. This embodiment can realize the state control of the target device corresponding to the target area and / or target location through the user's interactive actions in the target area and / or target location, without relying on the central control device for adjustment, thus meeting the usage needs in different scenarios.

[0103] Furthermore, as Figure 1 and Figure 2 The specific implementation of the method shown in this embodiment provides a device control apparatus, such as... Figure 3 As shown, the device includes: a control module 31.

[0104] The control module 31 is configured to control the target device corresponding to the target area and / or target location to adjust to the target state based on the user's interactive actions in the target area and / or target location within the terminal device.

[0105] In some examples of this embodiment, the interactive action includes an interactive action applied by the user to the area where the target device is located, and / or an interactive action applied by the user to a target location of the target device.

[0106] In some examples of this embodiment, the interaction action is a contact-based interaction action.

[0107] In some examples of this embodiment, the control module 31 is specifically configured to determine the state information of the first target device corresponding to the target area and / or target location based on the interactive action; and control the first target device to adjust to the first target state according to the state information of the first target device.

[0108] In some examples of this embodiment, the control module 31 is further configured to control the first target device to be adjusted to a closed state when the first target device is in an on state; and to control the first target device to be adjusted to an on state when the first target device is in a closed state.

[0109] In some examples of this embodiment, the control module 31 is further configured to output a first interactive prompt message in response to the target duration of the refrigerator being turned on when the first target device is a refrigerator. The first interactive prompt message is used to indicate that the refrigerator is in the on state.

[0110] In some examples of this embodiment, the control module 31 is further configured to broadcast the first interactive prompt information via voice; and / or to display the first interactive prompt information through a virtual avatar and / or a target window.

[0111] In some examples of this embodiment, the control module 31 is further configured to determine the status information of the first target device based on the patting gesture made by the user on the first target device.

[0112] In some examples of this embodiment, the control module 31 is further configured to control the second target device to adjust to the target state and / or display the second interactive prompt information corresponding to the second target device based on the user's approach action to the first target device.

[0113] In some examples of this embodiment, the control module 31 is further configured to control the target seat of the user to move closer to the first target device based on the user's approach action to the first target device, according to the user's seating position and the device position of the first target device.

[0114] In some examples of this embodiment, the control module 31 is further configured to control the target seat to move backward and / or control the backrest of the target seat to tilt when the seating position is in front of the device position; and to control the user's seat to move forward when the seating position is behind the device position.

[0115] In some examples of this embodiment, the control module 31 is further configured to control the second target device to restore its state in response to the user completing the interaction action; to control the second target device to restore its state in response to the first target device completing the state adjustment; and to control the second target device to restore its state in response to the user's target instruction.

[0116] In some examples of this embodiment, the control module 31 is further configured to control the second target device to maintain its state based on the user's approach to the first target device when the terminal device is in a driving state and the user is the primary driver.

[0117] In some examples of this embodiment, the target device includes a first target device and / or a second target device. The first target device includes a refrigerator and / or a display device, and the second target device includes at least one of the front seat, second row seat, and third row seat of the terminal device. The first target device is disposed between the front seat and the second row seat of the terminal device.

[0118] It should be noted that other corresponding descriptions of the functional units involved in the device control apparatus provided in this embodiment can be found in [reference]. Figure 1 and Figure 2 The corresponding description in [the document] will not be repeated here.

[0119] Based on the above, Figure 1 and Figure 2 Accordingly, this embodiment also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-described method. Figure 1 and Figure 2 The method shown.

[0120] Based on this understanding, the technical solution of this application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as CD-ROM, USB flash drive, mobile hard drive, etc.) and includes several instructions to cause a computer device (such as personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of this application.

[0121] like Figure 4 The diagram shown is a hardware structure schematic of an electronic device according to the present invention, comprising: At least one processor 401; and, A memory 402 is communicatively connected to at least one of the processors 401; wherein, The memory 402 stores instructions that can be executed by at least one of the processors to enable the at least one of the processors to perform the device control method as described above.

[0122] Figure 4 Take a processor 401 as an example.

[0123] The electronic device may also include an input device 403 and a display device 404.

[0124] The processor 401, memory 402, input device 403, and display device 404 can be connected via a bus or other means. Figure 4 Taking the example of a connection between China and Israel via a bus.

[0125] Memory 402, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the device control method in the embodiments of this application, for example, Figure 1 and Figure 2 The method flow is shown. The processor 401 executes various functional applications and data processing by running non-volatile software programs, instructions, and modules stored in the memory 402, thereby realizing the device control method in the above embodiments.

[0126] Memory 402 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and application programs required for at least one function; the data storage area may store data created according to the use of the device control method, etc. Furthermore, memory 402 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 402 may optionally include memory remotely located relative to processor 401, and these remote memories may be connected to the means of performing the device control method via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0127] Input device 403 can receive user clicks and generate signal inputs related to user settings and function control of the device control method. Display device 404 may include display devices such as a display screen.

[0128] When one or more modules are stored in the memory 402, and are run by one or more processors 401, the device control method in any of the above method embodiments is executed.

[0129] Optionally, the aforementioned physical devices may also include a user interface, a network interface, a camera, radio frequency (RF) circuitry, sensors, audio circuitry, a Wi-Fi module, etc. The user interface may include a display screen, input units such as a keyboard, etc., and optional user interfaces may also include USB interfaces, card reader interfaces, etc. The network interface may optionally include standard wired interfaces, wireless interfaces (such as Wi-Fi interfaces), etc.

[0130] Those skilled in the art will understand that the physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or combine certain components, or have different component arrangements.

[0131] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the aforementioned physical device, supporting the operation of information processing programs and other software and / or programs. The network communication module is used to enable communication between the various components within the storage medium, as well as communication with other hardware and software in the information processing physical device.

[0132] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented using software plus necessary general-purpose hardware platforms, or it can be implemented using hardware. By applying the solution of this embodiment, compared with related technologies, this embodiment can control the state adjustment of the device in the target area and / or target location based on the user's interactive actions in the target area and / or target location of the terminal device, thereby adjusting the target device to the target state. This embodiment can achieve state control of the target device corresponding to the target area and / or target location through the user's interactive actions in the target area and / or target location, without relying on a central control device for adjustment, thus meeting the usage needs in different scenarios.

[0133] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the term "comprising" or any other variations thereof is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0134] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A device control method, characterized in that, include: Based on the user's interactive actions in the target area and / or target location within the terminal device, the target device corresponding to the target area and / or target location is controlled to adjust to the target state.

2. The method according to claim 1, characterized in that, The interactive actions include interactive actions applied by the user to the area where the target device is located, and / or interactive actions applied by the user to the target location of the target device.

3. The method according to claim 1 or 2, characterized in that, The interaction is a contact-based interaction.

4. The method according to any one of claims 1 to 3, characterized in that, The step of controlling the target device corresponding to the target area and / or target location to adjust to the target state based on the user's interactive actions in the target area and / or target location within the terminal device includes: Based on the interactive action, determine the status information of the first target device corresponding to the target area and / or target location; Based on the status information of the first target device, control the first target device to adjust to the first target state.

5. The method according to claim 4, characterized in that, The step of controlling the first target device to adjust to a first target state based on the state information of the first target device includes: When the first target device is in the on state, control the first target device to adjust to the off state; When the first target device is in a closed state, control the first target device to be adjusted to an open state.

6. The method according to claim 5, characterized in that, The method further includes: When the first target device is a refrigerator, in response to the target duration of the refrigerator being turned on, a first interactive prompt message is output, which is used to indicate that the refrigerator is in the on state.

7. The method according to claim 6, characterized in that, The output of the first interactive prompt information includes: The first interactive prompt message is read aloud via voice; and / or, The first interactive prompt information is displayed through a virtual avatar and / or target window.

8. The method according to any one of claims 4 to 7, characterized in that, The step of determining the state information of the first target device based on the user's target gesture on the first target device includes: Based on the patting gesture made by the user towards the first target device, the status information of the first target device is determined.

9. The method according to any one of claims 4 to 8, characterized in that, The method further includes: Based on the user's approach to the first target device, the second target device is controlled to adjust to the target state and / or display the second interactive prompt information corresponding to the second target device.

10. The method according to claim 9, characterized in that, Based on the user's approach to the first target device, control the second target device to adjust its state, including: Based on the user's approach to the first target device, and according to the user's seating position and the device position of the first target device, the target seat in which the user is sitting is controlled to move closer to the first target device.

11. The method according to claim 10, characterized in that, The step of controlling the target seat where the user is sitting to move closer to the first target device based on the seating position and the device position of the first target device includes: When the seating position is in front of the device position, control the target seat to move backward and / or control the backrest of the target seat to tilt backward; When the seating position is behind the device position, the user's seat is moved forward.

12. The method according to claim 10 or 11, characterized in that, The method further includes at least one of the following: In response to the user completing the interaction, the second target device is controlled to restore its state. In response to the first target device completing state adjustment, the second target device is controlled to perform state recovery; In response to the user's target command, the second target device is controlled to perform state recovery.

13. The method according to any one of claims 10 to 12, characterized in that, The method further includes: When the terminal device is in motion and the user is the primary driver, the second target device is controlled to maintain its state based on the user's approach to the first target device.

14. The method according to any one of claims 1 to 13, characterized in that, The target device includes a first target device and / or a second target device. The first target device includes a refrigerator and / or a display device. The second target device includes at least one of the front seat, second row seat and third row seat of the terminal device. The first target device is disposed between the front seat and second row seat of the terminal device.

15. A device control apparatus, characterized in that, include: The control module is configured to adjust the target device corresponding to the target area and / or target location to the target state based on the user's interactive actions in the target area and / or target location within the terminal device.

16. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 14.

17. An electronic device, characterized in that, The invention includes a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, characterized in that the processor, when executing the computer program, implements the method of any one of claims 1 to 14.

18. A vehicle or robot, characterized in that, include: The apparatus of claim 15, or the electronic device of claim 17.

Images