An interaction method and apparatus

Abstract

This application relates to the field of communication technology and discloses an interaction method and apparatus. The interaction method provided in this application allows a first terminal device (vehicle-mounted terminal device) to send vehicle data information to a second terminal device (home terminal device), enabling the second terminal device to execute tasks corresponding to the vehicle data information. This enables collaboration between smart cars and smart homes, improving the user experience.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to an interaction method and apparatus. Background Technology

[0002] Intelligent vehicles are those equipped with advanced onboard environmental perception systems (such as radar and cameras) and control systems. For example, through these advanced systems, intelligent vehicles possess intelligent environmental perception capabilities, enabling them to automatically analyze the safety and danger states of the vehicle. Furthermore, these advanced systems can achieve partial or fully autonomous driving functions.

[0003] Smart home is a residential platform that integrates facilities related to home life using comprehensive wiring technology, network communication technology, security technology, automatic control technology, and audio-visual technology. It builds an efficient management system for residential facilities and daily household affairs, improves home security, convenience, comfort, and aesthetics, and achieves an environmentally friendly and energy-saving living environment.

[0004] With the rapid development of smart car and smart home technologies, people's demand for interconnected smart cars and smart homes is growing. However, at present, smart cars and smart homes still operate independently, lacking deep interaction and collaboration, making it difficult to meet users' diverse needs in driving and home life. Summary of the Invention

[0005] This application provides an interaction method and apparatus to solve the problem that smart cars and smart homes cannot communicate collaboratively.

[0006] In a first aspect, embodiments of this application provide an interaction method for a first terminal device, the method comprising: acquiring vehicle data information, the vehicle data information including driving data information corresponding to the vehicle where the first terminal device is located and the time information of the vehicle's arrival at its destination, and sending the vehicle data information to a second terminal device.

[0007] In this embodiment of the application, the first terminal device can be an in-vehicle terminal device, and the second terminal device can be a home terminal device.

[0008] The interaction method provided in this application embodiment allows a first terminal device to send vehicle data information to a second terminal device, enabling the second terminal device to execute tasks corresponding to the vehicle data information. For example, after acquiring the vehicle data information, the second terminal device can display it. This allows family members to monitor the driver's driving dynamics in real time and plan events accordingly. For instance, family members can plan cooking time based on the estimated arrival time of the vehicle at their home, as indicated in the vehicle data information. This enables collaboration between smart cars and smart homes, improving the user experience.

[0009] In one possible implementation of the first aspect, the driving data information includes at least one of the following: vehicle location information, vehicle trajectory information, or road condition information of the vehicle's journey.

[0010] In this embodiment, the driving data information may also include any data information related to vehicle movement that the first terminal device can obtain, such as vehicle speed and / or information about obstacles around the vehicle. It is understood that by sending the driving data information to the second terminal device, family members can easily access the driving data and monitor the driving dynamics in real time.

[0011] In one possible implementation of the first aspect, the method further includes: obtaining driver status information and sending the driver status information to a second terminal device.

[0012] This solution allows the second terminal device to display driver status information upon receiving it. For example, the driver status information could indicate whether the driver is fatigued or not. This allows family members to be aware of the driver's condition and make appropriate arrangements, such as reminding the driver to rest and avoid driving while fatigued, or preparing energy-boosting food for the driver.

[0013] In one possible implementation of the first aspect, the method further includes: receiving alarm information from the second terminal device, responding to the user's operation of viewing the monitoring screen, sending a monitoring data acquisition instruction to the second terminal device, and receiving monitoring data from the second terminal device and displaying the monitoring screen corresponding to the monitoring data.

[0014] In this embodiment, when the second terminal device detects a non-safety factor, it can send an alarm message to the first terminal device. The non-safety factor can include one or more of the following: a stranger entering the home, a gas leak, a gas alarm, or a fire. For example, if the second terminal device detects a stranger in the home using a camera, detects a fire, or detects a gas leak alarm, it can send an alarm message to the first terminal device. The first terminal device can then issue an alarm notification, such as displaying a message indicating: "Stranger in the home," or "Gas leak in the home." This allows occupants of the vehicle to take appropriate emergency measures, such as remotely controlling home appliances or handling the alarm.

[0015] In one possible implementation of the first aspect, the method further includes: detecting a control command corresponding to a home appliance connected to the second terminal device, and sending the control command to the second terminal device.

[0016] In some embodiments, the first terminal device can detect control commands for home appliances sent by the user via the voice assistant on the first terminal device. In some embodiments, the first terminal device can also detect control commands input by the user through text input, clicking application interface controls, etc. It can be understood that sending control commands from the first terminal device to the second terminal device can enable remote control of home appliances and improve the user experience.

[0017] In one possible implementation of the first aspect, the method further includes: detecting a communication request operation between the user and the second terminal device, and sending a communication request instruction corresponding to the communication request operation to the second terminal device, wherein the communication request instruction includes a voice communication request instruction or a video communication request instruction.

[0018] In some embodiments, the first terminal device can detect voice communication request commands or video communication request commands sent by the user through the voice assistant of the first terminal device. In some embodiments, the first terminal device can detect voice communication request commands corresponding to the user clicking the voice call button on the application interface, or video communication request commands corresponding to the user clicking the video call button. Thus, the communication method provided in this application embodiment can meet the real-time communication needs between people in the vehicle and people at home.

[0019] In one possible implementation of the first aspect, the method further includes: obtaining task process information corresponding to a first task running on a first terminal device, and sending the task process information corresponding to the first task to a second terminal device.

[0020] In some embodiments, the first terminal device can obtain task progress information corresponding to one or more tasks (e.g., the first task) running on the first terminal device, and send the task progress information to the second terminal device, so that the second terminal device can continue running the task based on the task progress information. For example, the task can be any task running on the first terminal device, such as a video playback task and / or a music playback task. The task progress information may include the task process name and / or task progress. For example, when the user closes the first terminal device, a variety show video is playing on the first terminal device, and the process name of the variety show video is thread1, and the playback progress is 30%, then the first terminal device can send the process name thread1 and the playback progress of 30% of the variety show video to the second terminal device, so that the second terminal device can run the process thread1 and continue playing the variety show video from the 30% progress point. In this way, a seamless entertainment experience can be achieved.

[0021] In one possible implementation of the first aspect, the method further includes: receiving home information from a second terminal device, wherein the home information includes at least one of status information of home appliances connected to the second terminal device and activity information of people in the home.

[0022] It's understandable that the primary terminal device can display home information. This allows passengers to monitor their home situation in real time and perform corresponding actions.

[0023] Secondly, embodiments of this application provide an interaction method for a second terminal device. The method includes: receiving vehicle data information from N first terminal devices, the vehicle data information including driving data information corresponding to the vehicle where the first terminal device is located and the time information of the vehicle's arrival at the destination; and executing the task corresponding to the vehicle data information of the N first terminal devices, wherein N is a positive integer.

[0024] It should be noted that the beneficial effects of the second aspect embodiment are similar to those of the first aspect embodiment, and will not be repeated here.

[0025] It is understood that the interaction method provided in this application embodiment may include one or more first terminal devices, which can simultaneously interact with second terminal devices. For example, multiple first terminal devices may all send vehicle data information to the second terminal device, and the second terminal device may display data information corresponding to the vehicles of the multiple first terminal devices. In this way, collaboration between multiple first terminal devices and second terminal devices is achieved.

[0026] In one possible implementation of the second aspect, the driving data information includes at least one of the following: vehicle location information, vehicle trajectory information, or road condition information of the vehicle's journey.

[0027] In one possible implementation of the second aspect, performing the task corresponding to the vehicle data information of N first terminal devices includes: displaying the vehicle data information of the N first terminal devices. For example, this can be done by displaying a pop-up banner notification, a card, or other similar method.

[0028] In one possible implementation of the second aspect, the destination includes the home location of the second terminal device; the task corresponding to the vehicle data information of the N first terminal devices includes: displaying and / or voice-broadcasting welcome information associated with the N first terminal devices based on the time information of the arrival of the vehicles of the N first terminal devices at the home location of the second terminal device.

[0029] It's understandable that different primary terminal devices can be associated with different welcome messages corresponding to family members. For example, if the vehicle on primary terminal device A is the one frequently driven by the father, the user can set primary terminal device A to be associated with the welcome message "Welcome Dad Home." If the vehicle on primary terminal device B is the one frequently driven by the mother, the user can set primary terminal device B to be associated with the welcome message "Welcome Mom Home." Thus, based on the arrival time of the vehicle on primary terminal device A at the home location, "Welcome Dad Home" can be displayed and / or voice-announced, and based on the arrival time of the vehicle on primary terminal device B at the home location, "Welcome Mom Home" can be displayed and / or voice-announced. By setting different personalized welcome methods for different users, deeper collaboration between in-vehicle terminal devices and home terminal devices can be further achieved, enhancing the user experience.

[0030] In one possible implementation of the second aspect, the destination includes the location of the second terminal device, and the task corresponding to the vehicle data information of N first terminal devices is executed, including: adjusting the state of the home device connected to the second terminal device based on the driving data information corresponding to the vehicles of the N first terminal devices and the time information of at least one vehicle arriving at the location of the second terminal device.

[0031] In one possible implementation of the second aspect, adjusting the state of home appliances connected to the second terminal device includes at least one of the following: adjusting the working state of security equipment connected to the second terminal device; or adjusting the working state of lighting equipment connected to the second terminal device; or adjusting the working state of audio-visual equipment connected to the second terminal device; or adjusting the working state of home appliances connected to the second terminal device; or adjusting the working state of kitchen and bathroom equipment connected to the second terminal device.

[0032] In some embodiments, security equipment may include various security doors of the home, monitoring equipment, etc. For example, the second terminal device may, based on the time information of the vehicle's arrival at the home location corresponding to the second terminal device, control the garage door to open when it determines that the vehicle is about to arrive home or has arrived home, and control the monitoring equipment to switch the main monitoring screen to the monitoring screen corresponding to the garage. In some embodiments, the second terminal device may also acquire the monitoring screen corresponding to the garage monitored by the monitoring equipment and display the monitoring screen corresponding to the garage.

[0033] It is understandable that controlling the monitoring equipment to switch the main monitoring screen to the monitoring screen corresponding to the garage, as well as displaying the monitoring screen corresponding to the garage, can make it easier for family members to view the monitoring screen, thereby inferring the precise time when the people in the vehicle (such as the driver and other people) went upstairs, the time when the door was opened, etc.

[0034] In some embodiments, the lighting device may include lamps or similar fixtures. For example, the second terminal device may turn on the lights in advance based on the time information of the vehicle's arrival at the user's home location. This ensures that the home is well-lit when the user arrives, improving the user experience.

[0035] In some embodiments, the audio-visual equipment may include a television, stereos, etc. For example, the second terminal device can control the television to play user-favorited or preset television programs, or control the stereo to play user-favorited music, based on the time information of the vehicle's arrival at the home location corresponding to the second terminal device. In this way, users can directly watch user-favorited or preset television programs, or listen to user-favorited music, etc., upon arriving home, thus improving the user experience.

[0036] In some embodiments, the home appliance may include one or more of the following: an air conditioner, a heater, or an aromatherapy diffuser. For example, the second terminal device can pre-set the air conditioner to turn on for a predetermined duration based on the time information of the vehicle's arrival at the home location corresponding to the second terminal device. For instance, if the vehicle arrives at the home location corresponding to the second terminal device at 5:30, and the air conditioner needs to be on for five minutes to reach a comfortable indoor temperature, the second terminal device can control the air conditioner to turn on at 5:25, so that the indoor temperature is comfortable when the user arrives at home, improving the user experience. It is understood that determining the air conditioner's start time based on the time information of the vehicle's arrival at the home location corresponding to the second terminal device can also avoid energy waste caused by turning on the air conditioner too early.

[0037] In some embodiments, kitchen and bathroom appliances may include one or more of the following: a rice cooker or a smart toilet. For example, the second terminal device can pre-set the cooking time of the rice cooker based on the time information of the vehicle's arrival at the user's home location, so that the rice is cooked just as the user arrives home. This saves the user cooking time and improves the user experience.

[0038] In one possible implementation of the second aspect, the method further includes: receiving at least one driver status information from at least one first terminal device, displaying at least one driver status information, and / or displaying health alert information based on at least one driver status information, and / or adjusting the status of home devices connected to the second terminal device based on at least one driver status information.

[0039] In some embodiments, after receiving the driver status information, the second terminal device can display the driver status information. For example, the driver status information can be "fatigue driving" or "not fatigued driving." This allows family members to be aware of the driver's status and make appropriate arrangements, such as reminding the driver to rest and avoid fatigued driving, or preparing food to replenish the driver's energy.

[0040] In some embodiments, after receiving driver status information, the second terminal device can also display health reminder information based on the driver status information. For example, the health reminder information may include one or more reminders such as "Please remind the driver not to drive while fatigued" or "Please remind the driver to take a rest." This makes it easier for family members to remind the driver to perform corresponding tasks based on the health reminders, such as reminding the driver to take a rest.

[0041] In some embodiments, after receiving driver status information, the second terminal device can also adjust the status of home appliances connected to the second terminal device based on the driver status information. For example, it can control a calming aromatherapy device to turn on when the driver is almost home to alleviate driver fatigue.

[0042] In one possible implementation of the second aspect, the method further includes: sending home information to N first terminal devices, wherein the home information includes at least one of home device status information or home occupant activity information.

[0043] In one possible implementation of the second aspect, the method further includes: detecting a non-safety factor, sending alarm information to N first terminal devices, receiving monitoring data acquisition instructions from the N first terminal devices, and sending monitoring data to the N first terminal devices.

[0044] In one possible implementation of the second aspect, the method further includes: receiving control instructions from N first terminal devices, the control instructions being used to control home appliances connected to second terminal devices, and executing the control instructions from the N first terminal devices.

[0045] In one possible implementation of the second aspect, when N is a positive integer greater than or equal to 2, the control instructions of N first terminal devices are executed, including: when the control instructions of the N first terminal devices are mutually exclusive instructions issued simultaneously, the control instruction of the first terminal device with the highest priority among the N first terminal devices is executed.

[0046] It can be understood that mutually exclusive instructions are instructions that cannot be executed simultaneously. For example, when there are N first terminal devices, including first terminal device A and first terminal device B, if the control instruction sent by first terminal device A is to adjust the air conditioner temperature to 28°C, and the control instruction sent by first terminal device B is to adjust the air conditioner temperature to 21°C, then the control instruction sent by first terminal device A and the control instruction sent by first terminal device B are mutually exclusive instructions.

[0047] In some embodiments, the priorities of the N first terminal devices can be pre-set by the user in the second terminal devices. For example, if the priority of first terminal device A is set to be higher than that of first terminal device B, then when the control commands sent by first terminal device A and first terminal device B are mutually exclusive, the second terminal device can execute the control commands of first terminal device A, such as adjusting the air conditioner temperature to 28°C. It can be understood that by setting the priorities of the N first terminal devices, the situation where the second terminal device cannot execute a mutually exclusive command can be avoided.

[0048] In one possible implementation of the second aspect, the method further includes: receiving a communication request instruction from one of the N first terminal devices, the communication request instruction including a voice communication request instruction or a video communication request instruction; if human activity is detected in the home, establishing a communication connection corresponding to the communication request instruction with the first terminal device.

[0049] In some embodiments, when the second terminal device receives a voice communication request command or a video communication request command, it can control a camera device connected to the second terminal device or a camera device mounted on the second terminal device to detect information about human activity in the home. Upon detecting human activity, it automatically establishes voice and video communication connections, that is, it automatically establishes a voice or video communication connection with the first terminal device. This further enhances the intelligence of vehicle-home collaboration and improves the user experience.

[0050] In one possible implementation of the second aspect, the method further includes: receiving task process information from one of the N first terminal devices, wherein the task process information is the task process information corresponding to the first task being run by the one terminal device, and the second terminal device continues to run the first task based on the task process information.

[0051] In one possible implementation of the second aspect, the N first terminal devices include first terminal device A and first terminal device B. The method further includes: receiving first arrival time information from first terminal device A, wherein the first arrival time information is the time information of first terminal device A arriving at the home location corresponding to the second terminal device, and first terminal device A is associated with first family member information; activating a first home device mode based on the first arrival time information; and further, receiving second arrival time information sent from first terminal device B, wherein the second arrival time information is the time information of first terminal device B arriving at the home location corresponding to the second terminal device, and first terminal device B is associated with second family member information; and activating a second home device mode based on the second arrival time information.

[0052] In some embodiments, the second terminal device can control home appliances to be in different modes based on the arrival events of different family members, so as to meet the needs of different family members for the home environment and improve the home experience of different family members.

[0053] For example, the second terminal device can receive the first arrival time information from the first terminal device A. The first arrival time information is the time information when the first terminal device A arrives at the home location corresponding to the second terminal device. The second terminal device can start the first home device mode based on the first arrival time information. For example, if the family member associated with the first terminal device A is the father, the first home device mode can play music collected by the father on the speaker, set the air conditioner temperature to 28 degrees, etc.

[0054] For example, the second terminal device can receive second arrival time information sent from the first terminal device B. This second arrival time information is the time when the first terminal device B arrives at the home location corresponding to the second terminal device. Based on this second arrival time information, the second terminal device can activate a second home appliance mode. For example, if the first terminal device B is associated with a mother and child, the second home appliance mode could enable functions such as turning on an aromatherapy diffuser, setting the air conditioner to 21 degrees Celsius, and activating lighting for study mode.

[0055] Thirdly, embodiments of this application provide an interactive system, including a first terminal device and a second terminal device. The first terminal device is used to execute the method in any of the implementations of the first aspect described above, and the second terminal device is used to execute the method in any of the implementations of the second aspect described above.

[0056] Fourthly, embodiments of this application provide a communication device, including: one or more processors; one or more memories; the one or more memories storing one or more programs, which, when executed by one or more processors, cause the communication device to perform the method in any of the implementations of the first aspect described above.

[0057] Fifthly, embodiments of this application provide a communication device, including: one or more processors; one or more memories; the one or more memories storing one or more programs, which, when executed by one or more processors, cause the communication device to perform the method in any of the implementations of the second aspect described above.

[0058] In a sixth aspect, embodiments of this application provide a readable storage medium storing a program or instructions. When the program or instructions are executed by a first terminal device, they implement the method in any of the implementations of the first aspect described above; or when the program or instructions are executed by a second terminal device, they implement the method in any of the implementations of the second aspect described above.

[0059] In a seventh aspect, embodiments of this application provide a computer program product, including instructions, which, when executed, cause a first terminal device to execute the method in any of the implementations of the first aspect, or cause a second terminal device to execute the method in any of the implementations of the first aspect.

[0060] Eighthly, embodiments of this application provide a chip including a processor coupled to a memory for executing computer programs or instructions stored in the memory, such that the chip implements the method in any of the implementations of the first aspect above, or implements the method in any of the implementations of the second aspect above. Attached Figure Description

[0061] Figure 1 According to some embodiments of this application, a schematic diagram of an interaction scenario between an in-vehicle terminal device and a home terminal device is shown;

[0062] Figure 2 According to some embodiments of this application, a flowchart of an interaction method is shown;

[0063] Figure 3 According to some embodiments of this application, a schematic diagram of an interaction scenario between an in-vehicle terminal device and a home terminal device is shown;

[0064] Figure 4 According to some embodiments of this application, a schematic diagram of an interaction scenario between an in-vehicle terminal device and a home terminal device is shown;

[0065] Figure 5 According to some embodiments of this application, a schematic diagram of an interaction scenario between an in-vehicle terminal device and a home terminal device is shown;

[0066] Figure 6 According to some embodiments of this application, a schematic diagram of an interaction scenario between an in-vehicle terminal device and a home terminal device is shown;

[0067] Figure 7 According to some embodiments of this application, a schematic diagram of the structure of a home terminal device is shown;

[0068] Figure 8 According to some embodiments of this application, a structural schematic diagram of an in-vehicle terminal device is shown;

[0069] Figure 9 According to some embodiments of this application, a structural schematic diagram of a vehicle is shown;

[0070] Figure 10 According to some embodiments of this application, a schematic diagram of the structure of a communication device is shown. Detailed Implementation

[0071] The illustrative embodiments of this application include, but are not limited to, an interactive method and apparatus.

[0072] The terminal device in this application can be a device with wireless transceiver capabilities, and can also be referred to as a terminal, UE, mobile station, mobile terminal, etc. Terminals can be widely used in various scenarios, such as device-to-device (D2D), vehicle-to-everything (V2X) communication, machine-type communication (MTC), Internet of Things (IoT), virtual reality, augmented reality, industrial control, autonomous driving, telemedicine, smart grids, smart furniture, smart offices, smart wearables, smart transportation, smart cities, etc. Terminal devices can be mobile phones, smart TVs, wearable devices, tablets, smart screens, computers with wireless transceiver capabilities, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, and so on. The embodiments of this application do not limit the specific technologies or device forms used in the electronic devices.

[0073] To facilitate understanding of the technical solutions of this application, the first terminal device provided in this application is illustrated using a vehicle-mounted terminal device as an example. This vehicle-mounted terminal device can be installed in a vehicle and used to realize data communication, information processing, and control functions between the vehicle and external systems; for example, it can be a vehicle-mounted infotainment system. The second terminal device provided in this application is illustrated using a home terminal device as an example. Home terminal devices include, but are not limited to, smart home screens, smart TVs, smart computers, and other terminal devices used to control home appliances and communicate with other external systems.

[0074] It should be noted that the vehicle terminal equipment and home terminal equipment are merely examples for understanding the technical solution of this application. The first terminal equipment and the second terminal equipment in this application can also be in other forms, as long as they can demonstrate the collaborative communication between intelligent vehicles and intelligent homes, they are all within the protection scope of this application.

[0075] To achieve collaboration between in-vehicle terminal devices and home terminal devices, this application provides an interaction method. The in-vehicle terminal device can send vehicle data information to the home terminal device. This vehicle data information may include driving data information of the vehicle (e.g., vehicle location information, vehicle trajectory information, and road condition information during the journey), and arrival time information of the vehicle at its destination (e.g., estimated arrival time). The home terminal device can then execute tasks corresponding to this vehicle data information. This enables collaboration between smart cars and smart homes, improving the user experience.

[0076] In some embodiments, the home terminal device executes tasks corresponding to vehicle data information. For example, after acquiring vehicle data information, the home terminal device can display the vehicle data information via pop-up banners, cards, or other means. This allows family members to easily monitor the driver's driving activities in real time and plan events accordingly. For instance, family members can plan cooking times based on the estimated arrival time of the vehicle at their home, as indicated by the vehicle data.

[0077] It is understood that in the interaction methods provided in the embodiments of this application, one or more vehicle-mounted terminal devices can interact with a home terminal device simultaneously in various interaction embodiments. For example, multiple vehicle-mounted terminal devices can all send vehicle data information to the home terminal device, and the home terminal device can display data information corresponding to the vehicles of the multiple vehicle-mounted terminal devices. For ease of description, the interaction method in the embodiments of this application will be described using the interaction between one vehicle-mounted terminal device and a home terminal device as an example.

[0078] The following provides an exemplary description of the interaction scenarios between the vehicle-mounted terminal device and the home terminal device in the embodiments of this application.

[0079] Figure 1 Taking the vehicle terminal device as the vehicle system 100 and the home terminal device as the smart home screen 200 as an example, a schematic diagram of the interaction between the vehicle terminal device and the home terminal device is shown.

[0080] It should be noted that the vehicle-mounted system 100 can install a first application, which can be used for data interaction between the in-vehicle terminal device and the home terminal device. The home terminal device can install a second application, which can also be used for data interaction between the home terminal device and the in-vehicle terminal device. In some embodiments, the first application and the second application can be the same application. For example, both the first application and the second application can be any application capable of realizing the above functions, such as a smart living application or a vehicle-home interconnection application.

[0081] like Figure 1As shown, the first application of the vehicle system 100 displays a first interface 101, which can display the vehicle's location information S1 (10.6 kilometers away from the home location), the vehicle's driving trajectory information L1, and the estimated time for the vehicle to arrive at the home location in 20 minutes, etc. The vehicle system 100 can send the vehicle data information to the second application of the smart home screen 200, so that the second interface 201 of the second application can display the vehicle's location information S1, the vehicle's driving trajectory information L1, and the estimated time for the vehicle to arrive at the home location in 20 minutes, etc.

[0082] It is understandable that the above Figure 1 The presentation of vehicle data in this embodiment is merely illustrative. For example, in some embodiments, the vehicle's location information and driving trajectory information may also be presented in the form of a navigation map, etc., and this application does not limit the scope of the embodiments.

[0083] Figure 2 The diagram illustrates a flowchart of an interaction method according to an embodiment of this application. For example... Figure 2 As shown, the interaction methods may include:

[0084] 101: The vehicle-mounted terminal device acquires vehicle data information, which includes driving data information corresponding to the vehicle where the vehicle-mounted terminal device is located, as well as the vehicle's arrival time information.

[0085] In some embodiments, driving data information may include one or more of the following: vehicle location information, vehicle trajectory information, or road condition information of the vehicle's journey. For example, the driving data information may also include any data information related to vehicle movement that can be obtained by an in-vehicle terminal device, such as vehicle speed and / or information about obstacles around the vehicle.

[0086] For example, the destination in this application embodiment can be the home location corresponding to the home terminal device, or any location selected by the user, such as the company location, restaurant location, etc., and this application embodiment does not limit it. The following descriptions all use the home location corresponding to the home terminal device as the destination as an example.

[0087] For example, the vehicle arrival time information in the embodiments of this application may include the estimated arrival time, such as 5:00 am; or may include the estimated remaining time to arrive at the destination, such as 15 minutes later.

[0088] 102: The vehicle-mounted terminal device sends vehicle data information to the home terminal device. Correspondingly, the home terminal device receives the vehicle data information.

[0089] It is understood that in this embodiment of the application, the vehicle-mounted terminal device may install a first application, which can be used for data interaction between the vehicle-mounted terminal device and the home terminal device. The home terminal device may install a second application, which can also be used for data interaction between the home terminal device and the vehicle-mounted terminal device. In some embodiments, the vehicle-mounted terminal device may synchronize vehicle data information to a cloud server in real time based on the first application. The cloud server may send vehicle data information to the second application on the home terminal device.

[0090] In some embodiments, the first application and the second application can be the same application, that is, the first application and the second application can correspond to the same cloud server. The in-vehicle terminal device can synchronize vehicle data information to the cloud server in real time based on the first application, and the cloud server can send vehicle data information to the second application of the home terminal device.

[0091] In some embodiments, the first application and the second application can be different applications; that is, the cloud server may include a first application server and a second application server, wherein the first application corresponds to the first application server, and the second application corresponds to the second application server. The in-vehicle terminal device can synchronize vehicle data information to the first application server in real time based on the first application, the first application server can synchronize vehicle data information to the second application server, and the second application server can send vehicle data information to the second application of the home terminal device.

[0092] In some embodiments, the vehicle terminal device may also transmit other data or instructions to be sent mentioned in the embodiments of this application (such as driver status, control instructions, etc. mentioned below) to the cloud server through the first application, and the cloud server will then transmit the other data or instructions to be sent mentioned in the embodiments of this application to the second application of the home terminal device.

[0093] 103: Home terminal devices execute tasks corresponding to vehicle data information.

[0094] In some embodiments, the home terminal device performs tasks corresponding to vehicle data information based on the vehicle data information, which may include displaying the vehicle data information. For example, as described above. Figure 1 As shown, the second interface 201 of the second application of the smart home screen 200 can display vehicle location information S1, vehicle driving trajectory information L1, and vehicle data information such as the estimated arrival time of the vehicle at the home location in 20 minutes. This allows family members to easily monitor the driver's driving dynamics in real time and make event arrangements; for example, family members can plan cooking time based on the estimated arrival time of the vehicle at the home location.

[0095] In some embodiments, the home terminal device, based on vehicle data information, may further perform tasks corresponding to that vehicle data information by adjusting the status of home appliances connected to the home terminal device based on driving data information corresponding to the vehicle where the in-vehicle terminal device is located, and the time information of the vehicle's arrival at the home location corresponding to the home terminal device. This allows users to experience a comfortable home environment upon arrival, improving the user experience.

[0096] In some embodiments, the status of home devices connected to a home terminal device is adjusted, including but not limited to one or more of the following methods:

[0097] (1) Adjust the working status of the security equipment connected to the home terminal device, wherein the security equipment may include various security doors of the home, monitoring equipment, etc. For example, the home terminal device may, based on the time information of the vehicle arriving at the home location corresponding to the home terminal device, control the garage door to open when it determines that the vehicle is about to arrive home or has arrived home, and control the monitoring equipment to switch the main monitoring screen to the monitoring screen corresponding to the garage. In some embodiments, the home terminal device may also acquire the monitoring screen corresponding to the garage monitored by the monitoring equipment and display the monitoring screen corresponding to the garage.

[0098] It is understandable that controlling the monitoring equipment to switch the main monitoring screen to the monitoring screen corresponding to the garage, as well as displaying the monitoring screen corresponding to the garage, can make it easier for family members to view the monitoring screen, thereby inferring the precise time when the people in the vehicle (such as the driver and other people) went upstairs, the time when the door was opened, etc.

[0099] (2) Adjust the working status of the lighting equipment connected to the home terminal device, whereby the lighting equipment may include lamps, etc. For example, the home terminal device can turn on the lights in advance based on the time information of the vehicle's arrival at the home location corresponding to the home terminal device. In this way, the home can be well-lit when the user arrives, improving the user experience.

[0100] (3) Adjust the working status of the audio-visual equipment connected to the home terminal device, which may include a television, stereo, etc. For example, the home terminal device can control the television to play user-favorited or preset TV programs, or control the stereo to play user-favorited music, etc., based on the time information of the vehicle's arrival at the home location corresponding to the home terminal device. In this way, users can directly watch user-favorited or preset TV programs, or listen to user-favorited music, etc., when they arrive home, thus improving the user experience.

[0101] (4) Adjust the operating status of home appliances connected to the home terminal device; these home appliances may include one or more, such as air conditioners, heaters, or aromatherapy diffusers. For example, the home terminal device can pre-set the air conditioner's operating time based on the time information of the vehicle's arrival at the home location corresponding to the home terminal device. For instance, if the vehicle arrives at the home location corresponding to the home terminal device at 5:30, and the air conditioner needs to be on for five minutes to reach a comfortable indoor temperature, the home terminal device can control the air conditioner to turn on at 5:25, so that the indoor temperature is comfortable when the user arrives at home, improving the user experience. It is understandable that determining the air conditioner's operating time based on the time information of the vehicle's arrival at the home location corresponding to the home terminal device can also avoid energy waste caused by turning on the air conditioner too early.

[0102] (5) Adjust the working status of kitchen and bathroom appliances connected to the home terminal device. These appliances may include one or more types, such as a rice cooker or a smart toilet. For example, the home terminal device can pre-set the cooking time of the rice cooker based on the time information of the vehicle's arrival at the home location, so that the rice is cooked just as the user arrives home. This saves the user cooking time and improves the user experience.

[0103] Based on the interaction method provided in this application, deep collaboration between smart cars and smart homes can be achieved, improving user experience. For example, vehicle-related information can be displayed in real time on a smart screen at home, allowing family members to stay informed about driving dynamics and access relevant services.

[0104] Other scenarios in the interaction methods provided in the embodiments of this application will be illustrated by examples below.

[0105] In some embodiments, the in-vehicle terminal device can also acquire driver status information and send it to the home terminal device. Upon receiving the driver status information, the home terminal device can display it. For example, the driver status information may indicate fatigued driving or not fatigued driving. This allows family members to be aware of the driver's status and make appropriate arrangements, such as reminding the driver to rest and avoid fatigued driving, or preparing energy-boosting food for the driver.

[0106] For example, such as Figure 3As shown, the first application display of the vehicle system 100 is a first interface 101. In addition to displaying vehicle data information (vehicle location information S1, vehicle driving trajectory information L1, and the estimated time for the vehicle to arrive at the home location in 20 minutes), the first interface 101 can also display the driver's driving status as fatigued. The vehicle system 100 can send the vehicle data information and the driver's fatigue status to the home smart screen 200, so the second interface 201 of the home smart screen 200 can display the vehicle data information and the driver's driving status as fatigued.

[0107] In some embodiments, after receiving driver status information, the home terminal device can also display health reminders based on the driver status information. These health reminders may include one or more reminders, such as advising the driver not to drive while fatigued or reminding the driver to take a rest. This allows family members to easily remind the driver to perform corresponding tasks based on the health reminders, such as reminding the driver to take a rest.

[0108] In some embodiments, after receiving driver status information, the home terminal device can also adjust the status of home appliances connected to the home terminal device based on the driver status information. For example, it can control a calming aromatherapy device to turn on when the driver is almost home to alleviate driver fatigue. The method for determining whether the driver is almost home can be based on the estimated time of the vehicle's arrival at the home's location.

[0109] It is understandable that in-vehicle terminal equipment can monitor the driver's status information based on the driver monitoring system (DMS). For example, the DMS system can use a high-definition vital sign detection camera to detect the driver's eye and facial features in real time to determine the driver's status. For instance, if the high-definition vital sign detection camera detects that the driver is blinking more frequently or that their eyes are narrowing, it can be confirmed that the driver is in a state of fatigue.

[0110] In some embodiments, the in-vehicle terminal device can also detect control commands corresponding to home appliances connected to the home terminal device and send the control commands to the home terminal device. Upon receiving the control command for the home appliance from the in-vehicle terminal device, the home terminal device can execute the control command. This enables remote control of home appliances and improves the user experience. In some embodiments, the in-vehicle terminal device can detect control commands for home appliances sent by the user via the in-vehicle terminal device's voice assistant. In some embodiments, the in-vehicle terminal device can also detect control commands input by the user through text input, clicking application interface controls, etc.

[0111] like Figure 4As shown, the vehicle system 100 can detect the voice command "turn on the home air conditioner" sent by the user through the voice assistant of the vehicle system 100, and send the control command "turn on the home air conditioner" to the smart home screen 200.

[0112] In some embodiments, when multiple vehicle-mounted terminal devices send control commands to a home terminal device, and the control commands from the multiple vehicle-mounted terminal devices are mutually exclusive commands sent simultaneously, the home terminal device executes the control command from the vehicle-mounted terminal device with the highest priority among the multiple vehicle-mounted terminal devices.

[0113] It can be understood that mutually exclusive instructions are instructions that cannot be executed simultaneously. For example, if the control instruction sent by the first vehicle terminal device is to adjust the air conditioning temperature to 28°C, and the control instruction sent by the second vehicle terminal device is to adjust the air conditioning temperature to 21°C, then the control instructions sent by the first vehicle terminal device and the control instructions sent by the second vehicle terminal device are mutually exclusive instructions.

[0114] In some embodiments, the priority of the vehicle terminal device can be preset by the user in the home terminal device. For example, if the priority of the first vehicle terminal device is set to be higher than that of the second vehicle terminal device, then when the control commands sent by the first vehicle terminal device and the control commands sent by the second vehicle terminal device are mutually exclusive, the home terminal device can execute the control commands of the first vehicle terminal device, for example, adjusting the air conditioning temperature to 28°C.

[0115] It is understandable that setting the priority of in-vehicle terminal devices can prevent situations where home terminal devices cannot execute mutually exclusive commands.

[0116] In some embodiments, the in-vehicle terminal device can detect communication request operations between the user and the home terminal device, and send a communication request instruction corresponding to the communication request operation to the home terminal device. The communication request instruction includes a voice communication request instruction or a video communication request instruction. In some embodiments, the in-vehicle terminal device can detect voice communication request instructions or video communication request instructions sent by the user through the voice assistant of the in-vehicle terminal device. In some embodiments, the in-vehicle terminal device can detect voice communication request instructions or video communication request instructions corresponding to operations such as clicking a voice call button or video call button on the interface of the first application. This application does not limit the form of the voice communication request instruction or video communication request instruction.

[0117] In some embodiments, the home terminal device can establish a corresponding voice communication connection or video communication connection with the vehicle terminal device in response to the user's connection operation. Thus, the communication method provided in this application embodiment can meet the real-time communication needs between people in the vehicle and people at home.

[0118] In some embodiments, when the home terminal device receives a voice communication request command or a video communication request command, it can control a camera device connected to the home terminal device or a camera device mounted on the home terminal device to detect information about human activity in the home. Upon detecting human activity, it automatically establishes voice and video communication connections, that is, it automatically establishes a voice or video communication connection with the vehicle terminal device. This further enhances the intelligence of vehicle-home collaboration and improves the user experience.

[0119] In some embodiments, the in-vehicle terminal device can obtain task progress information corresponding to one or more tasks (e.g., a first task) running on the in-vehicle terminal device, and send the task progress information to the home terminal device. The home terminal device then continues running the task based on the task progress information. For example, the task can be any task running on the in-vehicle terminal device, such as a video playback task and / or a music playback task. The task progress information may include the task process name and / or task progress. For example, when the user turns off the in-vehicle terminal device, if a variety show video is playing on the in-vehicle terminal device, and the process name of the variety show video is thread1, and the playback progress is 30%, the in-vehicle terminal device can send the process name thread1 and the playback progress of 30% of the variety show video to the home terminal device, so that the home terminal device can run the process thread1 and continue playing the variety show video from the 30% progress point. In this way, a seamless entertainment experience can be achieved.

[0120] In some embodiments, the in-vehicle terminal device can acquire the task (e.g., movie, TV series, music, etc.) selected by the user on the in-vehicle terminal device and send the user-selected task to the home terminal device. The home terminal device can prepare the task, such as setting the task to a pending or ready state, or directly switching to the playback interface of the task. This allows the user to quickly trigger the playback of the task upon returning home; for example, the user can directly click the play button on the playback interface of the task to start playback.

[0121] In some embodiments, the home terminal device can acquire home information and send it to the vehicle terminal device, which can then display the home information. This allows occupants of the vehicle to monitor their home in real time and perform corresponding actions. In some embodiments, the home information may include at least one of the status information of home appliances connected to the home terminal device or information on the activities of people in the home. For example, the home terminal device can send activity information to the vehicle terminal device when it detects activity. For instance, the home terminal device can send information such as the television program being played and / or temperature information to the vehicle terminal device.

[0122] For example, such as Figure 5As shown, when a monitoring device in the kitchen connected to the home terminal device detects that someone is preparing food in the kitchen, it can send the information "Food preparation in the kitchen" to the vehicle terminal device. The vehicle terminal device can display the information "Food preparation in the kitchen", the time when food preparation started, and can automatically or in response to user operation to obtain and display the real-time video of the monitoring device.

[0123] For example, such as Figure 6 As shown, when the home terminal device learns that the user is watching a movie on the living room TV connected to the home terminal device, it can send the "Watching a movie in the living room" information and the movie video information played on the living room TV to the vehicle terminal device. The vehicle terminal device can display the "Watching a movie in the living room" information and can obtain and display the movie video played on the living room TV.

[0124] In some embodiments, when the home terminal device detects a non-safety factor, it can send an alarm message to the vehicle terminal device. The non-safety factor may include one or more of the following: a stranger entering the home, a gas leak, a gas alarm, or a fire. For example, if the home terminal device detects a stranger in the home using a camera, detects a fire, or detects a gas leak alarm, it can send an alarm message to the vehicle terminal device. The vehicle terminal device can then provide an alarm notification, such as displaying a message indicating: "Stranger in the home," or "Gas leak in the home."

[0125] In some embodiments, upon receiving an alarm message from a home terminal device, the vehicle terminal device can automatically send a monitoring data retrieval command to the home terminal device, or it can send such a command in response to a user's request to retrieve monitoring data. When the home terminal device receives the monitoring data retrieval command, it can send the monitoring data to the vehicle terminal device, which can then display the corresponding monitoring footage. This allows users to easily monitor their home and take appropriate emergency actions, such as remotely controlling home appliances or handling alarms.

[0126] It is understandable that home terminal devices can obtain monitoring data based on the camera devices connected to the home terminal devices or the camera devices built into the home terminal devices.

[0127] In some embodiments, the home terminal device can control home devices to be in different modes based on the arrival events of different family members, so as to meet the needs of different family members for the home environment and improve the home experience of different family members.

[0128] For example, if family member 1 frequently drives vehicle C1 and family member 2 frequently drives vehicle C2, the user can set family member 1 to be associated with the first in-vehicle terminal device in vehicle C1 and family member 2 to be associated with the second in-vehicle terminal device in vehicle C2. The family terminal device can respond to the user's settings by storing the association relationship between family member 1 and the first in-vehicle terminal device in vehicle C1 (e.g., the identifier of the first in-vehicle terminal device) and the association relationship between family member 2 and the second in-vehicle terminal device in vehicle C2 (e.g., the identifier of the second in-vehicle terminal device).

[0129] For example, a home terminal device can receive the first arrival time information from a first vehicle terminal device. The first arrival time information is the time when the first vehicle terminal device arrives at the home location corresponding to the home terminal device. The home terminal device can activate the first home device mode based on the first arrival time information. For example, if the family member associated with the first vehicle terminal device is the father, the first home device mode can play music collected by the father on the speakers, set the air conditioner temperature to 28 degrees, etc.

[0130] For example, the home terminal device can receive second arrival time information from the second vehicle terminal device. This second arrival time information is the time when the second vehicle terminal device arrives at the home location corresponding to the home terminal device. Based on this second arrival time information, the home terminal device can activate a second home device mode. For example, if the second vehicle terminal device is associated with a mother and child, the second home device mode could enable functions such as turning on aromatherapy, setting the air conditioner to 21 degrees Celsius, and activating lighting for study mode.

[0131] In some embodiments, the home terminal device can execute different welcome modes based on the arrival times of different family members. For example, when the first vehicle terminal device is associated with the father, a welcome message can be associated between the first vehicle terminal device and the father. The home terminal device can display and / or voice-broadcast the welcome message for the father based on the first arrival time information corresponding to the first vehicle terminal device, such as "Dad is coming home soon, prepare dinner" or "Welcome Dad home." For example, when the second vehicle terminal device is associated with the mother and child, a welcome message can be associated between the second vehicle terminal device and the mother and child. The home terminal device can display and / or voice-broadcast the welcome message for the mother and child based on the second arrival time information corresponding to the second vehicle terminal device, such as "Welcome Mom home, welcome child home."

[0132] In summary, the interaction method provided in this application embodiment, by combining the estimated arrival time of the smart car with the real-time display of relevant information on the home terminal device, facilitates family members' understanding of the driving dynamics and provides corresponding services. Furthermore, the above-mentioned interaction method provides functions such as remote voice communication and video communication, enabling convenient interaction between the driver and family members and smart home devices during driving, improving communication efficiency between the driver and family members, and enhancing the collaborative service capabilities of the smart car and smart home. In addition, the home terminal device can control home devices to different modes based on the arrival events of different family members, and provide seamless integration of audio-visual and other tasks, improving the user experience.

[0133] To better understand the technical solution of this application, the second terminal device is described using a smart home screen 200 as an example, and the hardware structure of the second terminal device is introduced. Figure 7 A structural schematic diagram of the Home Smart Screen 200 is shown.

[0134] like Figure 7 As shown, the smart home screen 200 may include a processor 710, a power module 740, a memory 780, a mobile communication module 730, a wireless communication module 720, a sensor module 790, an audio module 750, a camera 770, an interface module 760, buttons 701, and a display screen 702, etc.

[0135] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the smart home screen 200. In other embodiments of this application, the smart home screen 200 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0136] The processor 710 may include one or more processing units, such as processing modules or circuits of a central processing unit (CPU), graphics processing unit (GPU), digital signal processor (DSP), microprocessor (MCU), artificial intelligence (AI) processor, or field programmable gate array (FPGA). Different processing units may be independent devices or integrated into one or more processors. The processor 710 may include storage units for storing instructions and data. In some embodiments, the storage unit in the processor 710 is a cache memory 780.

[0137] The processor can be used to execute the steps on the home terminal device side of the interaction method mentioned in the embodiments of this application.

[0138] The hardware structure of the first terminal device will be introduced below, taking the vehicle-mounted system 100 as an example. Figure 8 A schematic diagram of the vehicle infotainment system 100 is shown.

[0139] like Figure 8 As shown, the vehicle infotainment system 100 may include one or more processors 801, one or more memories 802, and one or more communication interfaces 803. The one or more processors 801, one or more memories 802, and one or more communication interfaces 803 are coupled to each other. Optionally, the one or more memories 802 may be used to store instructions executed by the one or more processors 801, or to store input data required for the one or more processors 801 to execute instructions, or to store data generated after the one or more processors 801 executes instructions. Optionally, see [link to documentation]. Figure 8 One or more processors 801, one or more memories 802, and one or more communication interfaces 803 are interconnected via a bus 804.

[0140] The processor 801 in the embodiments of this application can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The general-purpose processor can be a microprocessor or any conventional processor. When at least one of the processors 801 executes instructions, the steps on the vehicle-mounted terminal device side of the interaction method mentioned in the embodiments of this application can be implemented.

[0141] Embodiments of this application provide a vehicle, including a first terminal device (such as an in-vehicle terminal device). This embodiment uses vehicle 900 as an example to describe the vehicle mentioned herein.

[0142] like Figure 9As shown, vehicle 900 may include various subsystems, such as a mobility system 102, a sensor system 104, a control system 106, one or more peripheral devices 108, and a vehicle infotainment system 100. Optionally, vehicle 100 may include more or fewer subsystems, and each subsystem may include multiple components. Furthermore, each subsystem and component of vehicle 100 may be interconnected via wired or wireless means.

[0143] Some or all of the functions of the vehicle 100 are controlled by the vehicle infotainment system 100.

[0144] The vehicle infotainment system 100 can control the functions of the vehicle 100 based on inputs received from various subsystems (e.g., driving system 102, sensor system 104, control system 106, DMS system 107). For example, it can receive vehicle speed information, acceleration information, position information, etc. uploaded by sensor system 104. For example, it can receive driver status information uploaded by DMS system 107.

[0145] Sensor system 104 may include several sensors for sensing information about the environment surrounding vehicle 900. For example, sensor system 104 may include a Global Positioning System 122 (which may be a Global Positioning System (GPS) system, a BeiDou system, or another positioning system), an Inertial Measurement Unit (IMU) 124, radar 126, and a camera 130. Sensor system 104 may also include sensors for the internal systems of the monitored vehicle 900 (e.g., in-vehicle air quality monitor, fuel gauge, oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, orientation, speed, etc.). This detection and identification is a critical function for the safe operation of vehicle 100.

[0146] Please see Figure 10 This is a schematic diagram of a communication device provided in an embodiment of this application. The communication device 1000 may include a processing module 1010 (sometimes also called a processing unit) and a transceiver module 1020 (sometimes also called a transceiver unit). The transceiver module can implement sending and receiving functions. When the transceiver module implements the sending function, it can be called a sending module (sometimes also called a sending unit), and when the transceiver module implements the receiving function, it can be called a receiving module (sometimes also called a receiving unit). The sending module and the receiving module can be the same functional module, which is called the transceiver module and can implement both sending and receiving functions; or, the sending module and the receiving module can be different functional modules, and the transceiver module is a collective term for these functional modules.

[0147] In some possible implementations, the communication device 1000 provided in the embodiments of this application further includes: a storage module (sometimes also called a storage unit) for storing any data, computer instructions and / or computer programs that may be involved in the embodiments of this application.

[0148] The processing module 1010, transceiver module 1020, and storage module in this application embodiment are used to enable the communication device 1000 to implement the functions of the first terminal device or the second terminal device in the above method embodiment.

[0149] The following describes the various modules in the first terminal device, using the communication device 1000 to implement the functions of the first terminal device in the above method embodiments. In some possible implementations, the communication device 1000 provided in this application embodiment includes a processing module 1010 for acquiring vehicle data information, which includes driving data information corresponding to the vehicle where the first terminal device is located and the vehicle's arrival time information. A transceiver module 1020 is used to send the vehicle data information to the second terminal device.

[0150] The following describes the various modules in the second terminal device, using the communication device 1000 to implement the functions of the second terminal device in the above method embodiments. In some possible implementations, the communication device 1000 provided in this application embodiment includes a transceiver module 1020 for receiving vehicle data information from N first terminal devices. The vehicle data information includes driving data information corresponding to the vehicle where the first terminal device is located and the vehicle's arrival time information, where N is a positive integer. A processing module 1010 is used to execute tasks corresponding to the vehicle data information from the N first terminal devices.

[0151] For more detailed information on the operation of the above-mentioned processing module 1010 and transceiver module 1020, please refer to the description in the above method embodiments, which will not be repeated here.

[0152] It should be noted that the physical device corresponding to the processing module 1010 in this device can be a processor, and the physical device corresponding to the transceiver module 1020 can be a transceiver. Furthermore, the physical device corresponding to the storage module in this device can be a memory.

[0153] It should be noted that the information interaction and execution process between the modules of the above-mentioned device are based on the same concept as the method embodiment of this application, and the resulting technical effects are the same as those of the method embodiment of this application. For details, please refer to the description in the method embodiment shown above in this application, and it will not be repeated here.

[0154] This application provides an interactive system, including a first terminal device and a second terminal device. The first terminal device is used to execute the first terminal device side method in the interactive method of this application embodiment, and the second terminal device is used to execute the second terminal device side method in the interactive method of this application embodiment.

[0155] This application provides a communication device, including: one or more processors; one or more memories; the one or more memories storing one or more programs, which, when executed by one or more processors, cause the communication device to perform the method on the first terminal device side of the interaction method in this application.

[0156] This application provides a communication device, including: one or more processors; one or more memories; the one or more memories storing one or more programs, which, when executed by one or more processors, cause the communication device to execute the second terminal device side method in the interaction method of this application.

[0157] This application provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a first terminal device, the method on the first terminal device side of the interaction method in this application is implemented; or when the program or instructions are executed by a second terminal device, the method on the second terminal device side of the interaction method in this application is implemented.

[0158] This application provides a computer program product, including instructions, which, when executed, cause the method on the first terminal device side or the method on the second terminal device side in the interaction method of this application to be implemented.

[0159] This application provides a chip including a processor coupled to a memory for executing computer programs or instructions stored in the memory, such that the chip implements the method on the first terminal device side of the interaction method in this application embodiment, or the method on the second terminal device side of the interaction method in this application embodiment.

[0160] The various embodiments of the mechanisms disclosed in this application can be implemented in hardware, software, firmware, or a combination of these implementation methods. Embodiments of this application can be implemented as computer programs or program code executable on a programmable system, the programmable system including at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0161] Program code can be applied to input instructions to execute the functions described in this application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, the processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application-specific integrated circuit (ASIC), or a microprocessor.

[0162] The program code can be implemented using a high-level procedural language or an object-oriented programming language to communicate with the processing system. Assembly language or machine language can also be used when needed. In fact, the mechanisms described in this application are not limited to any particular programming language. In either case, the language can be a compiled language or an interpreted language.

[0163] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored thereon on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, the instructions may be distributed via a network or through other computer-readable media. Therefore, machine-readable media may include any mechanism for storing or transmitting information in a machine-readable (e.g., computer-readable) form, including but not limited to floppy disks, optical disks, CD-ROMs, magneto-optical disks, read-only memory (ROM), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic cards or optical cards, flash memory, or tangible machine-readable storage for transmitting information (e.g., carrier waves, infrared signals, digital signals, etc.) using the Internet in the form of electrical, optical, acoustic, or other propagation signals. Therefore, machine-readable media include any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a machine-readable (e.g., computer-readable) form.

[0164] In the accompanying drawings, some structural or methodological features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be necessary. Rather, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. Furthermore, the inclusion of structural or methodological features in a particular figure does not imply that such features are required in all embodiments, and in some embodiments, these features may be omitted or may be combined with other features.

[0165] It should be noted that all units / modules mentioned in the device embodiments of this application are logical units / modules. Physically, a logical unit / module can be a physical unit / module, a part of a physical unit / module, or a combination of multiple physical units / modules. The physical implementation of these logical units / modules themselves is not the most important factor; the combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed in this application. Furthermore, to highlight the innovative aspects of this application, the above-described device embodiments of this application have not introduced units / modules that are not closely related to solving the technical problems proposed in this application. This does not mean that the above-described device embodiments do not contain other units / modules.

[0166] It should be noted that in the examples and description of this patent, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0167] Although this application has been illustrated and described with reference to certain preferred embodiments thereof, those skilled in the art should understand that various changes in form and detail may be made thereto without departing from the spirit and scope of this application.

Claims

1. An interaction method, characterized in that, For a first terminal device, the method includes: Obtain vehicle data information, which includes driving data information corresponding to the vehicle where the first terminal device is located and the time information of the vehicle's arrival at the destination. The vehicle data information is sent to the second terminal device.

2. The method of claim 1, wherein, The driving data information includes at least one of the following: the vehicle's location information, the vehicle's driving trajectory information, or the road condition information of the vehicle's journey.

3. The method according to any of claims 1-2, characterized in that, The method further includes: Obtain driver status information; The driver status information is sent to the second terminal device.

4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: Receive alarm information from the second terminal device; In response to the user's operation of viewing the monitoring screen, a monitoring data acquisition command is sent to the second terminal device; Receive monitoring data from the second terminal device; The monitoring screen corresponding to the monitoring data is displayed.

5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: Detect control commands corresponding to home appliances connected to the second terminal device; The control command is sent to the second terminal device.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Detect the communication request operation between the user and the second terminal device; Send a communication request instruction corresponding to the communication request operation to the second terminal device. The communication request instruction may include a voice communication request instruction or a video communication request instruction.

7. The method according to any one of claims 1 to 6, characterized in that, The method further includes: Obtain the task process information corresponding to the first task running on the first terminal device; Send the task progress information corresponding to the first task to the second terminal device.

8. The method according to any one of claims 1 to 7, characterized in that, The method further includes: Receive family information from the second terminal device; The family information includes at least one of the following: status information of home appliances connected to the second terminal device and activity information of people in the home.

9. An interaction method, characterized in that, For a second terminal device, the method includes: Receive vehicle data information from N first terminal devices, wherein the vehicle data information includes driving data information corresponding to the vehicle where the first terminal device is located and the time information of the vehicle's arrival at the destination, and N is a positive integer; Execute the tasks corresponding to the vehicle data information of the N first terminal devices.

10. The method of claim 9, wherein, The driving data information includes at least one of the following: the vehicle's location information, the vehicle's driving trajectory information, or the road condition information of the vehicle's journey.

11. The method according to claim 9 or 10, characterized in that, The task corresponding to the vehicle data information of the N first terminal devices includes: Display the vehicle data information of the N first terminal devices.

12. The method according to any one of claims 9-11, characterized in that, The destination includes the home location where the second terminal device is located; The task corresponding to the vehicle data information of the N first terminal devices includes: Based on the time information of the arrival time of the vehicles of the N first terminal devices at the home location of the second terminal device, display and / or voice broadcast a welcome message associated with the N first terminal devices.

13. The method according to any one of claims 9-12, characterized in that, The destination includes the home location where the second terminal device is located; The task corresponding to the vehicle data information of the N first terminal devices includes: Based on the driving data information corresponding to the vehicles where the N first terminal devices are located, and the time information of the arrival time of the vehicles where the N first terminal devices are located at the home location of the second terminal device, the status of the home devices connected to the second terminal device is adjusted.

14. The method of claim 13, wherein, Adjusting the status of the home appliances connected to the second terminal device includes at least one of the following: Adjust the operating status of the security equipment connected to the second terminal device; or... Adjust the operating status of the lighting equipment connected to the second terminal device; or... Adjust the operating status of the audio-visual equipment connected to the second terminal device; or... Adjust the operating status of the home appliances connected to the second terminal device; or... Adjust the working status of the kitchen and bathroom equipment connected to the second terminal device.

15. The method according to any one of claims 9 to 14, characterized in that, The method further includes: Receive at least one driver status information from the N first terminal devices; Display the at least one driver status information, and / or display health alert information based on the at least one driver status information, and / or adjust the status of home devices connected to the second terminal device based on the at least one driver status information.

16. The method according to any one of claims 9-15, characterized in that, The method further includes: Send family information to the N first terminal devices; The family information includes at least one of the following: home appliance status information or household activity information.

17. The method according to any one of claims 9-16, characterized in that, The method further includes: If a non-safety factor is detected, an alarm message is sent to the N first terminal devices; Receive monitoring data acquisition instructions from the N first terminal devices; Send monitoring data to the N first terminal devices.

18. The method according to any one of claims 9-17, characterized in that, The method further includes: Receive control commands from the N first terminal devices, the control commands being used to control home appliances connected to the second terminal devices; Execute the control instructions of the N first terminal devices.

19. The method of claim 18, wherein, When N is a positive integer greater than or equal to 2, the control instructions for the N first terminal devices are executed, including: When the control commands of N first terminal devices are mutually exclusive commands issued simultaneously, the control command of the first terminal device with the highest priority among the N first terminal devices shall be executed.

20. The method of any one of claims 9-19, wherein, The method further includes: Receive a communication request instruction from one of the N first terminal devices, the communication request instruction including a voice communication request instruction or a video communication request instruction; If human activity is detected in the home, a communication connection corresponding to the communication request instruction is established with the first terminal device.

21. The method according to any one of claims 9-20, characterized in that, The method further includes: receiving task process information from one of the N first terminal devices, wherein the task process information is the task process information corresponding to the first task running by the first terminal device; The second terminal device continues to run the first task based on the task progress information.

22. The method of any one of claims 9-21, wherein, The N first terminal devices include first terminal device A and first terminal device B, and the method further includes: Receive first arrival time information from the first terminal device A, wherein the first arrival time information is the time information of the first terminal device A arriving at the home location corresponding to the second terminal device, and the first terminal device A is associated with the first family member information; Based on the first arrival time information, activate the first home appliance mode; Receive second arrival time information sent from the first terminal device B, wherein the second arrival time information is the time information of the first terminal device B arriving at the home location corresponding to the second terminal device, and the first terminal device B is associated with the second family member information; Based on the second arrival time information, activate the second home appliance mode.

23. An interactive system, characterized by It includes a first terminal device and a second terminal device, wherein the first terminal device is used to perform the method according to any one of claims 1-8, and the second terminal device is used to perform the method according to any one of claims 9-22.

24. A communication device, characterized in that, include: One or more processors; One or more memories; the one or more memories storing one or more programs, which, when executed by the one or more processors, cause the communication device to perform the interaction method according to any one of claims 1-8.

25. A communications device, characterized by include: One or more processors; One or more memories; the one or more memories storing one or more programs, which, when executed by the one or more processors, cause the communication device to perform the interaction method according to any one of claims 9-22.

26. A readable storage medium characterized by, The readable storage medium stores a program or instructions that, when executed by a first terminal device, implement the interaction method as described in any one of claims 1 to 8, or when executed by a second terminal device, implement the interaction method as described in any one of claims 9 to 22.

27. A computer program product, characterised in that, The instruction includes, when executed, causing the interaction method according to any one of claims 1-8 to be implemented, or causing the interaction method according to any one of claims 9-22 to be implemented.

28. A chip, characterized by The chip includes a processor coupled to a memory for executing a computer program or instructions stored in the memory, such that the chip implements the interaction method of any one of claims 1-8, or implements the interaction method of any one of claims 9-22.

29. A communications device, characterized by include: It includes modules for performing the method as described in any one of claims 1 to 8, or modules for performing the method as described in any one of claims 9 to 22.

Images