Continuity display method and device

Abstract

The present application provides a continuity display method and device, used for providing a method for conveniently continuing to display, on a device, content that a user has not finished watching on another device. The continuity display method comprises: in response to a first operation of a user, acquiring first biological information of the user; receiving second biological information and first content information sent by a server, the first content information being used for indicating first content and the display progress of the first content, and the second biological information and the first content information being uploaded to the server when a second device finishes displaying the first content; and when determining on the basis of the first biological information and the second biological information that the identity verification of the user succeeds, continuing to display the first content on the basis of the first content information. By means of the solution, convenient circulation of display content can be implemented among different devices without complex manual operations of users, thereby improving user experience.

Description

A continuous display method and device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of the People's Republic of China on September 26, 2023, with application number 202311268403.X and invention name "A method and device for continuous display", the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The present application relates to the field of Internet of Things technology, and in particular to a continuous display method and device. Background Art

[0004] With the development of intelligent vehicles, the entertainment services that smart cockpits can provide for passengers are becoming increasingly rich. In addition to the central control screen, smart screens can also be installed in the passenger and rear seats. Passengers in the passenger and rear seats can use the smart screens to watch videos while the car is driving. When the user leaves the smart cockpit and returns home, they hope to continue watching the video they watched in the car on their smart screen at home. However, the user needs to open the smart screen at home, manually select the video application, and search for the video they watched in the car to play it. This operation is cumbersome and the user experience is poor.

[0005] Summary of the Invention

[0006] The present application provides a continuous display method and device, which are used to provide a method for conveniently continuing to display on a device content that a user has not finished watching on other devices.

[0007] A first aspect provides a method for continued display, performed by a first device, which may be a display device in a smart home system. The method comprises: obtaining first biometric information of the user in response to a first user operation; receiving second biometric information and first content information from a server, wherein the first content information indicates first content and the display progress of the first content; the second biometric information and the first content information are uploaded to the server by the second device upon completion of displaying the first content; and, after determining that the user's identity has been authenticated based on the first biometric information and the second biometric information, continuing to display the first content based on the first content information.

[0008] In the above method, after the user operates to turn on the first device, the first device can verify the user's identity. After the user's identity is authenticated, the first content can continue to be displayed on the first device based on the received first content information. The first content information is uploaded to the server when the second device finishes displaying the first content, so that the user can continue to view the first content on the first device. The display content can be conveniently transferred between different devices without the user's complicated manual operations, thereby improving the user experience.

[0009] For example, the second device in the above method can be a vehicle-mounted central device in a smart cockpit. The application scenario of this method can be that the user views the first content through the display device in the smart cockpit in the smart cockpit scene. After the user moves to the smart home scene, the first device in the smart home system continues to display the first content.

[0010] In one possible design, the first biometric information is facial data; obtaining the first biometric information of the user includes: collecting a facial image of the user, and generating the facial data based on the facial image.

[0011] In one possible design, the first biometric information is voiceprint data, and obtaining the first biometric information of the user includes: playing audio for guiding user voice interaction, collecting the user's audio; and generating the voiceprint data based on the collected audio.

[0012] Through the above design, the first device can use facial data or voiceprint data to authenticate the user and ensure the accuracy of the identity authentication.

[0013] In one possible design, before receiving the second biometric information and the first content information sent by the server, the method further includes: sending a request message to the server, where the request message is used to obtain the second biometric information and the first content information.

[0014] Through this design, the first device can request the second biometric information and the first content information from the server, thereby obtaining information for user identity verification and content information for subsequent display.

[0015] In one possible design, before continuing to display the first content according to the first content information, the method further includes: displaying a reminder message, wherein the reminder message is used to ask the user whether to continue displaying the first content; and detecting a confirmation operation of the user.

[0016] With this design, the first device can ask the user whether to continue displaying the first content before continuing to display the first content, and continue to display the first content after the user confirms, thereby improving the user experience.

[0017] In one possible design, before continuing to display the first content based on the first content information, the method also includes: displaying a reminder message, the reminder message including controls corresponding to multiple candidate contents, the multiple candidate contents corresponding one-to-one to multiple content information, the multiple candidate contents including the first content; detecting the user's operation of selecting a control corresponding to the first content from the controls corresponding to the multiple candidate contents.

[0018] Through this design, the first device can obtain multiple content information from the server, and the first device can display controls for multiple candidate contents corresponding to the multiple content information, so that the user can select the content they want to display next, further improving the user experience.

[0019] In one possible design, the first content information includes at least one of an application identifier, account information, a content identifier, and a display progress.

[0020] In one possible design, the method further includes: displaying second content in response to a second operation of the user; obtaining second content information in response to a third operation of the user, wherein the second content information is used to indicate the second content and the display progress of the second content, and the third operation is used to end the display of the second content; and sending the user's first biometric information and the second content information to the server.

[0021] Through this design, when the first device finishes displaying the second content, it can send the second content information corresponding to the second content and the user's first biometric information to the server, so that other devices can obtain the second content information and the first biometric information from the server, and then provide the user with continued display services.

[0022] A second aspect provides a continuous display method, executed by a second device, which may be an in-vehicle hub device. The method includes: detecting that a first display device is online, obtaining second biometric information of a user in a first seat corresponding to the first display device; detecting that the vehicle is turned off, obtaining first content information corresponding to first content displayed on the first display device, the first content information being used to indicate the first content and the display progress of the first content; and transmitting the user's first biometric information and the first content information to a server.

[0023] In the above method, when the user is in the smart cockpit scene, the second device can send the acquired second biometric information of the user and the first content information corresponding to the first content displayed by the first display device to the server after detecting that the vehicle is turned off, so that other devices can obtain the first content information and the first biometric information from the server, and thus provide the user with a continuous display service.

[0024] In one possible design, the second biometric information is facial data; obtaining the second biometric information of the user at the first seat corresponding to the first display device includes: controlling at least one camera device in the cockpit to capture a facial image of the user at the first seat; receiving the facial image sent by the at least one camera device, and generating the facial data based on the facial image.

[0025] In one possible design, the second biometric information is voiceprint data; obtaining the second biometric information of the user at the first seat corresponding to the first display device includes: controlling the speaker at the first seat in the cockpit to play audio for guiding user voice interaction; controlling the microphone at the first seat in the cockpit to collect the user's audio; receiving the audio sent by the microphone, and generating the voiceprint data based on the audio sent by the microphone.

[0026] Through the above design, the second device can control the camera or microphone in the smart cockpit to collect user facial images or user audio to generate facial data or voiceprint data that can indicate the user's identity, ensuring the accuracy of the user's biometric information when used for identity authentication.

[0027] In one possible design, obtaining first content information corresponding to the first content displayed by the first display device includes: sending a sleep notification message to the first display device, and receiving the first content information sent by the first display device.

[0028] Through this design, the second device can instruct the first display device to enter a sleep state when it detects that the vehicle is turned off. Before entering a sleep state, the first display device obtains the first content information corresponding to the first content being displayed and sends the first content information to the vehicle-mounted central device to complete the transmission of the first content information between devices in the smart cockpit.

[0029] In one possible design, the method also includes: detecting that a third display device is online, obtaining third biometric information of a user at a second seat corresponding to the third display device; receiving fourth biometric information and second content information sent by the server, the second content information being used to indicate the second content and the display progress of the second content, and the fourth biometric information and the second content information being uploaded to the server by the first device when the display of the second content ends; after determining that the user identity authentication is passed based on the third biometric information and the fourth biometric information, the second content information is sent to the third display device, so that the third display device continues to display the second content according to the second content information.

[0030] Through this design, when the second device detects that the third display device is online, it can obtain the third biometric information of the user at the second seat corresponding to the third display device. After the user's identity is authenticated, the second content information sent by the first device can be sent to the third display device, and the third display device can continue to display the second content. The display content can be conveniently transferred between different devices without the user's complicated manual operations, thereby improving the user experience.

[0031] In one possible design, before receiving the fourth biometric information and the second content information sent by the server, the method further includes: sending a request message to the server, where the request message is used to obtain the fourth biometric information and the second content information.

[0032] In one possible design, the first content information includes at least one of an application identifier, account information, a content identifier, and a display progress.

[0033] In one possible design, the second device is a vehicle-mounted central device.

[0034] A third aspect provides a continuous display method, which can be performed by a first device, which can be a display device in a smart home system. The method includes: in response to a first user operation, obtaining first biometric information of the user; in response to a second user operation, displaying second content; in response to a third user operation, obtaining second content information, the second content information indicating the second content and the display progress of the second content, the third operation being used to terminate the display of the second content; and transmitting the first biometric information and the second content information to a server.

[0035] In the above method, when the first device finishes displaying the second content, it can send the acquired first biometric information of the user and the second content information corresponding to the second content to the server, so that other devices can obtain the second content information and the first biometric information from the server, thereby providing the user with a continuous display service.

[0036] The fourth aspect provides a method for continuous display, in which the execution subject of the method can be a second device, and the second device can be an in-vehicle hub device in a smart cockpit. The method includes: detecting that a third display device is online, obtaining third biometric information of a user at a second seat corresponding to the third display device; receiving fourth biometric information and second content information sent by a server, wherein the second content information is used to indicate the second content and the display progress of the second content, and the fourth biometric information and the second content information are uploaded to the server by the first device when the display of the second content ends; after determining that the user identity verification is passed based on the third biometric information and the fourth biometric information, the second content information is sent to the third display device, so that the third display device continues to display the second content according to the second content information.

[0037] In the above method, when the user is in the smart cockpit scenario, the second device detects that the third display device is online, and can obtain the third biometric information of the user in the second seat corresponding to the third display device. After the user is authenticated, the second content information sent by the server can be sent to the third display device. The third display device can continue to display the second content based on the received second content information. The second content information is uploaded to the server by the first device when the second content is finished being displayed, so that the user can continue to view the second content on the third display device. The display content can be conveniently transferred between different devices without the user's complicated manual operations, thereby improving the user experience.

[0038] For example, the second device in the above method can be an in-vehicle central device in a smart cockpit. The application scenario of this method can be that the user views the second content through a smart screen (first device) in a smart home scene. After the user moves to the smart cockpit scene, the third display device corresponding to the third seat where the user is located in the smart cockpit continues to display the second content.

[0039] A fifth aspect provides a device comprising multiple functional modules; the multiple functional modules interact with each other to implement the method performed by the first device in the first or third aspect and its respective embodiments, or to implement the method performed by the second device in the second or fourth aspect and its respective embodiments. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation.

[0040] The sixth aspect provides a device comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the device is running, the at least one processor executes the method executed by the first device in the above-mentioned first aspect or third aspect and its respective embodiments, or executes the method executed by the second device in the above-mentioned second aspect or fourth aspect and its respective embodiments.

[0041] The seventh aspect further provides a program product, which, when run on a device, enables the device to execute the method executed by the first device or the second device in any of the above aspects and its various embodiments.

[0042] The eighth aspect also provides a readable storage medium, which stores a program. When the program is executed by a device, the device executes the method executed by the first device or the second device in any of the above aspects and its various embodiments.

[0043] The ninth aspect also provides a chip, which is used to read the program stored in the memory and execute the method executed by the first device or the second device in any of the above aspects and its various embodiments.

[0044] A tenth aspect further provides a chip system, comprising a processor configured to support a device in implementing the method executed by the first device or the second device in any of the above aspects and their respective embodiments. In one possible design, the chip system further comprises a memory configured to store the necessary programs and data. The chip system may consist of a chip alone, or may include a chip and other discrete components. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] FIG1 is a schematic diagram of a smart cockpit provided in an embodiment of the present application;

[0046] FIG2 is a schematic diagram of a smart home system provided in an embodiment of the present application;

[0047] FIG3 is a schematic diagram of a scenario in which a continuous display method provided in an embodiment of the present application is applicable;

[0048] FIG4 is a schematic diagram of the structure of a device provided in an embodiment of the present application;

[0049] FIG5 is a schematic structural diagram of a vehicle-mounted hub device and a display device provided in an embodiment of the present application;

[0050] FIG6 is a schematic diagram of a camera device capturing a user's face according to an embodiment of the present application;

[0051] FIG7 is a schematic diagram of a display interface of a second display device provided in an embodiment of the present application;

[0052] FIG8 is a schematic diagram of a continuous display provided by an embodiment of the present application;

[0053] FIG9 is a schematic diagram of a display interface of a second display device provided in an embodiment of the present application;

[0054] FIG10 is a flow chart of a continuous display method provided in an embodiment of the present application;

[0055] FIG11 is a flow chart of a continuous display method provided in an embodiment of the present application;

[0056] FIG12 is a flow chart of a continuous display method provided in an embodiment of the present application;

[0057] FIG13 is a diagram showing a possible structural example of a device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] In order to make the purpose, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of the present application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.

[0059] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "at least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or plural.

[0060] With the rapid development of smart homes and smart cars, the interconnection between smart cockpits and smart homes can provide users with more convenient services.

[0061] FIG1 is a schematic diagram of a smart cockpit provided in an embodiment of the present application. Referring to FIG1 , the smart cockpit may include an onboard hub device, at least one display device, a microphone array, a speaker array, at least one camera device, and a wireless communication device. The onboard hub device, also known as the vehicle computer, is used to manage the vehicle status and various devices in the vehicle. As shown in FIG1 , the onboard hub device can be integrated with the main driver's screen into one device. Of course, the structure shown in FIG1 is merely an example and not a limitation. The onboard hub device and the main driver's screen can also be separate devices, and this is not limited in the present embodiment. The at least one display device in the smart cockpit can be, for example, the main driver's screen, the passenger driver's screen, and the two rear screens shown in FIG1 . When a user is in the car, they can use the display device corresponding to their seat to run applications installed on the device. For example, the user can operate to view the vehicle status, play videos, play music, view documents, etc. In some embodiments, the smart cockpit system can adopt a single-core, multi-screen control mechanism. In this case, the at least one display device can be multiple display screens of the onboard hub device, and the onboard hub device can control the content displayed on each display screen. In other embodiments, the smart cockpit system can adopt a multi-core and multi-screen control mechanism, then the display device in the smart cockpit can be a separate device, and the vehicle-mounted central device and at least one display device can be connected to a wireless communication device to access the network, so that the vehicle-mounted central device and at least one display device can discover each other and establish a connection, so that the vehicle-mounted central device can interact with at least one display device.

[0062] The microphone array in the smart cockpit can be used to receive audio, and the speaker array can be used to play audio. As shown in Figure 1, the microphone array and the speaker array can be distributed near each seat in the smart cockpit. At least one camera device is used to capture images inside the vehicle. The camera device in the smart cockpit can be a camera in the vehicle-mounted hub device or display device, or the camera device can be installed in a rearview mirror, above each seat, etc. The wireless communication device can, for example, be a wireless communication box for providing in-vehicle wireless fidelity (Wi-Fi) communication and mobile network communication. The wireless communication device includes a T-Box (telematics box). In the following embodiments, the vehicle-mounted hub device and the display device in the smart cockpit can be connected to the wireless communication device to communicate through the in-vehicle Wi-Fi provided by the wireless communication device. The vehicle-mounted hub device can also be connected to the wireless communication device to interact with the server through the mobile network provided by the wireless communication device. Optionally, the vehicle-mounted hub device can also integrate some or all of the functions of the wireless communication device to provide in-vehicle Wi-Fi communication and mobile network communication.

[0063] Figure 2 is a schematic diagram of a smart home system provided in an embodiment of the present application. Referring to Figure 2, the smart home system may include a routing device and at least one display device. The display device may be connected to the routing device to access the network, so that the display device can interact with the server to obtain relevant information about the display content. Optionally, the display device may include a camera, a speaker, and a microphone. Of course, the smart home system may also include at least one camera device installed in the home, and the display device may receive images captured by at least one camera device. The smart home system may also include at least one smart speaker, and the display device may receive audio captured by at least one smart speaker, and play audio through at least one smart speaker.

[0064] In some smart cockpit and smart home application scenarios, users can watch videos on the display device corresponding to the seat when they are in the co-pilot seat or back seat of the smart cockpit. In the future, when autonomous driving is supported, users in the driving seat can also watch videos on the main control screen. When the user leaves the smart cockpit and enters the home, if the user wants to continue watching the video watched in the car on the smart screen at home, the user needs to open the smart screen at home, manually select the video application, and find the video watched by the user in the car for playback. Alternatively, the user can log in to his or her account in the video application installed on the smart screen at home, and then select the video watched by the user in the car from the viewing history to play, so that he or she can continue to watch the video. It can be seen that the user's operation in the above method is more cumbersome, resulting in a poor user experience.

[0065] Based on the above problems, the present application provides a continuous display method, which can be executed by an in-vehicle hub device in the cockpit, a first display device, a server, and a second display device in the smart home system. Figure 3 is a schematic diagram of a scenario applicable to a continuous display method provided by an embodiment of the present application. Referring to Figure 3, the scenario includes an in-vehicle hub device in the cockpit, a first display device, a server, and a second display device in the user's home. In this method, when the user is in the cockpit, he can use the first display device to watch content, and the in-vehicle hub device can obtain the user's first biometric information. When the vehicle is powered off, the first display device can obtain content information and send the content information to the in-vehicle hub device, and the in-vehicle hub device sends the user's first biometric information and content information to the server. After the user enters the home and turns on the second display device, the second display device can obtain the user's second biometric information. The second display device can obtain the user's first biometric information and content information from the server. When the user's identity is authenticated based on the first biometric information and the second biometric information, the second display device can continue to display the content on the second display device based on the content information. Through this solution, when the user moves from the cockpit to home, the second display device in the smart home system can obtain the content information of the content displayed on the first display device in the cockpit, and after the user identity verification is completed, the content can be automatically continued to be displayed on the second display device, without the user having to manually operate, thereby improving the user experience.

[0066] In the embodiments of the present application, the first display device may be any display device in the cockpit, such as the driver's screen, the passenger screen, or the rear screen. The second display device may be any display device in a smart home system, such as a smart screen, a tablet computer, a smartphone, or a personal computer (PC). The embodiments of the present application do not impose any restrictions on the specific type of display device.

[0067] Figure 4 is a schematic diagram of the structure of a device provided in an embodiment of the present application. The vehicle-mounted hub device and the second display device in the smart home system in the embodiment of the present application may have the structure shown in Figure 4. Referring to Figure 4, the device may include a face recognition module, a voiceprint recognition module, a content synchronization module and a resume module. Among them, the face recognition module can be used to obtain the user's face information and generate face data based on the user's face information; the voiceprint recognition module can be used to obtain the user's voice information and generate voiceprint data based on the user's voice information. The content synchronization module is used to obtain the content information of the content being displayed by the device, or to obtain content information uploaded by other devices from the server. The resume module is used to continue displaying content based on the obtained content information. Optionally, when the device is a vehicle-mounted hub device, the device may also include a seat recognition module, which is used to determine the user's seat in the cabin.

[0068] Based on the scenario shown in FIG3 and the device structure shown in FIG4, the following describes the continuous display method provided in an embodiment of the present application. The continuous display method provided in an embodiment of the present application is applicable to a user moving from a cockpit scene to a smart home scene, or vice versa. The following description uses the user moving from the cockpit scene to the smart home scene as an example. The implementation method of the user moving from the smart home scene to the cockpit scene can be found in the following embodiments, and repeated parts are not repeated here.

[0069] 1. The user is in the cockpit scene.

[0070] 1. The first display device is online.

[0071] The user operates to start the first display device in the cockpit. After the first display device is started, it can access the network through the wireless communication device in the cockpit. The first display device can send an online notification message to the vehicle-mounted central device.

[0072] In some embodiments, the online notification message sent by the first display device to the vehicle-mounted hub device may be a discovery request message, which is used to request to establish a connection with the vehicle-mounted hub device. In an embodiment of the present application, the discovery request message sent by the first display device to the vehicle-mounted hub device may be used to indicate that the first display device is online. When the vehicle-mounted hub device receives the discovery request message sent by the first display device, it can determine that the first display device is online.

[0073] For example, Figure 5 is a structural diagram of a vehicle-mounted hub device and a display device provided in an embodiment of the present application. Referring to Figure 5, the vehicle-mounted hub device may include a discovery module, a connection module, a publish-subscribe module, and a power management module. Among them, the discovery module is used to discover other devices in the local area network, the connection module is used to establish a connection with other devices, the publish-subscribe module is used to receive subscription service messages sent by other devices and provide subscription services to other devices, and the power management module is used to manage the power on and off of the vehicle-mounted hub device. The display device may include a discovery module, a connection module, a subscription module, and a power management module. Among them, the subscription module is used to send subscription service messages to the vehicle-mounted hub device.

[0074] Based on the structure of the vehicle-mounted hub device and the display device shown in Figure 5, after the vehicle-mounted hub device and the display device in the cockpit are connected to the wireless network in the cockpit, the vehicle-mounted hub device and the display device can listen to broadcast messages sent by other devices through the user datagram protocol (UDP) port (such as port 5684) to discover other devices. After the first display device is started and connected to the network, the discovery module of the first display device can send a discovery request message, which can be a multicast message. The discovery request message may include the device identifier of the first display device, the device type, the seat identifier corresponding to the first display device, and the subscription services supported by the first display device. After the vehicle-mounted hub device receives the discovery request message sent by the first display device, it can determine that the first display device is online, and the publish-subscribe module of the vehicle-mounted hub device can also determine the service subscribed by the first display device and send a notification message related to the service to the first display device. For example, after the first display device subscribes to the vehicle status notification service from the vehicle-mounted hub device, when the vehicle status changes, the vehicle-mounted hub device can send a notification message to the first display device. For example, when the vehicle is turned off, the vehicle-mounted central device may send a notification message corresponding to an ACC Off event to the first display device.

[0075] 2. The vehicle-mounted central device obtains the user's second biometric information.

[0076] In an embodiment of the present application, after the vehicle-mounted central device determines that the first display device is online, it can obtain the user's second biometric information, which may include facial data or voiceprint data.

[0077] In an optional embodiment, the vehicle-mounted central device can instruct at least one camera device in the cabin to capture the facial image of the user at the first seat corresponding to the first display device. In implementation, the vehicle-mounted central device can store the correspondence between the first display device, the first seat corresponding to the first display device, and the camera configuration parameters corresponding to the first seat, wherein the camera configuration parameters corresponding to the first seat may include parameters such as azimuth and focal length that need to be adjusted when any one or more cameras in the cabin capture the facial information of the user at the first seat. After determining that the first display device is online, the vehicle-mounted central device can configure at least one camera device according to the camera configuration parameters corresponding to the first seat. Figure 6 is a schematic diagram of a camera device capturing a user's face provided in an embodiment of the present application. Referring to Figure 6, assuming that the first seat is the right seat in the back row, the configured camera device can quickly and automatically focus on the user's face at the first seat, thereby acquiring the user's facial image. The camera device can send the captured facial image to the vehicle-mounted central device, and the vehicle-mounted central device can generate facial data based on the facial image. Optionally, the step of determining the first seat corresponding to the first display device can be performed by the seat recognition module in the vehicle-mounted central device shown in Figure 4; the step of obtaining facial data can be performed by the facial recognition module in the vehicle-mounted central device shown in Figure 4.

[0078] In another optional embodiment, the vehicle-mounted central device can instruct the microphone array in the cockpit to collect the audio of the user at the first seat corresponding to the first display device. Referring to Figure 1, the microphone array and speaker array in the cockpit can be distributed near each seat in the cockpit. In this way, the vehicle-mounted central device can instruct the speaker corresponding to the first seat to play audio that guides the user to perform voice interaction. The microphone corresponding to the first seat can collect the user's audio and send the collected user's audio to the vehicle-mounted central device. The vehicle-mounted central device can generate voiceprint data based on the user's audio. Optionally, the step of determining the first seat corresponding to the first display device can be performed by the seat recognition module in the vehicle-mounted central device shown in Figure 4; the step of obtaining voiceprint data can be performed by the voiceprint recognition module in the vehicle-mounted central device shown in Figure 4.

[0079] In an embodiment of the present application, after obtaining the second biometric information of the user, the vehicle-mounted central device can store the second biometric information and store the correspondence between the second biometric information and the seat identifier of the first seat.

[0080] 3. The user uses the first display device to view content.

[0081] Optionally, the user can operate the first display device to run applications installed in the first display device. For example, the user can choose to run a video application to watch a video, or choose a music application to play music, or use the first display device to view documents.

[0082] 4. When the vehicle is turned off, the vehicle-mounted central device uploads the user's second biometric information and content information to the server.

[0083] In an embodiment of the present application, after the vehicle-mounted central device detects that the vehicle is turned off, it can send a sleep notification message to the first display device, or the user can operate the first display device to sleep. Before the first display device goes into sleep, it can obtain content information of the content displayed at the first moment, and the first moment is the moment when the sleep notification message sent by the vehicle-mounted central device is received, or the first moment is the moment when the user triggers the first display device to sleep. The content information may include at least one of the application identifier, account information, content identifier, and display progress. For example, at the first moment, the first display device is running a video application and playing video A, then the first display device can obtain content information such as the video application identifier, the account information of the user account logged in to the video application, the identifier of video A, and the playback time of video A.

[0084] The first display device can send the content information and the seat identification of the first seat to the vehicle-mounted central device. The vehicle-mounted central device can obtain the second biometric information of the user at the first seat based on the seat identification of the first seat, and send the user's second biometric information and content information to the server.

[0085] Optionally, the step of uploading the user's second biometric information and content information may be performed by a content synchronization module of the vehicle-mounted hub device shown in FIG. 4 .

[0086] After receiving the second biometric information and content information uploaded by the vehicle-mounted hub device, the server can categorize and store the content information according to the content type indicated by the content information. For example, the server can separately store content information such as "Continuation Service - Video Category" and "Continuation Service - Document Category." The vehicle-mounted hub device can also send the account information of the user logged into the vehicle-mounted hub device to the server when uploading the second biometric information and content information. The server can then associate the second biometric information and content information with the account information logged into the vehicle-mounted hub device.

[0087] It should be noted that when multiple users in the cabin use the display devices corresponding to their seats to watch content, the vehicle-mounted central device can respectively obtain the biometric information of each user and the content information of the content displayed by each display device, and upload the obtained biometric information and content information of multiple users to the server. For specific implementation, please refer to the above embodiments, and the repeated parts will not be repeated.

[0088] 2. The user is in a smart home scenario.

[0089] 1. The user enters the home and starts the second display device.

[0090] After the user leaves the cabin and enters the home, the second display device is activated. Optionally, the second display device may be in an off state and the user activates the second display device; or the second display device may be in a sleep state and the user activates the second display device.

[0091] The second display device may acquire the first biometric information of the user.

[0092] In one optional embodiment, the second display device may capture a facial image of the user in front of the second display device using a camera and generate facial data based on the facial image. Alternatively, when the smart home system includes multiple cameras, the second display device may instruct a camera near the second display device to capture the user's facial image and receive the user's facial image sent by the camera. Alternatively, the step of acquiring the user's facial data may be performed by the facial recognition module of the second display device shown in FIG. 4 .

[0093] In another optional embodiment, the second display device can play audio guiding the user to perform voice interaction and collect the user's audio, and the second display device can generate voiceprint data based on the user's audio. Optionally, the step of obtaining the user's voiceprint data can be performed by the voiceprint recognition module of the second display device shown in Figure 4.

[0094] 2. The second display device obtains the user's second biometric information and content information from the server and verifies the user's identity.

[0095] In an optional embodiment, the second display device may send a request message to the server, and the request message may include the account information of the account logged in to the second display device, and the request message is used to request to obtain the user's second biometric information and content information. In some embodiments, the account logged in to the second display device and the account logged in to the vehicle-mounted hub device may be the same account or an associated account. When the server receives the request message sent by the second display device, it can determine the biometric information and content information uploaded by other devices under the account, or the biometric information and content information uploaded by devices under other accounts associated with the account based on the account information in the request message. In an embodiment of the present application, the server can send the second biometric information and content information uploaded by the vehicle-mounted hub device to the second display device.

[0096] Optionally, the step of acquiring the second biometric information and content information of the user may be performed by a content synchronization module of the second display device shown in FIG. 4 .

[0097] The second display device can authenticate the user based on the second biometric information and the first biometric information. For example, the second electronic device can calculate the similarity between the second biometric information and the first biometric information. When the similarity exceeds a preset threshold, the second electronic device can determine that the user's identity has been verified. It should be noted that when the second display device detects multiple users in front of the second display device, it can obtain the biometric information of each user separately and authenticate each user.

[0098] 3. The second display device continues to display according to the content information.

[0099] In an optional embodiment, after the second display device passes the user's identity authentication, it can continue to display according to the content information. For example, when the content information includes the video application identifier, the account information of the user account logged in to the video application, the identifier of video A, and the playback time of video A, the second display device can start the video application. If the account is not logged in to the video application or the logged in account is different from the user account in the content information, the second display device can log in to the user's account in the video application. If the second display device does not store the user's account information, the second display device can display the login interface and remind the user to log in to the account. The second display device can search for video A in the video application according to the identifier of video A, and continue to play video A on the second display device according to the playback time of video A in the content information. Optionally, the step of continuing to display on the second display device can be performed by the resume module of the second display device shown in Figure 4.

[0100] Optionally, before continuing to display the content, the second display device may display a reminder message, which is used to ask the user whether to continue displaying the content. For example, Figure 7 is a schematic diagram of the display interface of a second display device provided in an embodiment of the present application. Referring to Figure 7, after the second display device passes the user identity verification, it may display a reminder message to ask the user whether to continue watching Video A. After the user triggers the confirmation operation, the second display device continues to play Video A.

[0101] For example, Figure 8 is a schematic diagram of a continuous display provided by an embodiment of the present application. Referring to Figure 8 (a), before the vehicle is turned off, the first display device displays Video A, and the playback duration is 34:09. Referring to Figure 8 (b), after the user returns home and the second display device verifies the user's identity, it resumes playing Video A on the second display device based on the content information, starting at 34:09.

[0102] In some scenarios, if the second display device receives the biometric information and content information of multiple users sent by the server, and the second display detects that there are multiple users in front of the second display device and the identity authentication of multiple users is passed, the second display device can display controls corresponding to multiple contents, and the user can choose which content to display next. For example, Figure 9 is a schematic diagram of the display interface of a second display device provided in an embodiment of the present application. Referring to Figure 9, when the second display device receives the biometric information and content information of three users, and the second display device passes the identity authentication of the three users in front of the second display device, the second display device can display the controls corresponding to each content respectively, such as video A with a viewing progress of 30%, video B with a viewing progress of 45%, and video C with a viewing progress of 88% as shown in Figure 9. The user can select any one of the three controls corresponding to the three videos to continue playing the video corresponding to the control on the second display device. If the user clicks the control corresponding to video A, the second display device can continue playing video A.

[0103] Based on the above embodiment, the following two examples are used to introduce the continuous display method provided in the embodiment of the present application:

[0104] Example 1: User moves from the smart cockpit scene to the smart home scene

[0105] FIG10 is a flow chart of a continuous display method provided by an embodiment of the present application. The method can be executed by a vehicle hub device, a first display device in a smart cockpit, a server, and a second display device in a smart home scene. Referring to FIG10 , the method includes the following steps:

[0106] S1001: In response to a fourth operation of the user, the first display device is started.

[0107] Optionally, the fourth operation may be an operation triggered by a user for starting the first display device. For example, the fourth operation may be the user pressing a power button of the first display device.

[0108] S1002: The first display device sends an online notification message to the vehicle-mounted central device.

[0109] S1003: The vehicle-mounted central device configures at least one camera device in the smart cockpit according to the camera configuration parameters corresponding to the first seat, and obtains the user's facial image captured by the at least one camera device.

[0110] Among them, the first seat is the seat corresponding to the first display device. For example, when the first display device is a passenger screen, the first seat is the passenger seat.

[0111] S1004: The vehicle-mounted central device generates second biometric information based on the user's facial image, and stores the corresponding relationship between the second biometric information and the seat identifier of the first seat.

[0112] The second biometric information may be facial data.

[0113] S1005: In response to the fifth operation of the user, the first display device displays content.

[0114] The fifth operation may be an operation triggered by the user, such as displaying a video, playing an audio, or displaying a document on the first display device.

[0115] S1006: The vehicle-mounted central device detects that the vehicle is turned off and sends a sleep notification message to the first display device.

[0116] S1007: The first display device obtains content information according to the displayed content.

[0117] S1008: The first display device sends the content information and the seat identifier of the first seat to the vehicle-mounted hub device.

[0118] S1009: The vehicle-mounted central device obtains the user's second biometric information according to the seat identifier of the first seat.

[0119] S1010: The vehicle-mounted hub device sends the user's second biometric information and content information to the server.

[0120] S1011: In response to a first operation by the user, the second display device is started.

[0121] Optionally, the first operation may be an operation triggered by a user for starting the second display device. For example, the first operation may be the user pressing a power button of the second display device.

[0122] S1012: The second display device collects a facial image of the user and generates first biometric information based on the facial image of the user.

[0123] The first biometric information may be facial data.

[0124] S1013: The second display device sends a request message to the server.

[0125] S1014: The server sends the second biometric information and content information to the second display device.

[0126] S1015: The second display device determines that the user identity verification is successful based on the first biometric information and the second biometric information.

[0127] S1016: The second display device displays a reminder message according to the content information, where the reminder message is used to inquire the user whether to continue displaying the content.

[0128] S1017: In response to the user's confirmation operation, the second display device continues to display the content according to the content information.

[0129] Optionally, the confirmation operation can be a user-triggered operation to confirm continued display, such as a user clicking a confirmation button in the reminder message, or a user inputting a confirmation command by voice. It should be understood that as a possible implementation, S1016-S1017 may not be performed, and after S1015, the second display device continues to display the content according to the content information.

[0130] Example 2: User moves from smart home scene to smart cockpit scene

[0131] FIG11 is a flow chart of a continuous display method provided by an embodiment of the present application. The method can be executed by a vehicle-mounted hub device, a first display device in a smart cockpit, a server, and a second display device in a smart home scene. Referring to FIG11 , the method includes the following steps:

[0132] S1101: In response to a first operation of the user, the second display device is started.

[0133] Optionally, the first operation may be an operation triggered by a user for starting the second display device. For example, the first operation may be the user pressing a power button of the second display device.

[0134] S1102: The second display device plays audio to guide user voice interaction and collects user audio.

[0135] S1103: The second display device generates first biometric information according to the user audio.

[0136] Optionally, the first biometric information may be voiceprint data.

[0137] S1104: In response to the user's second operation, the second display device displays content.

[0138] Optionally, the second operation may be an operation triggered by the user, such as displaying a video, playing an audio, or displaying a document on the second display device.

[0139] S1105: In response to the user's third operation, the second display device obtains content information according to the displayed content.

[0140] The third operation may be an operation for ending the display of content.

[0141] S1106: The second display device sends the user's first biometric information and content information to the server.

[0142] S1107: In response to the fourth operation of the user, the first display device is started.

[0143] Optionally, the fourth operation may be an operation triggered by a user for starting the first display device. For example, the fourth operation may be the user pressing a power button of the first display device.

[0144] S1108: The first display device sends an online notification message to the vehicle-mounted central device.

[0145] S1109: The vehicle-mounted central device controls the speaker corresponding to the first seat to play audio guiding user voice interaction, and receives user audio collected by the microphone corresponding to the first seat.

[0146] Among them, the first seat is the seat corresponding to the first display device. For example, when the first display device is a passenger screen, the first seat is the passenger seat.

[0147] S1110: The vehicle-mounted central device generates second biometric information based on the user audio.

[0148] The second biometric information may be voiceprint data.

[0149] S1111: The vehicle-mounted central device sends a request message to the server.

[0150] S1112: The server sends the first biometric information and content information to the vehicle-mounted central device.

[0151] S1113: The vehicle-mounted central device determines that the user identity authentication is successful based on the first biometric information and the second biometric information.

[0152] S1114: The vehicle-mounted hub device sends the content information to the first display device.

[0153] S1115: The first display device displays a reminder message according to the content information, where the reminder message is used to inquire the user whether to continue displaying the content.

[0154] S1116: In response to the user's confirmation operation, the first display device continues to display the content according to the content information.

[0155] Optionally, the confirmation operation can be a user-triggered operation to confirm continued display, such as a user clicking a confirmation button in the reminder message, or a user inputting a confirmation command by voice. It should be understood that as a possible implementation, S1015-S1116 may not be performed, and after S1114, the first display device continues to display the content according to the content information.

[0156] It should be noted that the above Example 1 is introduced by taking the example of the user moving from the smart cockpit scene to the smart home scene and the user's identity is authenticated based on face recognition, and the above Example 2 is introduced by taking the example of the user moving from the smart home scene to the smart cockpit scene and the user's identity is authenticated based on voiceprint recognition. The continuous display method provided in the embodiment of the present application can also have the following implementation methods: the user moves from the smart cockpit scene to the smart home scene and the user's identity is authenticated based on voiceprint recognition, and the user moves from the smart home scene to the smart cockpit scene and the user's identity is authenticated based on face recognition. For specific implementation, please refer to the introduction of the above embodiments, and the repeated parts will not be repeated.

[0157] Based on the same concept, an embodiment of the present application further provides a continuous display method, which can be performed by a first device. The first device can be the second display device in the above embodiment. Figure 12 is a flow chart of a continuous display method provided by an embodiment of the present application. Referring to Figure 12, the method includes the following steps:

[0158] S1201: In response to a first operation of a user, a first device obtains first biometric information of the user.

[0159] S1202: The first device receives the second biometric information and the first content information sent by the server.

[0160] The first content information is used to indicate the first content and the display progress of the first content; the second biometric information and the first content information are uploaded to the server by the second device when the second device finishes displaying the first content.

[0161] S1203: After the first device determines that the user identity verification is successful based on the first biometric information and the second biometric information, it continues to display the first content based on the first content information.

[0162] Optionally, when the first device is a vehicle-mounted hub device, the first device continuing to display the first content according to the first content information may be the vehicle-mounted hub device controlling the first display device to display the first content.

[0163] It should be noted that when implementing the continuous display method shown in Figure 12 of the present application, reference can be made to the above embodiments of the present application, and the repeated parts will not be repeated.

[0164] It should be understood that in order to realize the functions of the vehicle-mounted central device or the second display device in the above-mentioned embodiments, the vehicle-mounted central device or the second display device includes a hardware structure and / or software structure corresponding to the execution of each function. It should be easy for those skilled in the art to realize that, in combination with the units and method steps of each example described in the embodiments disclosed in this application, this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0165] Figure 13 is a possible structural example diagram of a device provided in an embodiment of the present application. The device can be used to implement the functions of the vehicle-mounted central device in the above embodiment, and can also be used to implement the functions of the second display device in the above embodiment, thereby also achieving the beneficial effects of the above embodiment.

[0166] Referring to Figure 13 , the device 1300 may include a processor 1301, a memory 1302, and a communication interface 1303. The processor 1301, the memory 1302, and the communication interface 1303 are coupled to each other. Optionally, the memory 1302 may be used to store instructions executed by the processor 1301, or to store input data required by the processor 1301 to execute instructions, or to store data generated after the processor 1301 executes instructions. The communication interface 1303 may be a transceiver or an input / output interface.

[0167] Optionally, referring to FIG13 , the processor 1301, the memory 1302, and the communication interface 1303 are interconnected via a bus 1304. The bus 1304 may be a Peripheral Component Interconnect Standard bus or an Extended Industry Standard Architecture bus. The bus may be classified as an address bus, a data bus, a control bus, etc. For ease of illustration, FIG13 shows only one thick line, but this does not imply that there is only one bus or only one type of bus.

[0168] When the device 1300 is used as a vehicle-mounted hub device, the processor 1301 can be used to implement the processing functions of the hub device in the above embodiment. The communication interface 1303 can be used to implement the transceiver functions of the vehicle-mounted hub device in the above embodiment.

[0169] It is understood that the processor 1301 in the embodiments of the present application may be a central processing unit, or may be another general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0170] The memory 1302 in FIG. 13 of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memory. Among them, the non-volatile memory can be a read-only memory, a programmable read-only memory, an erasable programmable read-only memory, an electrically erasable programmable read-only memory, or a flash memory. It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0171] Based on the above embodiments, the present application further provides a device comprising multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the vehicle hub device or the second display device in each method described in the embodiments of the present application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation.

[0172] Based on the above embodiments, the present application further provides a program product comprising instructions, which, when executed on a device or computer, enables the device or computer to execute the methods described in the embodiments of the present application.

[0173] Based on the above embodiments, the present application further provides a readable storage medium, in which a program is stored. When the program is executed by a device or a computer, the device or computer executes the various methods described in the embodiments of the present application.

[0174] Based on the above embodiments, the present application further provides a chip, which is used to read the program stored in the memory to implement the various methods described in the embodiments of the present application.

[0175] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a device to implement the various methods described in the embodiments of the present application. In one possible design, the chip system also includes a memory for storing the necessary programs and data for the device. The chip system can be composed of a chip or can include a chip and other discrete devices.

[0176] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or program products. Therefore, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware.

[0177] The present application is described with reference to the flowcharts and / or block diagrams of the methods, apparatus (system), and program products according to the present application. It should be understood that each process and / or block in the flowcharts and / or block diagrams, as well as combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by program instructions.

[0178] Obviously, those skilled in the art may make various modifications and variations to this application without departing from the scope of protection of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A continuous display method, characterized in that: Applied to a first device, the method includes: In response to a first operation of a user, acquiring first biometric information of the user; receiving second biometric information and first content information sent by the server, where the first content information is used to indicate first content and display progress of the first content, and the second biometric information and the first content information are uploaded to the server by the second device when the second device finishes displaying the first content; After determining that the user identity authentication has passed according to the first biometric information and the second biometric information, the first content continues to be displayed according to the first content information.

2. The method according to claim 1, characterized in that The first biometric information is face data, The obtaining of the first biometric information of the user includes: A facial image of the user is collected, and the facial data is generated according to the facial image.

3. The method according to claim 1, characterized in that The first biometric information is voiceprint data, The obtaining of the first biometric information of the user includes: Play audio used to guide user voice interaction and collect user audio; The voiceprint data is generated according to the collected audio.

4. The method according to any one of claims 1 to 3, characterized in that: Before receiving the second biometric information and the first content information sent by the server, the method further includes: A request message is sent to the server, where the request message is used to obtain the second biometric information and the first content information.

5. The method according to any one of claims 1 to 4, characterized in that: Before continuing to display the first content according to the first content information, the method further includes: displaying a reminder message, wherein the reminder message is used to ask the user whether to continue to display the first content; A confirmation operation of the user is detected.

6. The method according to any one of claims 1 to 4, characterized in that: Before continuing to display the first content according to the first content information, the method further includes: Displaying a reminder message, the reminder message including controls corresponding to a plurality of candidate contents, the plurality of candidate contents corresponding one-to-one to a plurality of content information, the plurality of candidate contents including the first content; An operation of the user selecting a control corresponding to the first content from controls corresponding to the multiple candidate contents is detected.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: In response to a second operation by the user, displaying a second content; In response to a third operation of the user, second content information is acquired, where the second content information is used to indicate second content and display progress of the second content, and the third operation is used to end display of the second content; The first biometric information of the user and the second content information are sent to a server.

8. A continuous display method, characterized in that: Applied to the second device, the method includes: Detecting that a first display device is online, obtaining second biometric information of a user at a first seat corresponding to the first display device; Detecting that the vehicle is turned off, acquiring first content information corresponding to the first content displayed by the first display device, where the first content information is used to indicate the first content and the display progress of the first content; The first biometric information of the user and the first content information are sent to a server.

9. The method according to claim 8, characterized in that The second biometric information is face data, The acquiring second biometric information of a user at a first seat corresponding to the first display device includes: Controlling at least one camera device in the cockpit to capture a facial image of the user at the first seat; Receive the facial image sent by the at least one camera device, and generate the facial data according to the facial image.

10. The method according to claim 9, characterized in that The second biometric information is voiceprint data, The acquiring second biometric information of a user at a first seat corresponding to the first display device includes: Controlling a speaker at the first seat in the cockpit to play audio for guiding user voice interaction; Controlling the microphone at the first seat in the cockpit to collect audio of the user; The audio sent by the microphone is received, and the voiceprint data is generated according to the audio sent by the microphone.

11. The method according to any one of claims 8 to 10, characterized in that: The acquiring first content information corresponding to the first content displayed by the first display device includes: A sleep notification message is sent to the first display device, and the first content information sent by the first display device is received.

12. The method according to any one of claims 8 to 11, characterized in that: The method further comprises: Detecting that a third display device is online, obtaining third biometric information of a user at a second seat corresponding to the third display device; receiving fourth biometric information and second content information sent by the server, where the second content information is used to indicate second content and display progress of the second content, and the fourth biometric information and the second content information are uploaded to the server by the first device when the first device finishes displaying the second content; After determining that the user identity authentication is passed according to the third biometric information and the fourth biometric information, the second content information is sent to the third display device, so that the third display device continues to display the second content according to the second content information.

13. The method according to claim 12, characterized in that Before receiving the fourth biometric information and the second content information sent by the server, the method further includes: A request message is sent to the server, where the request message is used to obtain the fourth biometric information and the second content information.

14. A continuous display method, characterized in that: Applied to a server, the method comprises: receiving second biometric information of a user and first content information sent by a second device, where the first content information is used to indicate first content and display progress of the first content; The second biometric information and the first content information of the user are sent to the first device.

15. The method according to claim 14, characterized in that Before sending the second biometric information and the first content information of the user to the first device, the method further includes: A request message sent by the first device is received, where the request message is used to obtain the second biometric information and the first content information.

16. The method according to claim 15, characterized in that The request message includes account information of a first account corresponding to the first device; The account corresponding to the second device is the first account; or The account corresponding to the second device is an account associated with the first account.

17. A device, characterized in that The invention comprises at least one processor, wherein the at least one processor is coupled to at least one memory, and the at least one processor is used to read the program stored in the at least one memory to execute the method according to any one of claims 1 to 7, or execute the method according to any one of claims 8 to 13.

18. A readable storage medium, characterized in that: The readable storage medium stores instructions, which, when executed on a device, enable the device to execute the method as claimed in any one of claims 1 to 7, or to execute the method as claimed in any one of claims 8 to 13.

Images