Continuous display method and equipment

Abstract

The invention provides a continuous display method and equipment, and aims to provide a method for conveniently and continuously displaying contents which are not completely watched by a user on other equipment on the equipment. The method comprises the steps of obtaining first biological information of a user in response to a first operation of the user; receiving second biological information and first content information sent by the server, wherein the first content information is used for indicating the first content and the display progress of the first content; the second biological information and the first content information are uploaded to the server when the second equipment finishes displaying the first content; and after determining that the user identity verification is passed according to the first biological information and the second biological information, continuing to display the first content according to the first content information. Through the scheme, convenient circulation of the display content can be carried out among different devices without complex manual operation of a user, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of Internet of Things, and in particular to a continuous display method and device. Background Art

[0002] With the development of automobile intelligence, the entertainment services that the car smart cockpit can provide for passengers are becoming more and more abundant. In addition to the central control screen, the smart cockpit can also install smart screens for the co-pilot and the back row. The co-pilot and the back row passengers can use the smart screen to watch videos while the car is driving. When the user leaves the smart cockpit and enters the home, he expects to continue watching the video watched in the car on the smart screen at home. The user needs to open the smart screen at home, manually select the video application, and find the video watched by the user in the car to play. The operation is cumbersome and the user experience is poor. Summary of the invention

[0003] The present application provides a continuous display method and device, which are used to provide a method for conveniently continuing to display on a device content that a user has not finished watching on other devices.

[0004] In the first aspect, a continuous display method is provided, and the execution subject of the method is a first device, and the first device can be a display device in a smart home system. The method includes: in response to a first operation of a user, obtaining the first biometric information of the user; receiving the second biometric information and the first content information sent by the server, the first content information is used to indicate the first content and the display progress of the first content; the second biometric information and the first content information are uploaded to the server by the second device when the display of the first content ends; after determining that the identity authentication of the user is passed according to the first biometric information and the second biometric information, the first content is continued to be displayed according to the first content information.

[0005] In the above method, after the user operates to turn on the first device, the first device can verify the user's identity. After the user's identity is authenticated, the first content can continue to be displayed on the first device according to the received first content information. The first content information is uploaded to the server by the second device when the display of the first content ends, so that the user can continue to view the first content on the first device. The display content can be conveniently transferred between different devices without the user's complicated manual operation, thereby improving the user experience.

[0006] For example, the second device in the above method can be a vehicle-mounted central device in a smart cockpit. The application scenario of this method can be that a user views the first content through a display device in the smart cockpit in a smart cockpit scenario. After the user moves to the smart home scene, the first device in the smart home system continues to display the first content.

[0007] In a possible design, the first biometric information is facial data; and obtaining the first biometric information of the user includes: collecting a facial image of the user, and generating the facial data based on the facial image.

[0008] In one possible design, the first biometric information is voiceprint data, and obtaining the first biometric information of the user includes: playing audio for guiding user voice interaction and collecting the user's audio; and generating the voiceprint data based on the collected audio.

[0009] Through the above design, the first device can use facial data or voiceprint data to authenticate the user and ensure the accuracy of identity authentication.

[0010] In one possible design, before receiving the second biometric information and the first content information sent by the server, the method further includes: sending a request message to the server, where the request message is used to obtain the second biometric information and the first content information.

[0011] Through this design, the first device can request the second biometric information and the first content information from the server, thereby obtaining information for user identity authentication and content information for subsequent display.

[0012] In one possible design, before continuing to display the first content according to the first content information, the method further includes: displaying a reminder message, wherein the reminder message is used to ask the user whether to continue displaying the first content; and detecting a confirmation operation of the user.

[0013] With this design, the first device can ask the user whether to continue displaying the first content before continuing to display the first content, and continue to display the first content after the user confirms, thereby improving the user experience.

[0014] In one possible design, before continuing to display the first content according to the first content information, the method also includes: displaying a reminder message, the reminder message including controls corresponding to multiple candidate contents, the multiple candidate contents corresponding one-to-one to multiple content information, the multiple candidate contents including the first content; and detecting the user's operation of selecting a control corresponding to the first content from the controls corresponding to the multiple candidate contents.

[0015] Through this design, the first device can obtain multiple content information from the server, and the first device can display controls for multiple candidate contents corresponding to the multiple content information, so that the user can select the content they want to display next, thereby further improving the user experience.

[0016] In one possible design, the first content information includes at least one of an application identifier, account information, a content identifier, and a display progress.

[0017] In one possible design, the method also includes: displaying second content in response to a second operation of the user; obtaining second content information in response to a third operation of the user, the second content information being used to indicate the second content and the display progress of the second content, the third operation being used to end displaying the second content; and sending the user's first biometric information and the second content information to a server.

[0018] Through this design, when the first device finishes displaying the second content, it can send the second content information corresponding to the second content and the user's first biometric information to the server, so that other devices can obtain the second content information and the first biometric information from the server, and then provide continuous display services for the user.

[0019] The second aspect provides a continuous display method, the execution subject of the method is a second device, and the second device can be a vehicle-mounted hub device. The method includes: detecting that the first display device is online, obtaining the second biological information of the user at the first seat corresponding to the first display device; detecting that the vehicle is turned off, obtaining the first content information corresponding to the first content displayed by the first display device, the first content information is used to indicate the first content and the display progress of the first content; sending the first biological information of the user and the first content information to the server.

[0020] In the above method, when the user is in the smart cockpit scene, the second device can send the acquired second biometric information of the user and the first content information corresponding to the first content displayed by the first display device to the server after detecting that the vehicle is turned off, so that other devices can obtain the first content information and the first biometric information from the server, and then provide continuous display services for the user.

[0021] In one possible design, the second biometric information is facial data; and obtaining the second biometric information of the user at the first seat corresponding to the first display device includes: controlling at least one camera device in the cockpit to capture a facial image of the user at the first seat; receiving the facial image sent by the at least one camera device, and generating the facial data based on the facial image.

[0022] In one possible design, the second biometric information is voiceprint data; and obtaining the second biometric information of the user at the first seat corresponding to the first display device includes: controlling the speaker at the first seat in the cockpit to play audio for guiding user voice interaction; controlling the microphone at the first seat in the cockpit to collect the user's audio; receiving the audio sent by the microphone, and generating the voiceprint data based on the audio sent by the microphone.

[0023] Through the above design, the second device can control the camera or microphone in the smart cockpit to capture the user's facial image or user audio to generate facial data or voiceprint data that can indicate the user's identity, thereby ensuring the accuracy of the user's biometric information when used for identity authentication.

[0024] In a possible design, obtaining first content information corresponding to the first content displayed by the first display device includes: sending a sleep notification message to the first display device, and receiving the first content information sent by the first display device.

[0025] Through this design, the second device can instruct the first display device to enter a sleep state when it detects that the vehicle is turned off. Before entering sleep mode, the first display device obtains the first content information corresponding to the first content being displayed, and sends the first content information to the vehicle-mounted central device to complete the transmission of the first content information between devices in the smart cockpit.

[0026] In one possible design, the method also includes: detecting that a third display device is online, and obtaining third biometric information of a user at a second seat corresponding to the third display device; receiving fourth biometric information and second content information sent by a server, wherein the second content information is used to indicate the second content and the display progress of the second content, and the fourth biometric information and the second content information are uploaded to the server by the first device when the display of the second content ends; after determining that the user identity authentication has passed according to the third biometric information and the fourth biometric information, the second content information is sent to the third display device, so that the third display device continues to display the second content according to the second content information.

[0027] Through this design, when the second device detects that the third display device is online, it can obtain the third biometric information of the user at the second seat corresponding to the third display device. After the user's identity is authenticated, the second content information sent by the first device can be sent to the third display device, and the third display device can continue to display the second content. The display content can be conveniently transferred between different devices without the user's complicated manual operations, thereby improving the user experience.

[0028] In a possible design, before receiving the fourth biometric information and the second content information sent by the server, the method further includes: sending a request message to the server, where the request message is used to obtain the fourth biometric information and the second content information.

[0029] In one possible design, the first content information includes at least one of an application identifier, account information, a content identifier, and a display progress.

[0030] In one possible design, the second device is a vehicle-mounted central device.

[0031] The third aspect provides a continuous display method, which can be performed by a first device, and the first device can be a display device in a smart home system. The method includes: in response to a first operation of a user, obtaining first biometric information of the user; in response to a second operation of the user, displaying second content; in response to a third operation of the user, obtaining second content information, the second content information is used to indicate the second content and the display progress of the second content, and the third operation is used to end the display of the second content; and sending the first biometric information of the user and the second content information to a server.

[0032] In the above method, the first device can send the acquired first biometric information of the user and the second content information corresponding to the second content to the server when the second content is finished being displayed, so that other devices can obtain the second content information and the first biometric information from the server, thereby providing a continuous display service for the user.

[0033] The fourth aspect provides a method for continuous display, the execution subject of the method may be a second device, and the second device may be a vehicle-mounted central device in a smart cockpit. The method includes: detecting that a third display device is online, obtaining the third biometric information of the user at the second seat corresponding to the third display device; receiving the fourth biometric information and second content information sent by the server, the second content information is used to indicate the second content and the display progress of the second content, and the fourth biometric information and the second content information are uploaded to the server by the first device when the display of the second content ends; after determining that the user identity authentication is passed according to the third biometric information and the fourth biometric information, the second content information is sent to the third display device, so that the third display device continues to display the second content according to the second content information.

[0034] In the above method, when the user is in the smart cockpit scene, the second device detects that the third display device is online, and can obtain the third biometric information of the user at the second seat corresponding to the third display device. After the user's identity is authenticated, the second content information sent by the server can be sent to the third display device, and the third display device can continue to display the second content according to the received second content information. The second content information is uploaded to the server by the first device when the second content is finished being displayed, so that the user can continue to view the second content on the third display device. The display content can be conveniently transferred between different devices without the user's complicated manual operation, thereby improving the user experience.

[0035] For example, the second device in the above method may be a vehicle-mounted central device in a smart cockpit. The application scenario of this method may be that a user views the second content through a smart screen (first device) in a smart home scene. After the user moves to the smart cockpit scene, the third display device corresponding to the third seat where the user is located in the smart cockpit continues to display the second content.

[0036] A fifth aspect provides a device, the device comprising a plurality of functional modules; the plurality of functional modules interact with each other to implement the method performed by the first device in the first aspect or the third aspect and its respective embodiments, or to implement the method performed by the second device in the second aspect or the fourth aspect and its respective embodiments. The plurality of functional modules may be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules may be arbitrarily combined or divided based on specific implementations.

[0037] The sixth aspect provides a device, comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the device is running, the at least one processor executes the method executed by the first device in the above-mentioned first aspect or third aspect and its respective embodiments, or executes the method executed by the second device in the above-mentioned second aspect or fourth aspect and its respective embodiments.

[0038] The seventh aspect also provides a program product, which, when executed on a device, enables the device to execute the method executed by the first device or the second device in any of the above aspects and their respective embodiments.

[0039] The eighth aspect also provides a readable storage medium, in which a program is stored. When the program is executed by a device, the device executes the method executed by the first device or the second device in any of the above aspects and its various embodiments.

[0040] The ninth aspect also provides a chip, which is used to read the program stored in the memory and execute the method executed by the first device or the second device in any of the above aspects and their respective embodiments.

[0041] The tenth aspect also provides a chip system, which includes a processor for supporting a device to implement the method executed by the first device or the second device in any of the above aspects and its various embodiments. In one possible design, the chip system also includes a memory, which is used to store the necessary programs and data. The chip system can be composed of a chip, or it can include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 A schematic diagram of a smart cockpit provided in an embodiment of the present application;

[0043] Figure 2 A schematic diagram of a smart home system provided in an embodiment of the present application;

[0044] Figure 3 A schematic diagram of a scenario applicable to a continuous display method provided in an embodiment of the present application;

[0045] Figure 4 A schematic diagram of the structure of a device provided in an embodiment of the present application;

[0046] Figure 5 A schematic diagram of the structure of a vehicle-mounted hub device and a display device provided in an embodiment of the present application;

[0047] Figure 6 A schematic diagram of a camera device capturing a user's face provided in an embodiment of the present application;

[0048] Figure 7 A schematic diagram of a display interface of a second display device provided in an embodiment of the present application;

[0049] Figure 8 A schematic diagram of a continuous display provided by an embodiment of the present application;

[0050] Fig. 9 A schematic diagram of a display interface of a second display device provided in an embodiment of the present application;

[0051] Fig.10 A flow chart of a continuous display method provided in an embodiment of the present application;

[0052] Fig.11 A flow chart of a continuous display method provided in an embodiment of the present application;

[0053] Fig.12 A flow chart of a continuous display method provided in an embodiment of the present application;

[0054] Fig.13 A possible structural example diagram of a device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. Among them, in the description of the embodiments of the present application, the terms "first" and "second" are used only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.

[0056] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "at least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, and c can be single or multiple.

[0057] With the rapid development of smart homes and smart cars, the interconnection between smart cockpits and smart homes can provide users with more convenient services.

[0058] Figure 1 A schematic diagram of a smart cockpit provided in an embodiment of the present application. Figure 1 The smart cockpit may include a vehicle-mounted central device, at least one display device, a microphone array, a speaker array, at least one camera device, and a wireless communication device. The vehicle-mounted central device may also be called a vehicle computer. The vehicle-mounted central device is used to manage the vehicle status and various devices in the vehicle, such as Figure 1 As shown, the vehicle hub device can be integrated with the main driving screen into one device. Figure 1 The structure shown is only an example and not a limitation. The vehicle-mounted central device and the main driving screen can also be separate devices, which is not limited in the present embodiment. The at least one display device in the smart cockpit can be, for example, Figure 1 The main driver's screen, the co-driver's screen, and the two rear screens are shown. When the user is riding in the car, he can use the display device corresponding to the seat where the user is sitting to run the application installed on the device, such as the user can operate to check the car status, play videos, play music, view documents, etc. In some embodiments, the smart cockpit system can adopt a one-core multi-screen control mechanism, then at least one display device can be a plurality of display screens of the vehicle-mounted central device, and the vehicle-mounted central device can control the content displayed on each display screen. In other embodiments, the smart cockpit system can adopt a multi-core multi-screen control mechanism, then the display devices in the smart cockpit can be separate devices, and the vehicle-mounted central device and at least one display device can be connected to the wireless communication device to access the network, so that the vehicle-mounted central device can discover and establish a connection with at least one display device, so that the vehicle-mounted central device can interact with at least one display device.

[0059] The microphone array in the smart cockpit can be used to receive audio, and the speaker array can be used to play audio, such as Figure 1As shown, the microphone array and the speaker array can be distributed near each seat of the smart cockpit. At least one camera device is used to capture images inside the vehicle. The camera device in the smart cockpit can be a camera in a vehicle-mounted central device or a display device, or the camera device can be installed in a position such as a rearview mirror or above each seat. The wireless communication device can, for example, be a wireless communication box for providing in-vehicle wireless fidelity (Wi-Fi) communication and mobile network communication. The wireless communication device includes a T-Box (telematics box). In the following embodiments, the vehicle-mounted central device and the display device in the smart cockpit can be connected to the wireless communication device to communicate through the in-vehicle Wi-Fi provided by the wireless communication device. The vehicle-mounted central device can also be connected to the wireless communication device to interact with the server through the mobile network provided by the wireless communication device. Optionally, the vehicle-mounted central device can also integrate some or all of the functions of the wireless communication device to provide in-vehicle Wi-Fi communication and mobile network communication.

[0060] Figure 2 A schematic diagram of a smart home system provided in an embodiment of the present application. Figure 2 , the smart home system may include a routing device and at least one display device. The display device may be connected to the routing device to access the network, so that the display device can interact with the server to obtain relevant information of the display content. Optionally, the display device may include a camera, a speaker, and a microphone. Of course, the smart home system may also include at least one camera device installed in the home, and the display device may receive images captured by at least one camera device. The smart home system may also include at least one smart speaker, and the display device may receive audio captured by at least one smart speaker, and play audio through at least one smart speaker.

[0061] In some smart cockpit and smart home application scenarios, users can watch videos on the display device corresponding to the seat when they are in the co-pilot seat or the back seat of the smart cockpit. After supporting autonomous driving in the future, users in the driving seat can also watch videos on the main control screen. When the user leaves the smart cockpit and enters the home, if the user wants to continue watching the video watched in the car on the smart screen at home, the user needs to turn on the smart screen at home, manually select the video application, and find the video watched by the user in the car for playback. Alternatively, the user can log in to his account in the video application installed on the smart screen at home, and then select the video watched by the user in the car from the viewing history to play, so that he can continue to watch the video. It can be seen that the user's operation in the above method is more cumbersome, resulting in a poor user experience.

[0062] Based on the above problems, the present application provides a continuous display method, which can be executed by an in-vehicle central device in the cockpit, a first display device, a server and a second display device in the smart home system. Figure 3 A schematic diagram of a scenario applicable to a continuous display method provided in an embodiment of the present application, refer to Figure 3 , the scenario includes a vehicle-mounted hub device in the cockpit, a first display device, a server, and a second display device in the user's home. In this method, when the user is in the cockpit, the first display device can be used to watch content, and the vehicle-mounted hub device can obtain the user's first biometric information. When the vehicle is powered off, the first display device can obtain content information and send the content information to the vehicle-mounted hub device, and the vehicle-mounted hub device sends the user's first biometric information and content information to the server. After the user enters the home and turns on the second display device, the second display device can obtain the user's second biometric information. The second display device can obtain the user's first biometric information and content information from the server, and when the user identity verification is passed according to the first biometric information and the second biometric information, the second display device can continue to display the content on the second display device according to the content information. Through this solution, when the user moves from the cockpit to the home, the second display device in the smart home system can obtain the content information of the content displayed by the user on the first display device in the cockpit, and after the user identity verification is completed, the content can be automatically continued to be displayed on the second display device, and the user can continue to watch the content without manual operation, thereby improving the user experience.

[0063] The first display device in the embodiment of the present application may be any display device in the cockpit, such as the first display device may be any device in the main driver's screen, the co-driver's screen, and the rear screen. The second display device may be any display device in the smart home system, such as the second display device may be a smart screen, a tablet computer, a smart phone, a personal computer (PC), etc., and the embodiment of the present application does not impose any restrictions on the specific type of the display device.

[0064] Figure 4 A schematic diagram of a device provided in an embodiment of the present application. The vehicle-mounted hub device and the second display device in the smart home system in the embodiment of the present application may have Figure 4 The structure shown. Figure 4 , the device may include a face recognition module, a voiceprint recognition module, a content synchronization module and a resume module. Among them, the face recognition module can be used to obtain the user's face information and generate face data based on the user's face information; the voiceprint recognition module can be used to obtain the user's voice information and generate voiceprint data based on the user's voice information. The content synchronization module is used to obtain the content information of the content being displayed by the device, or to obtain content information uploaded by other devices from the server. The resume module is used to continue displaying content based on the acquired content information. Optionally, when the device is a vehicle-mounted hub device, the device may also include a seat recognition module, which is used to determine the user's seat in the cabin.

[0065] based on Figure 3 The scenes shown and Figure 4 The device structure shown in the figure, the following introduces the continuous display method provided by the embodiment of the present application. The continuous display method provided by the embodiment of the present application is applicable to the user moving from the cockpit scene to the smart home scene, or the user moving from the smart home scene to the cockpit scene. The following takes the user moving from the cockpit scene to the smart home scene as an example for explanation. The implementation method of the user moving from the smart home scene to the cockpit scene can be referred to the following embodiment, and the repeated parts will not be repeated.

[0066] 1. The user is in the cockpit scene.

[0067] 1. The first display device is online.

[0068] The user operates to start the first display device in the cockpit. After the first display device is started, it can access the network through the wireless communication device in the cockpit. The first display device can send an online notification message to the vehicle-mounted central device.

[0069] In some embodiments, the online notification message sent by the first display device to the vehicle-mounted central device may be a discovery request message, and the discovery request message is used to request to establish a connection with the vehicle-mounted central device. In an embodiment of the present application, the discovery request message sent by the first display device to the vehicle-mounted central device may be used to indicate that the first display device is online. When the vehicle-mounted central device receives the discovery request message sent by the first display device, it can be determined that the first display device is online.

[0070] For example, Figure 5 A schematic diagram of the structure of a vehicle-mounted central device and a display device provided in an embodiment of the present application, referring to Figure 5 , the vehicle-mounted central device may include a discovery module, a connection module, a publish-subscribe module and a power management module. Among them, the discovery module is used to discover other devices in the local area network, the connection module is used to establish a connection with other devices, the publish-subscribe module is used to receive subscription service messages sent by other devices and provide subscription services to other devices, and the power management module is used to manage the power on and off of the vehicle-mounted central device. The display device may include a discovery module, a connection module, a subscription module and a power management module. Among them, the subscription module is used to send subscription service messages to the vehicle-mounted central device.

[0071] based on Figure 5The structure of the vehicle-mounted central device and the display device shown, after the vehicle-mounted central device and the display device in the cockpit are connected to the wireless network in the cockpit, the vehicle-mounted central device and the display device can listen to the broadcast messages sent by other devices through the user datagram protocol (UDP) port (such as port 5684) to discover other devices. After the first display device is started and connected to the network, the discovery module of the first display device can send a discovery request message, which can be a multicast message. The discovery request message may include the device identification of the first display device, the device type, the seat identification corresponding to the first display device, and the subscription service supported by the first display device. After the vehicle-mounted central device receives the discovery request message sent by the first display device, it can be determined that the first display device is online, and the publish and subscribe module of the vehicle-mounted central device can also determine the service subscribed by the first display device, and send a notification message related to the service to the first display device. For example, after the first display device subscribes to the vehicle status notification service from the vehicle-mounted central device, when the vehicle status changes, the vehicle-mounted central device can send a notification message to the first display device. For example, when the vehicle is turned off, the vehicle-mounted central device may send a notification message corresponding to an ACC Off event to the first display device.

[0072] 2. The vehicle-mounted central device obtains the user's second biometric information.

[0073] In the embodiment of the present application, after the vehicle-mounted central device determines that the first display device is online, it can obtain the user's second biometric information, and the second biometric information may include facial data or voiceprint data.

[0074] In an optional implementation, the vehicle-mounted central device may instruct at least one camera device in the cockpit to capture the facial image of the user at the first seat corresponding to the first display device. In implementation, the vehicle-mounted central device may store the correspondence between the first display device, the first seat corresponding to the first display device, and the camera configuration parameters corresponding to the first seat, wherein the camera configuration parameters corresponding to the first seat may include the azimuth angle, focal length and other parameters that need to be adjusted when any one or more camera devices in the cockpit capture the facial information of the user at the first seat. After determining that the first display device is online, the vehicle-mounted central device may configure at least one camera device according to the camera configuration parameters corresponding to the first seat. Figure 6 A schematic diagram of a camera device collecting a user's face provided in an embodiment of the present application, with reference to Figure 6, assuming that the first seat is the right seat in the back row, the configured camera device can quickly and automatically focus on the user's face in the first seat, thereby obtaining the user's face image. The camera device can send the collected face image to the vehicle-mounted central device, and the vehicle-mounted central device can generate face data based on the face image. Optionally, the step of determining the first seat corresponding to the first display device can be performed by Figure 4 The seat recognition module in the vehicle-mounted central device shown in the figure is executed; the step of obtaining face data can be performed by Figure 4 The face recognition module in the vehicle-mounted hub device shown is executed.

[0075] In another optional implementation, the vehicle-mounted central device may instruct the microphone array in the cabin to collect the audio of the user at the first seat corresponding to the first display device. Figure 1 , the microphone array and speaker array in the cockpit can be distributed near each seat in the cockpit. In this way, the vehicle-mounted central device can instruct the speaker corresponding to the first seat to play audio that guides the user to perform voice interaction, and the microphone corresponding to the first seat can collect the user's audio and send the collected user's audio to the vehicle-mounted central device, and the vehicle-mounted central device can generate voiceprint data based on the user's audio. Optionally, the step of determining the first seat corresponding to the first display device can be performed by Figure 4 The seat recognition module in the vehicle-mounted central device shown in the figure is executed; the step of obtaining the voiceprint data can be performed by Figure 4 The voiceprint recognition module in the vehicle-mounted central device is shown.

[0076] In an embodiment of the present application, after acquiring the second biometric information of the user, the vehicle-mounted central device can store the second biometric information and store the correspondence between the second biometric information and the seat identification of the first seat.

[0077] 3. The user uses the first display device to view content.

[0078] Optionally, the user can operate the first display device to run an application installed in the first display device. For example, the user can choose to run a video application to watch a video, or choose a music application to play music, or use the first display device to view a document.

[0079] 4. When the vehicle is turned off, the vehicle-mounted central device uploads the user's second biometric information and content information to the server.

[0080] In an embodiment of the present application, after the vehicle-mounted central device detects that the vehicle is turned off, it can send a sleep notification message to the first display device, or the user can operate the first display device to sleep. The first display device can obtain content information of the content displayed at the first moment before sleeping. The first moment is the moment when the sleep notification message sent by the vehicle-mounted central device is received, or the first moment is the moment when the user triggers the first display device to sleep. The content information may include at least one of an application identifier, account information, a content identifier, and a display progress. For example, at the first moment, the first display device is running a video application and playing video A, then the first display device can obtain content information such as the video application identifier, the account information of the user account logged in to the video application, the identifier of video A, and the playback time of video A.

[0081] The first display device can send the content information and the seat identification of the first seat to the vehicle-mounted central device. The vehicle-mounted central device can obtain the second biometric information of the user at the first seat according to the seat identification of the first seat, and send the user's second biometric information and content information to the server.

[0082] Optionally, the step of uploading the user's second biometric information and content information can be performed by Figure 4 The content synchronization module of the vehicle-mounted hub device shown is executed.

[0083] After receiving the second biometric information and content information uploaded by the vehicle-mounted central device, the server can classify and store the content information according to the content type indicated by the content information, such as the server can separately store content information such as "continuation service-video category" and "continuation service-document category". The vehicle-mounted central device can also send the account information of the user logged in to the vehicle-mounted central device to the server when uploading the second biometric information and content information, and the server can associate the second biometric information and content information with the account information logged in to the vehicle-mounted central device.

[0084] It should be noted that when multiple users in the cabin use the display devices corresponding to their seats to watch content, the vehicle-mounted central device can respectively obtain the biometric information of each user and the content information of the content displayed by each display device, and upload the obtained biometric information and content information of multiple users to the server. For specific implementation, please refer to the above embodiment, and the repeated parts will not be repeated.

[0085] 2. The user is in a smart home scenario.

[0086] 1. The user enters home and starts the second display device.

[0087] After the user leaves the cabin and enters the home, the second display device is started. Optionally, the second display device may be in an off state, and the user turns on the second display device; or the second display device may be in a sleep state, and the user operates to wake up the second display device.

[0088] The second display device may acquire the first biological information of the user.

[0089] In an optional implementation, the second display device may capture a facial image of a user in front of the second display device through a camera, and generate facial data based on the facial image. Optionally, when the smart home system includes multiple camera devices, the second display device may also instruct a camera device near the second display device to capture the facial image of the user, and receive the facial image of the user sent by the camera device. Optionally, the step of acquiring the facial data of the user may be performed by Figure 4 The face recognition module of the second display device shown is executed.

[0090] In another optional implementation, the second display device can play audio that guides the user to perform voice interaction, and collect the user's audio, and the second display device can generate voiceprint data based on the user's audio. Figure 4 The voiceprint recognition module of the second display device shown is executed.

[0091] 2. The second display device obtains the second biometric information and content information of the user from the server and verifies the user's identity.

[0092] In an optional implementation, the second display device may send a request message to the server, and the request message may include the account information of the account logged in to the second display device, and the request message is used to request to obtain the user's second biometric information and content information. In some embodiments, the account logged in to the second display device and the account logged in to the vehicle-mounted central device may be the same account or an associated account. When the server receives the request message sent by the second display device, it can determine the biometric information and content information uploaded by other devices under the account, or the biometric information and content information uploaded by devices under other accounts associated with the account based on the account information in the request message. In an embodiment of the present application, the server can send the second biometric information and content information uploaded by the vehicle-mounted central device to the second display device.

[0093] Optionally, the step of obtaining the user's second biometric information and content information may be performed by Figure 4 The content synchronization module of the second display device is shown to execute.

[0094] The second display device can authenticate the user based on the second biometric information and the first biometric information. For example, the second electronic device can calculate the similarity between the second biometric information and the first biometric information. When the similarity is greater than a preset threshold, it can be determined that the user identity has been verified. It should be noted that when the second display device detects that there are multiple users in front of the second display device, the biometric information of each user can be obtained separately, and the identity of each user can be authenticated.

[0095] 3. The second display device continues to display according to the content information.

[0096] In an optional implementation, after the second display device passes the user's identity authentication, it can continue to display according to the content information. For example, when the content information includes the video application identifier, the account information of the user account logged in to the video application, the identifier of video A, and the playback time of video A, the second display device can start the video application. If the account is not logged in to the video application or the logged in account is different from the user account in the content information, the second display device can log in to the user's account in the video application. If the second display device does not store the user's account information, the second display device can display a login interface and remind the user to log in to the account. The second display device can search for video A in the video application according to the identifier of video A, and continue to play video A on the second display device according to the playback time of video A in the content information. Optionally, the step of continuing to display on the second display device can be performed by Figure 4 The resume module of the second display device shown is executed.

[0097] Optionally, before continuing to display the content, the second display device may display a reminder message, which is used to ask the user whether to continue to display the content. Figure 7 A schematic diagram of a display interface of a second display device provided in an embodiment of the present application, referring to Figure 7 After the user identity is authenticated, the second display device can display a reminder message to ask the user whether to continue watching video A. After the user triggers the confirmation operation, the second display device continues to play video A.

[0098] For example, Figure 8 A schematic diagram of a continuous display provided by an embodiment of the present application. Figure 8 In (a), before the vehicle is turned off, the first display device displays video A, and the playback duration is 34:09. Figure 8 In (b), the user returns home, and after the second display device verifies the user's identity, it continues to play video A on the second display device according to the content information, and starts playing from 34:09.

[0099] In some scenarios, if the second display device receives biometric information and content information of multiple users sent by the server, and the second display device detects that there are multiple users in front of the second display device and the identity authentication of multiple users is passed, the second display device can display controls corresponding to multiple contents, and the user can choose which content to display next. For example, Fig. 9 A schematic diagram of a display interface of a second display device provided in an embodiment of the present application, referring to Fig. 9 , when the second display device receives the biometric information of three users and the three content information, and the identity authentication of the three users in front of the second display device is passed, the second display device can display the controls corresponding to each content respectively, such as Fig. 9 In the example, video A with a viewing progress of 30%, video B with a viewing progress of 45%, and video C with a viewing progress of 88% are displayed. The user can select any of the three controls corresponding to the three videos to continue playing the video corresponding to the control on the second display device. If the user clicks the control corresponding to video A, the second display device can continue playing video A.

[0100] Based on the above embodiments, the following two examples are used to introduce the continuous display method provided in the embodiments of the present application:

[0101] Example 1: The user moves from the smart cockpit scene to the smart home scene

[0102] Fig.10 A flow chart of a continuous display method provided in an embodiment of the present application. The method can be executed by a vehicle-mounted central device, a first display device in a smart cockpit, a server, and a second display device in a smart home scene. Fig.10 , the method comprises the following steps:

[0103] S1001: In response to a fourth operation of the user, the first display device is started.

[0104] Optionally, the fourth operation may be an operation triggered by a user for starting the first display device. For example, the fourth operation may be the user pressing a power button of the first display device.

[0105] S1002: The first display device sends an online notification message to the vehicle-mounted central device.

[0106] S1003: The vehicle-mounted central device configures at least one camera device in the smart cockpit according to the camera configuration parameters corresponding to the first seat, and obtains the user's facial image captured by the at least one camera device.

[0107] Among them, the first seat is the seat corresponding to the first display device. For example, when the first display device is a passenger screen, the first seat is the passenger seat.

[0108] S1004: The vehicle-mounted central device generates second biometric information based on the user's facial image, and stores the corresponding relationship between the second biometric information and the seat identification of the first seat.

[0109] The second biometric information may be facial data.

[0110] S1005: In response to the fifth operation of the user, the first display device displays content.

[0111] The fifth operation may be an operation triggered by the user such as displaying a video, playing an audio, or displaying a document on the first display device.

[0112] S1006: The vehicle-mounted central device detects that the vehicle is turned off and sends a sleep notification message to the first display device.

[0113] S1007: The first display device obtains content information according to the displayed content.

[0114] S1008: The first display device sends the content information and the seat identifier of the first seat to the vehicle-mounted central device.

[0115] S1009: The vehicle-mounted central device obtains the user's second biometric information according to the seat identifier of the first seat.

[0116] S1010: The vehicle-mounted central device sends the user's second biometric information and content information to the server.

[0117] S1011: In response to a first operation of the user, the second display device is started.

[0118] Optionally, the first operation may be an operation triggered by a user for starting the second display device. For example, the first operation may be the user pressing a power button of the second display device.

[0119] S1012: The second display device collects a facial image of the user, and generates first biometric information according to the facial image of the user.

[0120] The first biometric information may be facial data.

[0121] S1013: The second display device sends a request message to the server.

[0122] S1014: The server sends the second biological information and content information to the second display device.

[0123] S1015: The second display device determines that the user identity authentication is passed according to the first biometric information and the second biometric information.

[0124] S1016: The second display device displays a reminder message according to the content information, where the reminder message is used to inquire the user whether to continue displaying the content.

[0125] S1017: In response to the user's confirmation operation, the second display device continues to display the content according to the content information.

[0126] Optionally, the confirmation operation may be an operation triggered by the user to confirm the continued display, such as the user may click a confirmation button in the reminder message, or the user may input a confirmation instruction by voice. It should be understood that as a possible implementation, S1016-S1017 may not be executed, and after S1015, the second display device continues to display the content according to the content information.

[0127] Example 2: The user moves from the smart home scene to the smart cockpit scene

[0128] Fig.11 A flow chart of a continuous display method provided in an embodiment of the present application. The method can be executed by a vehicle-mounted central device, a first display device in a smart cockpit, a server, and a second display device in a smart home scene. Fig.11 , the method comprises the following steps:

[0129] S1101: In response to a first operation of a user, a second display device is started.

[0130] Optionally, the first operation may be an operation triggered by a user for starting the second display device. For example, the first operation may be the user pressing a power button of the second display device.

[0131] S1102: The second display device plays audio for guiding user voice interaction and collects user audio.

[0132] S1103: The second display device generates first biometric information according to the user audio.

[0133] Optionally, the first biometric information may be voiceprint data.

[0134] S1104: In response to a second operation of the user, the second display device displays content.

[0135] Optionally, the second operation may be an operation triggered by the user such as displaying a video, playing an audio, or displaying a document on the second display device.

[0136] S1105: In response to the third operation of the user, the second display device obtains content information according to the displayed content.

[0137] The third operation may be an operation for ending the display of content.

[0138] S1106: The second display device sends the user's first biometric information and content information to the server.

[0139] S1107: In response to the fourth operation of the user, the first display device is started.

[0140] Optionally, the fourth operation may be an operation triggered by a user for starting the first display device. For example, the fourth operation may be the user pressing a power button of the first display device.

[0141] S1108: The first display device sends an online notification message to the vehicle-mounted central device.

[0142] S1109: The vehicle-mounted central device controls the speaker corresponding to the first seat to play audio guiding user voice interaction, and receives user audio collected by the microphone corresponding to the first seat.

[0143] Among them, the first seat is the seat corresponding to the first display device. For example, when the first display device is a passenger screen, the first seat is the passenger seat.

[0144] S1110: The vehicle-mounted central device generates second biometric information based on the user audio.

[0145] The second biometric information may be voiceprint data.

[0146] S1111: The vehicle-mounted central device sends a request message to the server.

[0147] S1112: The server sends the first biometric information and content information to the vehicle-mounted central device.

[0148] S1113: The vehicle-mounted central device determines that the user identity authentication is passed based on the first biometric information and the second biometric information.

[0149] S1114: The vehicle-mounted central device sends the content information to the first display device.

[0150] S1115: The first display device displays a reminder message according to the content information, where the reminder message is used to inquire the user whether to continue displaying the content.

[0151] S1116: In response to the user's confirmation operation, the first display device continues to display the content according to the content information.

[0152] Optionally, the confirmation operation may be an operation triggered by the user to confirm the continued display, such as the user may click a confirmation button in the reminder message, or the user may input a confirmation instruction by voice. It should be understood that as a possible implementation, S1015-S1116 may not be executed, and after S1114, the first display device continues to display the content according to the content information.

[0153] It should be noted that the above Example 1 is introduced by taking the example of a user moving from a smart cockpit scene to a smart home scene and authenticating the user based on face recognition, and the above Example 2 is introduced by taking the example of a user moving from a smart home scene to a smart cockpit scene and authenticating the user based on voiceprint recognition. The continuous display method provided in the embodiments of the present application may also have the following implementation methods: the user moves from a smart cockpit scene to a smart home scene and authenticates the user based on voiceprint recognition, and the user moves from a smart home scene to a smart cockpit scene and authenticates the user based on face recognition. For specific implementation, please refer to the introduction of the above embodiments, and the repeated parts will not be repeated.

[0154] Based on the same concept, the embodiment of the present application further provides a continuous display method, which can be executed by a first device. The first device can be the second display device in the above embodiment. Fig.12 A flowchart of a continuous display method provided in an embodiment of the present application, referring to Fig.12 , the method comprises the following steps:

[0155] S1201: In response to a first operation of a user, a first device obtains first biometric information of the user.

[0156] S1202: The first device receives the second biometric information and the first content information sent by the server.

[0157] The first content information is used to indicate the first content and the display progress of the first content; the second biological information and the first content information are uploaded to the server by the second device when the second device finishes displaying the first content.

[0158] S1203: After the first device determines that the user identity authentication is passed according to the first biometric information and the second biometric information, the first device continues to display the first content according to the first content information.

[0159] Optionally, when the first device is a vehicle-mounted hub device, the first device continuing to display the first content according to the first content information may be the vehicle-mounted hub device controlling the first display device to display the first content.

[0160] It should be noted that this application Fig.12 The specific implementation of the continuous display method shown can refer to the above embodiments of the present application, and the repeated parts will not be repeated.

[0161] It should be understood that in order to realize the functions of the vehicle-mounted central device or the second display device in the above-mentioned embodiments, the vehicle-mounted central device or the second display device includes a hardware structure and / or software structure corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and method steps of each example described in the embodiments disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0162] Fig.13 A possible structural example diagram of a device provided in an embodiment of the present application, the device can be used to implement the function of the vehicle-mounted central device in the above embodiment, and can also be used to implement the function of the second display device in the above embodiment, and thus can also achieve the beneficial effects possessed by the above embodiment.

[0163] refer to Fig.13 , the device 1300 may include a processor 1301, a memory 1302, and a communication interface 1303. The processor 1301, the memory 1302, and the communication interface 1303 are coupled to each other. Optionally, the memory 1302 may be used to store instructions executed by the processor 1301 or to store input data required by the processor 1301 to run instructions or to store data generated after the processor 1301 runs instructions. The communication interface 1303 may be a transceiver or an input-output interface.

[0164] Optional, see Fig.13 The processor 1301, the memory 1302 and the communication interface 1303 are connected to each other via a bus 1304. The bus 1304 may be a peripheral component interconnection standard bus or an extended industrial standard structure bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.13 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0165] When the device 1300 is applied to a vehicle-mounted hub device, the processor 1301 can be used to implement the processing function of the hub device in the above embodiment. The communication interface 1303 can be used to implement the transceiver function of the vehicle-mounted hub device in the above embodiment.

[0166] It is understood that the processor 1301 in the embodiment of the present application may be a central processing unit, or other general-purpose processors, digital signal processors, application-specific integrated circuits, field programmable gate arrays or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0167] This application Fig.13 The memory 1302 in the system 1300 may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory, a programmable read-only memory, an erasable programmable read-only memory, an electrically erasable programmable read-only memory, or a flash memory. It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0168] Based on the above embodiments, the present application further provides a device, the device comprising multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the vehicle-mounted hub device or the second display device in each method described in the embodiments of the present application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.

[0169] Based on the above embodiments, the present application also provides a program product containing instructions, when the program product is run on a device or a computer, the device or the computer executes the methods described in the embodiments of the present application.

[0170] Based on the above embodiments, the present application also provides a readable storage medium, in which a program is stored. When the program is executed by a device or a computer, the device or the computer executes the methods described in the embodiments of the present application.

[0171] Based on the above embodiments, the present application also provides a chip, which is used to read the program stored in the memory to implement the methods described in the embodiments of the present application.

[0172] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a device to implement the methods described in the embodiments of the present application. In one possible design, the chip system also includes a memory, which is used to store the necessary programs and data for the device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0173] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware.

[0174] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and program products according to the present application. It should be understood that each flow and / or box in the flow chart and / or block diagram, as well as the combination of the flow chart and / or box in the flow chart and / or block diagram, can be implemented by program instructions.

[0175] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of protection of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A continuous display method, characterized in that: Applied to a first device, the method includes: In response to a first operation of a user, acquiring first biometric information of the user; receiving second biometric information and first content information sent by the server, where the first content information is used to indicate first content and display progress of the first content, and the second biometric information and the first content information are uploaded to the server by the second device when the second device finishes displaying the first content; After determining that the user identity authentication has passed according to the first biometric information and the second biometric information, the first content continues to be displayed according to the first content information.

2. The method according to claim 1, characterized in that The first biometric information is face data, The obtaining of the first biometric information of the user includes: A facial image of the user is collected, and the facial data is generated according to the facial image.

3. The method according to claim 1, characterized in that The first biometric information is voiceprint data, The obtaining of the first biometric information of the user includes: Play audio used to guide user voice interaction and collect user audio; The voiceprint data is generated according to the collected audio.

4. The method according to any one of claims 1 to 3, characterized in that: Before receiving the second biometric information and the first content information sent by the server, the method further includes: A request message is sent to the server, where the request message is used to obtain the second biometric information and the first content information.

5. The method according to any one of claims 1 to 4, characterized in that: Before continuing to display the first content according to the first content information, the method further includes: displaying a reminder message, wherein the reminder message is used to ask the user whether to continue to display the first content; A confirmation operation of the user is detected.

6. The method according to any one of claims 1 to 4, characterized in that: Before continuing to display the first content according to the first content information, the method further includes: Displaying a reminder message, the reminder message including controls corresponding to a plurality of candidate contents, the plurality of candidate contents corresponding one-to-one to a plurality of content information, the plurality of candidate contents including the first content; An operation of the user selecting a control corresponding to the first content from controls corresponding to the multiple candidate contents is detected.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: In response to a second operation by the user, displaying a second content; In response to a third operation of the user, second content information is acquired, where the second content information is used to indicate second content and display progress of the second content, and the third operation is used to end display of the second content; The first biometric information of the user and the second content information are sent to a server.

8. A continuous display method, characterized in that: Applied to the second device, the method includes: Detecting that a first display device is online, obtaining second biometric information of a user at a first seat corresponding to the first display device; Detecting that the vehicle is turned off, acquiring first content information corresponding to the first content displayed by the first display device, where the first content information is used to indicate the first content and the display progress of the first content; The first biometric information of the user and the first content information are sent to a server.

9. The method according to claim 8, characterized in that The second biometric information is face data, The acquiring second biometric information of a user at a first seat corresponding to the first display device includes: Controlling at least one camera device in the cockpit to capture a facial image of the user at the first seat; Receive the facial image sent by the at least one camera device, and generate the facial data according to the facial image.

10. The method according to claim 9, characterized in that The second biometric information is voiceprint data, The acquiring second biometric information of a user at a first seat corresponding to the first display device includes: Controlling a speaker at the first seat in the cockpit to play audio for guiding user voice interaction; Controlling the microphone at the first seat in the cockpit to collect audio of the user; The audio sent by the microphone is received, and the voiceprint data is generated according to the audio sent by the microphone.

11. The method according to any one of claims 8 to 10, characterized in that: The acquiring first content information corresponding to the first content displayed by the first display device includes: A sleep notification message is sent to the first display device, and the first content information sent by the first display device is received.

12. The method according to any one of claims 8 to 11, characterized in that: The method further comprises: Detecting that a third display device is online, obtaining third biometric information of a user at a second seat corresponding to the third display device; receiving fourth biometric information and second content information sent by the server, where the second content information is used to indicate second content and display progress of the second content, and the fourth biometric information and the second content information are uploaded to the server by the first device when the first device finishes displaying the second content; After determining that the user identity authentication is passed according to the third biometric information and the fourth biometric information, the second content information is sent to the third display device, so that the third display device continues to display the second content according to the second content information.

13. The method according to claim 12, characterized in that Before receiving the fourth biometric information and the second content information sent by the server, the method further includes: A request message is sent to the server, where the request message is used to obtain the fourth biometric information and the second content information.

14. A continuous display method, characterized in that: Applied to a server, the method comprises: receiving second biometric information of a user and first content information sent by a second device, where the first content information is used to indicate first content and display progress of the first content; The second biometric information and the first content information of the user are sent to the first device.

15. The method according to claim 14, characterized in that Before sending the second biometric information and the first content information of the user to the first device, the method further includes: A request message sent by the first device is received, where the request message is used to obtain the second biometric information and the first content information.

16. The method according to claim 15, characterized in that The request message includes account information of a first account corresponding to the first device; The account corresponding to the second device is the first account; or The account corresponding to the second device is an account associated with the first account.

17. A device, characterized in that The invention comprises at least one processor, wherein the at least one processor is coupled to at least one memory, and the at least one processor is used to read the program stored in the at least one memory to execute the method according to any one of claims 1 to 7, or execute the method according to any one of claims 8 to 13.

18. A readable storage medium, characterized in that: The readable storage medium stores instructions, which, when executed on a device, enable the device to execute the method as claimed in any one of claims 1 to 7, or to execute the method as claimed in any one of claims 8 to 13.

Images