Interaction control method and device, electronic equipment, storage medium and vehicle

Abstract

Embodiments of the present disclosure provide an interaction control method and device, electronic equipment, storage medium and vehicle. The interaction control method comprises: in response to receiving a display task triggered when a user interacts with a first display screen, determining whether the display task is a display task executed by a second display screen; in the case where the display task is a display task executed by the second display screen, controlling the first display screen to play a dynamic guide image, the dynamic guide image being used to gradually switch the user's attention to the display screen from the first display screen to the second display screen. By using the method, the user's visual focus can be moved along with the guide image, and then the user's focus of attention is moved to the second display screen involuntarily, thereby solving the problem that the user experience is poor due to the static prompt information prompting the user to pay attention to other display screens.

Description

Technical Field

[0001] This disclosure relates to the field of human-machine intelligent interaction technology, specifically to an interactive control method, device, electronic device, storage medium, and vehicle. Background Technology

[0002] With the popularization and commercialization of the smart cockpit concept, some mid-to-high-end vehicles have been equipped with multiple display screens to enable more convenient and personalized interaction between drivers and passengers and the vehicle, as well as personalized entertainment needs of drivers and passengers in various locations.

[0003] Although multiple displays are deployed in a vehicle, not every display is configured to perform all display functions. For example, in one vehicle, only the central control display can show the navigation map. When the driver or passenger interacts with the vehicle's infotainment system using a display other than the central control display to activate navigation, the other screens cannot display the navigation map; only the central control display can show the navigation map. In this situation, a cross-screen prompt needs to be displayed on the screen the user is currently viewing to remind the user to pay attention to the central control display.

[0004] However, existing cross-screen prompting methods only display static prompts on the screen currently being viewed by the driver or passenger, failing to proactively guide the driver or passenger to pay attention to other screens, resulting in a poor user experience. Summary of the Invention

[0005] To address the aforementioned technical problems, embodiments of this disclosure provide an interactive control method, apparatus, electronic device, storage medium, and vehicle.

[0006] In a first aspect, embodiments of this disclosure provide an interactive control method, including:

[0007] In response to receiving a display task triggered when the user interacts with the first display screen, determine whether the display task is a display task executed by the second display screen;

[0008] When the display task is performed by the second display screen, the first display screen is controlled to play a dynamic guide image, which is used to gradually switch the user's attention from the first display screen to the second display screen.

[0009] Optionally, before controlling the first display screen to play the dynamic guide image, the method further includes:

[0010] The guiding direction is determined based on the relative positional relationship between the first and second display screens;

[0011] The first playback movement path is planned according to the guidance direction. The first playback movement path is the movement path of the dynamic guide image when it is played on the first display screen.

[0012] The control of the first display screen to play dynamic guide images includes:

[0013] A dynamic guide image is displayed on the first screen along the first playback path.

[0014] Optionally, the method also includes:

[0015] Determine the current focus position, which is the position of the first display screen that the user is looking at when interacting with the first display screen;

[0016] Plan the first playback path based on the guided direction, including:

[0017] Plan the first playback path based on the guidance direction and the current focus location.

[0018] Optionally, the first playback path can be planned based on the guidance direction and the current focus position, including:

[0019] The current focus position is set as the initial position of the first playback movement path;

[0020] Determine the projection direction of the guiding direction on the first display screen;

[0021] The endpoint position of the first playback movement path at the edge of the first display screen is determined based on the initial position and projection direction.

[0022] Plan the first playback movement path based on the initial position and the destination position.

[0023] Optionally, determine the current focus area, including:

[0024] Acquire real-time user images, which include images of the user's eye features;

[0025] Process user images to determine the user's iris and sclera regions;

[0026] The user's relative focus direction is determined based on the area of ​​the sclera region located around the iris region;

[0027] The current focus direction is determined based on the relative focus direction and the external parameters of the camera capturing the user's image;

[0028] Determine the current focus area based on the current area of ​​focus.

[0029] Optionally, the method may also include: determining the user's location;

[0030] Based on the user's location and the location of the first display screen, a first distance between the user and the first display screen is determined; and based on the user's location and the location of the second display screen, a second distance between the user and the second display screen is determined.

[0031] Based on the relationship between the first and second distances, the scaling method of the dynamic guide image is determined;

[0032] A dynamic guide image is displayed on the first screen along the first playback path, including:

[0033] Along the first playback path, a dynamic guide image is played on the first display screen in a scaling manner.

[0034] Optionally, based on the relationship between the first and second distances, the scaling method of the dynamic guide image is determined, including:

[0035] If the first distance is less than the second distance, the scaling method is determined to be the shrinking method; and,

[0036] If the first distance is greater than the second distance, the scaling method is determined to be zoom-in.

[0037] Optionally, the method also includes: determining the initial playback position of the dynamic guide image when it is played on the second display screen based on the guide direction;

[0038] Obtain the target playback position when the dynamic guide image is displayed on the second screen;

[0039] Based on the initial playback position and the target playback position, a second playback movement path is planned. The second playback movement path is the movement path of the dynamic guide image when it is played on the second display screen.

[0040] After controlling the first display screen to complete the playback of the dynamic guiding image, the method also includes:

[0041] Control the second display screen to continue playing the dynamic guide image along the second playback path.

[0042] Optionally, while playing the dynamic guide image on the first display screen along the first playback movement path, the method further includes:

[0043] The stereo playback system is controlled to output a first prompt voice along the first playback movement path. The first prompt voice is a voice prompting the user to switch the focus of the display screen from the first display screen to the second display screen.

[0044] Optionally, controlling the stereo playback system to output a first prompt voice along the first playback movement path includes: determining the simulated playback position of the audio frame in the first prompt voice in the first playback movement path;

[0045] Based on the simulated playback position, the audio frame, and the position of each speaker in the stereo playback system, a modulation signal is generated to control the sound output of each speaker;

[0046] The modulation signal is used to drive the corresponding loudspeaker to work, so that the sound waves emitted by each loudspeaker reverberate in the sound field to form the first prompt voice.

[0047] Optionally, the method further includes: determining the continued movement path of the simulated sound source based on the end position of the first playback movement path and the position of the second display screen, wherein the continued movement path is the path of continuing to play the prompt voice after the dynamic guidance image is played on the first display screen;

[0048] After controlling the stereo playback system to output the first prompt voice along the first playback movement path, the method further includes:

[0049] The stereo playback system is controlled to output a second prompt voice along the continued movement path. The second prompt voice is a voice that continues to guide the user to pay attention to the second display screen.

[0050] Secondly, embodiments of this disclosure provide an interactive control device, including:

[0051] The task determination unit is used to determine whether the display task is a display task executed by the second display screen in response to receiving a display task triggered when the user interacts with the first display screen;

[0052] The display control unit controls the first display screen to play a dynamic guide image when the display task is performed by the second display screen. The dynamic guide image is used to gradually switch the user's attention from the first display screen to the second display screen.

[0053] Thirdly, embodiments of this disclosure provide an electronic device, including a processor and a memory, wherein the memory is used to store computer programs;

[0054] When a computer program is loaded by a processor, it causes the processor to execute the interactive control method as described in any one of claims 1-10.

[0055] Fourthly, embodiments of this disclosure provide a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to implement the aforementioned interactive control method.

[0056] Fifthly, embodiments of this disclosure provide a vehicle including a processor, a memory, a first display screen, and a second display screen; the processor stores a computer program; when the computer program is loaded by the processor, it causes the processor to perform the aforementioned interactive control method, causing the first display screen to play a dynamic guide image; and after the first display screen completes the playback of the dynamic guide image, it controls the second display screen to perform a display task.

[0057] The technical solution provided in this disclosure has the following advantages compared with the prior art:

[0058] The technical solution provided in this disclosure, when receiving a display task triggered by a user and determining that the display task is performed by the second display screen, uses the first display screen to play a dynamic guiding image that prompts the user to gradually switch their attention from the first display screen to the second display screen. This allows the user's visual focus to move with the guiding image, thereby causing the user's focus to unconsciously move to the second display screen. This solves the problem of poor user experience caused by using static prompts to prompt the user to pay attention to other display screens. Attached Figure Description

[0059] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0060] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without any creative effort, wherein:

[0061] Figure 1 This is a flowchart of the interactive control method provided in the embodiments of this disclosure;

[0062] Figure 2 This is a flowchart of an interactive control method provided in some other embodiments of this disclosure;

[0063] Figure 3 This is a flowchart of an interactive control method provided in some embodiments of this disclosure;

[0064] Figure 4 This is a schematic diagram of the structure of the interactive control device provided in the embodiments of this disclosure;

[0065] Figure 5 This is a schematic diagram of the structure of an electronic device provided in some embodiments of this disclosure. Detailed Implementation

[0066] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0067] The term "comprising" and its variations as used herein are open-ended, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below. It should be noted that the concepts of "first", "second", etc., used in this disclosure are only used to distinguish different devices, modules, or units, and are not intended to limit the order of functions performed by these devices, modules, or units or their interdependencies.

[0068] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0069] Figure 1 This is a flowchart of the interactive control method provided in an embodiment of this disclosure. Figure 1 As shown, the interactive control method provided in this embodiment includes S110-S120.

[0070] It should be noted that the interactive control method provided in this disclosure can be executed by various electronic devices, such as vehicle terminal devices, smart home devices, and other terminal devices that can be configured with multiple displays. Of course, the method provided in this disclosure can also be executed collaboratively by multiple electronic devices, for example, a central control device, a passenger entertainment device, and a rear entertainment device of a vehicle terminal device can be executed collaboratively. The interactive control method provided in this disclosure will be described below using a vehicle terminal device including multiple displays.

[0071] S110: In response to receiving a display task triggered when the user interacts with the first display screen, determine whether the display task is a display task executed by the second display screen.

[0072] In this embodiment of the disclosure, the first display screen is the display screen that is currently interacting with the user, that is, the display screen that the user is paying attention to or watching. In this embodiment of the disclosure, the first display screen can be various types of display screens, and this embodiment of the disclosure does not make any particular limitation.

[0073] For example, if the user is a front passenger and is watching the front passenger entertainment display, then the front passenger entertainment display can be used as the primary display.

[0074] For example, if the user is a rear passenger and is watching the rear entertainment display, then the rear entertainment display can be used as the primary display.

[0075] For example, if the user is a driver and is viewing the head-up display screen in front of the driver's seat, the instrument display screen on the driver's seat, or the control display screen on the steering wheel, then the aforementioned head-up display screen, instrument display screen, or control display screen on the steering wheel can be used as the first display screen.

[0076] In this embodiment of the disclosure, the user can interact with the first display screen using various interactive methods to trigger the vehicle terminal device to control the display screen to perform display tasks.

[0077] For example, if the first display screen is the aforementioned passenger entertainment display screen, rear entertainment display screen, or control display screen on the driver's steering wheel, and the first display screen is a touch display screen, the user can control the function buttons displayed on the first display screen to enable the in-vehicle terminal device to obtain interactive commands, thereby enabling the in-vehicle terminal device to receive the display task triggered by the user.

[0078] For example, when the in-vehicle terminal is equipped with voice interaction control, the user can issue interactive control commands via voice while viewing the first display screen, thereby enabling the in-vehicle terminal device to receive the display task triggered by the user. Specifically, the in-vehicle terminal device is equipped with at least one microphone for picking up sound within the vehicle. The microphone picks up the sound signal inside the cabin in real time and sends it to the in-vehicle terminal device. Subsequently, the in-vehicle terminal device extracts the voice signal from the sound signal. If the picked-up sound signal includes the voice signal, the in-vehicle terminal device processes the voice signal to obtain the corresponding text, and processes the text to determine whether to receive the control command issued by the user, and then determines whether to receive the display task triggered by the user based on the control command.

[0079] After receiving a display task triggered when the user interacts with the first display screen, the vehicle terminal device determines whether the display task is executed by the second display screen.

[0080] The second display screen is an independent display screen located in a different position from the first display screen.

[0081] In this embodiment of the disclosure, the in-vehicle terminal device is pre-configured with display tasks that each display screen can perform. For example, the aforementioned passenger-side entertainment display screen or rear-seat entertainment display screen can perform various entertainment display tasks, such as playing movies, playing songs, and displaying game screens. As another example, the aforementioned head-up display screen or instrument panel display screen can only perform tasks such as displaying vehicle status and road characteristics ahead. As yet another example, the central control display screen can display navigation and vehicle status adjustment pages.

[0082] S120: When the display task is performed by the second display screen, control the first display screen to play a dynamic guide image, which is used to gradually switch the user's attention from the first display screen to the second display screen.

[0083] If it is determined that the display task is performed by the second display screen, the vehicle terminal device then uses the second display screen to perform the aforementioned display task. In this embodiment of the present disclosure, if the vehicle terminal device determines that the display task is performed by the second display screen, the vehicle terminal will control the first display screen to play a dynamic guide image.

[0084] Dynamic guide images are those that gradually switch the user's attention from the first display screen to the second display screen. Dynamic guide images can be anthropomorphic, object-like, or other similar images.

[0085] For example, in one specific embodiment of this disclosure, the dynamic guide image is an animated character. As another example, in another specific embodiment of this disclosure, the dynamic guide image is a humanoid face with a circular main body and movable eyes. In these embodiments, the dynamic guide image can have multiple display states, such as a user-facing state, a turned-around state, or a state with its back to the user.

[0086] In this embodiment of the disclosure, controlling the first display screen to play the dynamic guide image involves playing video frames including the dynamic guide image frame by frame. This causes the dynamic guide image to gradually move from a display position near the center of the first display screen to a display position near the edge of the first display screen near the second display screen, or from a position far from the second display screen to a position near the edge of the first display screen near the second display screen. This gradually guides the user's visual attention from the center of the first display screen to the edge area, and then naturally switches to the second display screen.

[0087] As previously stated, the dynamic guide image in this embodiment has several different display states. When controlling the first display screen to play the dynamic guide image that gradually guides the user's visual attention from the first display screen to the second display screen, the display state of the dynamic guide image can be adjusted in a timely manner. For example, when in the middle area of ​​the first display screen, the dynamic guide image is displayed in a backward form. After displaying a backward form, the dynamic guide image is transformed into a turning or side-view form, so that the user perceives the guide image gradually leaving the middle area of ​​the first display screen.

[0088] By employing the interactive control method provided in this embodiment, when a user-triggered display task is received and it is determined that the display task is performed by the second display screen, a dynamic guiding image that prompts the user to gradually switch their attention from the first display screen to the second display screen is played on the first display screen. This allows the user's visual focus to move with the guiding image, thereby causing the user's focus to unconsciously shift to the second display screen. This solves the problem of poor user experience caused by using static prompts to prompt the user to pay attention to other display screens.

[0089] Figure 2 This is a flowchart of an interactive control method provided in other embodiments of this disclosure. For example... Figure 2 As shown, in some other embodiments of this disclosure, the interactive control method includes S210-S240.

[0090] S210: In response to receiving a display task triggered when the user interacts with the first display screen, determine whether the display task is a display task executed by the second display screen; if so, execute S220.

[0091] S220: Determine the guiding direction based on the positions of the first display screen and the second display screen.

[0092] S230: Plan the first playback movement path according to the guidance direction. The first playback movement path is the movement path when the dynamic guide image is played on the first display screen.

[0093] S240: Play a dynamic guide image on the first display screen along the first playback movement path.

[0094] Unlike the aforementioned embodiments, in this embodiment, when the vehicle terminal device determines that the display task triggered when the user interacts with the first display screen is a display task executed by the second display screen, the vehicle terminal obtains the positions of the first and second display screens and determines the guidance direction based on the positions of the first and second display screens. Subsequently, it plans a first playback movement path for the dynamic guide image to play on the first display screen based on the guidance direction.

[0095] In some embodiments of this disclosure, when the first display screen and the second display screen are fixed display screens, the vehicle terminal device can search for pre-stored information based on the identification information of the first display screen and the second display screen to determine the position of the first display screen and the second display screen.

[0096] In other embodiments of this disclosure, when at least one of the first and second displays is a movable display, the vehicle-mounted terminal device can determine the real-time position of the corresponding display based on signals output by devices such as inertial sensors in the display. After determining the real-time positions of the first and second displays, the vehicle-mounted terminal device can determine the guidance direction based on the positions of the first and second displays.

[0097] The guiding direction is the direction that guides the user's attention from the first display screen to the second display screen. In this embodiment, the guiding direction is a three-dimensional guiding direction, that is, the guiding direction is from the location of the first display screen to the location of the second display screen.

[0098] The first playback movement path is the movement path of the dynamic guide image when it is played on the first display screen, that is, how the dynamic guide image moves from the middle area of ​​the first display screen to the edge area.

[0099] In this embodiment of the disclosure, the playback movement path of the dynamic guide image is determined based on the positions of the first display screen and the second display screen. This is based on the relative positional relationship between the first display screen and the second display screen, to determine a path that is more convenient for moving the user's visual attention from the first display screen to the second display screen.

[0100] For example, if the first display screen is located on the passenger side directly in front of the front passenger, and the second display screen is located in the center console area, the playback path could be from the center of the first display screen to its lower left edge. As another example, if the first display screen is located in the middle of the rear seats, and the second display screen is located in the center console area, the playback path could be from the center of the first display screen to its lower center edge.

[0101] After determining the first playback path, the vehicle terminal device can control the first display screen to play a dynamic guide image along the playback path, so that the dynamic guide image can guide the user according to the playback path, so that the user's visual attention moves to the edge of the first display screen and then naturally moves to the second display screen.

[0102] Optionally, in some embodiments of this disclosure, before executing the aforementioned S230 to plan the first playback movement path according to the guidance direction, the vehicle terminal device may also execute S240-S250.

[0103] S250: Determines the user's current focus area.

[0104] In this embodiment of the disclosure, the current focus position is the display position of the first display screen that the user focuses on when interacting with the first display screen. That is, the current focus position is the display position of the first display screen that the user is currently viewing.

[0105] In some embodiments of this disclosure, the user's current focus position can be determined using the following steps S251-S2452.

[0106] S251: Determine the user's location and current focus.

[0107] In some embodiments of this disclosure, the vehicle-mounted terminal device can determine the user's location in various ways. For example, in some embodiments, the vehicle-mounted terminal device can determine the user's location based on pressure sensors on the seat, thereby determining the user's seat position.

[0108] In other embodiments of this disclosure, at least two microphones are configured in the carriage, and the two microphones monitor the audio signals in the carriage in real time. The vehicle terminal equipment can determine the user's location through S251A-S251C as follows.

[0109] S251A: Acquire audio signals monitored by at least two pickups.

[0110] S251B: Determine whether the audio signal includes a speech signal; if so, execute S251C.

[0111] S251C: Performs spatial positioning based on voice signals to determine the user's location.

[0112] After acquiring audio signals from at least two microphones, the in-vehicle terminal device first determines whether the audio signals include speech signals. If the audio signals include speech signals, it is determined that the user is speaking. At this point, the in-vehicle terminal device can perform spatial positioning based on the speech signals included in at least two audio signals to determine the user's location, specifically the location of the user's head area.

[0113] Specifically, the vehicle-mounted terminal device performs spatial positioning based on at least two audio signals, including voice signals. This is achieved by performing inverse calculations based on the reception time of voice signals with similar characteristics in each audio signal and the position of the microphone to determine the user's mouth position. For details on how spatial positioning is performed based on voice signals to determine the user's position, please refer to existing technical literature and products in the field of acoustics; this disclosure will not elaborate further.

[0114] Optionally, before executing the aforementioned S251C, the vehicle terminal device may also execute S251D: acquiring the pressure signal output by the seat pressure sensor.

[0115] Correspondingly, when executing S251C, spatial positioning is performed based on the voice signal to determine the user's location, specifically S251C1.

[0116] S251C1: Determines the user's location by performing spatial fusion positioning based on voice and pressure signals.

[0117] In a specific embodiment, Kalman filtering or particle filtering can be used to spatially fuse the location determined by the voice signal and the location determined by the pressure signal to determine the user's location. By fusing the voice signal and the pressure signal for location determination, the accuracy of determining the user's location can be improved.

[0118] In some other embodiments of this disclosure, an interior camera is also installed in the vehicle compartment. This interior camera can capture images inside the vehicle, specifically images of the user inside the vehicle. The vehicle-mounted terminal device can determine the user's current focus using the following steps S251E-S251I.

[0119] S251E: Acquire real-time user footage.

[0120] S251F: Processes user images to determine the iris region and the white of the eye region.

[0121] In this embodiment, the interior camera can capture images inside the vehicle compartment in real time and determine the user image within those images based on the captured images. It should be noted that in this embodiment, the user image includes images of the user's eye features.

[0122] After acquiring the user's image, the in-vehicle terminal device can determine the iris region and sclera region of the user's eyes based on the image. In a specific embodiment, a pre-trained deep learning model can be used to determine the user's eye region, and pixel extraction can be performed based on the pixel features of the iris region and sclera region to determine the iris region and sclera region.

[0123] S251G: Determines the user's relative focus direction based on the area of ​​the sclera region located around the iris.

[0124] Common sense tells us that a user's focus is determined by eye movement. The ultimate purpose of eye movement is to change the orientation of the iris area. When a user moves their eyes, the area of ​​the sclera (white part of the eye) exposed outside the eyelid changes. For example, when a user is looking straight ahead, the areas of the sclera on both sides of the iris are roughly the same, as are the areas on the top and bottom of the iris. When the user moves their eyes to the right, the area of ​​the sclera on the left side of the iris is approximately the same as the area on the right side, and the areas on the top and bottom of the iris are roughly the same. Based on the distribution characteristics of the sclera area, the user's relative focus direction can be determined. It should be noted that the aforementioned relative focus direction can be a precise direction or a rough one.

[0125] S251H: Determines the current direction of interest based on the relative direction of interest and the extrinsic parameters of the camera capturing the user's image.

[0126] S251I: Determine the current focus position based on the current focus direction.

[0127] The extrinsic parameters of a camera are parameters used to characterize how the camera's position and shooting angle are calibrated in the world coordinate system. Extrinsic parameters may include a rotation matrix. Determining the current direction of interest based on the relative direction of interest and the extrinsic parameters involves performing a coordinate transformation based on the relative direction of interest and the extrinsic parameters, and then using the transformed direction of interest as the current direction of interest.

[0128] After determining the current focus direction, the first display area in this direction can be determined based on the current focus direction, and this display area is the current focus position.

[0129] S252 can then be executed after the user's current focus.

[0130] In the foregoing embodiments, the current focus direction is determined based on the user's image. In other embodiments, the current focus direction of the user can also be determined based on the user's location.

[0131] S252: Determine the current focus location based on the user's location and / or the user's current focus direction.

[0132] In some embodiments of this disclosure, the first display screen is a large display screen. In this case, the user may only focus on a portion of the first display screen, such as the area closest to their current location. To better guide the user to switch the display screen of focus using the dynamic guide image, the initial playback position of the dynamic guide image on the first display screen is preferably located at the current focus position on the first display screen. That is, the current focus position needs to be determined as the initial position of the playback movement path.

[0133] In this embodiment of the disclosure, after determining the user's current focus position, S230 plans the first playback movement path according to the guidance direction, which can specifically be S231.

[0134] S231: Plan the first playback path based on the guidance direction and the current focus position.

[0135] In this embodiment of the disclosure, the first playback movement path is planned based on the current focus position and the guidance direction. The current focus position is used as the starting point, and the guidance direction is used to determine the approximate direction of the first playback movement path.

[0136] Optionally, in some embodiments of this disclosure, planning the first mobile playback path based on the guidance direction and the current focus position may include S231A-S231D.

[0137] S231A: Determine the current focus position as the initial position of the first playback movement path;

[0138] S231B: Determine the projection direction of the guide direction on the first display screen.

[0139] The projection direction is the direction determined by projecting the guiding direction onto the first display screen; that is, the projection direction is a branch direction of the guiding direction on the plane where the first display screen is located. In this embodiment of the disclosure, after determining the projection direction and the plane where the first display screen is located, the projection direction can be determined by projection transformation.

[0140] S231C: Determine the endpoint position of the first playback movement path at the edge of the first display screen based on the initial position and projection direction.

[0141] In this embodiment, the endpoint position is determined based on the initial position and the projection direction, thus defining a ray originating from the initial position and extending along the projection direction. Since the projection direction is the direction on the screen where the first display screen is located, the aforementioned ray is located on the screen where the first display screen is located. Subsequently, the corner point between the ray and the edge of the first display screen can be calculated to determine the midpoint of the first playback movement path at the edge of the first display screen.

[0142] S231D: Plans the first playback movement path based on the initial and final positions.

[0143] In this embodiment of the disclosure, after determining the initial and ending positions of the first playback movement path, the initial and ending positions can be connected by a straight line, and the connecting line can be used as the first playback movement path. In practical applications, the aforementioned connecting line can also be randomly perturbed to obtain a smooth curve, and the smooth curve can be used as the first playback movement path.

[0144] By employing the aforementioned method, the initial position of the playback path is determined based on the user's current focus, ensuring that the dynamic guide image is visible to the user from the start of playback. The ending position of the playback path is determined based on the positions of the first and second displays, allowing the dynamic guide image to move along a logical path. This guides the user's attention in a reasonable direction, naturally leading them to view the second display.

[0145] Furthermore, in some embodiments of this disclosure, before executing S230 to play the dynamic guide image along the playback movement path on the first display screen, the vehicle terminal device may also execute S260-S280.

[0146] S260: Determine the user's location.

[0147] In this embodiment, determining the user's location is primarily about determining the location of the user's head. The user's location can be determined using the pressure detection, sound source detection, and image detection methods described above, and will not be repeated here.

[0148] S270: Determine a first distance between the user and the first display screen based on the user's location and the location of the first display screen; and determine a second distance between the user and the second display screen based on the user's location and the location of the second display screen.

[0149] S280: Determine the scaling method of the dynamic guide image based on the first distance and the second distance.

[0150] Based on the first distance and the second distance, the scaling method for the cross-screen guide image is determined as follows.

[0151] (1) Determine whether the dynamic guide image on the first display screen is displayed in a reduced size, enlarged size, or with the proportions unchanged.

[0152] In order to make the scaling method of the dynamic guide image conform to the visual perception, the following method is adopted in this disclosure to determine the scaling method of the dynamic guide image based on the first distance and the second distance: when the first distance is less than the second distance, the scaling method is determined to be a shrinking method; when the first distance is greater than the second distance, the scaling method is determined to be a zooming method; when the first distance and the second distance are the same, the scaling method is determined to be a method that keeps the proportion unchanged.

[0153] In some embodiments, the second distance is greater than the first distance, meaning the second display screen is farther from the user than the first display screen. For example, the first display screen is a rear-seat entertainment display screen, and the second display screen is a vehicle center console display screen; the second distance between the second display screen and the rear-seat user is greater than the first distance between the first display screen and the rear-seat user. In this case, in order for the user to look forward independently while viewing the dynamic guide image, it is also necessary for the user to perceive that the dynamic guide image is moving away. To make the user perceive the dynamic guide image gradually moving away, the dynamic guide image can be reduced in size during playback.

[0154] In other embodiments, the first distance and the second distance are approximately the same, meaning the distance between the first display screen and the second display screen is roughly the same as the distance to the user. For example, if the first display screen is a passenger-side entertainment display screen and the second display screen is a vehicle center console display screen, the second distance between the second display screen and the passenger-side user is roughly equal to the first distance between the first display screen and the passenger-side user. In this case, the dynamic guide image is simply translated on the first display screen, maintaining the proportions of the dynamic guide image unchanged.

[0155] (2) When the zoom mode is set to shrink playback mode, determine the shrinkage ratio and zoom rate at each position. When the zoom mode is set to zoom up playback mode, determine the zoom ratio and zoom rate at each position.

[0156] In this embodiment of the disclosure, the scaling ratio can be determined based on the ratio of the first distance and the second distance, and the scaling ratio can be determined based on the moving speed and moving playback path of the dynamic guide image.

[0157] When performing the aforementioned S260-S280, S230 plays a dynamic guide image on the first display screen along the first playback movement path, including S231.

[0158] S231: Play a dynamic guide image on the first display screen along the first playback path and in a scaling manner.

[0159] By playing a dynamic guide image along the first moving playback path in a scaling manner, users can perceive the cross-screen image moving away or closer, thereby allowing them to perceive whether the second display screen is closer or farther away from the first display screen. This, in turn, enables users to better perceive the position of the second display screen and further improves the user experience.

[0160] In the foregoing embodiments, the endpoint of the first playback movement path is determined based on the projection direction of the guidance direction on the first display screen and the current focus position. In other embodiments of this disclosure, where the dynamic guidance image can be scaled, the endpoint of the first playback movement path can also be determined directly based on the current focus position and the guidance direction of the current focus position.

[0161] For example, in some embodiments, the step of determining the endpoint of the first playback movement path based on the current focus position and the guidance direction may include S232.

[0162] S232: Based on the imaging principle, determine the endpoint of the first playback movement path according to the current focus position and the guidance direction.

[0163] Based on imaging principles, and taking into account the current focus position and guidance direction, the current position is used as the starting point, and the guidance direction as the actual pointing direction. This determines how, if the dynamic guidance image were a real image, it could reach the second display screen from the current focus position via a relatively convenient path. Subsequently, the first display screen uses 3D imaging principles to simulate the aforementioned path from the current focus position, determining the endpoint of the first playback movement path.

[0164] S233: Determine the first playback movement path based on the current focus position and the destination position.

[0165] After determining the endpoint, the initial and ending positions can be connected by a straight line, and this connecting line can be used as the first playback path. In practical applications, the connecting line can be randomly perturbed to obtain a smooth curve, which can then be used as the first playback path. It should be noted that because the dynamic guide image scales according to a set scaling method while playing along the first playback path, users can perceive the cross-screen guide image as moving away or closer.

[0166] Optionally, in some embodiments of this disclosure, in addition to executing the aforementioned S290 and S230 to plan the first playback movement path according to the guidance direction, the vehicle terminal device can also execute S290-S320.

[0167] S290: Determine the initial playback position of the dynamic guide image when it is played on the second display screen according to the guide direction.

[0168] In this embodiment of the disclosure, the initial playback position of the dynamic guide image when it is played on the second display screen can be determined according to the guide direction using the following method.

[0169] (1) Determine the projection of the guiding direction onto the second display screen. Then, based on the projection and the extension direction of the guiding direction, determine the point closest to the first display screen, and use the aforementioned closest point as the initial position when the dynamic guiding image is played on the second display screen.

[0170] (2) Determine the intersection of the guiding direction and the second display screen, and directly use the aforementioned intersection as the initial playback position of the dynamic guiding image on the second display screen.

[0171] S300: Obtain the target playback position when the dynamic guide image is played on the second display screen.

[0172] In this embodiment of the disclosure, the corresponding playback position can be found according to the task type of the display task as the target playback position when the dynamic guide image is played on the second display screen.

[0173] S310: Based on the initial playback position and the target playback position, plan the second playback movement path.

[0174] In this embodiment of the disclosure, the second playback movement path is the movement path of the dynamic guide image when it is played on the second display screen.

[0175] If S290-S310 is executed, S320 can be executed after S240 is completed.

[0176] S320: Control the second display screen to continue playing the dynamic guide image along the second playback path.

[0177] In this embodiment of the disclosure, controlling the second display screen to play a dynamic guide image involves moving the dynamic guide image from the initial playback position to the target playback position. Of course, when using the second display screen to play the dynamic guide image along a second playback movement path, the scaling method of the dynamic guide image on the second display screen can also be determined based on the distances of the initial playback position and the target playback position from the user.

[0178] S240: After executing the aforementioned S230 and controlling the first display screen to complete the playback of the dynamic guide image, the vehicle terminal device can also execute S290.

[0179] The dynamic guide image allows the second display screen to continue playing a cross-screen dynamic guide image, making the user aware that the guide image has moved to the second display screen, thus allowing the user to more naturally switch their focus to the second display screen.

[0180] Figure 3 This is a flowchart of an interactive control method provided in some embodiments of this disclosure. For example... Figure 3As shown, in some embodiments of this disclosure, the interactive control method includes S410-S430.

[0181] S410: In response to receiving a display task triggered when the user interacts with the first display screen, determine whether the display task is a display task executed by the second display screen; if so, execute S420.

[0182] S420: Based on the positions of the first display screen and the second display screen, plan the first playback movement path, which is the movement path of the dynamic guide image when it is played on the first display screen.

[0183] 430: Play dynamic guide images on the first display screen along the first playback path.

[0184] The specific implementation process of S410-S430 can be the same as that in the previous embodiments, and will not be repeated here. For details, please refer to the previous embodiments.

[0185] S440: Controls the stereo playback system to output the first prompt voice along the first playback movement path.

[0186] In this embodiment of the disclosure, the first prompt voice is a voice prompting the user to switch their attention from the first display screen to the second display screen. In some embodiments of the disclosure, the output prompt voice may be a voice such as "The subsequent task will be displayed on the second display screen".

[0187] While the guiding image is playing on the first display screen, the first prompt voice can be output, allowing users to obtain information more naturally under the guidance of the first prompt voice and the dynamic guiding image, and thus more naturally shift their attention from the first display screen to the second display screen.

[0188] In some embodiments of this disclosure, S440 may include S441-S443.

[0189] S441: Determine the simulated playback position of the audio frame in the first prompt voice within the first playback movement path.

[0190] Determining the simulated playback position of the audio frame in the first prompt sound within the first playback movement path is equivalent to determining the coordinate position of the simulated sound source when playing the aforementioned audio frame.

[0191] The vehicle-mounted terminal device can determine the simulated playback position of all audio frames in the first playback movement path before playing the first prompt sound, or it can gradually determine the simulated playback position during the playback of the first prompt sound. This embodiment of the present disclosure does not impose any particular limitation.

[0192] S442: Generates modulation signals to control the sound output of each speaker based on the analog playback position, audio frame, and the position of each speaker in the stereo playback system.

[0193] In order for the sound emitted by each speaker to reverberate in the sound field, and for the user to perceive the effect of stereo movement after reverberation, it is necessary to adaptively adjust the operating characteristics of each speaker in the stereo playback system. This includes adjusting whether each speaker is working and emitting sound, the sound intensity when the speaker is working and emitting sound, and the playback time for a specific audio frame signal.

[0194] In some embodiments, the in-vehicle terminal device needs to determine the sound characteristics (e.g., timbre and tone quality) required for reverberation based on audio frames, determine the reverberation position characteristics formed by each speaker based on the simulated playback position, and then generate modulation signals to control the sound output of each speaker based on the sound characteristics, reverberation position characteristics, and the position of each speaker. To achieve the aforementioned objectives, technicians first calibrated the system based on the vehicle cabin space, speaker installation positions, and the listening positions of the main users. Based on the calibration results, sound field reverberation tests were conducted to construct a sound field reverberation model.

[0195] When the vehicle-mounted terminal device is working, a sound field reverberation model can be used to determine the modulation signal for controlling each speaker based on the simulated playback position and audio frame.

[0196] S443: The corresponding loudspeaker is driven by a modulation signal so that the sound waves emitted by each loudspeaker reverberate in the sound field to form the first prompt voice.

[0197] Based on the foregoing analysis, after driving each speaker with a modulation signal, the sound waves emitted by each speaker reverberate in the sound field, forming single-point sounds corresponding to audio frames. The continuous playback of these single-point sounds allows the user's auditory system to perceive the first prompt voice gradually moving along the playback path to the edge of the first display screen after receiving the stereo prompt. This allows the user to be naturally guided by the first prompt voice while viewing the dynamic guidance image, thus providing a better user experience.

[0198] Optionally, in some embodiments of this disclosure, after executing the aforementioned S440, the vehicle terminal device may also execute S450-S450.

[0199] S450: Determine the continued movement path of the analog sound source based on the end position of the first playback movement path and the position of the second display screen.

[0200] In this embodiment of the disclosure, the continuing movement path is the continuing movement path of the simulated sound source after the dynamic guidance image is played on the first display screen.

[0201] S460: After controlling the stereo playback system to output the first prompt voice, control the stereo playback system to continue outputting the second prompt voice along the movement path. The second prompt voice is a voice that continues to guide the user to pay attention to the second display screen.

[0202] In this embodiment of the disclosure, the second prompt voice is a voice that continues to guide the user to pay attention to the second display screen.

[0203] By continuing to output a second prompt voice along the continued movement path using a stereo playback system after the first prompt voice is output, the user's attention can be naturally guided to the second display screen through the second prompt voice, further improving the user experience.

[0204] In some embodiments of this disclosure, the vehicle terminal device may also execute S470 before executing the aforementioned S450.

[0205] S470: Determine whether there is an obstacle between the first display screen and the second display screen; if so, then S450 is specifically S451.

[0206] S451: Determine the continued movement path based on the end position of the playback movement path, the position of the obstacle, and the position of the second display screen.

[0207] In practical applications, there may or may not be an obstacle between the first and second displays.

[0208] For example, if the first display screen is the passenger entertainment display screen and the second display screen is the central control display screen, and there are no obstacles between the first display screen and the second display screen, then the shortest straight line between the two can be used as the sound source movement path.

[0209] If the first display screen is a movable rear entertainment screen, and the second display screen is a central control screen, the front seats may obstruct the view between the two screens. In this case, if the line connecting the first and second screens is used as the sound source path, the sound source path will overlap with the front seats. Outputting stereo voice prompts along this path will make the user feel that the sound is coming from the seats, causing perceptual confusion and a poor user experience.

[0210] To avoid the aforementioned situation, in this embodiment of the present disclosure, when the vehicle terminal device determines that there is an obstacle between the first display screen and the second display screen, it will also determine the sound source's continued movement path based on the location of the obstacle, so that the sound source's continued movement path avoids the obstacle, thereby making the simulated sound source move in an open area, avoiding perceptual confusion for the user, and ensuring that the user has a better user experience.

[0211] It should be noted that the aforementioned first and second prompt voice messages can be continuous or discontinuous, and this embodiment does not impose any particular limitation. It should also be noted that the second prompt voice message is the voice message that precedes the continued playback of the dynamic guide image on the second display screen.

[0212] In addition to playing the aforementioned first and second prompt voice messages, in some embodiments of this disclosure, the second prompt voice message can also be played while the dynamic guide image continues to be displayed on the second display screen.

[0213] In addition to providing the aforementioned interactive control method, embodiments of this disclosure also provide an interactive control device for implementing the aforementioned interactive control method.

[0214] Figure 4 This is a schematic diagram of the structure of the interactive control device provided in the embodiments of this disclosure. Figure 4 As shown, the interactive control device 400 provided in this embodiment includes a task judgment unit 401 and a display control unit 402.

[0215] The task determination unit 401 is used to determine whether the display task is a display task executed by the second display screen in response to receiving a display task triggered when the user interacts with the first display screen.

[0216] The display control unit 402 is used to control the first display screen to play a dynamic guide image when the display task is performed by the second display screen. The dynamic guide image is used to gradually switch the user's attention from the first display screen to the second display screen.

[0217] In some embodiments of this disclosure, the interactive control device 400 further includes a guidance direction determination unit and a movement path determination unit. The guidance direction determination unit determines a guidance direction based on the positional relationship between the first display screen and the second display screen. The movement path determination unit plans a first playback movement path based on the guidance direction, the first playback movement path being the movement path of the dynamic guide image when it is played on the first display screen.

[0218] Correspondingly, the display control unit 402 plays a dynamic guide image on the first display screen along the first playback movement path.

[0219] In some embodiments of this disclosure, the interactive control device 400 further includes a current focus position determination unit. The current focus position determination unit determines the user's current focus position, which is the position on the first display screen that the user is focusing on when interacting with the first display screen. Correspondingly, the movement path determination unit plans a first playback movement path based on the guidance direction and the current focus position.

[0220] In some embodiments of this disclosure, the motion path determination unit includes an initial position determination subunit, a projection direction determination subunit, an endpoint position determination subunit, and a first playback motion path determination subunit. The initial position determination subunit is used to determine the current position of interest as the initial position of the first playback motion path. The projection direction determination subunit is used to determine the projection direction of the guiding direction on the first display screen. The endpoint position determination subunit is used to determine the endpoint position of the first playback motion path at the edge of the first display screen based on the initial position and the projection direction. The first playback motion path determination subunit is used to plan the first playback motion path based on the initial position and the endpoint position.

[0221] In some embodiments of this disclosure, the initial position determination subunit determines the current attention position using the following method: acquiring a real-time captured user image, the user image being an image including the user's eye features; processing the user image to determine the user's iris region and sclera region; determining the user's relative attention direction based on the area of ​​the sclera region located around the iris region; determining the current attention direction based on the relative attention direction and the extrinsic parameters of the camera capturing the user image; and determining the current attention position based on the current attention direction.

[0222] In some embodiments of this disclosure, the interactive control device 400 further includes a position determination unit, a distance calculation unit, and a scaling mode determination unit. The position determination unit determines the user's position. The distance calculation unit determines a first distance between the user and the first display screen based on the user's position and the position of the first display screen, and a second distance between the user and the second display screen based on the user's position and the position of the second display screen. The scaling mode determination unit determines the scaling mode of the dynamic guide image based on the first and second distances. Correspondingly, the display control unit 402 plays the dynamic guide image on the first display screen along a first playback movement path according to the scaling mode.

[0223] In some embodiments of this disclosure, the scaling mode determination unit determines the scaling mode as shrinking when the first distance is less than the second distance, and determines the scaling mode as zooming when the first distance is greater than the second distance.

[0224] In some embodiments of this disclosure, the movement path determination unit is further configured to determine the initial playback position of the dynamic guide image when it is played on the second display screen according to the guidance direction, obtain the target playback position of the dynamic guide image when it is played on the second display screen, and plan a second playback movement path according to the initial playback position and the target playback position, wherein the second playback movement path is the movement path of the dynamic guide image when it is played on the second display screen.

[0225] After controlling the first display screen to complete the playback of the dynamic guide image, the display control unit 402 can also control the second display screen to continue playing the dynamic guide image along the second playback movement path.

[0226] In some embodiments of this disclosure, the interactive control device 400 further includes a voice output unit. The voice output unit is used to control the stereo playback system to output a first prompt voice along a first playback movement path while the display control unit 402 controls the first display screen to play a dynamic guide image. The first prompt voice is a voice prompting the user to switch their attention from the first display screen to the second display screen.

[0227] In some embodiments of this disclosure, the voice output unit includes a playback position determination subunit, a modulation signal sound field subunit, and a control subunit. The playback position determination subunit is used to determine the simulated playback position of the audio frame in the first prompt voice within the first playback movement path. The modulation signal sound field subunit is used to generate a modulation signal controlling the sound output of each speaker based on the simulated playback position, the audio frame, and the positions of each speaker in the stereo playback system. The control subunit is used to drive the corresponding speaker to operate using the modulation signal, so that the sound waves emitted by each speaker reverberate in the sound field to form the first prompt voice.

[0228] In some embodiments of this disclosure, the movement path determination unit is further configured to, after controlling the stereo playback system to output a first prompt voice, control the stereo playback system to continue outputting a second prompt voice along the movement path, wherein the second prompt voice is a voice prompt to continue guiding the user to pay attention to the second display screen.

[0229] This disclosure also provides an electronic device, which includes a processor and a memory, wherein the memory stores a computer program that, when executed by the processor, can implement the interactive control method of any of the above embodiments.

[0230] Figure 5 This is a schematic diagram of the structure of an electronic device provided in some embodiments of this disclosure. See below for details. Figure 5 It shows a schematic diagram of a structure suitable for implementing the electronic device 500 in the embodiments of this disclosure. Figure 5 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0231] like Figure 5As shown, the electronic device 500 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory ROM 502 or a program loaded from a storage device 508 into a random access memory RAM 503. The RAM 503 also stores various programs and data required for the operation of the electronic device 500. The processing unit 501, ROM 502, and RAM 503 are interconnected via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0232] Typically, the following devices can be connected to I / O interface 505: input devices 505 including, for example, touchscreens, touchpads, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 507 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 508 including, for example, magnetic tapes, hard disks, etc.; and communication devices 509. Communication device 509 allows electronic device 500 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 5 An electronic device 500 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0233] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing device 501, it performs the functions defined in the methods of embodiments of this disclosure.

[0234] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0235] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0236] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0237] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to: in response to receiving a display task triggered when a user interacts with the first display screen, determine whether the display task is a display task executed by the second display screen; and if the display task is a display task executed by the second display screen, control the first display screen to play a dynamic guiding image that gradually switches the user's attention from the first display screen to the second display screen.

[0238] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0239] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0240] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0241] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0242] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include, based on electrical connections of one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0243] This disclosure also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it can implement the methods of any of the above method embodiments. The execution method and beneficial effects are similar, and will not be described again here.

[0244] Furthermore, this disclosure also provides a vehicle, which includes a processor, a memory, a first display screen, and a second display screen. The aforementioned processor can be an in-vehicle processor or a dedicated processor. The memory stores a computer program; when the computer program is loaded by the processor, it causes the processor to execute the interactive control method described in the foregoing embodiments, causing the first display screen to play the dynamic guide image; and after the first display screen completes the playback of the dynamic guide image, it controls the second display screen to perform the display task.

[0245] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0246] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An interactive control method, characterized in that, include: In response to receiving a display task triggered when the user interacts with the first display screen; When the display task is performed by the second display screen, the dynamic guide image is controlled to switch from the first display screen to the second display screen in a scaling manner, and the display task is performed on the second display screen; The method further includes: Determine the user's location; Based on the user's location and the location of the first display screen, a first distance between the user and the first display screen is determined; and based on the user's location and the location of the second display screen, a second distance between the user and the second display screen is determined. Based on the first distance and the second distance, the scaling method of the dynamic guide image is determined.

2. The method according to claim 1, characterized in that, Before the control dynamic guide image switches from the first display screen to the second display screen, the method further includes: The guiding direction is determined based on the positional relationship between the first display screen and the second display screen; A first playback movement path is planned according to the guidance direction, and the first playback movement path is the movement path of the dynamic guide image when it is played on the first display screen; the control of the dynamic guide image to switch from the first display screen to the second display screen includes: The dynamic guide image is played on the first display screen along the first playback movement path.

3. The method according to claim 2, characterized in that, The method further includes: Determine the current focus position, which is the display position of the first display screen that the user is looking at when interacting with the first display screen; The step of planning the first playback movement path according to the guidance direction includes: The first playback movement path is planned based on the guidance direction and the current focus position.

4. The method according to claim 3, wherein planning the first playback movement path based on the guidance direction and the current focus position includes: The current focus position is determined as the initial position of the first playback movement path; Determine the projection direction of the guiding direction on the first display screen; The endpoint position of the first playback movement path at the edge of the first display screen is determined based on the initial position and the projection direction. The first playback movement path is planned based on the initial position and the final position.

5. The method according to claim 4, characterized in that, Determining the current focus location includes: Acquire real-time captured user images, which include images of the user's eye features; Process the user image to determine the user's iris region and sclera region; The user's relative focus direction is determined based on the area of ​​the sclera region located around the periphery of the iris region; The current focus direction is determined based on the relative focus direction and the extrinsic parameters of the camera capturing the user's image; The current focus position is determined based on the current focus direction.

6. The method according to claim 2, characterized in that, Determining the scaling method of the dynamic guide image based on the first distance and the second distance includes: Based on the relationship between the first distance and the second distance, the scaling method of the dynamic guide image is determined; The control of the dynamic guidance image switching from the first display screen to the second display screen includes: The dynamic guide image is played on the first display screen along the first playback path and according to the scaling method.

7. The method according to claim 6, characterized in that, The step of determining the scaling method of the dynamic guide image based on the relationship between the first distance and the second distance includes: If the first distance is less than the second distance, the scaling method is determined to be a shrinking method; and, If the first distance is greater than the second distance, the scaling method is determined to be the zoom-in method.

8. The method according to any one of claims 2-7, characterized in that, The method further includes: The initial playback position of the dynamic guide image when it is played on the second display screen is determined according to the guide direction. Obtain the target playback position when the dynamic guide image is played on the second display screen; Based on the initial playback position and the target playback position, a second playback movement path is planned, which is the movement path of the dynamic guide image when it is played on the second display screen. The control of the dynamic guidance image switching from the first display screen to the second display screen also includes: The dynamic guide image is controlled to continue playing on the second display screen along the second playback path.

9. The method according to any one of claims 2-7, characterized in that, While the controlled dynamic guide image switches from the first display screen to the second display screen, the method further includes: The stereo playback system is controlled to output a first prompt voice along the first playback movement path. The first prompt voice is a voice prompting the user to switch the focus of the display screen from the first display screen to the second display screen.

10. The method according to claim 9, characterized in that, The control stereo playback system outputs a first prompt voice along the first playback movement path, including: Determine the simulated playback position of the audio frame in the first prompt voice within the first playback movement path; Based on the simulated playback position, the audio frame, and the position of each speaker in the stereo playback system, a modulation signal is generated to control the sound output of each speaker; The modulation signal is used to drive the corresponding loudspeaker to work, so that the sound waves emitted by each loudspeaker reverberate in the sound field to form the first prompt voice.

11. The method according to claim 10, characterized in that, The method further includes: The continued movement path of the simulated sound source is determined based on the end position of the first playback movement path and the position of the second display screen. The continued movement path is the path to continue playing the prompt voice after the dynamic guidance image is played on the first display screen. After controlling the stereo playback system to output the first prompt voice along the first playback movement path, the method further includes: The stereo playback system is controlled to output a second prompt voice along the continued movement path. The second prompt voice is a voice that continues to guide the user to pay attention to the second display screen.

12. An interactive control device, characterized in that, include: The task judgment unit is used to respond to a display task triggered when the user interacts with the first display screen; The display control unit controls the dynamic guide image to switch from the first display screen to the second display screen in a scaling manner when the display task is performed by the second display screen, and performs the display task on the second display screen; Location determination unit, used to determine the user's location; A distance calculation unit is configured to determine a first distance between the user and the first display screen based on the user's location and the location of the first display screen; and to determine a second distance between the user and the second display screen based on the user's location and the location of the second display screen. The scaling method determination unit is used to determine the scaling method of the dynamic guide image based on the first distance and the second distance.

13. An electronic device, characterized in that, Includes a processor and a memory, the memory being used to store computer programs; When the computer program is loaded by the processor, it causes the processor to execute the interactive control method as described in any one of claims 1-11.

14. A computer-readable storage medium, characterized in that, The storage medium stores a computer program that, when executed by a processor, causes the processor to implement the interactive control method as described in any one of claims 1-11.

15. A vehicle, characterized in that, The system includes a processor, a memory, a first display screen, and a second display screen; the memory stores a computer program; when the computer program is loaded by the processor, it causes the processor to execute the interactive control method as described in any one of claims 1-11, causing the dynamic guide image to switch from the first display screen to the second display screen; and, After the second display screen completes the playback of the dynamic guide image, the second display screen is controlled to perform the display task.

Images