Intelligent robot screen image display method and device, equipment and medium

Abstract

The application provides a display method, device and equipment of a screen image of an intelligent robot and a medium. The method comprises the following steps: acquiring a voice signal in a target space; determining a screen on which a target user gazes in the case that text corresponding to the voice signal matches preset wake-up text; determining a gaze condition of other users in the target space on the screen; displaying the screen image of the intelligent robot on a first display area of the screen in the case that the other users do not gaze at the screen; and displaying the screen image on a second display area of the screen in the case that the other users gaze at the screen, wherein the attention degree of the second display area is less than that of the first display area. According to the method, the screen image of the intelligent robot is displayed on display areas with different attention degrees in the screen according to whether other users in the target space gaze at the screen on which the user gazes to wake up the intelligent robot, so that the influence of the display of the screen image of the intelligent robot on the use of the screen by the other users can be reduced.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a method, apparatus, device, and medium for displaying the image of an intelligent robot on a screen. Background Technology

[0002] In practical applications, multiple users in the same space may have the ability to use the same screen. For example, with the development of technology and the progress of society, screen applications in cars are increasing, and multiple passengers may have the ability to use the same screen. In vehicles equipped with in-vehicle intelligent robots, when a passenger wakes up the in-vehicle intelligent robot, the screen image of the in-vehicle intelligent robot will be displayed on the corresponding screen, which may disturb other passengers' use of the screen. Summary of the Invention

[0003] This application proposes a method, apparatus, device, and medium for displaying the image of an intelligent robot on a screen. The specific solution is as follows:

[0004] One embodiment of this application proposes a method for displaying the image of an intelligent robot on a screen, including:

[0005] Acquire speech signals within the target space;

[0006] If the text corresponding to the voice signal matches the preset wake-up text, determine the screen that the target user is looking at;

[0007] Determine the screen viewing status of other users within the target space, where other users refer to users within the target space other than the target user;

[0008] The screen image of the intelligent robot is displayed in the first display area of ​​the screen when other users are not looking at the screen.

[0009] While other users are looking at the screen, the screen image is displayed in a second display area of ​​the screen, where the attention level of the second display area is less than that of the first display area.

[0010] In one possible implementation of one aspect of this application, displaying the screen image of the intelligent robot in the first display area of ​​the screen includes:

[0011] A screen image of a preset size is displayed in the first display area of ​​the screen;

[0012] Displaying the screen image in the second display area of ​​the screen includes:

[0013] A screen image of a target size is displayed in the second display area of ​​the screen, wherein the target size is smaller than the preset size.

[0014] In one possible implementation of one aspect of this application, before determining the viewing status of other users on the screen within the target space, the method further includes:

[0015] It was determined that other users had not activated the smart robot.

[0016] In one possible implementation of one aspect of this application, multiple screens are arranged within the target space, and determining the screen to which the voice signal belongs and which the target user is looking includes:

[0017] Determine the location information of the target user;

[0018] Based on the detection data from the target detection device corresponding to the target user's location information, determine the target user's first gaze angle;

[0019] The first gaze angle is matched with the first preset angle corresponding to each screen; wherein, each first preset angle refers to the gaze angle when viewing each screen at the target user's location information;

[0020] If the first gaze angle matches the first preset angle corresponding to any screen, then any screen is determined to be the screen that the target user is gazing at.

[0021] In one possible implementation of one aspect of this application, before determining the first gaze angle of the target user based on the detection data of the target detection device corresponding to the location information of the target user, the method further includes:

[0022] Based on the location information of each detection device in the target space, determine the target detection device corresponding to the location information of the target user;

[0023] The target detection device is activated to obtain its detection data.

[0024] In one possible implementation of one aspect of this application, determining the location information of the target user includes:

[0025] Based on the correspondence between each voice acquisition device in the target space and the seats in the target space, and the target voice acquisition device corresponding to the voice signal, the target seat corresponding to the target voice acquisition device is determined.

[0026] Based on the target seat, determine the location information of the target user.

[0027] In one possible implementation of one aspect of this application, determining the viewing status of the screen by other users within the target space includes:

[0028] Determine the second gaze angle of other users based on the detection data from the detection device that corresponds to the location information of other users.

[0029] The gaze of other users on the screen is determined based on the matching degree between the second gaze angle and the second preset angle corresponding to the screen; wherein, the second preset angle corresponding to the screen refers to the gaze angle when other users view the screen from their location information.

[0030] Another embodiment of this application proposes a display device for an intelligent robot screen image, comprising:

[0031] The acquisition module is used to acquire speech signals within the target space;

[0032] The first determining module is used to determine the screen that the target user is looking at when the text corresponding to the voice signal matches the preset wake-up text.

[0033] The second determining module is used to determine the viewing status of other users in the target space on the screen, where other users refer to users in the target space other than the target user;

[0034] The display module is used to display the image of the intelligent robot in a first display area of ​​the screen when other users are not looking at the screen; and to display the image in a second display area of ​​the screen when other users are looking at the screen, wherein the attention of the second display area is less than that of the first display area.

[0035] In one possible implementation of one aspect of this application, the display module is configured to display a screen image of a preset size in a first display area of ​​the screen when other users are not looking at the screen; and to display a screen image of a target size in a second display area of ​​the screen when other users are looking at the screen, wherein the target size is smaller than the preset size.

[0036] In one possible implementation of another embodiment of this application, the device further includes:

[0037] The third determination module is used to determine whether other users have woken up the intelligent robot.

[0038] In another possible implementation of this application, multiple screens are provided within the target space, and the first determining module includes:

[0039] The first determining unit is used to determine the location information of the target user;

[0040] The second determining unit is used to determine the first gaze angle of the target user based on the detection data of the target detection device corresponding to the location information of the target user;

[0041] A matching unit is used to match a first gaze angle with a first preset angle corresponding to each screen; wherein each second preset angle refers to the gaze angle when viewing each screen at the target user's location information;

[0042] The third determining unit is used to determine any screen as the screen being gazed at by the target user when the first gaze angle matches a first preset angle corresponding to any screen.

[0043] In one possible implementation of another embodiment of this application, the first determining module further includes:

[0044] The fourth determining unit is used to determine the target detection device corresponding to the target user's location information based on the location information of each detection device in the target space.

[0045] The control unit is used to control the target detection device to turn on in order to obtain the detection data of the target detection device.

[0046] In one possible implementation of another embodiment of this application, the first determining unit is configured to:

[0047] Based on the correspondence between each voice acquisition device in the target space and the seats in the target space, and the target voice acquisition device corresponding to the voice signal, the target seat corresponding to the target voice acquisition device is determined.

[0048] Based on the target seat, determine the location information of the target user.

[0049] In one possible implementation of another embodiment of this application, the second determining module is used for:

[0050] Determine the second gaze angle of other users based on the detection data from the detection device that corresponds to the location information of other users.

[0051] The gaze of other users on the screen is determined based on the matching degree between the second gaze angle and the second preset angle corresponding to the screen; wherein, the second preset angle corresponding to the screen refers to the gaze angle when other users view the screen from their location information.

[0052] Another embodiment of this application provides a computer device including a processor and a memory;

[0053] The processor reads executable program code stored in the memory to run a program corresponding to the executable program code, so as to implement the method described in one aspect of the above embodiment.

[0054] Another embodiment of this application proposes a vehicle that includes the aforementioned computer equipment.

[0055] Another embodiment of this application provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the method described in the above-described embodiment.

[0056] Another embodiment of this application provides a computer program product including a computer program that, when executed by a processor, performs the steps of the method described in the above-described embodiment.

[0057] The method, apparatus, computer device, and storage medium for displaying the screen image of an intelligent robot according to embodiments of this application acquire voice signals within a vehicle; if the text corresponding to the voice signal matches a preset wake-up text, determine the screen to which the target user of the voice signal is looking; determine the viewing status of the screen by other users within the vehicle; if other users are not looking at the screen, display the screen image of the intelligent robot in a first display area of ​​the screen; if other users are looking at the screen, display the screen image in a second display area of ​​the screen, wherein the attention level of the second display area is less than that of the first display area. Therefore, when a user wakes up the intelligent robot, by determining the screen to which the user waking up the intelligent robot is looking, and displaying the screen image of the intelligent robot in display areas with different levels of attention based on whether other users in the target space are looking at the screen, the impact of displaying the screen image of the intelligent robot on other users' screen usage can be reduced.

[0058] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0059] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0060] Figure 1 A flowchart illustrating a method for displaying an image of an intelligent robot on a screen, as provided in an embodiment of this application;

[0061] Figure 2 A flowchart illustrating another method for displaying an image of an intelligent robot on a screen, provided in an embodiment of this application;

[0062] Figure 3 A flowchart illustrating another method for displaying an image of an intelligent robot on a screen, provided in an embodiment of this application;

[0063] Figure 4 A flowchart illustrating another method for displaying an image of an intelligent robot on a screen, provided in an embodiment of this application;

[0064] Figure 5A schematic diagram of the interior of a vehicle provided in this application embodiment;

[0065] Figure 6 A schematic diagram of the structure of a display device for an intelligent robot screen image provided in an embodiment of this application;

[0066] Figure 7 A block diagram of a computer device for displaying the image of an intelligent robot on a screen, as provided in an embodiment of this application. Detailed Implementation

[0067] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0068] The following description, with reference to the accompanying drawings, describes a method, apparatus, computer device, and storage medium for displaying the image of an intelligent robot on a screen according to embodiments of this application.

[0069] Figure 1 This is a flowchart illustrating a method for displaying an image of an intelligent robot on a screen, as provided in an embodiment of this application.

[0070] The method for displaying the screen image of an intelligent robot according to the embodiments of this application can be executed by the display device for displaying the screen image of an intelligent robot provided in the embodiments of this application. The device can be configured in a computer device, such as in a vehicle system. By determining the screen that the user who wakes up the intelligent robot is looking at, and depending on whether other users in the target space are looking at the screen, the screen image of the intelligent robot is displayed in display areas with different levels of attention on the screen, thereby reducing the impact of the display of the screen image of the intelligent robot on other users' use of the screen.

[0071] like Figure 1 As shown, the display method of the intelligent robot's screen includes:

[0072] Step 101: Acquire the speech signal within the target space.

[0073] The target space contains multiple screens. The target space can be a space inside a vehicle, a game room, or other spatial areas. This application does not limit this.

[0074] In this application, a voice acquisition device, such as a microphone, can be installed in the target space. When a user speaks in the target space, the voice acquisition device can acquire the corresponding voice signal, thereby obtaining the voice signal in the target space acquired by the voice acquisition device.

[0075] Taking the space inside a vehicle as an example, a voice acquisition device, such as a microphone, can be installed inside the vehicle. When passengers speak inside the vehicle, the voice acquisition device can collect the corresponding voice signals, thereby obtaining the voice signals inside the vehicle collected by the voice acquisition device.

[0076] To improve the quality of the acquired voice signal, this application proposes to install a voice acquisition device near each seat in the vehicle, so that when a passenger in a certain seat speaks, the voice acquisition device corresponding to that seat can acquire the passenger's voice signal.

[0077] Step 102: If the text corresponding to the voice signal matches the preset wake-up text, determine the screen that the target passenger to which the voice signal belongs is looking at.

[0078] In this application, users within the target space can wake up the intelligent robot by voice, thereby allowing one or more preset wake-up texts to be pre-set, such as "Hello, Student A".

[0079] After acquiring the voice signal, it can be recognized to obtain the corresponding text. This text is then compared with a preset wake-up text. If the text matches, it indicates the user is waking up the intelligent robot. In this case, the screen the target user is looking at can be determined, i.e., the screen the user waking up the intelligent robot is looking at. Here, the target user refers to the user who issued the voice signal.

[0080] In this context, the target user of the voice signal refers to the user who emitted the voice signal, and the target user's location information can be the target user's coordinates within the target space. In this application, the location information of each screen within the vehicle can be pre-stored. When determining the screen the target user is looking at, the user's gaze angle can be determined based on detection data from a detection device installed within the target space, and it can be determined whether the location information of each screen is located in the direction of the target user's gaze angle. If the location information of a screen is located in the direction of the target user's gaze angle, that screen is determined to be the screen the target passenger is looking at.

[0081] Step 103: Determine the viewing status of other users on the screen within the target space.

[0082] In this context, "other users" refers to passengers within the target space other than the target user. For example, if the target space is the space inside a vehicle, then "other users" refers to all users inside the vehicle except the target user.

[0083] In this application, a detection device is installed in the target space. The detection device can collect data from users in the target space and obtain detection data. Based on the detection data of other passengers in the target space, it can determine the viewing angle of other users in the target space on the screen that the target user is looking at, and determine whether other users in the target space are looking at the screen based on the viewing angle of other passengers.

[0084] Alternatively, the location information of each screen can be obtained in advance. If the screen being looked at by the target user is in the direction of the other passengers' viewing angle, it can be determined that the other users are looking at the screen; if the screen being looked at by the target user is not in the direction of the other users' viewing angle, it can be determined that the other users are not looking at the screen.

[0085] Taking vehicles as an example, in practical applications, some passengers inside the vehicle may not be able to see the screen that the target passenger is looking at. For instance, the passenger sitting in the front passenger seat obviously cannot see the screen in the back seat.

[0086] Therefore, to reduce computational load, this application pre-determines which seats each in-vehicle screen can view, i.e., pre-determines the seats associated with each in-vehicle screen. After determining the screen the target passenger is viewing, based on the seats of other passengers in the vehicle and the seats associated with the screen viewed by the target passenger, other passengers besides the target passenger are identified from among the other passengers in the vehicle.

[0087] For example, a vehicle has two rows of seats, with a screen directly in front of the driver's seat and the front passenger seat. If the target passenger is the passenger in the front passenger seat, the screen they are looking at is the screen directly in front of the front passenger seat. The other passengers associated with that screen, besides the target passenger, can include the passenger in the driver's seat, the passenger in the left seat of the second row, and the passenger in the middle seat of the second row. If there is a passenger in the driver's seat and a passenger in the left seat of the second row, then the other passengers in the vehicle are the other passengers associated with the screen besides the target passenger.

[0088] Alternatively, the location information of each in-vehicle screen can be pre-stored, and the location information of other passengers in the vehicle can be matched with the location information of the in-vehicle screen to identify other passengers besides the target passenger among those associated with the screen being viewed by the target passenger.

[0089] After identifying the passengers associated with the screen other than the target passenger, it is possible to determine the gaze angle of the other passengers toward the screen that the target passenger is looking at. Based on the gaze angle of the other passengers, it can be determined whether the other passengers associated with the screen are looking at the screen.

[0090] Step 104: Display the screen image of the intelligent robot in the first display area of ​​the screen when other users are not looking at the screen.

[0091] In this application, it is possible to determine whether other users within the target space are looking at the screen being looked at by the target user. If other users are not looking at the screen being looked at by the target user, then the screen image can be displayed in the first display area of ​​the screen. The first display area of ​​the screen can refer to an area with high user attention or an area with the best viewing effect, such as the central area of ​​the screen.

[0092] If there are multiple other users in the target space, it can be determined whether each other user is looking at the screen. If none of the other users are looking at the screen, the screen image can be displayed in the first display area of ​​the screen.

[0093] Taking the target space as the space inside the vehicle as an example, the target passenger is located in the right seat of the second row of the vehicle, and the screen that the target passenger is looking at is the screen of the second row. Other passengers in the vehicle include the passenger in the driver's seat and the passenger in the front passenger seat. Since the front passenger cannot look at the screen in the rear row, the screen image can be displayed in the first display area of ​​the screen that the target passenger is looking at.

[0094] Step 105: Display the screen image in the second display area of ​​the screen while other users are looking at the screen.

[0095] In this application, if other users within the target space are looking at the screen, to avoid affecting other users viewing the screen, a screen image of the target size can be displayed in the second display area of ​​the screen. The attention span of the second display area is less than that of the first display area.

[0096] For example, the second display area could be an edge area of ​​the screen where users pay less attention. If other users are looking at the screen, the image of the intelligent robot can be displayed as a small window floating in the edge area of ​​the screen, which can avoid obscuring the content displayed in the first display area.

[0097] If there are multiple other users, it can be determined whether each other user is looking at the screen that the target user is looking at. If one other user is looking at the screen, the screen image can be displayed in the second display area of ​​the screen.

[0098] In this embodiment, the following steps are taken: First, acquire a voice signal within a target space. If the text corresponding to the voice signal matches a preset wake-up text, determine the screen the target user is looking at. Then, determine the viewing status of other users within the target space. If other users are not viewing the screen, display the screen image of the intelligent robot in a first display area of ​​the screen. If other users are viewing the screen, display the screen image in a second display area of ​​the screen, where the attention level of the second display area is lower than that of the first display area. Therefore, when a user wakes up the intelligent robot, by determining the screen the user is looking at and displaying the screen image of the intelligent robot in display areas with different levels of attention based on whether other users within the target space are viewing the screen, the impact of displaying the intelligent robot's screen image on other users' screen usage can be reduced.

[0099] Figure 2 This is a flowchart illustrating another method for displaying an image of an intelligent robot on a screen, as provided in an embodiment of this application.

[0100] like Figure 2 As shown, the display method of the intelligent robot's screen includes:

[0101] Step 201: Obtain the voice signal inside the vehicle.

[0102] Step 202: If the text corresponding to the voice signal matches the preset wake-up text, determine the screen that the target passenger to which the voice signal belongs is looking at.

[0103] Step 203: Determine the viewing status of other users on the screen within the target space.

[0104] In this application, steps 201-203 are similar to those described in the above embodiments, so they will not be repeated here.

[0105] Step 204: Display a screen image of a preset size in the first display area of ​​the screen when other passengers are not looking at the screen.

[0106] In this application, it is possible to determine whether other passengers in the target space are looking at the screen being looked at by the target user. If other users are not looking at the screen being looked at by the target passenger, then a screen image of a preset size can be displayed in the first display area of ​​the screen. The first display area of ​​the target screen can refer to an area with high user attention or an area with the best viewing effect, such as the central area of ​​the screen; the preset size can match the size of the first display area.

[0107] If there are multiple other passengers in the user's group, it can be determined whether each other user is looking at the screen. If none of the other users are looking at the screen, a screen image of a preset size can be displayed in the first display area of ​​the screen.

[0108] Taking the target space as the space inside the vehicle as an example, the target passenger is located in the right seat of the second row of the vehicle, and the screen that the target passenger is looking at is the screen of the second row. Other passengers in the vehicle include the passenger in the driver's seat and the passenger in the front passenger seat. Since the front passenger cannot look at the screen in the rear row, a screen image of a preset size can be displayed in the first display area of ​​the screen that the target passenger is looking at.

[0109] Furthermore, if it is determined whether other passengers (excluding the target passenger) are looking at the screen being viewed by the target passenger, then the image of the vehicle's intelligent robot can be displayed on the screen being viewed by the target passenger, based on the viewing behavior of these other passengers. If none of the other passengers are looking at the screen being viewed by the target passenger, then a screen image of a preset size can be displayed in the first display area of ​​the screen.

[0110] Step 205: While other passengers are looking at the screen, display a screen image of the target size in the second display area of ​​the screen.

[0111] Taking the space inside a vehicle as an example, in this application, if other passengers in the vehicle are looking at the screen, in order to avoid affecting other passengers who are watching the screen, a screen image of the target size can be displayed in the second display area of ​​the screen. The attention given to the second display area is less than that given to the first display area, and the target size is smaller than a preset size.

[0112] For example, the second display area could be an edge area of ​​the screen where users pay less attention. If other passengers are looking at the screen, the image of the in-vehicle intelligent robot can be displayed as a small window floating in the edge area of ​​the screen, which can avoid obscuring the content displayed in the first display area.

[0113] If there are multiple other passengers, it can be determined whether each other passenger is looking at the screen that the target passenger is looking at. If one other passenger is looking at the screen, the target size screen image can be displayed in the second display area of ​​the screen.

[0114] In this application, if other passengers are watching the screen, a screen image of the in-vehicle intelligent robot of the target size can be displayed in the second display area of ​​the screen to provide interaction with the target passenger in a smaller form, so as to avoid disturbing other passengers who are looking at the screen.

[0115] In this embodiment, a screen image of a preset size is displayed in the second display area of ​​the screen when other passengers are not looking at the screen; and a screen image of a target size is displayed in the second display area of ​​the screen when other passengers are looking at the screen. Therefore, by displaying different sizes of the intelligent robot's screen image in different attention areas of the screen according to whether other passengers in the vehicle are watching the screen, it is possible to avoid disturbing other passengers when the intelligent robot's screen image is displayed on the screen.

[0116] In practical applications, multiple passengers in a vehicle may simultaneously or at short intervals wake up the in-vehicle intelligent robot. To ensure the service quality of the in-vehicle intelligent robot, in one embodiment of this application, before determining the screen viewing status of other users in the target space, it can be determined whether other users have a need to use the intelligent robot.

[0117] In this application, it is first determined whether other users in the target space have activated the intelligent robot before the target user does. If it is determined that other users have not activated the intelligent robot, it means that other users do not have a need for using the intelligent robot, and the intelligent robot only serves the target user. Then, the viewing behavior of other users in the target space is determined to ascertain whether other users have a need for using the screen. If it is determined that other users activated the intelligent robot before the target user, then the screen image of the intelligent robot can be displayed on that screen.

[0118] In this embodiment, before determining the screen gaze of other users in the target space, it is first determined that other users have not woken up the intelligent robot, thereby ensuring that the intelligent robot serves only one user and improving service quality.

[0119] With the advancement of automotive technology, screens are increasingly used in cars, and multiple screens can be installed in vehicles to meet demand. In related technologies, for vehicles equipped with in-vehicle intelligent robots, when a passenger activates the robot, its image may be displayed on multiple screens simultaneously, while the passenger may only need to interact with one screen. Therefore, in one embodiment of this application, if multiple screens are provided in the target space, a method can be adopted... Figure 3 The method shown determines the screen that the target user is looking at. Figure 3 This is a flowchart illustrating another method for displaying an image of an intelligent robot on a screen, as provided in an embodiment of this application.

[0120] like Figure 3 As shown, the display method of the intelligent robot's screen includes:

[0121] Step 301: Acquire the speech signal within the target space.

[0122] In this application, step 301 is similar to the content described in the above embodiments, so it will not be repeated here.

[0123] Step 302: If the text corresponding to the voice signal matches the preset wake-up text, determine the location information of the target user to whom the voice signal belongs.

[0124] Taking the target space as the space inside the vehicle as an example, in this application, the acquired voice signal can be recognized to obtain the corresponding text, and the text corresponding to the voice signal can be matched with the preset wake-up text. If the text corresponding to the voice signal matches the preset wake-up text, it means that the passenger who issued the voice signal is waking up the vehicle-mounted intelligent robot, and then the location information of the target passenger to which the voice signal belongs can be determined.

[0125] The target passenger's location information can be their coordinates within the vehicle, or the position of their seat. For example, if the passenger in the front passenger seat wakes up the in-vehicle intelligent robot via voice, then that passenger's location information would be the front passenger's seat.

[0126] In this application, multiple cameras can be installed inside the vehicle. By analyzing the images captured by the in-vehicle cameras, the passenger who emitted the voice signal and their location information can be determined. Alternatively, a correspondence between each voice acquisition device in the vehicle and the seats can be pre-established. After acquiring the voice signal, the voice acquisition device that acquired the voice signal, i.e., the target voice acquisition device, can be identified. By querying the correspondence between each voice acquisition device and the seats in the vehicle based on the target voice acquisition device, the target seat corresponding to the target voice acquisition device can be determined. Then, based on the target seat, the location information of the target passenger can be determined.

[0127] For example, if the target seat is the front passenger seat, then the target passenger's location information is the front passenger seat.

[0128] Step 303: Determine the first gaze angle of the target user based on the detection data of the target detection device corresponding to the location information of the target user.

[0129] In this application, one or more detection devices may be installed within the target space to collect data on passengers within the target space, thereby determining the user's gaze angle based on the detection data. These detection devices may include cameras, eye-tracking devices, electromagnetic radar, etc.

[0130] Taking the space inside a vehicle as an example, if the detection device is a regular camera, the head images of the target passenger captured by the camera can be analyzed to determine the head rotation angle of the target passenger, i.e., the first gaze angle. The camera can capture images of passengers in one or more seats, which is related to the camera's field of view.

[0131] If the detection device is an eye-tracking detection device, one eye-tracking detection device can be installed in front of each seat. The infrared light array in the eye-tracking detection device can emit infrared rays to the passenger's eyes, and the camera in the eye-tracking detection device can capture the distribution of infrared lights on the eyes. Therefore, the infrared light distribution obtained by the target eye-tracking detection device at the target passenger's location information can be compared with the infrared light distribution when the eyes are looking at various angles at that location information to determine the target passenger's first gaze angle.

[0132] If the detection device is an electromagnetic wave radar, an electromagnetic wave radar can be installed in front of each seat. It can determine the current scattering cross section of the target passenger's head based on the first power of the electromagnetic wave emitted by the target electromagnetic wave corresponding to the target passenger's position information and the second power of the received reflected electromagnetic wave. Based on the current scattering cross section of the target passenger's head, it is compared with the scattering cross section of the target passenger at each angle at the position information obtained in advance to determine the angle corresponding to the current scattering cross section of the target passenger's head, that is, the first gaze angle.

[0133] Step 304: Match the first gaze angle with the first preset angle corresponding to each screen.

[0134] In this application, based on the target user's location information, a first preset angle corresponding to each in-vehicle screen can be obtained in advance. The target user's first gaze angle is then matched with the first preset angle corresponding to each screen. For example, the difference between the first gaze angle and the first preset angle can be calculated, and the matching degree can be determined based on the difference. The larger the difference, the smaller the matching degree. Here, the first preset angle corresponding to each screen can refer to the gaze angle when the target user views each screen from the location information.

[0135] For example, if a vehicle has three seats in the second row, with a screen in front of the driver and front passenger, and the second row sharing a single screen, then each seat in the second row can view all three screens, resulting in a first preset angle for each screen on each seat. If the middle passenger in the second row activates the in-vehicle intelligent robot, their head posture angle can be matched with the first preset angle for each screen on the middle seat. Similarly, if the passenger on the left seat in the second row activates the robot, their head posture angle can be matched with the first preset angle for each screen on the left seat.

[0136] In this application, if the detection device is a telephoto camera with an extremely narrow field of view and extremely high pixel count, such a camera can be set in front of each seat. The pupil image captured by the camera corresponding to the target passenger is compared with the appearance image of each in-vehicle screen that has been acquired in advance to determine the screen that the target passenger is looking at.

[0137] Step 305: If the first gaze angle matches the first preset angle corresponding to any screen, determine any screen as the screen that the target user is gazing at.

[0138] In this application, the first preset angle can be an angle range. If the first gaze angle is within the angle range corresponding to any screen, then that screen can be considered as the screen being gazed at by the target user.

[0139] Step 306: Determine the viewing status of other passengers in the target space regarding the screen.

[0140] Step 307: Display the screen image of the intelligent robot in the first display area of ​​the screen when other users are not looking at the screen.

[0141] Step 308: Display the screen image in the second display area of ​​the screen while other users are looking at the screen.

[0142] In this application, steps 306-308 are similar to those described in the above embodiments, so they will not be repeated here.

[0143] In this embodiment of the application, if multiple screens are set in the target space, when determining the screen to which the voice signal belongs and which the target user is looking, the target user's gaze angle is determined by the detection data of the target detection device corresponding to the target user's location information. Based on the matching of the target user's gaze angle with the first preset angle corresponding to each vehicle screen, the screen to which the target user is looking is determined, and the screen image of the intelligent robot is displayed on the screen to which the target user is looking. This avoids displaying the screen image of the intelligent robot on multiple screens at the same time, reducing the impact on the screen use of other users.

[0144] In practical applications, if the detection device within the target space remains constantly on, power consumption will be high, and it will also occupy a significant amount of storage space. To save power and storage space, in one embodiment of this application, a method can be adopted... Figure 4 As shown, Figure 4 This is a flowchart illustrating another method for displaying an image of an intelligent robot on a screen, as provided in an embodiment of this application.

[0145] like Figure 4 As shown, the display method of the intelligent robot's screen includes:

[0146] Step 401: Acquire the speech signal within the target space.

[0147] Step 402: If the text corresponding to the voice signal matches the preset wake-up text, determine the location information of the target user to whom the voice signal belongs.

[0148] In this application, steps 401-402 are similar to those described in the above embodiments, so they will not be repeated here.

[0149] Step 403: Based on the location information of each detection device in the target space, determine the target detection device corresponding to the location information of the target user.

[0150] Taking the target space as the space inside a vehicle as an example, in this application, the position information of each detection device inside the vehicle can be obtained in advance. This position information can be the relative position information between each detection device and other equipment inside the vehicle, or it can be coordinate information within the vehicle, etc.

[0151] As one possible approach, after determining the location information of the target user, the location information of the target user can be matched with the location information of each detection device, and the detection device closest to the target user can be identified as the target detection device.

[0152] For example, if the target space is the space inside a vehicle, as another possible implementation method, the correspondence between the seats inside the vehicle and the camera device can be established in advance. After determining the seat where the target user is located, the correspondence between the seat and the detection device can be found based on the seat where the target user is located, and the detection device corresponding to the seat where the target user is located, that is, the target detection device, can be determined.

[0153] For example, a detection device can be pre-installed for each seat in the vehicle. When a user in a seat wakes up the in-vehicle intelligent robot, the camera corresponding to that seat can be identified as the target for detection.

[0154] Step 404: Control the target detection device to turn on in order to obtain the detection data of the target detection device.

[0155] After the target detection device is identified, it is activated to collect data from the target user. Then, when it is determined that a user is waking up the intelligent robot, the corresponding detection device is activated again.

[0156] Step 405: Determine the first gaze angle of the target user based on the detection data of the target detection device corresponding to the location information of the target user.

[0157] Step 406: Match the first gaze angle with the first preset angle corresponding to each in-vehicle screen.

[0158] Step 407: If the first gaze angle matches the first preset angle corresponding to any screen, determine that any screen is the screen being gazed at by the target user.

[0159] Step 408: Determine the viewing status of other users on the screen within the target space.

[0160] Step 409: Display the screen image of the intelligent robot in the first display area of ​​the screen when other users are not looking at the screen.

[0161] Step 410: Display the screen image in the second display area of ​​the screen while other users are looking at the screen.

[0162] In this application, steps 405-410 are similar to those described in the above embodiments, so they will not be repeated here.

[0163] In this application, after the intelligent robot's screen image is displayed on the screen for a preset time, the target detection device can be turned off until a user wakes up the intelligent robot at the target user's location information, thereby avoiding the target detection device from being constantly turned on.

[0164] In this embodiment, before determining the first gaze angle of the target user based on the detection data of the target detection device corresponding to the target user's location information, the target detection device corresponding to the target user's location information can be determined based on the location information of each detection device in the vehicle, and the target detection device can be controlled to turn on to obtain the detection data of the target detection device. Therefore, when a user wakes up the intelligent robot, the corresponding detection device is turned on based on the user's location, thus avoiding the detection device being constantly on, saving power and storage space.

[0165] In one embodiment of this application, when determining the gaze of other users on the screen within the target space, the second gaze angle of other users can also be determined based on the detection data of the detection device corresponding to the location information of other users. This is similar to the method of determining the first gaze angle of the target user based on the detection data of the target detection device, and therefore will not be described in detail.

[0166] After determining the second gaze angle, the matching degree between the second gaze angle and the corresponding second preset angle on the screen can be used to determine the gaze status of other users on the screen. The corresponding second preset angle refers to the gaze angle when other users view the screen from their location information. If the matching degree between another user's second gaze angle and the corresponding second preset angle on the screen is greater than a threshold, it can be assumed that the other user is also gazing at the screen being viewed by the target passenger; if the matching degree is less than or equal to the threshold, it can be assumed that the other user is not gazing at the screen being viewed by the target passenger.

[0167] In practical applications, other passengers within the target space may not be able to see the screen being viewed by the target passenger. In this application, for passengers within the target space who cannot view the target passenger's screen, the second preset angle corresponding to the screen can be set to empty. For example, if the target user is viewing the screen in the second row of the vehicle, since the driver cannot view the screen in the second row, the viewing angle from the driver's position can be set to empty, that is, the second preset angle corresponding to the screen is empty.

[0168] In this embodiment, the gaze angle of other users can be determined by the detection data of the detection device corresponding to the location information of other users. Based on the matching degree between the gaze angle of other users and the second preset angle corresponding to the screen, it can be determined whether other users are looking at the screen being looked at by the target user, thus improving accuracy.

[0169] To further illustrate the above embodiments, the following example uses a camera as the detection device and the space inside a vehicle as the target space. Figure 5 To explain, Figure 5 This is a schematic diagram of the interior of a vehicle provided in an embodiment of this application.

[0170] like Figure 5 As shown, the vehicle has four seats: seat 1, seat 2, seat 3, and seat 4. Each seat has a microphone nearby. There is a screen 1 in front of seat 1, a screen 2 in front of seat 2, and a screen 3 in front of seats 3 and 4. Each seat has a corresponding camera, and both seats 1 and 2 are within the field of view of that camera. Each seat also has a corresponding camera, and both seats 3 and 4 are within the field of view of that camera.

[0171] Suppose that the passenger in seat 3 issues a wake-up voice. The sound wave of the wake-up voice will be first collected by the microphone closest to the passenger. The voice signal collected by the microphone will be identified, and the passenger will be determined to be waking up the vehicle's intelligent robot based on the identification result.

[0172] When a passenger in a particular seat wakes up the in-vehicle intelligent robot, the vehicle's infotainment system can determine the location of the passenger from the microphone position and activate the corresponding camera to capture head rotation. If the passenger is determined to be in seat 1 or seat 2, camera 1 is activated; if the passenger is determined to be in seat 3 or seat 4, camera 2 is activated.

[0173] In practical applications, the wake-up voice issued by the passenger in seat 3 may be collected by all the microphones in the vehicle. The microphone closest to the passenger will collect the strongest voice signal. The location of the passenger can be determined based on the location of the microphone with the strongest voice signal, and then the corresponding camera 2 can be activated.

[0174] When installing cameras inside a vehicle, if there are two rows of seats, at least two cameras, one in front and one behind, should be installed to avoid obstruction. At the same time, the field of view of a single camera must be able to cover the head movement area of ​​the people above the two seats it corresponds to.

[0175] Once activated, camera 3 continuously captures images of the heads of passengers on seats 3 and 4, transmitting them to the vehicle's infotainment system. The system calculates the passenger's gaze angle on seat 3, including head pitch and horizontal rotation. After obtaining the gaze angle, the direction the head is pointing can be determined. Then, a ray is drawn from the head as the origin, pointing in that direction. The screen along the ray's path is the screen the passenger is viewing. Thus, screen 3 is identified from the three screens as the one the passenger on seat 3 is looking at.

[0176] Similarly, for passengers associated with screen 3 other than those in seat 3, such as the passenger in seat 4, the vehicle system will activate the microphone next to seat 4 to collect their voice recordings. The system will then recognize the collected voice signals and determine if the text corresponding to the voice signal of the passenger in seat 4 matches a preset wake-up text. This will determine if the passenger in seat 4 has a need for the in-vehicle intelligent robot. If the text corresponding to the voice signal of the passenger in seat 4 does not match the preset wake-up text, it means that the passenger in seat 4 does not need the in-vehicle intelligent robot, and it can be assumed that the in-vehicle intelligent robot only serves the passenger in seat 3.

[0177] After determining whether the passenger in seat 4 has a need to use the in-vehicle intelligent robot, it is necessary to assess whether they still require interaction with screen 3. This assessment can be made by analyzing the image captured by camera 3 to determine the passenger's viewing angle. Based on this angle, it can be determined whether the passenger in seat 4 is looking at the screen. If the passenger is looking at screen 3, the primary display area of ​​screen 3 should be kept as unobstructed as possible, allowing for interaction with a small portion of the screen. If the passenger is not looking at screen 3, the image of the in-vehicle intelligent robot can be displayed in the primary display area of ​​screen 3.

[0178] To achieve the above embodiments, this application also provides a structural schematic diagram of a display device for an image of an intelligent robot screen. Figure 6 This is a schematic diagram of the structure of a display device for an intelligent robot screen image provided in an embodiment of this application.

[0179] like Figure 6 As shown, the display device 600 for the intelligent robot's screen image includes:

[0180] Acquisition module 610 is used to acquire speech signals within the target space;

[0181] The first determining module 620 is used to determine the screen to which the target user of the voice signal is looking when the text corresponding to the voice signal matches the preset wake-up text.

[0182] The second determining module 630 is used to determine the viewing status of other users in the target space on the screen, wherein other users refer to users in the target space other than the target user;

[0183] The display module 640 is used to display the image of the intelligent robot in a first display area of ​​the screen when other users are not looking at the screen; and to display the image in a second display area of ​​the screen when other users are looking at the screen, wherein the attention of the second display area is less than that of the first display area.

[0184] In one possible implementation of this application embodiment, the device may further include:

[0185] The third determination module is used to determine whether other users have woken up the intelligent robot.

[0186] In one possible implementation of this application embodiment, multiple screens are provided within the target space, and the first determining module 620 includes:

[0187] The first determining unit is used to determine the location information of the target user;

[0188] The second determining unit is used to determine the first gaze angle of the target user based on the detection data of the target detection device corresponding to the location information of the target user;

[0189] A matching unit is used to match a first gaze angle with a first preset angle corresponding to each screen; wherein each first preset angle refers to the gaze angle when viewing each screen at the target user's location information;

[0190] The third determining unit is used to determine any screen as the screen being gazed at by the target user when the first gaze angle matches a first preset angle corresponding to any screen.

[0191] In one possible implementation of this application embodiment, the first determining module 620 further includes:

[0192] The fourth determining unit is used to determine the target detection device corresponding to the target user's location information based on the location information of each detection device in the target space.

[0193] The control unit is used to control the target detection device to turn on in order to obtain the detection data of the target detection device.

[0194] In one possible implementation of this application embodiment, the display module 640 is configured to display a screen image of a preset size in a first display area of ​​the screen when other users are not looking at the screen; and to display a screen image of a target size in a second display area of ​​the screen when other users are looking at the screen, wherein the target size is smaller than the preset size.

[0195] In one possible implementation of this application embodiment, the first determining unit is configured to:

[0196] Based on the correspondence between each voice acquisition device in the target space and the seats in the target space, and the target voice acquisition device corresponding to the voice signal, the target seat corresponding to the target voice acquisition device is determined.

[0197] Based on the target seat, determine the location information of the target user.

[0198] In one possible implementation of this application embodiment, the second determining module 630 is used for:

[0199] Determine the second gaze angle of other users based on the detection data from the detection device that corresponds to the location information of other users.

[0200] The gaze of other users on the screen is determined based on the matching degree between the second gaze angle and the second preset angle corresponding to the screen; wherein, the second preset angle corresponding to the screen refers to the gaze angle when other users view the screen from their location information.

[0201] It should be noted that the above explanation of the method for displaying the image of an intelligent robot on a screen also applies to the display device for the image of an intelligent robot on a screen in this embodiment, and therefore will not be repeated here.

[0202] In this embodiment, the following steps are taken: First, acquire a voice signal within a target space. If the text corresponding to the voice signal matches a preset wake-up text, determine the screen the target user is looking at. Then, determine the viewing status of other users within the target space. If other users are not looking at the screen, display the screen image of the intelligent robot in a first display area of ​​the screen. If other users are looking at the screen, display the screen image in a second display area of ​​the screen, where the attention level of the second display area is less than that of the first display area. Therefore, when a user wakes up the intelligent robot, by determining the screen the user is looking at and displaying the screen image of the intelligent robot in display areas with different levels of attention based on whether other users within the target space are looking at the screen, the impact of displaying the intelligent robot's screen image on other users' screen usage can be reduced.

[0203] Figure 7 A block diagram of a computer device for displaying the image of an intelligent robot on a screen, as provided in an embodiment of this application.

[0204] like Figure 7 As shown, the computer device 700 includes:

[0205] The system includes a memory 710 and a processor 720, and a bus 730 connecting different components (including the memory 710 and the processor 720). The memory 710 stores a computer program, and when the processor 720 executes the program, it implements the method for displaying the intelligent robot screen image as described in the embodiments of this application.

[0206] Bus 730 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. Examples of these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0207] Computer device 700 typically includes a variety of computer device readable media. These media can be any available media that can be accessed by computer device 700, including volatile and non-volatile media, removable and non-removable media.

[0208] The memory 710 may also include computer system readable media in the form of volatile memory, such as random access memory (RAM) 740 and / or cache memory 750. The computer device 700 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 760 can be used to read and write non-removable, non-volatile magnetic media (…). Figure 7 Not shown; usually referred to as a "hard drive"). Although Figure 7 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 730 via one or more data media interfaces. Memory 710 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of this application.

[0209] A program / utility 780 having a set (at least one) of program modules 770 may be stored, for example, in memory 710. Such program modules 770 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 770 typically perform the functions and / or methods described in the embodiments of this application.

[0210] Computer device 700 can also communicate with one or more external devices 790 (e.g., keyboard, pointing device, display 791, etc.), and with one or more devices that enable a user to interact with computer device 700, and / or with any device that enables computer device 700 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed via input / output (I / O) interface 792. Furthermore, computer device 700 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 793. As shown, network adapter 793 communicates with other modules of computer device 700 via bus 730. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with computer device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0211] The processor 720 executes various functional applications and data processing by running programs stored in the memory 710.

[0212] It should be noted that the implementation process and technical principles of the computer device in this embodiment are explained in the foregoing description of the display method of the intelligent robot screen image in the embodiments of this application, and will not be repeated here.

[0213] To implement the above embodiments, this application also proposes a computer device, including a processor and a memory;

[0214] The processor reads executable program code stored in memory to run a program corresponding to the executable program code, so as to implement the method for displaying the intelligent robot screen image as described in the above embodiments.

[0215] To implement the above embodiments, this application also proposes a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the method for displaying the intelligent robot screen image as described in the above embodiments.

[0216] To implement the above embodiments, this application also proposes a computer program product, including a computer program, wherein when the computer program is executed by a processor, it displays the steps of the intelligent robot screen image method described in the above embodiments.

[0217] In the description of this specification, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "multiple" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0218] Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of this application.

Claims

1. A method for displaying the image of an intelligent robot on a screen, characterized in that, include: Acquire speech signals within the target space; If the text corresponding to the voice signal matches the preset wake-up text, determine the screen that the target user is looking at; Determine the gaze status of other users in the target space towards the screen, wherein the other users refer to users in the target space other than the target user; When other users are not looking at the screen, the screen image of the intelligent robot is displayed in the first display area of ​​the screen; When other users are looking at the screen, the screen image is displayed in a second display area of ​​the screen, wherein the attention level of the second display area is less than that of the first display area.

2. The method as described in claim 1, characterized in that, The display of the intelligent robot's image on the first display area of ​​the screen includes: A screen image of a preset size is displayed in the first display area of ​​the screen; Displaying the screen image in the second display area of ​​the screen includes: A screen image of a target size is displayed in the second display area of ​​the screen, wherein the target size is smaller than the preset size.

3. The method as described in claim 1, characterized in that, Before determining the gaze of other users on the screen within the target space, the method further includes: It was determined that the other users did not wake up the intelligent robot.

4. The method as described in claim 1, characterized in that, The target space is provided with multiple screens, and the process of determining the screen to which the voice signal belongs and which the target user is looking includes: Determine the location information of the target user; The first gaze angle of the target user is determined based on the detection data of the target detection device corresponding to the location information of the target user; The first gaze angle is matched with a first preset angle corresponding to each of the screens; wherein each of the first preset angles refers to the gaze angle when viewing each of the screens at the target user's location information; If the first gaze angle matches a first preset angle corresponding to any screen, then the screen is determined to be the screen being gazed at by the target user.

5. The method as described in claim 4, characterized in that, Before determining the first gaze angle of the target user based on the detection data from the target detection device corresponding to the location information of the target user, the method further includes: Based on the location information of each detection device within the target space, determine the target detection device corresponding to the location information of the target user; The target detection device is turned on to obtain the detection data of the target detection device.

6. The method as described in claim 4, characterized in that, Determining the location information of the target user includes: Based on the correspondence between each voice acquisition device in the target space and the seats in the target space, and the target voice acquisition device corresponding to the voice signal, the target seat corresponding to the target voice acquisition device is determined; Based on the target seat, determine the location information of the target user.

7. The method as described in claim 1, characterized in that, Determining the gaze of other users on the screen within the target space includes: The second gaze angle of the other user is determined based on the detection data from the detection device corresponding to the location information of the other user; The gaze of other users on the screen is determined based on the matching degree between the second gaze angle and the second preset angle corresponding to the screen; wherein, the second preset angle corresponding to the screen refers to the gaze angle when the other user views the screen from the location information of the other user.

8. A display device for an intelligent robot screen image, characterized in that, include: The acquisition module is used to acquire speech signals within the target space; The first determining module is used to determine the screen to which the target user is looking when the text corresponding to the voice signal matches a preset wake-up text. The second determining module is used to determine the gaze status of other users in the target space towards the screen, wherein the other users refer to users in the target space other than the target user; The display module is configured to display the image of the intelligent robot in a first display area of ​​the screen when other users are not looking at the screen, and to display the image in a second display area of ​​the screen when other users are looking at the screen, wherein the attention level of the second display area is less than that of the first display area.

9. A computer device, characterized in that, Including processor and memory; The processor reads executable program code stored in the memory to run a program corresponding to the executable program code, so as to implement the method as described in any one of claims 1-7.

10. A vehicle, characterized in that, include: The computer device as described in claim 9.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-7.

12. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the steps of the method according to any one of claims 1-7.

Images