In-vehicle communication method based on directional sound production equipment, directional sound production equipment and system

Abstract

The invention relates to the technical field of telecommunication, and discloses an in-vehicle communication method based on a directional sound production device, the directional sound production device and a system, and the method comprises the steps: collecting environment information in a coverage area in response to a call request initiated by a second directional sound production device; determining a user behavior and a user position of at least one user in the coverage area based on the environment information; generating prompt information of the call request according to the user behavior; and in response to a connection instruction of the user, directionally outputting call content to the position of the user through the first directional sound production equipment. The method has the beneficial effect that the communication efficiency of users in the vehicle is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of electric communication technology, in particular to an in-vehicle communication method based on a directional sound emitting device, a directional sound emitting device and a system. BACKGROUND

[0002] With the continuous development of the automotive industry, the in-vehicle space is increasing. However, in a 7-seater or more vehicle, due to the long distance between the front and rear rows, it is difficult for the in-vehicle personnel to communicate effectively. The in-vehicle entertainment system brings rich intelligent experience to users. However, the entertainment needs of each person in the vehicle are different, some people like to sleep, some people prefer to listen to music, and some people like to watch videos. In the same in-vehicle space, the sound of each person may interfere with others, and the privacy is poor. Therefore, how to reduce the interference of each user in the vehicle during entertainment and improve the communication efficiency of the in-vehicle user has become a problem to be solved. SUMMARY

[0003] The present application provides an in-vehicle communication method based on a directional sound emitting device, a directional sound emitting device and a system, which solves the technical problem that users in different seats in the vehicle cannot communicate, and achieves the technical effect of improving the communication efficiency of the in-vehicle user.

[0004] In order to achieve the above purpose, the main technical scheme adopted by the present application comprises: In a first aspect, the present application provides an in-vehicle communication method based on a directional sound emitting device, the directional sound emitting device corresponding to a coverage area where at least one seat is located, applied to a first directional sound emitting device, the method comprising: In response to a call request initiated by a second directional sound emitting device, collecting environmental information in the coverage area; Based on the environmental information, determining the user behavior and user position of at least one user in the coverage area; According to the user behavior, generating prompt information of the call request; In response to a user's on instruction, the first directional sound emitting device is used to output call content to the user position.

[0005] In this embodiment, by collecting environmental information when the call request is obtained, and determining the user behavior and user position accordingly, and then generating prompt information according to the user behavior and outputting call content according to the user position, the flexibility of in-vehicle communication is improved, the privacy of communication is improved, and the communication efficiency is improved.

[0006] In an example, if there is one user in the coverage area, generating prompt information of the call request according to the user behavior comprises any of the following: if the user behavior indicates that the user is looking at a screen of the first directional sound emitting device, displaying prompt information of the call request on the screen; if the user behavior indicates that the user is looking at a place other than the screen of the first directional sound emitting device, generating voice prompt information of the call request and outputting the voice prompt information to the user location by the first directional sound emitting device; if the user behavior indicates that the user is in a sleep state, displaying prompt information of the call request on the screen of the first directional sound emitting device and feeding back sleep state confirmation information to the second directional sound emitting device; the sleep state confirmation information indicates whether the second directional sound emitting device needs to generate voice prompt information of the call request.

[0007] Exemplarily, by means of taking targeted prompting according to different user behaviors, the efficiency of prompting the call request is improved, and the effect of improving user experience is realized.

[0008] In an example, if there are multiple users in the coverage area, before generating the prompt information of the call request according to the user behavior, the method further comprises: generating call object confirmation information according to the user behavior of multiple users; the call object confirmation information includes identification information of a user who is not in a sleep state; feeding back the call object confirmation information to the second directional sound emitting device, so that the second directional sound emitting device displays the identification information of multiple users and feeds back a first selection instruction; the first selection instruction is used to indicate at least one user participating in the call.

[0009] Exemplarily, by means of generating call object confirmation information when multiple users are detected and sending the call object confirmation information to the second directional sound emitting device to obtain the first selection instruction fed back by the second directional sound emitting device, the effect of accurately determining the user participating in the call is realized, the flexibility of the call is improved, and the user experience is improved.

[0010] In an example, the method comprises: displaying the seat corresponding to the first directional sound emitting device and obtaining a second selection instruction; the second selection instruction is used to indicate a new seat of a new user participating in the call which needs to be added; generating a first increase request based on the second selection instruction; sending the first increase request to the second directional sound emitting device; the first increase request contains identification information of the new user and is used to indicate whether the second directional sound emitting device agrees to add the new user to the call; If the second directional sound emitting device feedback information indicates that the new user is allowed to join the call, the directional sound emitting device outputs the call content to the new user.

[0011] Exemplarily, by generating the second selection instruction for selecting the new user, generating the first increase request sent to the second directional sound emitting device, and outputting the call content to the new user when the second directional sound emitting device feedback information indicates that the new user is allowed to join the call, the effect of flexibly adding the user to participate in the call is realized, the flexibility of the call is improved, and the user experience is improved.

[0012] In an example, the method comprises: If the first directional sound emitting device is in a call state with the second directional sound emitting device, the second increase request is generated in response to a call request initiated by the third directional sound emitting device; The second increase request is sent to the second directional sound emitting device, and the second increase request contains identification information of the third directional sound emitting device, which is used to indicate whether the second directional sound emitting device allows the third directional sound emitting device to join the call.

[0013] Exemplarily, when the first directional sound emitting device is in a call state with the second directional sound emitting device, if the third directional sound emitting device sends a call request to the first directional sound emitting device, the first directional sound emitting device can generate a second increase request and send the second increase request to the second directional sound emitting device, so that the second directional sound emitting device decides whether to allow the third directional sound emitting device to join the call, thereby realizing the effect of flexibly adjusting the directional sound emitting device participating in the call according to the call demand, and improving the user experience.

[0014] In an example, the method further comprises: When it is determined according to the environment information that there is no user in the coverage area, a no-one notification is fed back to the directional sound emitting device initiating the call request; wherein the no-one notification is used to prompt that there is no user in the coverage area.

[0015] Exemplarily, by feeding back the no-one notification to the second directional sound emitting device when it is determined that there is no user in the coverage area of the first directional sound emitting device, the effect of timely informing the second directional sound emitting device that there is no user in the coverage area of the first directional sound emitting device is realized, the waiting time of the user using the second directional sound emitting device to initiate the call is reduced, and the user experience is improved.

[0016] In an example, the method further comprises: According to the environment information, a noise optimization coefficient is determined. Based on the noise optimization coefficient, the call content output by the first directional sound device is optimized and adjusted.

[0017] For example, by determining a noise optimization coefficient based on environmental information and optimizing the output call content of the first directional sound-emitting device based on that coefficient, the clarity and audibility of the call content in complex environments can be improved.

[0018] Secondly, embodiments of this application provide a A vehicle-to-vehicle communication method based on a directional sound-emitting device, wherein the directional sound-emitting device corresponds to a coverage area where at least one seat is located, and is applied to a first directional sound-emitting device, the method comprising: The receiving module is used to collect environmental information within the coverage area in response to a call request initiated by the second directional sound-emitting device. The processing module is configured to determine the user behavior and user location of at least one user within the coverage area based on the environmental information; generate a prompt message for the call request based on the user behavior; and, in response to the user's call connection command, output the call content to the user's location via the first directional sound device.

[0019] In this embodiment, by collecting environmental information when a call request is received, determining user behavior and location based on this information, generating prompt information based on user behavior, and outputting call content in a targeted manner based on user location, the flexibility of in-vehicle calls, the privacy of calls, and the efficiency of communication can be improved.

[0020] In one example, if a user exists within the coverage area, the processing module is configured to: If the user behavior indicates that the user is looking at the screen of the first directional sound device, then a prompt message for the call request is displayed on the screen; If the user behavior indicates that the user is looking at a place outside the screen of the first directional sound device, then a voice prompt message for the call request is generated, and the voice prompt message is output to the user's location via the first directional sound device; If the user behavior indicates that the user is asleep, then a prompt message for the call request is displayed on the screen of the first directional sound device, and a sleep status confirmation message is sent back to the second directional sound device; the sleep status confirmation message indicates to the second directional sound device whether a voice prompt message for the call request needs to be generated.

[0021] For example, by providing targeted prompts based on different user behaviors, the efficiency of call request prompts can be improved, thereby enhancing the user experience.

[0022] In an example, if there are multiple users in the coverage area, the processing module is configured to: generate call object confirmation information according to the user behaviors of the multiple users; the call object confirmation information includes identification information of a user who is not in a sleeping state; feed back the call object confirmation information to the second directional sound emitting device, so that the second directional sound emitting device displays the identification information of the multiple users and feeds back a first selection instruction; the first selection instruction is used to indicate at least one user participating in the current call.

[0023] In an example, by generating the call object confirmation information when multiple users are detected and feeding back the call object confirmation information to the second directional sound emitting device, the first selection instruction fed back by the second directional sound emitting device is obtained, so that the effect of accurately determining the user participating in the current call is achieved, the flexibility of the call is improved, and the user experience is improved.

[0024] In an example, the processing module is configured to: display the seat corresponding to the first directional sound emitting device and obtain a second selection instruction; the second selection instruction is used to indicate a seat of a new user participating in the current call that needs to be added; generate a first addition request based on the second selection instruction, and send the first addition request to the second directional sound emitting device; the first addition request includes identification information of the new user and is used to indicate whether the second directional sound emitting device agrees to add the new user to the current call; if the feedback information of the second directional sound emitting device indicates that the new user is agreed to be added to the current call, the directional sound emitting device is used to directionally output call content to the multiple users in the coverage area.

[0025] In an example, by generating the second selection instruction for selecting the new user, generating the first addition request sent to the second directional sound emitting device, and directionally outputting the call content to the new user when the feedback information of the second directional sound emitting device indicates that the new user is agreed to be added, the effect of flexibly adding the user participating in the call is achieved, the flexibility of the call is improved, and the user experience is improved.

[0026] In an example, the processing module is configured to: if the first directional sound emitting device is in a call state with the second directional sound emitting device, the receiving module is configured to generate a second addition request in response to a call request initiated by a third directional sound emitting device; the processing module is configured to send the second addition request to the second directional sound emitting device; the second addition request includes identification information of the third directional sound emitting device and is used to indicate whether the second directional sound emitting device agrees to add the third directional sound emitting device to the current call.

[0027] Exemplarily, when the first directional sound emitting device and the second directional sound emitting device are in a call state, if the third directional sound emitting device sends a call request to the first directional sound emitting device, the first directional sound emitting device can generate a second increase request and send the second increase request to the second directional sound emitting device, so as to make the second directional sound emitting device decide whether to agree that the third directional sound emitting device joins the call, thereby achieving the effect of flexibly adjusting the directional sound emitting devices participating in the call according to the call demand and improving the user experience.

[0028] In an example, a processing module is configured to: when it is determined according to the environment information that there is no user in the coverage area, feeding back a no-user notification to the directional sound emitting device initiating the call request; wherein the no-user notification is used to prompt that there is no user in the coverage area.

[0029] Exemplarily, by feeding back the no-user notification to the second directional sound emitting device when it is determined that there is no user in the coverage area of the first directional sound emitting device, the effect of timely informing the second directional sound emitting device that there is no user in the coverage area of the first directional sound emitting device is achieved, the waiting time of the user using the second directional sound emitting device to initiate the call is reduced, and the user experience is improved.

[0030] In an example, a processing module is configured to: determining a noise optimization coefficient according to the environment information; optimizing and adjusting the call content output by the first directional sound emitting device based on the noise optimization coefficient.

[0031] Exemplarily, by determining the noise optimization coefficient according to the environment information and optimizing and adjusting the call content output by the first directional sound emitting device based on the coefficient, the effect of improving the intelligibility and audibility of the call content in a complex environment is achieved.

[0032] In a third aspect, an embodiment of the present application provides a directional sound emitting device, comprising a memory and a processor, which are in communication connection with each other, the memory stores computer instructions, and the processor executes the computer instructions to perform the method in any one of the above embodiments.

[0033] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, which stores computer instructions, and the computer instructions are used to make a computer execute the method in any one of the above embodiments.

[0034] In a fifth aspect, an embodiment of the present application provides a computer program product, comprising computer instructions for causing a computer to execute the method described in any of the above embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the specific embodiments or prior art of the present application, the drawings needed to be used in the description of the specific embodiments or prior art will be briefly introduced as follows. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort on the basis of these drawings.

[0036] Figure 1 A flow chart of a vehicle interior communication method based on a directional sound emitting device according to an embodiment of the present application is shown. Figure 2 A structural diagram of a vehicle interior communication system based on a directional sound emitting device according to an embodiment of the present application is shown. Figure 3 A structural diagram of a vehicle interior communication system based on a directional sound emitting device according to an embodiment of the present application is shown. Figure 4 A module diagram of a vehicle interior communication device based on a directional sound emitting device according to an embodiment of the present application is shown. Figure 5 A structural diagram of a directional sound emitting device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative effort fall within the scope of protection of the present application.

[0038] With the continuous development of the automotive industry, the vehicle interior space is increasing. However, in 7-seater and more vehicles, due to the long distance between the front and rear rows, it is difficult for the people in the vehicle to communicate effectively. The vehicle entertainment system brings rich intelligent experience to the user. However, the entertainment needs of each person in the vehicle are different. Some people like to sleep, some people prefer to listen to music, and some people like to watch videos. In the same vehicle interior space, the sound of each person may interfere with others, and the privacy is poor.

[0039] It can be seen that for three rows or more than three rows of cars, there are two main problems in the car: first, the distance between the in-car manager and the rear passengers is too far, and it is difficult to hear the voice of the other party, leading to communication difficulties; second, each person has different entertainment needs, and the unified speaker in the car will cause audio noise, and the traditional speaker plays too loudly, lacking privacy.

[0040] To solve the above problems, the application provides a method for avoiding mutual interference between different users using in-car directional sound emitting devices. Moreover, based on the in-car communication system composed of directional sound emitting devices, users can realize communication between different seats in the car, solving the problem of communication difficulties caused by long distance in the car. Therefore, by constructing an in-car communication system based on directional sound emitting devices, the application realizes the characteristics of accurate arrangement direction and high sound directivity, and is accompanied by video display function, which can effectively solve the problems of long distance, meet various audio and video needs and avoid mutual interference.

[0041] According to an embodiment of the application, an in-car communication method based on directional sound emitting devices is provided. It should be noted that the steps shown in the flowchart can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order from here.

[0042] In this embodiment, an in-car communication method based on directional sound emitting devices is provided, which can be used for the directional sound emitting devices described above. The directional sound emitting device can be a terminal device arranged in the interior of the vehicle. The directional sound emitting device can be arranged in front of the seat. Each directional sound emitting device can correspond to at least one seat. The user located on the seat can realize functional operation through the directional sound emitting device. The functional operation can include watching video, listening to audio, communicating with other directional sound emitting devices in the car, etc.

[0043] Figure 1 A flowchart of an in-car communication method based on directional sound emitting devices according to an embodiment of the application is shown in FIG. 1, which takes a first directional sound emitting device arranged in the car as the execution subject, and the flow includes the following steps: Figure 1 As shown in FIG. 1, the flowchart of the in-car communication method based on directional sound emitting devices according to an embodiment of the application is shown in FIG. 1, which takes a first directional sound emitting device arranged in the car as the execution subject, and the flow includes the following steps: S101, in response to a call request initiated by a second directional sound emitting device, collecting environmental information in the coverage area.

[0044] Exemplarily, after receiving the call request initiated by the second directional sound emitting device, the first directional sound emitting device immediately starts the environmental information collection process. The first directional sound emitting device can collect various types of environmental information in the coverage area of the first directional sound emitting device through the environmental information collection process.

[0045] In an implementation, the first directional sound emitting device and the second directional sound emitting device are any two directional sound emitting devices in the vehicle.

[0046] In an implementation, the directional sound emitting device is a device with a directional sound emitting function, which can output sound to a specific direction or area.

[0047] In an implementation, the coverage area refers to a preset range corresponding to the directional sound emitting device. The preset range is usually smaller than the spatial range in which the sound of the directional sound emitting device can be effectively transmitted and covered. Each directional sound emitting device can send sound to a user in the coverage area. The directional sound emitting device usually cannot send sound to a user outside the coverage area.

[0048] In an implementation, the environmental information at least includes image information or video information in the coverage area. Based on the image information or video information, the directional sound emitting device can analyze the user position and user behavior of the user in the coverage area.

[0049] Optionally, the environmental information can also include noise information. The directional sound emitting device can optimize the audio output based on the noise information, so that the user can hear clearer sound.

[0050] Optionally, when the directional sound emitting device includes a screen, the environmental information can also include information such as light intensity and reflection intensity. Based on the light intensity, reflection intensity, and the like, the directional sound emitting device can optimize the display brightness, sharpening degree, and the like of the screen, thereby optimizing the effect of the user watching the screen.

[0051] Optionally, the environmental information can also include information such as temperature and humidity. Based on the temperature, the vehicle master control can correspondingly adjust the air conditioning temperature, air outlet, and the like of the coverage area of the directional sound emitting device. Based on the humidity, the vehicle master control can perform dehumidification, humidification, and the like on the coverage area of the directional sound emitting device.

[0052] In an implementation, the directional sound emitting device can collect the environmental information based on a sensor arranged in the coverage area.

[0053] S103, determining the user behavior and the user position of at least one user in the coverage area based on the environmental information.

[0054] Exemplarily, the first directional sound emitting device can identify the environmental information of the coverage area through a preset identification algorithm after obtaining the environmental information, determine the user position of the user existing in the coverage area. At the same time, the first directional sound emitting device can also determine the user behavior of the user in the coverage area by identifying the action of the user.

[0055] In an implementation, the environmental information used in this step can include image information, video information, laser radar information, etc. of the coverage area.

[0056] In an implementation, the user behavior can include looking at the screen of the first directional sound emitting device, looking at a place other than the screen of the first directional sound emitting device, sleeping, etc.

[0057] In an implementation, the user position can be a three-dimensional coordinate of the user in the coverage area. Alternatively, the user position can specifically be the position of the head of the user. Alternatively, the user position can also be the position where the ear of the user is located.

[0058] In an implementation, the first directional sound emitting device can identify the user in the coverage area through the environmental information by using a target recognition algorithm of computer vision, and then obtain the user position.

[0059] In an implementation, the first directional sound emitting device can analyze the posture of the user based on the user that has been identified by using a posture recognition algorithm of computer vision, and obtain the user behavior.

[0060] In an implementation, the first directional sound emitting device can determine the position where the eyes of the user are located based on the user that has been identified, and then obtain the position where the user's line of sight is fixed by inferring the pupil position, so as to determine whether the user is looking at the screen of the first directional sound emitting device.

[0061] S105. Generating prompt information of the call request according to the user behavior.

[0062] Exemplarily, after determining the user behavior of the user, the first directional sound emitting device generates information for prompting the user that there is a call request according to different user behaviors by using preset rules and logic.

[0063] In an implementation, the prompt information of the call request is information generated by the first directional sound emitting device for notifying the user that there is a call request from the second directional sound emitting device.

[0064] Alternatively, the prompt information can be in the form of sound and no sound. The prompt information in the form of sound can be directly output to the user by the first directional sound emitting device. The prompt information in the form of no sound can be directly displayed on the screen of the first directional sound emitting device.

[0065] S106. Directing the first directional sound emitting device to output the call content to the user position in response to the on instruction of the user.

[0066] Exemplarily, the first directional sound emitting device, upon obtaining the user triggered on instruction, establishes a call connection with the second directional sound emitting device in response to the on instruction. Thereafter, the call content sent by the second directional sound emitting device to the first directional sound emitting device can be outputted to the user location by the first directional sound emitting device, ensuring that only the user can clearly hear the call content, reducing the interference to the surrounding environment.

[0067] In an implementation manner, the on instruction of the user is a feedback signal of the user for agreeing to answer the call request. For example, the user can trigger the on instruction by clicking an answer button.

[0068] In an implementation manner, the first directional sound emitting device can realize directional output of the call content to the user location based on a beamforming technology.

[0069] In an implementation manner, the first directional sound emitting device can utilize an acoustic lens technology to control the sound emitted by the sound source to focus on the user location according to a specific refraction rule after passing through the acoustic lens, thereby realizing directional output of the call content to the user location.

[0070] In an implementation manner, the first directional sound emitting device can adopt an ultrasonic directional technology to modulate the call content to an ultrasonic frequency band, emit the modulated ultrasonic wave through the first directional sound emitting device, and utilize the nonlinear effect of air to demodulate the ultrasonic wave to audible sound near the user location, thereby realizing directional output of the call content to the user location.

[0071] In an implementation manner, when the user triggers a reject instruction, the first directional sound emitting device can send a rejection feedback to the second directional sound emitting device.

[0072] The reject instruction can be generated when the user performs a reject operation for the call request. For example, the user can trigger the reject instruction by clicking a reject button.

[0073] The rejection feedback is used to end the call request of the second directional sound emitting device and display a rejection prompt. After receiving the rejection feedback, the second directional sound emitting device ends the call request and displays a rejection prompt on the interface to inform the user initiating the call request through the second directional sound emitting device that the user of the first directional sound emitting device rejects the request.

[0074] In the embodiment, by collecting environment information when obtaining the call request, determining the user behavior and the user location, and then generating a prompt information according to the user behavior and outputting the call content to the user location, the effect of improving the flexibility of in-vehicle call, improving the call privacy and improving the communication efficiency is realized.

[0075] In an example, if the first directional sound emitting device detects only one user in the coverage area after target recognition of the environmental information, the prompt information of the call request is generated according to the user behavior in step S105, including any of the following: S1051, if the user behavior indicates that the user is looking at the screen of the first directional sound emitting device, the prompt information of the call request is displayed on the screen.

[0076] In an example, after obtaining the user behavior, the first directional sound emitting device determines whether the user behavior indicates that the user is looking at the screen of the first directional sound emitting device. If the first directional sound emitting device determines that the user behavior indicates that the user is currently paying attention to the screen of the first directional sound emitting device, the prompt information of the call request can be displayed on the screen. This way can facilitate the user to quickly see the call request and then quickly respond.

[0077] In an implementation, the first directional sound emitting device can display the prompt information of the call request in the form of a pop-up window, a small window, a notch display, a side display, etc.

[0078] In an implementation, the prompt information can include the name information of the second directional sound emitting device that initiates the call request. In addition, the prompt information can also include buttons for answering or rejecting.

[0079] S1052, if the user behavior indicates that the user is looking at a place other than the screen of the first directional sound emitting device, the voice prompt information of the call request is generated and output to the user's location by the first directional sound emitting device.

[0080] In an example, after obtaining the user behavior, the first directional sound emitting device determines whether the user behavior indicates that the user is looking at a place other than the screen of the first directional sound emitting device. If the first directional sound emitting device determines that the user behavior indicates that the user is currently not looking at the screen of the first directional sound emitting device but paying attention to other places, the voice prompt information can be output to the user's location by the first directional sound emitting device. This way can facilitate the user to quickly hear the call request and then quickly respond.

[0081] In an implementation, the voice prompt information can be a pre-written text prompt content. Optionally, the voice prompt content can include the name information of the second directional sound emitting device.

[0082] In an implementation, the first directional sound emitting device can also display the prompt information of the call request on its screen. After hearing the voice prompt, the user can operate the buttons contained in the prompt information on the screen to answer or reject the call request.

[0083] S1053, if the user behavior indicates that the user is in a sleeping state, the screen of the first directional sound emitting device displays prompt information of the call request, and the second directional sound emitting device is fed back sleeping state confirmation information. The sleeping state confirmation information indicates whether the second directional sound emitting device needs to generate voice prompt information of the call request.

[0084] Exemplarily, after obtaining the user behavior, the first directional sound emitting device determines whether the user behavior indicates that the user is in a sleeping state. If yes, the first directional sound emitting device can display prompt information of the call request on its screen. At the same time, the first directional sound emitting device can send sleeping state confirmation information to the second directional sound emitting device.

[0085] The second directional sound emitting device can display a sleeping prompt that the user corresponding to the first directional sound emitting device is sleeping on the screen after receiving the sleeping state confirmation information. The user corresponding to the second directional sound emitting device can select to continue sending voice prompt information based on the sleeping prompt. Alternatively, the user corresponding to the second directional sound emitting device can select to end the call request based on the sleeping prompt.

[0086] In an implementation manner, the sleeping state is that the user is in a closed-eye state such as false sleep or sleep.

[0087] In an implementation manner, the sleeping state confirmation information is inquiry information sent by the first directional sound emitting device to the second directional sound emitting device. The second directional sound emitting device needs to feed back a decision result of whether to generate voice prompt information to the first directional sound emitting device according to the sleeping state confirmation information.

[0088] In an implementation manner, the sending of the sleeping state confirmation information can inform the user corresponding to the second directional sound emitting device of the state of the user corresponding to the first directional sound emitting device, so as to facilitate the user corresponding to the second directional sound emitting device to determine whether the user corresponding to the first directional sound emitting device needs to be awakened through voice prompt information according to the emergency degree of the current call.

[0089] In an implementation manner, when the first directional sound emitting device displays the prompt information of the call request, the first directional sound emitting device can adopt a display mode of low brightness and soft color, so as to reduce the interference on the user's sleep.

[0090] In an implementation manner, after the first directional sound emitting device receives the indication that the second directional sound emitting device needs to generate voice prompt information, the first directional sound emitting device can generate voice prompt information and output the voice prompt information to the user's position.

[0091] In the example, by means of taking targeted prompt according to different user behaviors, the efficiency of prompting the call request is improved, and the effect of improving the user experience is achieved.

[0092] In an example, if the first directional sound emitting device detects multiple users in the coverage area after target recognition of the environmental information, before generating the prompt information of the call request according to the user behavior in step S105, the first directional sound emitting device further performs the following steps: S1041, generating call object confirmation information according to the user behavior of the multiple users. The call object confirmation information includes the identification information of the user not in the sleep state.

[0093] In an example, the first directional sound emitting device first collects the user behavior of the multiple users in the coverage area, and generates the call object confirmation information according to the user behavior of the multiple users.

[0094] In an implementation, the first directional sound emitting device can obtain the identification information of each user. The first directional sound emitting device can write the identification information into the call object confirmation information.

[0095] In an implementation, the identification information can be the seat number of the user. Alternatively, the identification information can be a picture of the user taken at the current time.

[0096] In an implementation, if the multiple users include multiple users not in the sleep state, the first directional sound emitting device can use the identification information of the user not in the sleep state to form the call object confirmation information.

[0097] In an implementation, if the multiple users include one user not in the sleep state and at least one user in the sleep state, the first directional sound emitting device can perform the corresponding operation according to step S1051 or step S1052 based on the user not in the sleep state.

[0098] In an implementation, if the multiple users are all in the sleep state, the first directional sound emitting device can form the identification information of all the users in the sleep state into the call object confirmation information.

[0099] In an implementation, the call object confirmation information is a set of the identification information of the user generated by the first directional sound emitting device. The first directional sound emitting device can send the call object confirmation information to the second directional sound emitting device. The first directional sound emitting device can obtain the call object fed back by the second directional sound emitting device based on the call object confirmation information. The call object is the user who needs to participate in the call.

[0100] S1042, feeding back the call object confirmation information to the second directional sound emitting device, so that the second directional sound emitting device displays the identification information of the multiple users and feeds back the first selection instruction. The first selection instruction is used to indicate at least one user participating in the call.

[0101] Exemplarily, after generating the call object confirmation information, the first directional sound generating device sends the call object confirmation information to the second directional sound generating device through a pre-established communication link. The first directional sound generating device can obtain the first selection instruction fed back by the second directional sound generating device. The first directional sound generating device can continue to perform the operations corresponding to steps S1051, S1052 and S1053 according to the user behavior of the user specified in the first selection instruction.

[0102] In an implementation manner, after receiving the information, the second directional sound generating device parses and displays the identification information of the multiple users in the call object confirmation information. Optionally, the display manner can be to present the multiple users in the form of a list or an icon on the screen of the device.

[0103] The user can select at least one user participating in the current call from the displayed multiple users through an interactive interface provided by the second directional sound generating device, and generate a first selection instruction.

[0104] The second directional sound generating device feeds back the first selection instruction to the first directional sound generating device, so that the first directional sound generating device performs subsequent call-related operations according to the instruction.

[0105] In an implementation manner, the first selection instruction is an instruction generated by the user after selecting the user participating in the current call through the second directional sound generating device, and is used to specify a specific call object.

[0106] In this example, by means of generating the call object confirmation information when multiple users are detected, sending the call object confirmation information to the second directional sound generating device, and obtaining the first selection instruction fed back by the second directional sound generating device, the effect of accurately determining the user participating in the current call is achieved, the flexibility of the call is improved, and the user experience is improved.

[0107] In an example, when the first directional sound generating device establishes a call with the second directional sound generating device, if a user who wants to join the call exists in the coverage area of the first directional sound generating device during the call, the following steps can be performed.

[0108] For example, after a user in a sleep state wakes up in the coverage area of the first directional sound generating device, the user wants to join the call. Or, after a user of another seat changes the position and sits in the position in the coverage area of the first directional sound generating device, the user wants to join the call.

[0109] The process can include: S1071, display a seat corresponding to the first directional sound generating device, and obtain a second selection instruction. The second selection instruction is used to indicate a seat of an added user participating in the current call that needs to be added.

[0110] Exemplarily, the first directional sound emitting device can present the seats within its coverage range on its display interface. The first directional sound emitting device can obtain a second selection instruction generated by the user selecting a seat within the coverage range through the interactive interface.

[0111] In an implementation manner, the seat contained in the second selection instruction is a seat not participating in the current call.

[0112] In an implementation manner, the seat contained in the second selection instruction is a seat corresponding to the user participating in the call of the first directional sound emitting device, and the seat is a seat where a new user who wants to participate in the current call is located.

[0113] In an implementation manner, the first directional sound emitting device can present the seats within its coverage range on its display interface when triggering the new user participating in the call.

[0114] S1072, generating a first increase request based on the second selection instruction. The first increase request is sent to the second directional sound emitting device. The first increase request contains the identification information of the new user, and is used to instruct the second directional sound emitting device to feed back whether to agree that the new user joins the current call.

[0115] Exemplarily, after the first directional sound emitting device generates the second selection instruction, the first directional sound emitting device can obtain the identification information of the new user on the seat according to the seat specified in the second selection instruction. Further, the first directional sound emitting device can generate the first increase request based on the identification information of the new user.

[0116] The first directional sound emitting device can send the first increase request to the second directional sound emitting device. The first directional sound emitting device can also obtain the result of whether the second directional sound emitting device agrees that the new user joins the current call.

[0117] In an implementation manner, after the second directional sound emitting device receives the first increase request, the second directional sound emitting device can display the identification information of the new user contained in the first increase request on its screen. The second directional sound emitting device can also display a feedback button on the screen. The feedback button can include acceptance and rejection.

[0118] The second directional sound emitting device can obtain feedback information generated by the user corresponding to the second directional sound emitting device through the interactive interface when triggering the feedback button. The feedback information can be that the new user agrees to join the current call. Or, the feedback information can be that the new user refuses to join the current call.

[0119] S1073, if the feedback information of the second directional sound emitting device indicates that the new user agrees to join the current call, the directional sound emitting device outputs the call content to the multiple user positions in the coverage area.

[0120] Exemplarily, the first directional sound emitting device can acquire feedback information from the second directional sound emitting device. When the feedback information is received and indicates that the new user is allowed to join the current call, the first directional sound emitting device can start the directional sound emitting function and increase the directional output of the call content to the new user.

[0121] In an implementation manner, if the feedback information indicates that the new user is not allowed to join the current call, the first directional sound emitting device can inform the user corresponding to the first directional sound emitting device of the decision result of the user corresponding to the second directional sound emitting device through a pop-up window.

[0122] In the example, the effect of flexibly adding a user participating in the call is achieved by generating the second selection instruction for selecting the new user, generating the first addition request sent to the second directional sound emitting device, and outputting the call content to the new user in a directional manner when the feedback information of the second directional sound emitting device indicates that the new user is allowed to join the call, thereby improving the flexibility of the call and the user experience.

[0123] In an example, when the first directional sound emitting device establishes a call with the second directional sound emitting device, if there is a third directional sound emitting device that wants to call the first directional sound emitting device, the first directional sound emitting device can directly reject the call. Alternatively, the first directional sound emitting device can initiate a second addition request for adding a user participating in the current call to the second directional sound emitting device. The second addition request can include the following steps: S1081, if the first directional sound emitting device is in a call state with the second directional sound emitting device, a second addition request is generated in response to a call request initiated by the third directional sound emitting device.

[0124] Exemplarily, if the first directional sound emitting device receives a call request initiated by the third directional sound emitting device after establishing a valid call connection with the second directional sound emitting device, the first directional sound emitting device can analyze the call request initiated by the third directional sound emitting device and generate a second addition request.

[0125] In an implementation manner, the first directional sound emitting device being in a call state with the second directional sound emitting device means that a stable audio communication link has been established between the first directional sound emitting device and the second directional sound emitting device, and voice information can be exchanged between the two devices.

[0126] In an implementation manner, the call request initiated by the third directional sound emitting device is a request sent by the third directional sound emitting device to the first directional sound emitting device, hoping to establish a stable audio communication link with the first directional sound emitting device.

[0127] In an implementation, the second adding request is inquiry information generated by the first directional sound emitting device according to a talk request initiated by the third directional sound emitting device. The inquiry information is used to inquire whether the second directional sound emitting device agrees to let the third directional sound emitting device join the current talk.

[0128] In an implementation, the second adding request can include name information of the third directional sound emitting device.

[0129] S1082, sending a second adding request to the second directional sound emitting device. The second adding request contains identification information of the third directional sound emitting device, and is used to instruct the second directional sound emitting device to feed back whether the second directional sound emitting device agrees to let the third directional sound emitting device join the current talk.

[0130] Exemplarily, after generating the second adding request, the first directional sound emitting device can send the second adding request to the second directional sound emitting device through a pre-established communication link with the second directional sound emitting device. The first directional sound emitting device can obtain decision information fed back by the second directional sound emitting device about whether the second directional sound emitting device agrees to let the third directional sound emitting device join the current talk.

[0131] In an implementation, after receiving the second adding request, the second directional sound emitting device can display name information of the third directional sound emitting device contained in the second adding request on a screen. The second directional sound emitting device can also display a decision button about whether to agree to let the third directional sound emitting device join the current talk on the screen. The second directional sound emitting device can obtain decision information generated when a user triggers the decision button through an interactive interface. The second directional sound emitting device can send the decision information to the first directional sound emitting device.

[0132] In an implementation, if the second directional sound emitting device agrees to let the third directional sound emitting device join the current talk, the first directional sound emitting device and the second directional sound emitting device can simultaneously establish a communication link with the third directional sound emitting device.

[0133] In the example, when the first directional sound emitting device and the second directional sound emitting device are in a talk state, if the third directional sound emitting device sends a talk request to the first directional sound emitting device, the first directional sound emitting device can generate a second adding request and send the second adding request to the second directional sound emitting device, so that the second directional sound emitting device decides whether to agree to let the third directional sound emitting device join the talk. In this way, the effect of flexibly adjusting the directional sound emitting devices participating in the talk according to the talk demand is achieved, and the user experience is improved.

[0134] In an example, when the first directional sound emitting device detects the environmental information, the method further includes the following steps: S102, when it is identified according to the environmental information that there is no user in the coverage area, feeding back a no-user notification to the directional sound device that initiates the call request. The no-user notification is used to prompt that there is no user in the coverage area.

[0135] Exemplarily, after detecting the environmental information, the first directional sound device can determine whether there is a user in the coverage area of the first directional sound device. If there is no user in the coverage area, the first directional sound device generates a no-user notification and feeds back the no-user notification to the second directional sound device that initiates the call request, so as to prompt the other party that there is no user in the coverage area of the first directional sound device.

[0136] In an implementation manner, the no-user notification is a specific message or signal. The no-user notification is used to explicitly inform the other party that there is no user currently detected in the coverage area. The no-user notification is generated by the first directional sound device and sent to the second directional sound device that initiates the call request.

[0137] In the example, by feeding back the no-user notification to the second directional sound device when it is determined that there is no user in the coverage area of the first directional sound device, the effect of timely informing the second directional sound device that there is no user in the coverage area of the first directional sound device is achieved, the waiting time of the user who initiates the call using the second directional sound device is reduced, and the user experience is improved.

[0138] In an example, the first directional sound device can also optimize the audio output by the first directional sound device according to the environmental noise, and the process includes: S1091, determining a noise optimization coefficient according to the environmental information.

[0139] Exemplarily, the first directional sound device continuously collects the environmental information in the coverage area during operation. The environmental information includes various data reflecting the environmental noise condition. The first directional sound device can determine a noise optimization coefficient according to the environmental information. The noise optimization coefficient will be used for subsequent optimization and adjustment of the audio output by the first directional sound device.

[0140] In an implementation manner, the noise-related data in the environmental information can include sound intensity, frequency distribution, background noise type, etc. in the environment. These information can reflect the noise condition of the current environment and provide a basis for determining the noise optimization coefficient.

[0141] In an implementation manner, the noise optimization coefficient is a parameter calculated according to the environmental information. The parameter can be a numerical value, a vector, a matrix, etc.

[0142] In an implementation manner, the noise optimization coefficient is superimposed into the audio output by the first directional sound device to optimize the audio.

[0143] In an implementation, the first directional sound emitting device continuously measures the sound intensity in the environment through the built-in sound sensor. The measured sound intensity is compared with a plurality of preset intensity intervals, each of which corresponds to a different noise optimization coefficient. The noise optimization coefficient can be used to adjust the volume of the audio output by the first directional sound emitting device. When the sound intensity is in a lower interval, it indicates that the environmental noise is small, and the noise optimization coefficient can be set to be small. When the sound intensity is in a higher interval, it indicates that the environmental noise is large, and the noise optimization coefficient is set to be large.

[0144] In an implementation, the first directional sound emitting device uses a frequency analysis technique to analyze the sound in the environment, and identifies the noise components in different frequency bands. The first directional sound emitting device determines the noise optimization coefficient according to the distribution of the main noise frequency band and a preset frequency-coefficient correspondence relationship. For example, if there is more low-frequency noise in the environment, a specific noise optimization coefficient can be used. If high-frequency noise dominates, another corresponding coefficient is used.

[0145] In an implementation, the first directional sound emitting device collects a large number of environmental information samples and corresponding ideal noise optimization coefficients, and constructs a machine learning model. In actual operation, the environmental information collected in real time is input into the model, and the model outputs a suitable noise optimization coefficient through learning and analysis. This way can determine more accurate coefficients according to complex and variable environmental information.

[0146] S1092, based on the noise optimization coefficient, the call content output by the first directional sound emitting device is optimized and adjusted.

[0147] Exemplarily, after the first directional sound emitting device determines the noise optimization coefficient, the coefficient is used to optimize and adjust the audio of the call content to be output, so that the output audio offsets the influence of the environmental noise, and the user can hear the call content more clearly.

[0148] In an implementation, the optimization and adjustment includes adjusting the volume, frequency, clarity, etc. of the audio output by the first directional sound emitting device.

[0149] In an implementation, the first directional sound emitting device can dynamically adjust the volume of the call content according to the size of the noise optimization coefficient. When the noise optimization coefficient is large, it indicates that the environmental noise is strong, and the volume of the call content is appropriately increased to ensure that the receiving party can hear. When the noise optimization coefficient is small, the environmental noise is weak, and the volume of the call content is reduced to avoid discomfort caused by too loud sound.

[0150] For example, when the road noise is large, the first directional sound emitting device increases the call volume, and when the road noise is small, the volume is reduced.

[0151] In an implementation, the first directional sound device can optimize the frequency of the call content by using the noise optimization coefficient. By analyzing the frequency characteristics of the environmental noise, the frequency of the call content is adjusted accordingly to avoid overlapping with the noise frequency, thereby improving the intelligibility of the call content.

[0152] For example, if the environmental noise is mainly concentrated in a certain frequency band, the device can adjust the frequency of the call content to other relatively clean frequency bands.

[0153] In an implementation, the first directional sound device can use an audio enhancement algorithm to process the intelligibility of the call content according to the noise optimization coefficient. The first directional sound device can improve the intelligibility of the call content by removing noise, enhancing speech signals, etc.

[0154] For example, using a noise reduction algorithm to remove background noise in the environment while enhancing the spectral characteristics of the speech, the receiving party can more clearly distinguish the call content.

[0155] In this example, by determining the noise optimization coefficient according to the environmental information and adjusting the output of the call content by the first directional sound device based on the coefficient, the effect of improving the intelligibility and audibility of the call content in a complex environment is achieved.

[0156] In an implementation, the audio optimization method can also be used for video sound, music audio, etc. output by the first directional sound device.

[0157] Figure 2 A structure schematic diagram of an in-vehicle communication system based on a directional sound device is shown in an embodiment of the present application, in Figure 1 Based on the embodiment shown in Figure 2 For example, a three-row seven-seat vehicle, the in-vehicle communication system can include a front row instrument and a co-pilot using a directional sound device, and a directional sound device in front of each seat in the middle and rear rows.

[0158] Each directional sound device is built-in with a microphone (MIC). The MIC is used to collect audio input of users in the coverage area of the directional sound device. The directional sound device can transmit the audio to the cabin through a gigabit multimedia serial link (GMSL). The directional sound device is also provided with a deserializer. The deserializer is used to analyze and output the audio sent by the cabin to the directional sound device. The directional sound device is provided with a screen. The screen is a directional sound screen.

[0159] For example, the microphone of the second directional sound device can acquire the user's input of the call content. The second directional sound device can then send this call content to the cockpit. The cockpit forwards this call content to the first directional sound device involved in the call. The deserializer of the first directional sound device parses the call content and outputs the result.

[0160] In one implementation, the audio acquired by the microphone can be converted from a continuous analog signal to a discrete digital signal using an analog-to-digital converter (ADC). The ADC then inputs the digital audio signal to a deserializer for processing, and the deserializer sends the processed audio to the vehicle's SOC.

[0161] In one implementation, the ADC and the deserializer can communicate via an I2C bus.

[0162] In one implementation, after the deserializer receives the audio output from the channel, it can send the audio to the power amplifier (PA) via the I2C bus. The PA then sends the audio to the directional sound panel to achieve audio output.

[0163] In one implementation, the deserializer can also transmit the video content quickly via Low-Voltage Differential Signaling (LVDS) when it receives the video content, and transmit the video content to the directional sound screen to achieve video output.

[0164] In one implementation, the central control screen can restrict the audio, video, and call permissions played by other directional sound-emitting devices.

[0165] In one implementation, the main control of the in-vehicle communication system is handled by a system-on-a-chip (SOC).

[0166] In one implementation, such as Figure 3 As shown, for large vehicles such as buses, the SOC can be expanded via a switch network. Each expanded SOC can handle the audio and video input and output of multiple directional sound devices.

[0167] In one example, based on the aforementioned in-vehicle communication system, a passenger's call request includes the following: S211. Passenger 1 opens the vehicle seating chart on the directional sound device 1. This seating chart has each seat numbered. Passenger 1 clicks on the seat of the passenger 2 they wish to speak to to initiate a call request.

[0168] S212, the call request is transmitted to the SOC through the directional sound device 1. The SOC first determines whether the specified seat is in the call prohibited state. If it is call prohibited, the call request failure is returned to the directional sound device 1. If it can be normally called, the request signal is sent to the directional sound device 2 corresponding to the specified seat.

[0169] The call prohibited state can be set by the central control. Alternatively, the call prohibited state can be set by the user of the seat on the directional sound device corresponding thereto.

[0170] S213, the occupant 2 can trigger the decision result of receiving the call or rejecting the call through the button. After rejecting the call, the directional sound device 2 can return the call failure information to the directional sound device 1. After receiving the call, the directional sound device 2 can establish a connection with the directional sound device 1. At this time, the SOC can send the connection establishment information to the central control screen to display that the occupant 1 of seat X and the occupant 2 of seat Y are in the call. The administrator processing the central control information can view the connection information, and the administrator has the right to close the call.

[0171] S214, during the call, if the occupant 3 is to be added to participate, the occupant 1 or the occupant 2 can initiate a first addition request in the seat distribution diagram. After one party initiates the first addition request, the SOC first sends the first addition request information to the other occupants in the call to confirm whether the other occupants in the call agree to add the occupant 3 to the call. If all agree, the SOC further determines whether the seat corresponding to the occupant 3 is in the call prohibited state. If not, the call request is sent to the directional sound device 3 corresponding to the occupant 3. When the occupant 3 agrees to join the call, the SOC further refreshes the connection information of the rear staff call on the central control screen.

[0172] In an example, based on the above-mentioned in-vehicle communication system, the driver call request includes the following contents: S221, the administrator opens the in-vehicle seat distribution diagram on the central control screen, and clicks the seat of the occupant 4 who wants to call to initiate a call request.

[0173] S222, the call request is transmitted to the SOC through the central control screen. The SOC first determines whether the specified seat is in the call prohibited state. If it is call prohibited, the call prohibited state is first returned to the central control. The administrator can choose whether to remove the call prohibited state.

[0174] If the administrator chooses to remove, the SOC forcibly removes the prohibited state, sends the request signal to the directional sound device 4 on the specified seat, and waits for the occupant 4 to connect. If the connection is established, the call is performed between the instrument position directional sound device and the directional sound device 4. If it is rejected, the call failure is returned.

[0175] If the administrator wants to force a call, they can click "Force Call". Afterwards, the SOC first disables all other audio outputs of the directional sound device 4, and then forcibly opens the audio channel of the directional sound device at the instrument location and the directional sound device 4.

[0176] S223. Administrators can also use the one-click broadcast button. In this mode, the SOC first shuts down the audio channels of all directional sound emitters and then opens the unidirectional audio channel of the directional sound emitter at the instrument location to broadcast.

[0177] If a passenger wishes to make a call, they can initiate a call request through their corresponding directional sound device, and the administrator will confirm whether to grant them call access.

[0178] At this time, if passengers wish to play videos, they can initiate a playback request through their corresponding directional sound device, and the administrator will confirm whether to grant them playback permissions.

[0179] In one example, this application can also use the directional sound-emitting device to achieve directional sound emission during audio and video playback, avoiding noise interference to other people and protecting a certain degree of privacy.

[0180] Figure 4 This is a structural diagram illustrating an in-vehicle communication device based on a directional sound-emitting device, as shown in an embodiment of this application. Figure 4 As shown, the directional sound-emitting device corresponds to the coverage area where at least one seat is located. Applied to the first directional sound-emitting device, the in-vehicle communication device 400 includes: The receiving module 401 is used to collect environmental information within the coverage area in response to a call request initiated by the second directional sound-emitting device.

[0181] Processing module 402 is used to determine the user behavior and location of at least one user within the coverage area based on environmental information. Based on the user behavior, it generates a call request prompt. In response to the user's answer command, it outputs the call content directionally to the user's location via a first directional sound device.

[0182] In one example, if there is a user within the coverage area, processing module 402 is used to: If the user's behavior indicates that the user is looking at the screen of the first directional sound device, then a call request message is displayed on the screen.

[0183] If the user's behavior indicates that the user is looking outside the screen of the first directional sound device, a voice prompt message for a call request is generated and output to the user's location via the first directional sound device.

[0184] If the user behavior indicates that the user is in a sleep state, the screen of the first directional sound device displays prompt information of the call request, and sleep state confirmation information is fed back to the second directional sound device. The sleep state confirmation information indicates whether the second directional sound device needs to generate voice prompt information of the call request.

[0185] In an example, if there are multiple users in the coverage area, the processing module 402 is configured to: According to the user behavior of the multiple users, call object confirmation information is generated. The call object confirmation information includes identification information of the user who is not in a sleep state.

[0186] The call object confirmation information is fed back to the second directional sound device, so that the second directional sound device displays the identification information of the multiple users and feeds back a first selection instruction. The first selection instruction is used to indicate at least one user participating in the call.

[0187] In an example, the processing module 402 is configured to: The seat corresponding to the first directional sound device is displayed, and a second selection instruction is obtained. The second selection instruction is used to indicate the seat of the new user participating in the call that needs to be added.

[0188] Based on the second selection instruction, a first addition request is generated. The first addition request is sent to the second directional sound device. The first addition request includes identification information of the new user, and is used to indicate whether the second directional sound device agrees to add the new user to the call.

[0189] If the feedback information of the second directional sound device indicates that the new user is agreed to join the call, the directional sound device is used to output the call content to the positions of the multiple users in the coverage area.

[0190] In an example, the processing module 402 is configured to: The receiving module 401 is configured to, if the first directional sound device is in a call state with the second directional sound device, generate a second addition request in response to a call request initiated by a third directional sound device.

[0191] The processing module 402 is configured to send the second addition request to the second directional sound device. The second addition request includes identification information of the third directional sound device, and is used to indicate whether the second directional sound device agrees to add the third directional sound device to the call.

[0192] In an example, the processing module 402 is configured to: When it is identified according to the environmental information that there is no user in the coverage area, a nobody notification is fed back to the directional sound device initiating the call request. The nobody notification is used to prompt that there is no user in the coverage area.

[0193] In one example, processing module 402 is used for: Based on environmental information, determine the noise optimization coefficient.

[0194] Based on the noise optimization coefficient, the call content output by the first directional sound-emitting device is optimized and adjusted.

[0195] Further functional descriptions of the above modules and units are the same as those in the corresponding embodiments described above, and will not be repeated here.

[0196] In this embodiment, the in-vehicle communication device based on a directional sound-emitting device is presented in the form of a functional unit. Here, a unit refers to an application-specific integrated circuit (ASIC), a processor and memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.

[0197] Figure 5 This is a schematic diagram of the structure of a directional sound-generating device shown in an embodiment of this application, such as... Figure 5 As shown, the directional sound-emitting device includes one or more processors 501, a memory 502, and interfaces for connecting the components, including high-speed interfaces and low-speed interfaces. The components communicate with each other via different buses and can be mounted on a common motherboard or otherwise as needed. The processors can process instructions executed within the directional sound-emitting device, including instructions stored in or on memory to display graphical information of a GUI on external input / output devices (such as display devices coupled to the interface). In some alternative implementations, multiple processors and / or multiple buses can be used with multiple memories and multiple memory modules, if desired. Similarly, multiple directional sound-emitting devices can be connected, each providing some of the necessary operations (e.g., as a server array, a group of blade servers, or a multiprocessor system). Figure 5 Take a processor 501 as an example.

[0198] Processor 501 may be a central processing unit, a network processor, or a combination thereof. Processor 501 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The programmable logic device may be a complex programmable logic device (CAMP), a field-programmable gate array (FPGA), a general-purpose array logic (GDA), or any combination thereof.

[0199] The memory 502 stores instructions executable by at least one processor 501 to cause at least one processor 501 to perform the method shown in the above embodiments.

[0200] The memory 502 can include a program storage area and a data storage area. The program storage area can store an operating system, application programs, and the like needed by at least one function. The data storage area can store data created by the directed sound emitting device, and the like. In addition, the memory 502 can include a high-speed random access memory, and can also include a non-transitory memory such as at least one disk memory device, a flash memory device, or other non-transitory solid state memory device. In some alternative embodiments, the memory 502 can optionally include a memory disposed remotely from the processor 501, which can be connected to the directed sound emitting device through a network. Examples of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0201] The memory 502 can include a volatile memory, such as a random access memory. The memory can also include a non-volatile memory, such as a flash memory, a hard disk, or a solid state disk. The memory 502 can also include a combination of the above-mentioned kinds of memories.

[0202] The directed sound emitting device also includes a communication interface 503 for the directed sound emitting device to communicate with other devices or a communication network.

[0203] Embodiments of the present application provide a vehicle interior communication system based on a directed sound emitting device. The vehicle interior communication system includes a plurality of directed sound emitting devices. The directed sound emitting device can be disposed in front of a seat in a vehicle. Each directed sound emitting device can correspond to at least one seat.

[0204] Embodiments of the present application also provide a computer readable storage medium. The above-mentioned method according to embodiments of the present application can be implemented in hardware, firmware, or recorded in a storage medium, or implemented through computer code originally stored in a remote storage medium or a non-transitory machine readable storage medium and stored in a local storage medium to be downloaded, so that the method described herein can be processed by such software on a storage medium using a general purpose computer, a special purpose processor, or programmable or special purpose hardware. The storage medium can be a disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid state disk, and the like. Further, the storage medium can also include a combination of the above-mentioned kinds of memories. It can be understood that the computer, processor, microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code, which, when accessed and executed by the computer, processor, or hardware, implements the method shown in the above embodiments.

[0205] The embodiment of the present application provides a computer program product, which comprises computer instructions stored in a computer readable storage medium. A processor of a directional sound emitting device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the directional sound emitting device executes the method of any embodiment of the present application.

[0206] Although the embodiments of the present application are described in conjunction with the drawings, various modifications and changes can be made by those skilled in the art without departing from the spirit and scope of the present application, and such modifications and changes fall within the scope defined by the appended claims.

[0207] It can be understood that, before using the technical solutions disclosed in the embodiments of the present disclosure, the type, use range, use scenario and the like of the personal information involved in the present disclosure should be informed to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations.

[0208] For example, in response to receiving the active request of the user, prompt information is sent to the user to explicitly prompt the user that the operation requested to be executed will require obtaining and using the personal information of the user. Thus, the user can voluntarily choose whether to provide the personal information to the software or hardware such as the electronic device, application program, server or storage medium that executes the operation of the technical solutions of the present disclosure according to the prompt information.

[0209] As an optional but not limited implementation manner, in response to receiving the active request of the user, the manner of sending the prompt information to the user may, for example, be a pop-up window manner, and the prompt information may be presented in the form of text in the pop-up window. In addition, the pop-up window may also carry selection controls for the user to select "agree" or "disagree" to provide the personal information to the electronic device.

[0210] It can be understood that the above notification and user authorization process is only illustrative, and does not limit the implementation manner of the present disclosure, and other manners meeting the relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0211] It can be understood that the data (including but not limited to the data itself, the acquisition or use of the data) involved in the present technical solution should comply with the requirements of the relevant laws and regulations and the relevant provisions.

[0212] It can be understood that in the specific embodiments of the present application, the data related to user information, location information, navigation data and the like is involved, and when the above embodiments of the present application are applied to specific products or technologies, the user's permission or consent needs to be obtained, and the collection, use and processing of the related data need to comply with the relevant laws and regulations and standards of the relevant countries and regions.

[0213] The systems, apparatuses, modules, or units disclosed in the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0214] For the sake of clarity, the above apparatuses are described with reference to functional units for describing various functions. Of course, the functions of the units can be implemented in one or more software and / or hardware.

[0215] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk memory, CD-ROM, optical memory, etc.) containing computer-usable program code.

[0216] The present application is described with reference to flowcharts and / or block diagrams of methods, systems, and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and combinations of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing apparatus to produce a machine, so that the instructions, which are executed via the processor of the computer or other programmable data processing apparatus, generate a means for implementing the functions specified in the flowcharts and / or block diagrams. Figure 1 The functions specified in a flow or multiple flows and / or blocks Figure 1 The apparatus that implements the functions specified in a flow or multiple flows and / or blocks.

[0217] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction apparatus that implements the functions specified in the flowcharts and / or block diagrams. Figure 1 The functions specified in a flow or multiple flows and / or blocks Figure 1 The apparatus that implements the functions specified in a flow or multiple flows and / or blocks.

[0218] These computer program instructions can also be loaded into a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 Figure 1

[0219] It should also be noted that the term "comprising" or "comprises" when used in this specification is taken to mean the term "including" or "includes" such that the process, method, article, or apparatus that comprises items includes those items but is not limited to those items.

[0220] Each of the embodiments in the present specification is described in a progressive manner, and the same or similar parts between the embodiments can be mutually referred to, and each of the embodiments mainly explains the difference from other embodiments. In particular, for the system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the part of the description of the method embodiments.

[0221] The above merely describes the embodiments of the present application and is not intended to limit the present application. The present application can have various modifications and changes for those skilled in the art. Any modification, equivalent replacement, improvement, etc. within the spirit and principle of the present application shall be included in the scope of the claims of the present application.

[0222] Although the embodiments of the present application are described in conjunction with the drawings, various modifications and changes can be made by those skilled in the art without departing from the spirit and scope of the present application, and such modifications and changes shall fall within the scope defined by the appended claims.​​

Claims

1. A vehicle-to-vehicle communication method based on a directional sound-emitting device, characterized in that, The directional sound-emitting device corresponds to the coverage area where at least one seat is located, and is applied to a first directional sound-emitting device. The method includes: In response to a call request initiated by the second directional sound device, environmental information within the coverage area is collected; Based on the environmental information, determine the user behavior and user location of at least one user within the coverage area; Based on the user's behavior, generate a prompt message for the call request; In response to the user's call connection command, the call content is output to the user's location via the first directional sound device.

2. The method according to claim 1, characterized in that, If a user exists within the coverage area, a prompt message for the call request is generated based on the user's behavior, including any one of the following: If the user behavior indicates that the user is looking at the screen of the first directional sound device, then a prompt message for the call request is displayed on the screen; If the user behavior indicates that the user is looking at a place outside the screen of the first directional sound device, then a voice prompt message for the call request is generated, and the voice prompt message is output to the user's location via the first directional sound device; If the user behavior indicates that the user is asleep, then a prompt message for the call request is displayed on the screen of the first directional sound device, and a sleep status confirmation message is sent back to the second directional sound device; the sleep status confirmation message indicates to the second directional sound device whether a voice prompt message for the call request needs to be generated.

3. The method according to claim 1, characterized in that, If there are multiple users within the coverage area, before generating the call request prompt information based on the user behavior, the method further includes: Based on the user behaviors of the multiple users, call object confirmation information is generated; the call object confirmation information includes the user's identification information; The second directional sound device is fed back the call subject confirmation information, so that the second directional sound device can display the identification information of multiple users and feed back a first selection instruction; the first selection instruction is used to indicate at least one user participating in this call.

4. The method according to any one of claims 1-3, characterized in that, The method includes: Display the seat corresponding to the first directional sound device and obtain a second selection instruction; the second selection instruction is used to indicate the seat of the new user who needs to be added to participate in this call. Based on the second selection instruction, a first add request is generated; the first add request is sent to the second directional sound device; the first add request includes the identification information of the newly added user, and is used to instruct the second directional sound device to provide feedback on whether to agree to the newly added user joining the current call; If the second directional sound device provides feedback indicating that it agrees to the addition of the new user to the call, then the call content is output to multiple user locations within the coverage area via the directional sound device.

5. The method according to any one of claims 1-3, characterized in that, The method includes: If the first directional sound device is in a call state with the second directional sound device, then in response to the call request initiated by the third directional sound device, a second add request is generated; The second add request is sent to the second directional sound device; the second add request contains the identification information of the third directional sound device, and is used to instruct the second directional sound device to provide feedback on whether it agrees to the third directional sound device joining the call.

6. The method according to any one of claims 1-3, characterized in that, The method further includes: When the environmental information indicates that no user is present within the coverage area, a no-user notification is sent to the directional sound device that initiated the call request; wherein the no-user notification is used to indicate that no user is present within the coverage area.

7. The method according to any one of claims 1-3, characterized in that, The method further includes: Based on the environmental information, determine the noise optimization coefficient; Based on the noise optimization coefficient, the call content output by the first directional sound device is optimized and adjusted.

8. An in-vehicle communication device based on a directional sound-emitting device, characterized in that, The directional sound-emitting device corresponds to the coverage area where at least one seat is located, and is applied to a first directional sound-emitting device. The device includes: The receiving module is used to collect environmental information within the coverage area in response to a call request initiated by the second directional sound-emitting device. The processing module is configured to determine the user behavior and user location of at least one user within the coverage area based on the environmental information; generate a prompt message for the call request based on the user behavior; and, in response to the user's call connection command, output the call content to the user's location via the first directional sound device.

9. A directional sound-emitting device, characterized in that, include: A memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, the processor executing the computer instructions to perform the method of any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions for causing the computer to perform the method of any one of claims 1 to 7.

11. A computer program product, characterized in that, Includes computer instructions for causing a computer to perform the method of any one of claims 1 to 7.

Images