Control method, control system and control device for vehicle-mounted audio and video playing

Abstract

The invention provides a control method, a control system and a control device for vehicle-mounted audio and video playing. The control method comprises the following steps: in response to starting of a vehicle-mounted audio-video mode, acquiring facial data of at least one user outside a vehicle; according to the face data of the at least one user, pose parameters of a projection screen are determined, the projection screen is integrated in a trunk door of the vehicle, and in the vehicle-mounted audio and video mode, the trunk door is opened, and the projection screen is in an unfolded state; adjusting the pose of the projection screen based on the pose parameter; controlling the vehicle-mounted projection device to project video data in the audio-video data to the projection screen; and controlling a vehicle-mounted external loudspeaker to synchronously play audio data in the audio-video data. The invention provides a mode for performing video and audio projection on the user outside the vehicle, and the pose of the vehicle-mounted projection screen can be automatically adjusted according to the face data of the user to adapt to the viewing angle of the user, so that the user experience of the vehicle-mounted video and audio mode is improved.

Description

Technical Field

[0001] The present invention relates to the vehicle field, and in particular to a control method, a control system and a control device based on vehicle audio and video playback in the vehicle entertainment field. Background Art

[0002] As cars become more and more popular in modern people's lives, people's requirements for cars are no longer limited to a single means of transportation. With the development of technology, the space of cars is constantly expanding outward. It is no longer limited to the inside of the car, but extends more to the outside of the car. Mobile life is subverting our understanding of cars.

[0003] In order to allow passengers in the car to experience in-car cinema, in-car karaoke, video conferencing, PPT presentations, etc., there is already a technical solution in the existing technology to set up a car screen inside the vehicle. However, the car screen set up inside the vehicle is limited by the limited space in the car, the screen size is small, and passengers usually feel uncomfortable sitting in the car with poor air circulation for a long time. Furthermore, the front-seat passengers in the car will affect the viewing effect of the rear-seat passengers.

[0004] In addition, there is also a technical solution in the prior art that allows users to watch the large screen set in front of the car through the front windshield. However, due to the long distance between the audience and the screen and the fact that the user sits inside the car, which is generally lower than the large screen in front of the car, the audience needs to always look up to watch, and the viewing angle is not good and not comfortable, which makes the audience's sense of participation and experience poor.

[0005] To sum up, in order to solve the above-mentioned problems existing in the prior art, the art urgently needs a control method, control system and control device for in-vehicle audio and video playback, which can project audio and video to users outside the vehicle, and can automatically adjust the position of the in-vehicle projection screen according to the user's facial data to adapt to the user's viewing angle, thereby greatly improving the user experience of the in-vehicle audio and video mode. Summary of the invention

[0006] A brief summary of one or more aspects is given below to provide a basic understanding of these aspects. This summary is not an exhaustive overview of all conceived aspects, and is neither intended to identify the key or critical elements of all aspects nor to define the scope of any or all aspects. Its only purpose is to give some concepts of one or more aspects in a simplified form as a prelude to a more detailed description that will be given later.

[0007] One object of the present invention is to provide a control method, a control system and a control device for in-vehicle audio and video playback. The advantage is that the present invention provides an in-vehicle audio and video mode for projecting audio and video to users outside the vehicle, and can automatically adjust the position of the in-vehicle projection screen according to the facial data of the user outside the vehicle to adapt to the user's viewing angle, without the need for the user to adjust the position by himself, thereby greatly improving the user experience of the in-vehicle audio and video mode.

[0008] Another object of the present invention is to provide a control method, a control system and a control device for in-vehicle audio and video playback. The advantage of the present invention is that the present invention can adjust the roll angle of the in-vehicle projection screen by collecting the position information of users at the left and right boundaries outside the vehicle to meet the viewing angles of multiple users in front of the screen, especially taking into account the viewing angles of users at the left and right boundaries outside the vehicle, so that they can enjoy a better audio and video experience.

[0009] Another object of the present invention is to provide a control method, a control system and a control device for in-vehicle audio and video playback. The advantage is that the present invention can determine the height of the projection screen by collecting user facial data and analyzing the highest and lowest points in the facial data of all users, thereby improving the user's viewing angle and providing a better audio and video experience.

[0010] Another object of the present invention is to provide a control method, a control system and a control device for in-vehicle audio and video playback. The advantage of the present invention is that the pitch angle of the in-vehicle projection screen can be adjusted by collecting facial pitch information of users outside the vehicle, so that users have a better viewing angle and enjoy a better audio and video experience.

[0011] Another object of the present invention is to provide a control method, a control system and a control device for in-vehicle audio and video playback. The advantage of the present invention is that the relative position of the rear of the vehicle and the user outside the vehicle can be automatically adjusted without the user moving the position, so that the projection screen on the trunk door at the rear of the vehicle and the user outside the vehicle can reach the optimal experience distance and experience angle for in-vehicle audio and video playback.

[0012] Another object of the present invention is to provide a control method, a control system and a control device for in-vehicle audio and video playback. The advantage of the present invention is that the present invention can adjust the screen orientation in a linked manner based on the relative position relationship between the user and the car by controlling the moving vehicle and adjusting the screen angle, so that the screen faces the user, without the user having to move or manually adjust the screen, thereby providing a better user experience.

[0013] Another object of the present invention is to provide a control method, control system and control device for in-vehicle audio and video playback. The advantage of the present invention is that the position of the external projection screen can be set with one click based on the user's position and orientation as a reference point, which is very convenient to use and improves the convenience of adjusting the projection screen.

[0014] The advantages and features of the present invention can be fully reflected by the following detailed description and can be realized by the accompanying illustrative embodiments.

[0015] One aspect of the present invention provides a control method for in-vehicle audio and video playback, the control method comprising the following steps: in response to the in-vehicle audio and video mode being turned on, acquiring facial data of at least one user located outside the vehicle; determining posture parameters of a projection screen based on the facial data of the at least one user, the projection screen being integrated in a trunk door of the vehicle, and in the in-vehicle audio and video mode, the trunk door is open and the projection screen is in an unfolded state; adjusting the posture of the projection screen based on the posture parameters; controlling an in-vehicle projection device to project video data in the audio and video data to the projection screen; and controlling an in-vehicle external speaker to synchronously play audio data in the audio and video data.

[0016] According to one embodiment of the present invention, the facial data includes leftmost facial feature position data and rightmost facial feature position data; wherein, determining the posture parameters of the projection screen based on the facial data of at least one user further includes the step of: determining the roll angle parameters of the projection screen based on the leftmost facial feature position data and the rightmost facial feature position data.

[0017] According to one embodiment of the present invention, the facial data includes topmost facial feature position data and bottommost facial feature position data; wherein, determining the posture parameters of the projection screen based on the facial data of the at least one user further includes the step of: determining the height parameters of the projection screen based on the topmost facial feature position data and the bottommost facial feature position data.

[0018] According to one embodiment of the present invention, the facial data includes facial pitch data; wherein, determining the posture parameters of the projection screen based on the facial data of the at least one user further includes the step of: determining the pitch angle parameters of the projection screen based on the facial pitch data.

[0019] According to one embodiment of the present invention, before acquiring facial data of at least one user located outside the vehicle, the control method further includes the following steps: acquiring current positions of the at least one user and the vehicle; determining a current relative position relationship between the trunk door and the at least one user based on the current positions of the at least one user and the vehicle; and in response to the current relative position relationship not meeting a preset target relative position relationship, determining driving parameters for adjusting the position and / or orientation of the vehicle; and controlling the movement of the vehicle based on the driving parameters.

[0020] Another aspect of the present invention further provides a control system for in-vehicle audio and video playback, the control system comprising a wake-up subsystem, a control device, an in-vehicle camera device, a projection screen, an adjustment mechanism, an in-vehicle projection device and an in-vehicle external speaker, wherein the wake-up subsystem is configured to wake up the control device based on a preset instruction to open the trunk door of the vehicle, the in-vehicle projection device and the in-vehicle external speaker; the projection screen is connected to the trunk door of the vehicle via the adjustment mechanism so that the projection screen is unfolded when the trunk door is opened; the in-vehicle projection device is arranged in an internal space surrounded by a body panel of the vehicle, and the in-vehicle projection device is configured to project video data in the audio and video data onto the projection screen after the in-vehicle projection device is turned on; the in-vehicle external speaker is arranged on the inner side of the body panel of the vehicle, The vehicle-mounted external speaker is configured to synchronously play the audio data in the audio and video data after the vehicle-mounted external speaker is turned on; the vehicle-mounted camera device is configured to obtain facial data of at least one user located outside the vehicle; the control device has a communication connection with the vehicle-mounted camera device, the adjustment mechanism, the vehicle-mounted projection device and the vehicle-mounted external speaker, and the control device is configured to: after being awakened by the awakening subsystem to open the trunk door of the vehicle, the vehicle-mounted projection device and the vehicle-mounted external speaker, receive the facial data of at least one user located outside the vehicle acquired by the vehicle-mounted camera device; determine the posture parameters of the projection screen according to the facial data of the at least one user; and output the posture parameters to the adjustment mechanism; the adjustment mechanism is configured to adjust the posture of the projection screen based on the posture parameters.

[0021] According to one embodiment of the present invention, the control system also includes a positioning device and a power system, and the positioning device and the power system are communicatively connected to the control device; wherein, before obtaining the facial data of at least one user located outside the vehicle, the control device is also configured to: obtain the current position of the at least one user and the vehicle based on the positioning device; determine the current relative position relationship between the trunk door and the at least one user according to the current position of the at least one user and the vehicle; and in response to the current relative position relationship not meeting the preset target relative position relationship, determine the driving parameters for adjusting the position and / or orientation of the vehicle; and control the power system to move the vehicle based on the driving parameters.

[0022] Another aspect of the present invention also provides a control device for in-vehicle audio and video playback, comprising: at least one processor; and a memory coupled to the at least one processor, the memory containing instructions stored therein, and when the instructions are executed by the at least one processor, the control device executes the control method for in-vehicle audio and video playback provided by the present invention.

[0023] Another aspect of the present invention further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the control method for in-vehicle audio and video playback provided by the present invention is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The above features and advantages of the present invention can be better understood after reading the detailed description of the embodiments of the present disclosure in conjunction with the following drawings. In the drawings, the components are not necessarily drawn to scale, and components with similar related properties or features may have the same or similar reference numerals.

[0025] Figure 1A The application scenario of the present invention is shown.

[0026] Figure 1B A schematic diagram of the vehicle structure in the present invention is shown (top view).

[0027] Figure 1C The schematic diagram of the structure of the rear part of the vehicle in the present invention is shown.

[0028] Figure 2 A schematic structural diagram of a control system for in-vehicle audio and video playback provided by one aspect of the present invention is shown.

[0029] Figure 3 A flow chart of a method for controlling in-vehicle audio and video playback provided by another aspect of the present invention is shown.

[0030] Figure 4A A schematic top view showing the relationship between a user and a projection screen in the present invention.

[0031] Figure 4B A front view schematic diagram showing the relationship between the user and the projection screen in the present invention.

[0032] Figure 4C The face image and key points for obtaining the face posture of the user in the present invention are illustrated.

[0033] Figure 5A A flow chart of an embodiment of determining the roll angle parameters of a projection screen in the present invention is shown.

[0034] Figure 5B A schematic diagram of adjusting the roll angle of the projection screen in the present invention is shown from a top view.

[0035] Fig. 6A A flow chart of an embodiment of determining the height parameter of the projection screen in the present invention is shown.

[0036] Figure 6B A schematic diagram of adjusting the height of the projection screen in the present invention is shown from a main viewing angle.

[0037] Fig. 7A A flow chart of an embodiment of determining the pitch parameters of a projection screen in the present invention is shown.

[0038] Figure 7B A schematic diagram of adjusting the pitch angle of the projection screen in the present invention is shown from a main viewing angle.

[0039] Figure 8 A flowchart of adjusting the vehicle position of a method for controlling in-vehicle audio and video playback provided by an embodiment of the present invention is shown.

[0040] Fig. 9 A schematic diagram of vehicle position adjustment of a method for controlling in-vehicle audio and video playback provided by an embodiment of the present invention is shown.

[0041] Fig.10 A schematic structural diagram of a vehicle-mounted audio and video playback control device provided by another aspect of the present invention is shown.

[0042] Reference numerals

[0043] 100, 101-104 users;

[0044] 110 vehicles;

[0045] 120, 240, 240' projection screens;

[0046] 130, 270 vehicle external speakers;

[0047] 140, 260 vehicle-mounted projection device;

[0048] 200 control system;

[0049] 210 wake-up subsystem;

[0050] 220 Control device;

[0051] 230 Vehicle-mounted camera device;

[0052] 250 Adjustment mechanism;

[0053] 280 Positioning device;

[0054] 290 Powertrain;

[0055] 1000 Control device;

[0056] 1001 memory;

[0057] 1002 processor;

[0058] 1003 bus;

[0059] 1004 Random Access Memory;

[0060] 1005 cache memory;

[0061] 1006 Storage system;

[0062] 1007 program module;

[0063] 1008 external devices;

[0064] 1009 display;

[0065] 1010 input / output (I / O) interface; and

[0066] 1011 network adapter. DETAILED DESCRIPTION

[0067] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. Note that the aspects described below in conjunction with the accompanying drawings and specific embodiments are only exemplary and should not be construed as limiting the scope of protection of the present invention in any way.

[0068] The following description is given to enable those skilled in the art to implement and use the invention and incorporate it into a specific application context. Various modifications, as well as various uses in different applications will be readily apparent to those skilled in the art, and the general principles defined herein are applicable to a wide range of embodiments. Thus, the present invention is not limited to the embodiments given herein, but should be granted the broadest scope consistent with the principles and novel features disclosed herein.

[0069] In the following detailed description, many specific details are set forth to provide a more thorough understanding of the present invention. However, it will be apparent to those skilled in the art that the practice of the present invention need not be limited to these specific details. In other words, known structures and devices are shown in block diagram form without detailed display to avoid obscuring the present invention.

[0070] The reader is reminded of all documents and literature filed simultaneously with this specification and open to public inspection, and the contents of all such documents and literature are incorporated herein by reference. Unless otherwise directly stated, all features disclosed in this specification (including any attached claims, abstracts and drawings) can be replaced by alternative features for achieving the same, equivalent or similar purposes. Therefore, unless otherwise explicitly stated, each feature disclosed is only an example of a group of equivalent or similar features.

[0071] Note that, where used, the symbols left, right, front, back, top, bottom, forward, reverse, clockwise and counterclockwise are used only for convenience and do not imply any specific fixed direction. In fact, they are used to reflect the relative position and / or direction between the various parts of the object. In addition, the terms "first" and "second" are used only for descriptive purposes and should not be understood as indicating or implying relative importance.

[0072] Note that, in the case of use, further, preferably, further and more preferably are simple beginnings for explaining another embodiment based on the previous embodiment, and the content of further, preferably, further or more preferably followed by the above embodiment is combined with the previous embodiment as a complete composition of another embodiment. Several further, preferably, further or more preferably settings followed by the same embodiment can be arbitrarily combined to form another embodiment.

[0073] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. Note that the aspects described below in conjunction with the accompanying drawings and specific embodiments are only exemplary and should not be construed as limiting the scope of protection of the present invention in any way.

[0074] As mentioned above, one of the mainstream implementation methods of the in-car audio and video playback mode in the prior art is to set up a car screen in the car, but due to the limited space in the car, the size of the car screen is small, which greatly reduces the viewing experience of the user in the car. Another way is to set up a projection screen outside the car to take into account the problem of the small car screen, but the prior art is more concerned with how to turn the projection screen on and off, and does not consider that the angle of the screen will affect the user's viewing comfort. In addition, the projection screen set outside the car in the prior art is usually fixed on a simple bracket, and the distance and orientation angle between the screen and the user cannot be automatically adjusted. The user must manually adjust the direction and distance of the screen to make it within a distance range suitable for the user to watch and face the user.

[0075] In order to solve the above-mentioned problems existing in the prior art, the present invention provides a control method, device and system for in-vehicle audio and video playback, provides an in-vehicle audio and video mode for projecting audio and video to users outside the vehicle, and can automatically adjust the position of the in-vehicle projection screen according to the facial data of the user outside the vehicle to adapt to the user's viewing angle, without the need for the user to adjust the position by himself, thereby greatly improving the user experience of the in-vehicle audio and video mode.

[0076] In some non-limiting embodiments, the control method for in-vehicle audio and video playback provided in one aspect of the present invention can be implemented by the control system and control device for in-vehicle audio and video playback provided in another aspect of the present invention. Specifically, the control device for in-vehicle audio and video playback has a memory and a processor. The memory includes but is not limited to a computer-readable storage medium provided in another aspect of the present invention, on which computer instructions are stored. The processor is connected to the memory and is configured to execute the computer instructions stored on the memory to implement the control method for in-vehicle audio and video playback provided in one aspect of the present invention.

[0077] The following will describe the working principles of the control device and control system of the vehicle-mounted audio and video playback in conjunction with some embodiments of the control method of vehicle-mounted audio and video playback. Those skilled in the art will understand that these embodiments of the control method of vehicle-mounted audio and video playback are only some non-limiting implementation methods provided by the present invention, and are intended to clearly demonstrate the main concept of the present invention and provide some specific solutions that are convenient for the public to implement, rather than to limit all working modes and all functions of the control device and control system of the vehicle-mounted audio and video playback. Similarly, the control device and control system of the vehicle-mounted audio and video playback are also only non-limiting implementation methods of the control method for executing vehicle-mounted audio and video playback provided by the present invention, and do not constitute a limitation on the implementation subject of each step in the control method of vehicle-mounted audio and video playback.

[0078] First, please refer to Figure 1A To understand the application scenario of the present invention. Figure 1A As shown, the present invention is applied to a vehicle environment, and is used to enable a user 100 to watch the video and audio provided by the vehicle projection device and the vehicle external speaker from the outside of the vehicle 110. The user can use the vehicle projection device, projection screen 120 and vehicle external speaker of the present invention to play and watch the video and audio outdoors, such as lawns, squares, camping bases, etc., or indoors, such as underground parking lots, empty factories, workshops, indoor stadiums, etc.

[0079] At least one vehicle-mounted external speaker 130 for emitting sound outward is arranged on the inner side of the body panel of the vehicle 110, so as to provide the vehicle 110 with an external sound emitting function, and the vehicle 110 is provided with a vehicle-mounted projection device 140 at the trunk door. Considering that in the present invention, the user is facing the trunk door of the vehicle 110, in a preferred embodiment, a plurality of vehicle-mounted external speakers may be arranged on the inner side of the panel of the trunk door (for example, arranged in the center and on both sides of the trunk door respectively), so that when playing audio and video data, the vehicle-mounted external speakers facing the user and closer to the user are given priority.

[0080] In some embodiments, Figure 1B As shown, in order to achieve a more stereoscopic sound effect, vehicle-mounted external speakers 130 can also be installed on the left and right doors, the front hood, and the trunk door of the vehicle 110, so that when these external speakers are working, a stereoscopic, surround sound field is created.

[0081] Please refer to further Figure 1C , Figure 1C The schematic diagram of the vehicle-mounted projection device 140 and the projection screen 120 at the trunk door is shown. When the vehicle 110 is in a parking state, in response to the activation of the vehicle-mounted audio and video mode, the trunk door of the vehicle 110 is opened, and the projection screen 120 located in the trunk is also unfolded and fixed between the opened trunk door and the vehicle body.

[0082] Combination Figure 1A and Figure 1C , in such Figure 1C In the illustrated embodiment, the vehicle-mounted projection device 140 is disposed on the top of the rear frame of the vehicle. At this time, the vehicle-mounted projection device 140 and the viewing user 100 are located on both sides of the projection screen 120. Therefore, it is necessary to adopt a rear projection projection mode to project and play the vehicle-mounted audio and video on the projection screen 120, that is, the light of the vehicle-mounted projection device 140 is projected onto the projection screen 120, and then penetrates the projection screen 120 and is observed by the human eyes of the user 100. This rear projection projection mode does not require the control of the surrounding ambient light, and is more suitable for the outdoor environment with good ambient light and lighting in the present invention.

[0083] To better understand the in-vehicle audio and video control method provided by the present invention, please first refer to Figure 2 , Figure 2 A schematic structural diagram of a control system for in-vehicle audio and video playback provided in one aspect of the present invention is shown.

[0084] like Figure 2As shown, in some embodiments, the control system 200 for in-vehicle audio and video playback includes a wake-up subsystem 210, a control device 220, an in-vehicle camera device 230, a projection screen 240, an adjustment mechanism 250, an in-vehicle projection device 260, and an in-vehicle external speaker 270. The control device 220 is in communication with the in-vehicle camera device 230, the adjustment mechanism 250, the in-vehicle projection device 260, and the in-vehicle external speaker 270.

[0085] The wake-up subsystem 210 is used to wake up the control device 220 according to a preset instruction, wherein the preset instruction includes a control instruction issued by a user. In response to the control device 220 being woken up, the trunk door of the vehicle, the vehicle-mounted projection device 260 and the vehicle-mounted external speaker 270 are opened. The projection screen 240 is connected to the trunk door of the vehicle via the adjustment mechanism 250, and the projection screen 240 is unfolded as the trunk door of the vehicle is opened. The vehicle-mounted projection device 260 is arranged in the internal space surrounded by the vehicle body panel. After the vehicle-mounted projection device 260 is turned on, the video data in the audio and video data will be projected onto the above-mentioned projection screen 240. The vehicle-mounted external speaker 270 is arranged on the inner side of the vehicle body panel. After the vehicle-mounted external speaker 270 is turned on, the audio data in the audio and video data projected on the projection screen 240 will be synchronously played to the outside of the vehicle. The vehicle-mounted camera device 230 is used to obtain the facial data of at least one user located outside the vehicle.

[0086] In such Figure 2 In the preferred embodiment shown, the control system 200 further includes a positioning device 280 and a power system 290 , and the positioning device 280 and the power system 290 can be communicatively connected with the control device 220 .

[0087] Next, the control method for in-vehicle audio and video playback provided by the present invention will be described in conjunction with the in-vehicle audio and video control system 200 described above. Figure 3 As shown, the control method for in-vehicle audio and video playback provided by the present invention includes the following steps:

[0088] Step S100: In response to the vehicle audio and video mode being turned on, acquiring facial data of at least one user located outside the vehicle;

[0089] Step S200: determining the posture parameters of the projection screen according to the facial data of the at least one user;

[0090] Step S300: adjusting the posture of the projection screen based on the posture parameters;

[0091] Step S400: Controlling the vehicle-mounted projection device to project the video data in the audio and video data onto the projection screen; and

[0092] Step S500: Control the vehicle-mounted external speaker to synchronously play the audio data in the video data.

[0093] In the above-mentioned step S100, the control method for in-vehicle audio and video playback provided by the present invention is started in response to the in-vehicle audio and video mode being turned on. In some embodiments of the present invention, the control device 220 can be awakened by giving a preset instruction to the awakening subsystem 210, thereby turning on the in-vehicle audio and video mode. The above-mentioned awakening subsystem 210 can be a system that monitors user instructions with low power consumption and receives user instructions at all times. The above-mentioned preset instructions can be voice instructions with preset words (such as turning on the outdoor audio and video mode), etc.

[0094] In other embodiments, the user can communicate and interact with the vehicle through a smart mobile terminal (such as a mobile phone), thereby realizing the functions of controlling and managing the vehicle through the smart terminal. Therefore, in these embodiments, the user can issue a wake-up command through the smart terminal to instruct the vehicle audio and video mode to be turned on. After the wake-up subsystem 210 receives the wake-up command sent by the smart terminal, it wakes up the control device 220, thereby turning on the vehicle audio and video mode to start the entire control method.

[0095] In response to the in-car audio and video mode being turned on, the trunk door is opened. The trunk door may be opened manually by the user, or the control device 220 may control the trunk door to open automatically in response to the in-car audio and video mode being turned on. It is understandable that those skilled in the art may adopt existing or future technologies for automatic door opening and closing to realize the opening of the trunk door. The projection screen 240 is integrated in the trunk door of the vehicle and is connected to the trunk door of the vehicle through an adjustment mechanism. After the in-car audio and video mode is turned on and the trunk door is opened, the adjustment mechanism 250 controls the unfolding of the projection screen 240.

[0096] In response to the vehicle audio and video mode being turned on, the control device 220 is also used to turn on the vehicle projection device 260 and the vehicle external speaker 270, so that the vehicle projection device 260 and the vehicle external speaker 270 are in a standby state so as to respond to the command of the control device 220 at any time to play audio and video data.

[0097] Furthermore, in the above step S100, in response to the in-vehicle audio and video mode being turned on, facial data of at least one user located outside the vehicle is obtained. In the above step S100, the user's facial data is obtained in order to be able to adjust the screen posture that is most suitable for the user to watch the movie based on the user's facial data. Therefore, the above-mentioned in-vehicle camera device for obtaining the user's facial data can be preferably set on the projection screen, so that the relative position relationship between the user and the projection screen can be intuitively obtained. If the in-vehicle camera device for obtaining the user's facial data is not set on the projection screen, it is necessary to determine the relative position relationship between the in-vehicle camera device and the projection screen in the early debugging, and consider the relative position relationship between the in-vehicle camera device and the projection screen when subsequently determining the posture of the projection screen based on the user's facial data.

[0098] On the one hand, the user's facial data can be used to determine the number of users and the distribution of users relative to the screen by recognizing their faces. On the other hand, the facial feature points of each user can be determined through the user's facial data, so that the rotation angle of each user's face can be determined. Furthermore, the position of the projection screen can be comprehensively determined based on the user's facial data.

[0099] Please combine Figures 4A-4C To understand the above user's facial data. First, please refer to Figure 4A , Figure 4A The relationship between the users 101-104 and the projection screen 240 is illustrated from a top-down perspective. Figure 4A In the illustrated embodiment, the vehicle-mounted camera device 230 is preferably disposed at the top center of the projection screen 240, and preferably uses a depth camera device. Through the vehicle-mounted camera device 230, the number of users can be obtained according to the number of recognized faces ( Figure 4A ). Without considering the facial posture, that is, when the faces of each user are normalized as a point or a circle, the distribution of each user relative to the projection screen 240 can also be obtained, that is, the facial feature position data of the distance, position, height, etc. of each user 101-104 relative to the vehicle-mounted camera device 230. In other words, the facial data includes facial feature position data representing the relative position between the users 101-104 and the projection screen 240. The above distance can be a straight-line distance or a vertical distance, that is, depth information. The position and height can be represented by the coordinates of the user relative to the vehicle-mounted camera device 230 (that is, the coordinates of the user in the coordinate system with the vehicle-mounted camera device 230 as the origin), or by relative direction (such as 15 degrees to the left or up).

[0100] Please refer to further Figure 4B and Figure 4C To understand the facial data of the above users. Figure 4BThe relationship between the user 100 and the projection screen 240 is illustrated from the perspective of the front view. Figure 4B It can be seen that even if the user's body position has been determined, the user can still tilt his head (rotate along the Y axis), or turn his head up and down (along the X axis) or left and right (along the Z axis). Different face rotation angles will also affect the user's viewing angle. In other words, facial data includes face rotation angles that represent facial postures.

[0101] Please refer to further Figure 4C First, it can be understood that the face rotation angle can be understood as the current position of the face ( Figure 4C Left side) and reference position ( Figure 4C The reference position points to the position where the face rotation angles in all directions are 0. Figure 4C The actual face image of the user on the left side can be obtained by the vehicle-mounted camera device 230 (indicating the current position of the face), Figure 4C The reference image on the right can be obtained by face detection and facial key point detection (representing the reference position). Figure 4C In the embodiment shown, six key points are defined, namely, the left eye corner, the right eye corner, the nose tip, the left mouth corner, the right mouth corner, and the mandible. It can be considered that the key points can be used to characterize the face model, and the user can set the key points and their number related to the accuracy of the face rotation angle estimation according to actual needs. Figure 4C After analyzing the face image on the left and the reference image on the right, Figure 4C The face image on the left is changed to the rotation vector of the reference image, and the rotation vector is converted into the corresponding Euler angle to obtain the face rotation angle.

[0102] It is understood by those skilled in the art that the Euler angle is a set of three independent angular parameters used to uniquely determine the position of a fixed-point rotating object. Figure 4B To understand the Euler angle coordinates in the present invention. Figure 4B As shown, rotation around the x-axis is defined as the pitch angle, rotation around the y-axis is defined as the yaw angle, and rotation around the z-axis is defined as the roll angle.

[0103] Please further combine Figure 5A-5B , 6A-6B, 7A-7B to understand the above step S200: determining the posture parameters of the projection screen according to the facial data of the at least one user. It can be understood that the posture refers to the position and posture of the projection screen.

[0104] To implement step S200, Figure 5AIn the illustrated embodiment, step S100 is further refined into step S110: obtaining the leftmost facial feature position data and the rightmost facial feature position data in the facial data; then, step S200 is further refined into step S210: determining the roll angle parameter α of the projection screen based on the leftmost facial feature position data and the rightmost facial feature position data.

[0105] Please combine Figure 5B To better understand Figure 5A In the method shown, the leftmost facial feature position data obtained in step S110 refers to the facial feature position data of the distance, position, height, etc. of the user 101 at the leftmost end among the users watching the in-vehicle video playback on site relative to the in-vehicle camera device 230. The rightmost facial feature position data refers to the facial feature position data of the distance, position, height, etc. of the user 104 at the rightmost end among the users watching the in-vehicle video playback on site relative to the in-vehicle camera device 230.

[0106] In step S210, Figure 5B As shown, it is desired that the projection screen 240 is parallel to the plane formed by the user 101 and the user 104 (shown as line LR in the figure). It can be understood that since the depth and position of the users 101 and 104 relative to the vehicle-mounted camera device 230 have been obtained in step S110, the distance between LR can be determined according to the leftmost facial feature position data and the rightmost facial feature position data, and then the roll angle α can be determined according to the depth and LR distance of the users 101 and 104 relative to the vehicle-mounted camera device 230. The control device 220 can adjust the roll angle α of the projection screen 240 by controlling the adjustment device 250 of the projection screen 240. In this embodiment, the adjustment device 250 is an angle adjuster including gears, driving components, etc., so that the projection screen 240 can be driven to rotate from the initial position to the desired projection screen 240' parallel to the LR plane based on the determined roll angle α.

[0107] In other embodiments of the present invention, when there is only one user on site, the leftmost and rightmost user facial feature position data can be selected from the depth and position of two key points at the left and right corners of the user's facial model from the projection screen 240. The method for obtaining the roll angle of the projection screen 240 is as described above and will not be repeated here. In another preferred embodiment, the facial roll angle of the only user obtained according to the facial posture can be directly considered as the roll angle parameter of the projection screen 240.

[0108] Originally, the distances between the faces of the leftmost and rightmost users in front of the projection screen 240 and the plane of the projection screen 240 may be too different. By adjusting the projection screen 240 according to the roll angle parameter, the adjusted distances of the plane of the projection screen 240 relative to the leftmost and rightmost users are substantially the same.

[0109] To implement step S200, Fig. 6A In the illustrated embodiment, step S100 is further refined into step S120: obtaining top facial feature position data and bottom facial feature position data in the facial data; then, step S200 is further refined into step S220: determining the height of the projection screen based on the top facial feature position data and the bottom facial feature position data.

[0110] In step S120, the topmost facial feature position data obtained refers to the facial feature position data of the distance, position, height, etc. of the user at the highest position among the users watching the in-vehicle video playback on site relative to the in-vehicle camera device 230. The bottommost facial feature position data refers to the facial feature position data of the distance, position, height, etc. of the user at the lowest position among the users watching the in-vehicle video playback on site relative to the in-vehicle camera device 230.

[0111] The average height of the user relative to the vehicle-mounted camera device 230 can be obtained by measuring the height of the highest and lowest users relative to the vehicle-mounted camera device 230, and the average height is used as the height parameter of the projection screen 240. Figure 6B As shown, the control device 220 controls the adjustment mechanism 250 to adjust the height parameter of the projection screen 240 to the projection screen 240 ′ so that it can be adapted to the viewing of users of different heights.

[0112] To implement step S200, Fig. 7A In the illustrated embodiment, step S100 is further refined into step S130: acquiring facial pitch data in the facial data; then, step S200 is further refined into step S230: determining a pitch angle parameter β of the projection screen according to the facial pitch data.

[0113] Furthermore, in the case of multiple users, the facial pitch data is the facial pitch mean data. It is understandable that the facial pitch mean data can be obtained by calculating the average of the maximum pitch angle parameter value Pmax and the minimum pitch angle parameter value Pmin of the user collected in the above step S100. The average calculation method includes but is not limited to the arithmetic average calculation method, the weighted average calculation method, etc.

[0114] After obtaining the average pitch data P of the maximum and minimum pitch angles of the faces of the users on site, the control device 220 controls the adjustment device 25 to rotate and adjust the pitch angle of the projection screen 240 so that the users can watch the screen at a more comfortable pitch angle. Figure 7B As shown, the angle at which the projection screen 240 rotates from the initial state to the projection screen 240 ′ is the pitch angle parameter β of the projection screen 240 .

[0115] according to Figure 5A-5B , 6A-6B, 7A-7B, after the control device 220 obtains the facial data of at least one user located outside the vehicle, the posture parameters of the projection screen 240 are determined according to the obtained facial data of the user, so as to implement step S200. The posture parameters are the position and posture of the projection screen 240, mainly including the roll angle parameters, height parameters and pitch angle parameters of the projection screen 230 obtained based on the facial data of the user.

[0116] In step S300, the control device 220 controls the adjustment device 250 connected to the projection screen 240 based on the posture parameters of the projection screen 240, so that the projection screen 240 can be adjusted to a suitable position and posture according to the posture parameters.

[0117] In some embodiments of the present invention, the adjustment device 250 may include a plurality of sub-adjustment devices respectively arranged on the upper and lower sides of the projection screen. For example, one sub-adjustment device may be arranged at the center of each of the upper and lower sides, or two sub-adjustment devices may be arranged at the left and right end corners of each of the upper and lower sides, or a sub-adjustment device may be arranged at the center of the upper side and two self-adjustment devices may be arranged at the lower side, etc. The structure of the adjustment device 250 itself may include a gear that moves in a predetermined track.

[0118] The structure, number and location of the adjustment device 250 can be adjusted according to the actual situation, combined with the vehicle body structure and the viewing needs of the user, and are not limited to the above examples. The adjustment mechanism located above the projection screen is used to fix the upper half of the projection screen 240, and the adjustment mechanism below the projection screen is used to fix the lower half of the projection screen 240.

[0119] After the projection screen 240 of the vehicle is adjusted to a suitable position, step S400 is executed, and the control device 220 of the vehicle controls the vehicle-mounted projection device 260 to project the video data in the audio and video data onto the projection screen 230. At the same time, step S500 is executed, and the control device 220 controls the vehicle-mounted external speaker 270 to synchronously play the audio data in the audio and video data outside the vehicle, thereby performing the vehicle-mounted audio and video playback.

[0120] According to the method provided by the present invention, the position of the projection screen can be adjusted according to the facial data of the user, thereby providing the user with a better viewing angle.

[0121] Preferably, in other embodiments of the present invention, when the distance between the projection screen 230 of the vehicle to be used for in-vehicle audio and video playback and the user is too large or the relative angle between the projection screen 230 and the user deviates too much, it is necessary to adjust the position of the current vehicle so that the distance and angle of the projection screen 230 relative to the user are within the range for in-vehicle audio and video viewing, thereby providing the user with a better viewing angle based on adjusting the position of the projection screen.

[0122] Please combine Figure 8 and Fig. 9 To understand, Figure 8 A vehicle position adjustment flow chart of a method for controlling in-vehicle video and audio playback according to an embodiment of the present invention is shown. Fig. 9 A schematic diagram of vehicle position adjustment in a method for controlling vehicle-mounted audio and video playback provided according to an embodiment of the present invention is shown.

[0123] In this embodiment, after the in-car audio-visual mode is turned on, the present invention can determine whether the position of the vehicle needs to be adjusted, especially the position relationship between the vehicle trunk door and the user, so that the position and angle of the vehicle trunk door adapt to the viewing angle of the user on site. In the subsequent steps, the angle of the projection screen is fine-tuned according to the user's facial data to provide the user with a better viewing angle.

[0124] Please refer to Figure 8 To understand how to adjust the vehicle position, specifically, the following steps can be included:

[0125] Step S810: obtaining the current positions of the at least one user and the vehicle;

[0126] Step S820: determining a current relative position relationship between the trunk door and the at least one user according to the current positions of the at least one user and the vehicle;

[0127] Step S830: In response to the current relative position relationship not meeting a preset target relative position relationship, determining a driving parameter for adjusting the position and / or orientation of the vehicle; and

[0128] Step S840: Controlling the movement of the vehicle based on the driving parameters.

[0129] In step S810, the vehicle and the user can be positioned through the vehicle-mounted UWB installed in the vehicle and the smart mobile terminal carried by the user to obtain the current position of at least one user and the vehicle. UWB (Ultra WideBand) is a carrier-free communication technology that uses non-sinusoidal narrow pulses in the nanosecond to microsecond range to transmit data. By transmitting extremely low-power signals over a wider spectrum, UWB can achieve data transmission rates of hundreds of Mbit / s to several Gbit / s within a range of about 10 meters. UWB has strong anti-interference performance, high transmission rate and large system capacity. The UWB system transmission power is very small, and communication equipment can achieve communication with a transmission power of less than 1mW. The low transmission power of UWB greatly extends the system power supply working time.

[0130] In one embodiment, if Fig. 9 As shown, the vehicle-mounted UWB can be considered to be located at the center of the vehicle body O. The user 100 holds a smart device, such as a mobile phone, to communicate with the vehicle-mounted UWB on the vehicle 110, so as to obtain not only the current location information of the vehicle 110 but also the current location information of the user 100.

[0131] Furthermore, it is necessary to determine the current relative position relationship between the trunk door and at least one user according to the current position of at least one user and the vehicle in step S820. In step S820, after the control device 220 obtains the current position information of the vehicle 110 and the current position information of the user 100, it can determine the current relative position relationship between the trunk door of the vehicle 110 and the user 100. The above relative position relationship includes relative angle and relative distance. Fig. 9 As shown, in the initial state, the center point of the vehicle 110 is represented by point O, and the direction of the line connecting the center point of the vehicle and the rear trunk door is the facing direction of the trunk door, which is also the facing direction of the projection screen. Fig. 9 In the example, it can be considered that the trunk door of the vehicle 110 is facing Fig. 9 At point D just above the user 100, the user 100 is located on the left side of the trunk door of the vehicle 110, which is a long distance from the vehicle 110 and has a large relative angle with respect to the user. In this case, it is difficult to achieve the desired effect by adjusting the position of the projection screen 240 by the adjustment mechanism 250, and it is necessary to adjust the angle of the rear of the vehicle toward the user.

[0132] In another embodiment, the current position of the user and the vehicle and the current relative position relationship between the two can also be obtained through the vehicle-mounted camera device 230. The above-mentioned vehicle-mounted camera device 230 can be the camera device set on the projection screen as described above. It can also be a panoramic or wide-angle camera that is different from the camera device set on the projection screen but is also set toward the rear of the vehicle, so that the vehicle can be characterized based on the vehicle-mounted camera device 230, especially the current position of the trunk door at the rear of the vehicle, and the current relative position relationship between the user and the trunk door of the vehicle can be determined through the user image obtained by the camera device.

[0133] In step S830, in response to the current relative position relationship not meeting the preset target relative position relationship, it is necessary to determine the driving parameters for adjusting the position and / or orientation of the vehicle. That is, before executing step S830, it is first necessary to determine whether the current relative position relationship between the vehicle 110 and the user 100 meets the preset target relative position relationship between the two. If the current relative position relationship meets the target relative position relationship, the vehicle 110 may not need to make a position adjustment; if the current relative position relationship does not meet the target relative position relationship, the vehicle 110 needs to make a position adjustment.

[0134] The above-mentioned target relative position relationship further includes target position relationship and target relative angle relationship. Fig. 9 To understand the above target position relationship and target relative angle relationship. The target position relationship is associated with the position of the center point of the vehicle body, and the target relative angle relationship is associated with the direction of the line between the center point of the vehicle body and the rear trunk door described above, that is, the relative angle between the trunk door facing the user and the user facing the trunk door.

[0135] like Fig. 9 As shown, in an embodiment based on UWB device positioning, the user 100 can provide his own location information through the UWB positioning device of the smart device. That is, the user draws an arc from left to right facing forward, the endpoints A and B of the arc represent the area where the user is located, and the protruding direction of the arc represents the direction facing the user.

[0136] Therefore, it is hoped that the center point O of the vehicle body falls within the rectangle AA'B'B with AB as one side, that is, the target position relationship is the position represented by the rectangle AA'B'B. Among them, the length of the side AA' of the rectangle AA'B'B is the preset maximum acceptable distance h from the vehicle to the user (assuming 10 meters). At the same time, the target relative angle relationship defines that the line OD between the center point O of the vehicle body and the rear trunk door should be within the triangle formed by the center point O of the vehicle body and the two points A and B.

[0137] If the center point of the vehicle body is outside the rectangle AA'B'B, it means that the vehicle is too far to the left or right of the user. In this case, even if the OD line representing the direction of the trunk door is within the triangle OAB, the user still needs to turn sideways to face the trunk door. On the other hand, it means that the vehicle is too far away from the user, and the user may not be able to see the content on the projection screen clearly, which is especially unfriendly to myopic users.

[0138] If the OD line representing the direction of the trunk door is outside the range of the triangle OAB, even if the center point O of the vehicle body is within the area of ​​the rectangle AA'B'B, the user still needs to turn sideways or move to face the trunk door. Therefore, the above-mentioned relative position relationship of the target needs to be considered from two dimensions.

[0139] from Fig. 9 In the illustrated embodiment, it can be considered that the center point O of the vehicle body is located inside the rectangle AA'B'B, but the line OD between the center point O of the vehicle body and the trunk door at the rear of the vehicle is not within the range of the triangle OAB. It can be considered that the relative angle between the vehicle 110 and the user does not meet the preset target relative angle relationship.

[0140] If it is determined in step S830 that the current relative position relationship does not meet the preset target relative position relationship, it is necessary to determine the driving parameters for adjusting the position and / or orientation of the vehicle. It is understandable that, although the target relative position relationship is a concept of a range when determining the current relative position relationship, since the position of the vehicle needs to be adjusted, it is hoped that the driving parameters can be determined with the optimal target position.

[0141] The above optimal target position is related to the midpoint of line segment AB. Generally speaking, it can be considered that the arc from A to B determined by the user through the UWB device is drawn with the user as the midpoint. Fig. 9 As shown, two points AB are connected to determine the midpoint C between the two points AB, and the point C is used to represent the user's own position. A perpendicular line is drawn through point C to the line segment AB, and it can be considered that the direction of this perpendicular line is the most directly facing the user. Therefore, it is hoped that the line OD connecting the center point O of the vehicle body and the rear trunk door coincides with this perpendicular line (the best direction and orientation), and it is hoped that the distance between the center point O of the vehicle body and point C after adjustment is the above-mentioned preset distance h (the best distance).

[0142] And in Fig. 9 In the illustrated embodiment, it can be considered that the center point O of the vehicle body is already located on this vertical line. If the center point O of the vehicle body is already located on this vertical line, and the distance between OC is less than or equal to the preset distance h, it can be considered that the vehicle no longer needs to be moved, but only needs to be turned, that is, the turning angle of turning the vehicle from the OD direction to the OC direction needs to be determined as the vehicle turning angle, so as to determine the driving parameters.

[0143] On the other hand, if the center point O of the vehicle body is not located on the vertical line, or even if the center point O of the vehicle body is located on the vertical line, but the OC distance exceeds the preset distance h, the vehicle needs to be moved to move the center point of the vehicle body to the optimal position. Therefore, it is necessary to determine the vehicle movement trajectory according to the current position of the center point of the vehicle body and the optimal position of the center point of the vehicle body, so as to determine the driving parameters.

[0144] In the above embodiment of determining the moving trajectory, preferably, obstacle information on the moving trajectory of the vehicle also needs to be considered, so as to adjust the moving trajectory of the vehicle to avoid possible obstacles.

[0145] Finally, step S840 is executed to control the movement of the vehicle based on the driving parameters. If the current relative position relationship between the vehicle 110 and the user 100 does not reach the target relative position relationship, the vehicle 110 is adjusted to be within the target relative position relationship range with the user 100 based on the steering angle and / or movement trajectory in the driving parameters.

[0146] If it is determined in step S830 that the driving parameters of the position and orientation of the vehicle need to be adjusted, in some embodiments, step S840 can be divided into two sub-steps, namely, after the steering angle is determined, the sub-step of moving the vehicle to adjust the vehicle orientation, and after the movement trajectory is determined, the sub-step of moving the vehicle to adjust the vehicle position, and the order of the above two sub-steps can be interchanged. In other embodiments, after the steering angle and the movement trajectory are determined, the vehicle can be moved to synchronously adjust the vehicle orientation and position to adjust the relative position relationship between the vehicle and the user.

[0147] Thus, according to the above embodiment, the present invention can use the user's position and orientation as a reference point to set the position of the projection screen outside the vehicle with one click, thereby improving the convenience of the user in adjusting the projection screen. So far, the control method of in-vehicle audio and video playback provided by one aspect of the present invention has been described, which can project audio and video to a user outside the vehicle, and can automatically adjust the position of the in-vehicle projection screen according to the user's facial data to adapt to the user's viewing angle, thereby greatly improving the user experience of the in-vehicle audio and video mode.

[0148] Another aspect of the present invention provides a vehicle-mounted audio and video playback control device, comprising: at least one processor; and a memory coupled to the at least one processor, wherein the memory contains instructions stored therein, and when the instructions are executed by the at least one processor, the control device executes the following Figure 3 The control method of in-vehicle audio and video playback is shown.

[0149] Please combine Fig.10 To understand the vehicle-mounted audio and video playback control device 1000 provided by the present invention. Fig.10 As shown, in this embodiment, the control device 1000 is in the form of a general computer device, which is used to implement the steps of the control method for in-vehicle audio and video playback described in any of the above embodiments. For details, please refer to the above description of the control method for in-vehicle audio and video playback, which will not be repeated here.

[0150] The components of the control device 1000 may include one or more memories 1001, one or more processors 1002, and a bus 1003 connecting different system components (including the memories 1001 and the processors 1002).

[0151] The bus 1003 includes a data bus, an address bus, and a control bus. The product of the number of bits of the data bus and the operating frequency is proportional to the data transmission rate. The number of bits of the address bus determines the maximum addressable memory space. The control bus (read / write) indicates the type of bus cycle and the time when the input / output operation is completed. The processor 1002 is connected to the memory 1001 via the bus 1003 and is configured to implement the control method for in-vehicle audio and video playback provided by any of the above embodiments.

[0152] The processor 1002 is the computing and control core of the control device 1000 and is the final execution unit for information processing and program operation. All software layer operations in the computer system will eventually be mapped to the operations of the processor 1002 through the instruction set. The functions of the processor 1002 are mainly to process instructions, execute operations, control time, and process data.

[0153] The memory 1001 refers to various storage devices in a computer for storing programs and data. The memory 1001 may include a computer system readable medium in the form of a volatile memory, such as a random access memory (RAM) 1004 and / or a cache memory 1005.

[0154] Random Access Memory (RAM) 1004 is an internal memory that directly exchanges data with the processor 1002. It can be read and written at any time (except when refreshed) and is very fast. It is usually used as a temporary data storage medium for the operating system or other running programs. Once the power is off, the data stored in it will be lost. Cache Memory (Cache) 1005 is a primary memory between the main memory and the processor 1002. Its capacity is relatively small but its speed is much higher than the main memory, close to the speed of the processor 1002.

[0155] It should be noted that, when the control device 1000 includes multiple memories 1001 and multiple processors 1002, the multiple memories 1001 and the multiple processors 1002 can have a distributed structure, for example, it can include memories and processors located at the local end and the background cloud, respectively, and the local end and the background cloud jointly implement the above-mentioned vehicle-mounted audio and video playback control method. Furthermore, in the embodiment adopting a distributed structure, each step can adjust the specific execution terminal according to the actual situation, and the specific scheme of each step implemented in a specific terminal should not unduly limit the protection scope of the present invention.

[0156] The control device 1000 may further include other removable / immovable, volatile / non-volatile computer system storage media. In this embodiment, the storage system 1006 may be used to read and write immovable, non-volatile magnetic media.

[0157] The memory 1001 may also include at least one set of program modules 1007. The program modules 1007 may be stored in the memory 1001. The program modules 1007 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may include an implementation of a network environment. The program modules 1007 generally perform the functions and / or methods of the embodiments described herein.

[0158] The control device 1000 may also communicate with one or more external devices 1008. The external devices 1008 in this embodiment include an in-vehicle camera device, an in-vehicle projection device, and an in-vehicle external speaker for acquiring in-vehicle data. The external device 1008 also includes a display 1009. When implementing the in-vehicle audio and video playback control method, the control device 1000 may display the position relationship between the user and the vehicle through the display 1009.

[0159] The control device 1000 may also communicate with one or more devices that enable a user to interact with the control device 1000, and / or with any device (e.g., a network card, a modem, etc.) that enables the control device 1000 to communicate with one or more other computing devices. Such communication may be performed through an input / output (I / O) interface 1010.

[0160] The control device 1000 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN) and / or a public network, such as the Internet) through the network adapter 1011. Fig.10As shown, the network adapter 1011 communicates with other modules of the control device 1000 via the bus 1003. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the control device 1000, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0161] Another aspect of the present invention further provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the method for controlling in-vehicle audio and video playback as described in any of the above embodiments. For details, please refer to the above description, which will not be repeated here. In addition, it can be understood that the above-mentioned computer-readable storage medium can also be in the form of a system, that is, including multiple computer-readable storage sub-media, so as to jointly implement the steps of the method for controlling in-vehicle audio and video playback described above through multiple computer-readable storage media.

[0162] So far, the control method, control system and control device of the in-vehicle audio and video playback provided by the present invention have been described. The present invention can automatically adjust the position of the in-vehicle projection screen according to the facial data of the audience to achieve the best viewing angle most suitable for all the audience, thereby greatly improving the user experience of the in-vehicle external audio and video playback mode.

[0163] The various illustrative logic modules and circuits described in conjunction with the embodiments disclosed herein may be implemented or executed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in cooperation with a DSP core, or any other such configuration.

[0164] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software module may reside in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read and write information from / to the storage medium. In an alternative, a storage medium may be integrated into a processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In an alternative, the processor and the storage medium may reside in a user terminal as discrete components.

[0165] In one or more exemplary embodiments, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented as a computer program product in software, each function may be stored on or transmitted by a computer-readable medium as one or more instructions or codes. Computer-readable media include both computer storage media and communication media, including any medium that facilitates the transfer of a computer program from one place to another. Storage media may be any available medium that can be accessed by a computer. As an example and not limitation, such a computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, disk storage or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of an instruction or data structure and can be accessed by a computer. Any connection is also properly referred to as a computer-readable medium. For example, if the software is transmitted from a website, a server, or other remote source using a coaxial cable, a fiber optic cable, a twisted pair, a digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwaves, the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwaves are included in the definition of the medium. Disk and disc as used herein include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, wherein disk often reproduces data magnetically, while disc reproduces data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0166] The foregoing description is provided to enable any person skilled in the art to practice the various aspects described herein. However, it should be understood that the scope of protection of the present invention shall be subject to the appended claims and shall not be limited to the specific structures and components of the above-described embodiments. Those skilled in the art may make various changes and modifications to the embodiments within the spirit and scope of the present invention, and these changes and modifications also fall within the scope of protection of the present invention.

Claims

1. A method for controlling in-vehicle audio and video playback, characterized in that: The following steps are involved: In response to the in-vehicle audio and video mode being turned on, obtaining the current position of at least one user and the vehicle located outside the vehicle; wherein, in the in-vehicle audio and video mode, the trunk door is opened and the projection screen is in an unfolded state, and the projection screen is integrated in the trunk door; Determining a current relative position relationship between the trunk door and the at least one user according to the current positions of the at least one user and the vehicle; In response to the current relative position relationship not meeting a preset target relative position relationship, determining a driving parameter for adjusting the position and / or orientation of the vehicle; Controlling movement of the vehicle based on the driving parameters; Controlling the vehicle-mounted projection device to project video data in the audio and video data onto the projection screen; The vehicle-mounted external speaker is controlled to synchronously play the audio data in the audio-visual data.

2. The control method according to claim 1, wherein: The current relative position relationship includes a current relative angle between the trunk door and the at least one user, and the target relative position relationship includes a target relative angle between the trunk door and the at least one user; The determining of driving parameters related to adjusting the position and / or orientation of the vehicle further comprises the steps of: Based on the current relative angle and the target relative angle, a vehicle steering angle for turning the vehicle from the current relative angle to the target relative angle is determined as the driving parameter.

3. The control method according to claim 1 or 2, wherein: The target relative position relationship includes a target relative angle relationship, and the target relative angle relationship indicates a relative angle between the facing direction of the trunk door and the facing direction of the at least one user.

4. The control method according to claim 3, wherein: The facing direction of the trunk door is the direction of the line connecting the center point of the vehicle body and the trunk door, and the facing direction of the at least one user is the direction of the arc drawn by the at least one user holding a smart device toward the front of himself, and the smart device includes a UWB positioning device.

5. The control method according to claim 1, wherein: The target relative position relationship includes the target position of the trunk door relative to the at least one user; The determining of driving parameters related to adjusting the position and / or orientation of the vehicle further comprises the steps of: Based on the current position of the vehicle and the target position, a vehicle movement trajectory that moves the vehicle from the current position of the vehicle to the target position is determined as the driving parameter.

6. The control method according to claim 1, wherein: Before controlling the vehicle-mounted projection device to project the video data in the audio and video data onto the projection screen, the control method further includes the following steps: acquiring facial data of at least one user located outside the vehicle; Determine the posture parameters of the projection screen according to the facial data of the at least one user; The posture of the projection screen is adjusted based on the posture parameters.

7. The control method according to claim 6, wherein: The facial data includes facial feature position data representing a relative position between the at least one user and the projection screen.

8. The control method according to claim 1, wherein: The vehicle is controlled to move based on the driving parameters so that the vehicle is adjusted to be within the target relative position relationship range with the at least one user.

9. The control method according to claim 1, wherein: The vehicle-mounted external speaker is arranged on the inner side of the vehicle body panel to synchronously play the audio data in the video data to the outside of the vehicle.

10. A method for controlling in-vehicle audio and video playback, characterized in that: The following steps are involved: In response to the in-vehicle video and audio mode being turned on, acquiring facial data of a plurality of users located outside the vehicle; Determining, according to the facial data of the plurality of users, a position parameter of a projection screen, wherein the projection screen is integrated in a trunk door of the vehicle, and in the in-vehicle audio-visual mode, the trunk door is open and the projection screen is in an unfolded state; adjusting the posture of the projection screen based on the posture parameters; Controlling the vehicle-mounted projection device to project video data in the audio and video data onto the projection screen; The vehicle-mounted external speaker is controlled to synchronously play the audio data in the audio-visual data.

11. The control method according to claim 10, wherein: The facial data includes facial feature position data representing relative positions between the plurality of users and the projection screen.

12. The control method according to claim 10, wherein: The posture of the projection screen is adjusted based on the posture parameters so that the projection screen is parallel to a plane formed by a leftmost user and a rightmost user among the multiple users.

13. The control method according to any one of claims 10 to 12, wherein: The facial data includes leftmost facial feature position data and rightmost facial feature position data, the leftmost facial feature position data is the facial feature position data of the user located at the leftmost end among the multiple users, and the rightmost facial feature position data is the facial feature position data of the user located at the rightmost end among the multiple users.

14. The control method according to claim 13, wherein: The posture parameters include roll angle parameters, and the step of determining the posture parameters of the projection screen according to the facial data of the plurality of users further includes the steps of: The roll angle parameter of the projection screen is determined according to the leftmost facial feature position data and the rightmost facial feature position data.

15. The control method according to claim 10 or 11, wherein: The facial data includes topmost facial feature position data and bottommost facial feature position data, the topmost facial feature position data being the facial feature position data of a user located at the highest position among the multiple users, and the bottommost facial feature position data being the facial feature position data of a user located at the lowest position among the multiple users.

16. The control method according to claim 15, wherein: The posture parameters include height parameters, and the step of determining the posture parameters of the projection screen according to the facial data of the at least one user further includes the steps of: A height parameter of the projection screen is determined based on the topmost facial feature position data and the bottommost facial feature position data.

17. The control method according to claim 10 or 11, wherein: The facial data includes facial pitch mean data, the posture parameters include pitch angle parameters, and determining the posture parameters of the projection screen according to the facial data of the at least one user further includes the steps of: The pitch angle parameter of the projection screen is determined according to the facial pitch mean data.

18. The method of claim 10, wherein: Before acquiring facial data of a plurality of users located outside the vehicle, the control method further comprises the following steps: Obtaining current locations of the multiple users and the vehicle; Determining a current relative position relationship between the trunk door and the multiple users according to the current positions of the multiple users and the vehicle; In response to the current relative position relationship not meeting a preset target relative position relationship, determining a driving parameter for adjusting the position and / or orientation of the vehicle; The vehicle movement is controlled based on the driving parameters.

19. The method of claim 10, wherein: The vehicle-mounted external speaker is arranged on the inner side of the vehicle body panel to synchronously play the audio data in the video data to the outside of the vehicle.

20. A vehicle-mounted audio and video playback control device, comprising: at least one processor; as well as A memory coupled to the at least one processor, the memory containing instructions stored therein, and the instructions, when executed by the at least one processor, enable the control device to execute the control method for in-vehicle audio and video playback as described in any one of claims 1-9 or claims 10-19.

Images