In-vehicle projection system, control method of the same and vehicle

Abstract

To provide an in-vehicle projection system, a control method of the same and a vehicle.SOLUTION: An in-vehicle projection system 1 comprises: a control apparatus which receives a user command, acquires a display interface related to operation of the command, and decides a position of the user in a vehicle based on the command; and a projection apparatus which projects the display interface to a prescribed area in the vehicle corresponding to the position of the user. The control apparatus starts execution of the operation of the command of the user to display a process in the display interface where the control apparatus executes the operation of the command of the user. Thereby, the display interface related to the operation of the command issued by the user is projected into an appropriate region the user can see so that the user can intuitively see the execution process of the command to improve interestingness and user experience.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to the field of in-vehicle device control, and particularly relates to an in-vehicle projection system, a control method for an in-vehicle projection system, and a vehicle.

Background Art

[0002] With the development of the automobile industry, in-vehicle networking functions have also evolved, and both in-vehicle entertainment devices and in-vehicle infotainment components can be controlled by an operating system.

[0003] Conventional control operations need to be realized by the user touching the screen by hand or pressing a button. However, for the driver, when controlling by touching the screen by hand or pressing a button during the driving process, the user experience is not good, which is disadvantageous to driving safety. For passengers sitting in the rear seats, it is difficult to participate in the control of the entertainment operating system or the in-vehicle infotainment screen, and the physical experience is also poor.

[0004] With the development of voice recognition technology, some control operations, such as turning on, switching, and volume adjustment of the entertainment system, can be realized by the in-vehicle voice recognition function, thereby greatly improving the user experience of the driver and passengers and being also advantageous to driving safety.

[0005] It should be noted that the above description of the technical background is only for clearly and completely explaining the technical solutions of the present invention and facilitating the understanding of those skilled in the art. These technical solutions are only described in the background art part of the present invention, and it should not be considered that the above technical solutions are known to those skilled in the art.

Summary of the Invention

Problems to be Solved by the Invention

[0006] The inventor found that although all users in the vehicle can control the entertainment system through voice commands, since only the result feedback of the voice commands can be heard, the process of voice control cannot be intuitively seen, lacking in interestingness. Also, since the result of adjustment control cannot be immediately confirmed, when the voice recognition is incorrect and the adjustment control is wrong, it cannot be discovered in a timely manner, and an intuitive feeling as if the user is operating the entertainment system himself / herself cannot be provided.

Means for Solving the Problem

[0007] In order to solve at least one problem in the above prior art, the present invention provides an in-vehicle projection system, a control method thereof, and a vehicle, which enable a user to intuitively view the execution process of a command, enhance interestingness, and improve the user experience.

[0008] The in-vehicle projection system according to the first aspect of the embodiment of the present invention includes a control device that receives a user's command, obtains a display interface related to the operation of the command, and determines the position of the user in the vehicle based on the command, and a projection device that projects the display interface onto a predetermined area in the vehicle corresponding to the position of the user, wherein the control device starts the execution of the operation of the user's command, and the display interface displays the process of the control device executing the operation of the user's command.

[0009] Furthermore, by projecting the display interface related to the operation of the command issued by the user onto an appropriate area where the user can view it, the user can intuitively view the execution process of the command, enhance interestingness, improve the user experience, and create an intuitive feeling as if the user himself / herself is operating the interface.

[0010] According to the second aspect of the embodiment of the present invention, the display interface includes a first interface before executing the operation of the command, and / or a second interface after completing the execution of the operation of the command, and / or a third interface in the process from before executing the operation of the command to after completing the execution of the operation of the command.

[0011] Furthermore, by displaying the interface of the process of executing the user's command to the user, the user can intuitively see the process of executing their own command and the changes before and after adjustment and control, enabling the user to obtain an immersive experience and improve the riding experience.

[0012] According to the third aspect of the embodiment of the present invention, the predetermined area includes at least one projection area, and the position of the projection area is determined based on the position of the user in the vehicle or the position of the user in the vehicle and the number of users.

[0013] Furthermore, by determining the projection area based on the position of the user or the position and number of the user, the projection area can be made to correspond to the user, enabling the user to intuitively view the screen on which they are projected, which is more user-friendly.

[0014] According to the fourth aspect of the embodiment of the present invention, the position of the user includes the area where the user is located in the vehicle and / or the seat where the user is located in the vehicle.

[0015] Furthermore, the position of the user may be determined by the area where the user is located in the vehicle, such as the front row or the rear row, or may be determined by the seat of the user in the vehicle, such as the right seat in the rear row. In this way, the predetermined area may be correspondingly set based on the position of the user, or may be set based on the actual needs to meet the preferences of the user.

[0016] According to the fifth aspect of the embodiment of the present invention, the predetermined area includes the front of the area where the user is located in the vehicle and / or the front of the seat where the user is located in the vehicle.

[0017] Furthermore, the predetermined area may be determined based on the setting method of the user's position, may be located in front of the vehicle interior area corresponding to the vehicle interior area, or may be located in front of a certain seat corresponding to a certain seat. In this way, the setting of the predetermined area may be set based on actual needs so as to meet the user's preferences.

[0018] According to a sixth aspect of an embodiment of the present invention, the predetermined area includes a plurality of projection areas, each seat in the vehicle corresponds to one of the projection areas, and when the control device receives a user command, based on the seat where the user is located, it determines the corresponding projection area, and the projection device projects the display interface onto the corresponding projection area.

[0019] According to a seventh aspect of an embodiment of the present invention, the predetermined area includes a plurality of projection areas, the vehicle interior space is virtually divided into a plurality of divided areas, each divided area corresponds to one of the projection areas, and when the control device receives a user command, based on the divided area where the user is located, it determines the corresponding projection area, and the projection device projects the display interface onto the corresponding projection area.

[0020] Furthermore, a solution means is provided when the projection area corresponds to a seat or a divided area in the vehicle interior, and by correspondingly setting the projection area according to the user's needs and the actual situation, the user's needs can be satisfied and the setting of the projection area can be simplified as much as possible.

[0021] According to an eighth aspect of an embodiment of the present invention, the control device further acquires the seat and / or number where the user is located within the divided area, and the projection device adjusts the position of the projection area corresponding to the divided area based on the seat and / or number where the user is located within the divided area.

[0022] According to a ninth aspect of an embodiment of the present invention, the vehicle interior space is divided into the plurality of divided areas based on the position and / or number where the user is located.

[0023] Furthermore, the divided area may be divided based on the situation inside the vehicle, such as the position and number of users inside the vehicle, allowing the user to intuitively view the display interface and providing an optimal area division. For example, when there are passengers on both the left and right sides of the rear row seats, by setting the entire rear row seats as one divided area, the display interface can be projected in the middle of the rear row area so that users on both sides can view it. When there are passengers on both the left side and the middle seat in the rear row, the left side and the middle seat in the rear row may be set as one divided area, and the specific position in the projection area of the display interface may be set in front of the left seat and the middle seat. The specific position in the projection area of the display interface may be adjusted according to the user's needs so as to better meet the user's personalization needs.

[0024] According to the tenth aspect of the embodiment of the present invention, the predetermined area includes at least one projection area, and the projection device projects two or more display interfaces simultaneously within the at least one projection area.

[0025] Furthermore, different display interfaces can be simultaneously displayed within one projection area. In this way, when the projection area is reasonably set, the needs of different users can also be met.

[0026] The projection device may include at least one projection apparatus, and the at least one projection apparatus includes a three-dimensional projection apparatus and / or a two-dimensional projection apparatus.

[0027] Furthermore, as the projection apparatus, a two-dimensional projection apparatus and / or a three-dimensional projection apparatus may be selected, and the selection is based on actual needs or the needs of the device to expand applicability.

[0028] According to the eleventh aspect of the embodiment of the present invention, the command includes a voice command and / or a gesture command.

[0029] Furthermore, by recognizing voice commands or gesture commands, the needs of different people can be satisfied and the service group of the product can be expanded.

[0030] According to a twelfth aspect of an embodiment of the present invention, the display interface includes an interface related to in-vehicle entertainment equipment, and the control device acquires the interface of the in-vehicle entertainment equipment based on the command.

[0031] Furthermore, by projecting the interface of the in-vehicle entertainment equipment in front of the user's eyes, a feeling that the user operates the in-vehicle entertainment equipment by himself / herself is created.

[0032] According to a thirteenth aspect of an embodiment of the present invention, the in-vehicle projection system further includes a mounting device, on which the projection device is movably and / or rotatably mounted, and the projection device controls the mounting device to move and / or rotate based on the position of the user, and projects the display interface onto the predetermined area.

[0033] Furthermore, after determining the predetermined area, the projection area of the projection device is adjusted by the mounting device, and since projection at any position within the entire vehicle area can be realized by one projection device, the projection area can be adapted to the user's viewing, and the user's in-vehicle experience can be further improved.

[0034] According to a fourteenth aspect of an embodiment of the present invention, the specific projection position in the predetermined area of the display interface changes correspondingly based on changes in the user's line of sight and / or the orientation of the user's face, and / or the specific projection position in the predetermined area of the display interface moves to another position based on the user's operation.

[0035] Furthermore, by controlling the specific projection position in a predetermined area of the display interface based on the user's line of sight, face orientation, operations, etc., and displaying the display interface following the user's line of sight or intention, the user can intuitively view the display interface in any state, further improving the user's in-vehicle experience. Also, based on the user's own operations, the display interface can be projected and displayed at the required position to meet the user's personalization needs.

[0036] According to the 15th aspect of the embodiment of the present invention, when the display interface is projected in the predetermined area for a predetermined time and it is detected within the predetermined time that the user has input a second command to the display interface projected in the predetermined area, a display interface of a process for executing the operation of the second command in the predetermined area is displayed.

[0037] Furthermore, by detecting the second command input by the user to the display interface and displaying the execution process of the second command, the user can continuously view the execution process of the command without a sense of discontinuity, further improving the user's in-vehicle experience.

[0038] According to the 16th aspect of the embodiment of the present invention, the display interface includes a virtual character, and the display interface displays a process in which the virtual character executes the operation of the user's command.

[0039] Furthermore, by displaying on the display interface a process in which a virtual character executes the operation of the user's command, the virtual character can be moved, and the display interface will not be boring to look at, further increasing the interestingness.

[0040] According to the 17th aspect of the embodiment of the present invention, when the control device receives a plurality of commands from a plurality of users, based on the positions where each user is located, it projects the display interface corresponding to each user's command onto each predetermined area corresponding to the position where each user is located. Alternatively, when the control device receives a plurality of commands from a plurality of users, it projects a plurality of display interfaces corresponding to the commands of the plurality of users onto at least one predetermined area corresponding to the locations where the plurality of users are located.

[0041] Furthermore, each user has a dedicated projection area, and even when there are a plurality of users, a personalized response can be provided, and different needs of each user can be satisfied. Of course, according to the needs of the users, display interfaces corresponding to a plurality of users can also be displayed in the same predetermined area, reasonably setting the projection area, and satisfying the needs of different users.

[0042] The control method of the in-vehicle projection system according to the 18th aspect of the embodiment of the present invention is receiving a user's command and obtaining a display interface related to the operation of the command; determining the position of the user based on the command; projecting the display interface onto a predetermined area inside the vehicle corresponding to the position of the user; executing the operation of the user's command and displaying the process of executing the operation of the user's command on the display interface.

[0043] The vehicle according to the 19th aspect of the embodiment of the present invention includes the in-vehicle projection system described in the embodiment of any one of the 1st aspect to the 17th aspect.

[0044] The beneficial effects of the present invention are as follows. By projecting the display interface related to the operation of the command issued by the user onto an appropriate area where the user can view it, the user can intuitively view the command execution process, enhancing the interestingness and improving the user experience. By determining the division of the projection area based on the position and / or number of users inside the vehicle, the needs of the users can be satisfied, realizing a personalized response, and improving the user experience inside the vehicle.

[0045] The embodiments of the present invention will be disclosed in detail with reference to the following description and drawings. It should be understood that the embodiments of the present invention are not limited in scope. Within the spirit and scope of the appended claims, the embodiments of the present invention include many modifications, corrections, and equivalents.

[0046] Features described and / or shown in one embodiment can be used in one or more other embodiments in the same or similar manner, combined with the features in other embodiments, or replace the features in other embodiments.

[0047] Note that the term "comprising / including / having" as used in this specification refers to the presence of a feature, a whole member, or a member, but does not exclude the presence or addition of one or more other features, a whole member, or a member.

Brief Description of the Drawings

[0048] The above and other objects, features, and advantages of the embodiments of the present invention will become more apparent by describing them in detail with reference to the following drawings.

[0049]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Mode for Carrying Out the Invention

[0050] Referring to the drawings, the above-described features of the present invention and other features will become apparent from the following description. The description and drawings specifically disclose specific embodiments of the present invention showing some embodiments that can utilize the principles of the present invention. It should be understood that the present invention is not limited to the described embodiments, but includes all modifications, variations, and equivalents within the scope of the appended claims.

[0051] Hereinafter, with reference to the drawings, the in-vehicle projection system according to an embodiment of the present invention, its control method, and a vehicle will be described.

[0052] (Embodiment 1) Embodiment 1 of the present invention provides an in-vehicle projection system. FIG. 1 is a schematic block diagram of the in-vehicle projection system according to Embodiment 1 of the present invention.

[0053] As shown in FIG. 1, the in-vehicle projection system 1 includes a control device 10 and a projection device 20. The control device 10 receives a user's command, acquires a display interface related to the operation of the command, and determines the position of the user in the vehicle based on the command. The projection device 20 projects the display interface onto a predetermined area corresponding to the position of the user. The control device 10 executes the operation of the user's command, and the display interface displays the process in which the control device 10 executes the operation of the user's command.

[0054] By projecting the display interface related to the operation of the command issued by the user onto an appropriate area where the user can view it, the user can intuitively view the command execution process, enhancing the interestingness, improving the user experience, and creating an intuitive feeling as if the user himself / herself is operating the interface.

[0055] In the embodiments of the present invention, the user's command may be a voice command or a gesture command. For example, the user's voice command may be recognized by a voice recognition chip, or the user's gesture may be captured by an imaging device and then the user's gesture command may be recognized by an image recognition chip. Also, the voice recognition chip and / or the image recognition chip may be integrated into the control device 10. In this way, the control device 10 can directly obtain the recognized command. The voice recognition chip and / or the image recognition chip may be integrated into a device such as an independent processor separate from the control device 10, and then, for example, the recognized command may be transmitted to the control device 10 by means of a wired or wireless communication link or the like. For specific implementation methods, related technologies can be referred to, and the embodiments of the present invention do not limit this.

[0056] Thereby, by recognizing voice commands or gesture commands, the needs of different people can be satisfied and the service group of the product can be expanded.

[0057] In an embodiment of the present invention, the control device 10 can determine the position of the user in the vehicle based on a command. For example, when the user uses a voice command, the control device 10 can detect the direction where the user is located by a voice sensor installed in the vehicle, and thus can determine the position where the user is located. Alternatively, the control device 10 can acquire an in-vehicle image by an imaging device in the vehicle, and analyze and determine the position where the user is located based on the image. Alternatively, the control device 10 can also determine the position where the user is located by combining a seat sensor and a voice sensor in the vehicle. For specific embodiments, related technologies can be referred to, and the embodiments of the present invention do not limit this.

[0058] In an embodiment of the present invention, the display interface includes a first interface before executing the operation of the command, and / or a second interface after completing the execution of the command, and / or a third interface in the process from before executing the operation of the command to after completing the execution of the command.

[0059] In this way, by displaying the interface of the process of executing the user's command to the user, the user can intuitively see the process of executing their own command and the changes before and after adjustment and control, enabling the user to obtain an immersive experience and improving the riding experience.

[0060] For example, as shown in FIG. 1, the vehicle may further include an in-vehicle entertainment device 30 and an in-vehicle infotainment device 40. The in-vehicle entertainment device 30 and the in-vehicle infotainment device 40 may be components of the in-vehicle projection system 1, or may be relatively independent parts from the in-vehicle projection system 1. The in-vehicle entertainment device 30 and the in-vehicle infotainment device 40 may be integrated together. The embodiments of the present invention do not limit this. The control device 10 and the in-vehicle entertainment device 30 or the in-vehicle infotainment device 40 may be integrated together or may be installed relatively independently. For example, the control device 10 may be built into the in-vehicle entertainment device 30. The embodiments of the present invention do not limit this.

[0061] In some embodiments, the display interface may be an interface related to the in-vehicle entertainment device 30 or a schematic interface of the in-vehicle infotainment device 40. For example, the in-vehicle entertainment device 30 includes a music player, which may be a software application program installed in an operating system or a player in hardware. The display interface may be various interfaces preset in the music player application program for interacting with the user, or a schematic interface showing the music player, such as an interface of a rotating record player. Taking the music player application program as an example, the user's command may be, for example, "open the music player". The first interface may be, for example, an interface for displaying an icon of the music player application program. The second interface may be, for example, an interactive interface when the music player application program is open. The third interface may be, for example, all interfaces in the process of switching from the interface for displaying the icon of the music player to the interface after the music player application program is opened.

[0062] Also, for example, the in-vehicle infotainment device 40 includes an air conditioner interface, and the display interface may be a slide bar corresponding to the set temperature of the air conditioner, a cold-warm color gradient bar, or an emoji corresponding to the set temperature. Taking the slide bar as an example, the user's command is, for example, "Set the in-vehicle temperature to 24 degrees", and the first interface may be an interface that displays the slide block stopping at the position representing the current in-vehicle temperature on the slide bar, the second interface may be an interface that displays the slide block stopping at the position representing 24 °C on the slide bar, and the third interface may be an interface that displays the slide block sliding from the position representing the current in-vehicle temperature on the slide bar to the position representing 24 °C.

[0063] In the embodiment of the present application, the projection device 20 may project at least one of the first interface, the second interface, and the third interface. For example, first project the first interface, then project the third interface, and then project the second interface, or project only the second interface, or project only the third interface, or project only the first interface. Specifically, which interface or which interfaces to project may be set based on the user's command as long as the user can view the execution process and result of the command after issuing the command. Of course, the first interface, the second interface, and the third interface may be static interfaces frame by frame or dynamic interfaces, which are not limited here.

[0064] In this way, by displaying the interface related to the execution of the command to the user, the user can obtain an immersive experience and improve the in-vehicle riding experience.

[0065] Hereinafter, the projection area of the display interface will be described.

[0066] FIG. 2 is a schematic diagram for explaining a projection area of the in-vehicle projection system according to Embodiment 1 of the present invention.

[0067] As shown in FIG. 2, taking the example of arranging two rows of seats in the vehicle front and rear, the space inside the vehicle may be virtually divided into a plurality of divided areas. For example, it may be divided into a front row area 201 and a rear row area 202 by a dashed line L1, and the space inside the vehicle may be divided according to different seats such as the driver's seat 211, the front passenger seat 212, the left rear seat 221, the right rear seat 222, and the middle rear seat 223. The specific setting of the divided areas may be customized and set by the user according to the user's needs, or a plurality of area division modes may be preset in the system and the user may select by himself based on the needs. The embodiments of the present invention do not limit the specific setting of the divided areas.

[0068] In the embodiments of the present invention, the direction parallel to the length direction of the vehicle is referred to as the "front-rear direction", the direction parallel to the vehicle height direction of the vehicle is referred to as the "up-down direction", and the direction parallel to the vehicle width direction of the vehicle is referred to as the "left-right direction".

[0069] Also, in the embodiments of the present invention, the example of arranging two rows of seats in the vehicle front and rear is described. However, those skilled in the art should understand that when arranging other numbers of seats in the vehicle, the space inside the vehicle can be divided in the same manner as above. The embodiments of the present invention can also be applied when arranging other numbers of seats in the vehicle, and in the following embodiments, this will not be repeatedly described.

[0070] In the embodiments of the present invention, the position of the user may include the area where the user is located inside the vehicle and / or the seat where the user is located inside the vehicle. For example, as shown in FIG. 2, it may be determined that the user is located in the front row area 201 based on a command issued by the user, or it may be determined that the user is located in the left rear seat 221 based on a command issued by the user.

[0071] In an embodiment of the present invention, the predetermined area may include the front of the area where the user is located inside the vehicle and / or the front of the seat where the user is located inside the vehicle. For example, as shown in FIG. 2, when it is determined that the user is located in the rear row area 202, the display interface may be projected in front of the rear row area 202, for example, on the back of the front row seat, or, for example, when it is determined that the user is located in the passenger seat 212, the display interface may be projected in front of the passenger seat 212, for example, on the front windshield, or on the road surface in front of the vehicle as it travels, or the display interface may be projected into the air in front of the area where the user is located in a holographic projection manner. In this way, the user can view the display interface within the line of sight.

[0072] In this way, by determining the projection area based on the position of the user, or the position and number of the users, the projection area is made to correspond to the user, and the user can intuitively view the projected screen.

[0073] Also, the position of the user may be determined by the area where the user is located inside the vehicle, such as the front row or the rear row, or may be determined by the seat of the user inside the vehicle, such as the rear row right seat. In this way, the predetermined area may be correspondingly set based on the position of the user, or may be set based on the actual needs to meet the preferences of the user.

[0074] In some embodiments, the control device 10 may determine the area where the user is located inside the vehicle based on the received command, and the projection device 20 may project the display interface in front of the area where the user is located.

[0075] As shown in FIG. 2, for example, when a user located in the driver's seat 211 or the passenger seat 212 issues a command, the control device 10 determines, based on the received command, that the user is located in the front row area 201, and the projection device 20 projects the display interface in front of the front row area 201, for example, projects it onto the front row projection area p1, and the front row projection area p1 is located, for example, at an intermediate position in front of the front windshield or in the air in front of the front row seats.

[0076] Alternatively, for example, when a user located in the rear left seat 221, the rear right seat 222, or the rear middle seat 223 issues a command, the control device 10 determines, based on the received command, that the user is located in the rear row area 202, and the projection device 20 projects the display interface in front of the rear row area 202, for example, projects it onto the rear row projection area p2, and the rear row projection area p2 is located, for example, at an intermediate position between the backs of the two front row seats.

[0077] In some embodiments, the control device 10 may determine the seat in the vehicle where the user is located based on the received command, and the projection device 20 may project the display interface in front of the seat where the user is located.

[0078] As shown in FIG. 2, for example, the control device 10 determines that it is a command issued by a user located in the rear right seat 222 based on the received command. In this case, the projection device 20 projects the display interface onto the projection area p6 in front of the rear right seat 222. Also, the projection area corresponding to the driver's seat 211 is p3, the projection area corresponding to the passenger seat 212 is p4, the projection area corresponding to the rear left seat 221 is p5, and the projection area corresponding to the rear middle seat 223 is p2.

[0079] In the embodiments of the present invention, the predetermined area may include at least one projection area. For example, as shown in FIG. 2, the predetermined area may include the projection area p1, or may include the projection areas p1 to p6.

[0080] In some embodiments, the position of the projection area is determined based on the position of the user in the vehicle or the position of the user in the vehicle and the number of users. For example, when the user in the vehicle is located in the front row area 201, the projection area p1 may be determined as the projection position of the display interface, or, for example, when there are two users in the front row area 201, the projection areas p3 and p4 may be determined as the projection positions of the display interface.

[0081] In some embodiments, each seat in the vehicle may correspond to one projection area. When the control device 10 receives a user's command, it determines the corresponding projection area based on the seat where the user is located, and the projection device 20 projects the display interface onto the corresponding projection area. For example, as shown in FIG. 2, each seat in the vehicle corresponds to one projection area. The driver's seat 211 corresponds to the projection area p3, the passenger seat 212 corresponds to the projection area p4, the left rear seat 221 corresponds to the projection area p5, the right rear seat 222 corresponds to the projection area p6, and the middle rear seat 223 corresponds to the projection area p2. When the control device 10 receives a user's command, it may determine, based on the user's command, the seat where the user is located, for example, the left rear seat 221, and determine that the corresponding projection area is the projection area p5. The projection device 20 projects the display interface onto the projection area p5.

[0082] For example, the predetermined area projected by the projection device 20 may include a plurality of projection areas corresponding to the seats in the vehicle. The control device 10 may obtain the number of users in the vehicle and the seats where each user is located in the vehicle. The projection device 20 determines the number of projection areas based on the number of users in the vehicle and projects the display interface onto the corresponding projection areas based on the seats where each user is located in the vehicle.

[0083] As shown in FIG. 2, for example, the projection device 20 may project the display interface onto the areas p2 to p6 corresponding to the seats in the vehicle interior. The control device 10, for example, obtains that there are a total of three users in the vehicle interior, and these three users are respectively in the driver's seat 211, the front passenger seat 212, and the left rear seat 221. The projection device 20 determines that it is necessary to project onto three projection areas, namely p3, which is the projection area corresponding to the driver's seat 211, p4, which is the projection area corresponding to the front passenger seat 212, and p5, which is the projection area corresponding to the left rear seat 221, and may project the display interface onto these projection areas. Similarly, the driver's seat 211 and the front passenger seat 212 may be made to correspond to one projection area, that is, the projection area p1, and the left rear seat 221 may be made to correspond to the projection area p5. The specific setting of the projection area may be set according to the actual needs of the user or may be customized and set.

[0084] In this way, by projecting the display interface onto the visible areas of each user in the vehicle interior, the setting of the projection area becomes more user-friendly, gives a sense of involvement to each user, and can improve the in-vehicle experience.

[0085] For example, the predetermined area projected by the projection device 20 may include a plurality of projection areas corresponding to a plurality of divided areas divided in the vehicle interior. The control device 10 may obtain the divided areas where all the users in the vehicle interior are located. The projection device projects the display interface onto the corresponding projection areas based on the divided areas where all the users are located.

[0086] As shown in FIG. 2, for example, the plurality of divided regions inside the vehicle are the front row region 201 and the rear row region 202, and the projection regions projected by the projection device 20 are the front row projection region p1 corresponding to the front row region 201 and the rear row projection region p2 corresponding to the rear row region 202. According to whether the user is located in the front row region 201 or the rear row region 202, it is determined whether to project the display interface onto the front row projection region p1 or the rear row projection region p2. For example, the control device 10 determines that all users inside the vehicle are located in the front row region 201, and the projection device 20 projects the display interface onto the front row projection region p1 corresponding to the front row region 201. Also, the control device 10 determines that all users inside the vehicle are located in the rear row region 202, and the projection device 20 projects the display interface onto the rear row projection region p2 corresponding to the rear row region 202. Also, when the control device 10 determines that there are users in both the front row region 201 and the rear row region 202, the projection device 20 projects the display interface onto both the front row projection region p1 and the rear row projection region p2.

[0087] In this way, by projecting the display interface onto the regions where all users are located, all users can view the control process of the command, and the riding experience can be improved.

[0088] Also, since the projection regions can be correspondingly set according to the needs and actual situations of the users, the needs of the users can be satisfied, and the setting of the projection regions can be simplified as much as possible.

[0089] In some embodiments, the control device 10 may further obtain the seats and / or the number of users located in the divided regions, and the projection device 20 adjusts the position of the projection region corresponding to the divided region based on the seats and / or the number of users located in the divided regions.

[0090] As shown in FIG. 2, for example, the control device 10 acquires that there is one user in the rear row area 202 and is located in the rear left seat 221. The projector device 20 moves the projection area p2 corresponding to the rear row area 202 in front of the rear left seat 221. For example, the projection area p2 may be moved to the position where the projection area p5 is located. Alternatively, when the projectable area of the projector device 20 includes the projection areas p2 and p5, the projector device 20 may select to project the display interface onto the area p5. Also, for example, the control device 10 acquires that there are two users in the rear row area 202 and are located in the rear left seat 221 and the rear middle seat 223 respectively. The projector device 20 moves the projection area p2 corresponding to the rear row area 202 in the direction of the projection area p5. For example, it may be moved to a position between the projection area p2 and the projection area p5 so that the user in the rear left seat 221 can see clearly.

[0091] Also, for example, during the driving process, when the control device 10 determines that all users in the vehicle are located in the front row area 201 and determines that there is only one user in the front row area 201, it can be estimated that the user in the driver's seat 211 has issued a command. In this case, the projector device 20 may move the projection area in front of the driver's seat 211. For example, the projection area may be moved from p1 to p3. However, when the projectable area of the projector device 20 includes the projection areas p1 and p3, the projector device 20 may select to project the display interface onto the area p3.

[0092] In this way, by determining the seat and / or the number of users in the divided area, the projection area can be set more reasonably, meeting the user's need to view the interface, enabling the user to view the command control process more comfortably, omitting unnecessary complex settings, being more user-friendly, and further improving the in-vehicle experience.

[0093] In addition, the divided regions may be divided based on the situation inside the vehicle, such as the position and number of users inside the vehicle, enabling the user to intuitively view the display interface and providing an optimal region division. For example, when there are passengers on both the left and right sides of the rear row seats, by setting the entire rear row seats as one divided region, the display interface can be projected in the middle of the rear row region so that users on both the left and right sides can view it.

[0094] In some embodiments, when the control device 10 receives a plurality of commands from a plurality of users, based on the positions where each user is located, the control device projects the display interface corresponding to each user's command onto each predetermined region corresponding to the position where each user is located.

[0095] For example, as shown in FIG. 2, a user sitting in the passenger seat 212 issues command C1, a user sitting in the rear middle seat 223 issues command C2, the control device 10 receives command C1 and command C2, determines based on command C1 that command C1 is from the user in the passenger seat 212, determines based on command C2 that command C2 is from the user in the rear middle seat 223, and the control device 10 projects the display interface A1 corresponding to command C1 onto the predetermined region (for example, projection region p4) corresponding to the passenger seat 212, and projects the display interface B1 corresponding to command C2 onto the predetermined region (for example, projection region p2) corresponding to the rear middle seat 223.

[0096] Also, a plurality of commands from a plurality of users may be received simultaneously, and the control device 10 may simultaneously display a plurality of display interfaces corresponding to the plurality of commands in respective corresponding predetermined regions. For example, in the above example, the control device 10 received command C1 and command C2 simultaneously, but the control device 10 may simultaneously project the display interface A1 and the display interface B1 onto the projection region p4 and the projection region p2, respectively. The control device 10 may display a plurality of display interfaces corresponding to a plurality of commands within one predetermined region. For example, in the above example, when two users are respectively located in the rear row region and the control device 10 receives the commands C1 and C2 of the two users, the control device 10 may simultaneously project the display interface A1 and the display interface B1 onto the projection region p2 corresponding to the rear row region, that is, a plurality of display interfaces can be simultaneously projected within one projection region.

[0097] Note that the "simultaneously" described in the embodiments of the present invention does not necessarily require absolute temporal synchronization, and may refer to synchronization to a certain extent. For example, when the issuance of command C1 and the issuance of command C2 overlap in time to a certain extent, the time when the control device 10 receives command C1 and the time when it receives command C2 overlap to a certain extent, and these two commands may be considered to be simultaneous. For example, it is determined whether the overlapping time is within a predetermined time. If it is within the predetermined time, it is considered to be simultaneous. The predetermined time is, for example, 2 seconds, and the embodiments of the present application do not limit this. In this case, the control device 10 may project the display interface A1 and the display interface B1 onto the projection region p4 and the projection region p2, respectively, at a predetermined time interval.

[0098] In this way, each user has a dedicated projection region, and even when there are a plurality of users, personalized correspondence can be provided, and different needs of each user can be satisfied.

[0099] FIG. 3 is a schematic diagram for explaining the divided regions of the in-vehicle projection system according to Embodiment 1 of the present invention.

[0100] The above has been described by taking the example of dividing the in-vehicle space into a front row area and a rear row area in the longitudinal direction. However, the embodiments of the present application are not limited thereto, and the in-vehicle space may be divided into a plurality of divided areas based on the position and / or number of users. For example, as shown in FIG. 3, when there are users in the driver's seat 211 and the left rear seat 221, the in-vehicle space may be divided in the left-right direction. For example, it may be divided into a left area 301 and a right area 302 by a dashed line L2, or, by dashed lines L2 and L3, the in-vehicle space may be divided into three divided areas: a divided area 303 centered on the driver's seat 211, a divided area 304 centered on the front passenger seat 212, and a divided area 305 corresponding to the three seats in the rear row. Alternatively, when there is only one user in the vehicle, the seat where the user is located may be divided into one divided area, and the other space in the vehicle may be divided into another divided area. Specifically, how to divide the plurality of divided areas may be predefined or customized by the user, and the embodiments of the present invention do not limit this.

[0101] In some embodiments, the projection device 20 may include at least one projection apparatus. For example, as shown in FIG. 2, six projection apparatuses may be correspondingly installed in the projection areas p2 to p6 corresponding to all seats, or two projection apparatuses may be correspondingly installed in the projection areas p1 and p2 corresponding to two divided areas (for example, the front row area 201 and the rear row area 202). Also, only one projection apparatus may be installed, and a plurality of projection surfaces may be formed by one projection apparatus.

[0102] Alternatively, the projection device may be moved to project onto a plurality of areas. For example, as shown in FIG. 1, the in-vehicle projection system 1 may further include a mounting device 50. The projection device 20 is mounted on the mounting device 50 and is movable and / or rotatable. The projection device 20 is controlled to move the mounting device 50 based on the position of the user and can project onto the area where the display interface is to be projected. For example, the function of making the mounting device 50 movable by a slide rail and the function of making the mounting device 50 rotatable by a rotating turntable may be realized, or the movement of the mounting device 50 may be realized by other related technologies. The embodiments of the present invention do not limit this.

[0103] In this way, by adjusting the projection area of the projection device by the mounting device, the projection area can be better adapted to the user's viewing, and the user's in-vehicle experience can be further improved.

[0104] Further, the projection device of the embodiment of the present invention may be a 2D projection device. For example, the projection areas p5 and p6 may be the back surfaces of the front seats, and the display interface can be projected using the back surfaces of the front seats as a projection screen. The projection device may also be a 3D projection device or a holographic projection device. For example, a projection device based on the Pepper's Ghost principle may be used to project the display interface onto a plurality of projection areas. For the specific embodiments of the 2D projection device and the 3D projection device, related technologies can be referred to, and the embodiments of the present invention do not limit this.

[0105] FIG. 4 and FIG. 5 are schematic diagrams for explaining the projection positions of the in-vehicle projection system according to Embodiment 1 of the present invention, respectively.

[0106] In some embodiments, the specific projection position in a predetermined area of the display interface changes correspondingly based on the change of the user's line of sight and / or the orientation of the user's face, and / or the specific projection position in a predetermined area of the display interface moves to another position based on the user's operation.

[0107] For example, as shown in FIG. 4, when the user's line of sight changes from direction E1 to direction E2 or the orientation of the user's face changes from direction E1 to direction E2, the projection device 20 may be moved from the projection position P1 corresponding to the direction E1 of the display interface within the predetermined area PA to the projection position P2 corresponding to the direction E2.

[0108] Also, for example, as shown in FIG. 5, when the user performs a slide operation S on the display interface and the position of the finger slides from position H1 to position H2, for example, the projection device 20 may be moved from the projection position P3 corresponding to the position H1 of the display interface within the predetermined area PA to the projection position P4 corresponding to the position H2.

[0109] In this way, by making the display interface follow the user's line of sight or the user's intention, the user's viewing needs at that time can be further satisfied, and the user's in-vehicle experience can be further improved.

[0110] FIG. 6 is a schematic diagram for explaining the display of the execution process of a command on the display interface of the in-vehicle projection system according to Embodiment 1 of the present invention.

[0111] In some embodiments, when the display interface is projected within the predetermined area for a predetermined time and it is detected within the predetermined time that the user has input a second command to the display interface projected in the predetermined area, the display interface of the process for executing the operation of the second command in the predetermined area is displayed.

[0112] For example, as shown in FIG. 6, a display interface U1 is projected within a predetermined area, and it is detected that the user inputs another command to the display interface U1 within a predetermined time. For example, it is detected that the user clicks the play button B on the display interface U1 or the play voice command output by the user is detected. The control device 10 may display the next playback interface U2 in the predetermined area. As described above, taking the detection that the user clicks a button on the display interface as an example, the input of the second command by the user to the display interface has been described. However, the embodiments of the present invention are not limited thereto. For example, by recognizing the voice command of the user, the second command input by the user to the display interface may be determined. For the embodiment of detecting the command input to the display interface, related technologies can be referred to, and the embodiments of the present invention do not limit this.

[0113] In this way, by detecting the second command input by the user to the display interface and displaying the execution process of the second command, the user can continuously view the execution process of the command without a sense of discontinuity, further improving the user's in-vehicle experience.

[0114] FIG. 7 is a schematic diagram for explaining projecting two or more display interfaces within the projection area of the in-vehicle projection system according to Embodiment 1 of the present invention.

[0115] In some embodiments, the projection device 20 may simultaneously project at least two display interfaces within at least one projection area.

[0116] For example, as shown in FIG. 7, the display interfaces U3 and U4 may be simultaneously projected within the projection area p1. The display interfaces U3 and U4 may be different display interfaces. The display interface U3 is, for example, a display interface on which an operation of a command issued by a user sitting in the driver's seat 211 is executed, and the display interface U4 is, for example, a display interface on which an operation of a command issued by a user sitting in the passenger seat 212 is executed. Of course, two different display interfaces corresponding to two commands issued by the same passenger may be simultaneously projected within one projection area p1. For example, the display interface U3 is a display interface obtained by operating a command to adjust the air conditioner issued by the passenger, and U4 is a display interface obtained by operating a command to adjust the seat issued by the same passenger. In this way, the same passenger can simultaneously adjust different functions, and can intuitively view the display interfaces of the command execution processes at the same time, which is more user-friendly.

[0117] In this way, different display interfaces can be simultaneously displayed within one projection area, and when the projection area is reasonably set, the needs of different users can also be satisfied.

[0118] In some embodiments, the display interface further includes a virtual character, and the virtual character may display the process of executing the operation of the user's command on the display interface. Thereby, the interestingness is further increased.

[0119] As can be seen from the above embodiments, by projecting the display interface related to the operation of the command issued by the user onto an appropriate area where the user can view it, the user can intuitively view the command execution process, enhance the interestingness, and improve the user experience.

[0120] (Embodiment 2) Example 2 of the present invention provides a control method for an in-vehicle projection system. FIG. 8 is a flowchart of the control method for the in-vehicle projection system according to Example 2 of the present invention.

[0121] As shown in FIG. 8, the control method 700 of the embodiment of the present invention includes: Step 701 of receiving a user command and obtaining a display interface related to the operation of the command; Step 702 of determining the user's position based on the command; Step 703 of projecting the display interface onto a predetermined area inside the vehicle corresponding to the user's position; Step 704 of executing the operation of the user command and displaying the process of executing the user command on the display interface.

[0122] Thereby, by projecting the display interface related to the operation of the command issued by the user onto an appropriate area where the user can see it, the user can intuitively view the execution process of the command, enhancing the interestingness and improving the user experience.

[0123] In some embodiments, in step 702, based on the command, the area where the user is located inside the vehicle may be determined, and in step 703, the display interface may be projected in front of the area where the user is located. In some embodiments, in step 702, based on the command, the seat where the user is located inside the vehicle may be determined, and in step 703, the display interface may be projected in front of the seat where the user is located.

[0124] In some embodiments, the predetermined area includes a plurality of projection areas, each seat inside the vehicle corresponds to one projection area. In step 702, when receiving the user's command, based on the seat where the user is located, the corresponding projection area is determined, and in step 703, the display interface is projected onto the corresponding projection area.

[0125] In some embodiments, the predetermined area may include a plurality of projection areas corresponding to seats inside the vehicle. In step 702, the number of users inside the vehicle and the seats where each user is located inside the vehicle are obtained. In step 703, the number of projection areas is determined based on the number of users inside the vehicle, and the display interface may be projected onto the corresponding projection area based on the seats where each user is located inside the vehicle.

[0126] In some embodiments, the predetermined area includes a plurality of projection areas, the vehicle interior space is virtually divided into a plurality of divided areas, each divided area corresponds to one projection area. In step 702, when a user's command is received, the corresponding projection area is determined based on the divided area where the user is located. In step 703, the display interface is projected onto the corresponding projection area.

[0127] In some embodiments, the predetermined area may include a plurality of projection areas corresponding to a plurality of divided areas divided inside the vehicle. In step 702, the divided areas where all users inside the vehicle are located are obtained. In step 703, the display interface may be projected onto the corresponding projection area based on the divided areas where all users are located.

[0128] In some embodiments, in step 702, the seat and / or number where the user in the divided area is located is further obtained. In step 703, the position of the projection area corresponding to the divided area may be adjusted based on the seat and / or number where the user in the divided area is located.

[0129] In some embodiments, in step 703, the specific projection position in the predetermined area of the display interface changes correspondingly based on the change in the user's line of sight and / or the orientation of the user's face, and / or the specific projection position in the predetermined area of the display interface moves to another position based on the user's operation.

[0130] In some embodiments, in step 703, when the display interface is projected within a predetermined area for a predetermined time and it is detected within the predetermined time that the user has input a second command to the display interface projected in the predetermined area, a display interface of a process for executing an operation of the second command in the predetermined area is displayed.

[0131] In some embodiments, the display interface includes a virtual character, and the display interface displays a process in which the virtual character executes an operation of the user's command.

[0132] In some embodiments, in step 701, when a plurality of commands from a plurality of users are received, in step 703, based on the positions where each user is located, a display interface corresponding to each user's command is projected onto a predetermined area corresponding to the position where each user is located.

[0133] In the embodiments of the present invention, for the implementation of each of the above steps, reference can be made to the description of the functions of the related devices in Embodiment 1, and no repeated description will be given here.

[0134] The embodiments of the present invention further provide a control device for an in-vehicle projection system, and the control device corresponds to the control method described in the above embodiments. For the functions of the device, reference can be made to the description of the related steps of the control method of the in-vehicle projection system in Embodiment 2, and the overlapping content will not be specifically described.

[0135] FIG. 9 is a schematic block diagram of a control device of an in-vehicle projection system according to Embodiment 2 of the present invention. As shown in FIG. 9, the control device 800 may include a processor 810 and a memory 820, and the memory 820 is coupled to the processor 810. It should be noted that this figure is illustrative, and in order to implement a telecommunication function or other functions, other types of structures may be used to add to or replace this structure.

[0136] In one embodiment, the processor 810 may be configured to receive a user command, obtain a display interface related to the operation of the command, determine the user's position based on the command, and project the display interface onto a predetermined area based on the user's position.

[0137] In the embodiments of the present invention, for the implementation of the functions of the processor 810, reference may be made to the description of the related steps of the control method of the in-vehicle projection system in Embodiment 2, and details will not be repeated here.

[0138] The processor 810 may also be referred to as a controller or an operation control, and may include a microprocessor or other processor device and / or a logic device. The processor 810 receives inputs and controls the operation of each component of the control device 800. Further, the processor 810 may be the processor of the in-vehicle projection system 1 in Embodiment 1, and realizes the control functions in the control device 10 and the projection device 20.

[0139] The memory 820 may be, for example, one or more of a buffer, a flash memory, a hard disk, a removable medium, a volatile memory, a non-volatile memory, or other suitable devices. It can store various data and can also store a program for executing related information. Then, the processor 810 can execute the program stored in the memory 820 to realize information storage or processing, etc. Since the functions of other components are similar to those in the prior art, the description is omitted here. Each component of the control device 800 may be realized by dedicated hardware, firmware, software, or a combination thereof without departing from the scope of the present invention.

[0140] Also, as shown in FIG. 9, the control device 800 may further include a communication module 830. It should be noted that the control device 800 does not necessarily need to include all the components shown in FIG. 9, and the control device 800 may further include components not shown in FIG. 9. Reference may be made to related technologies.

[0141] As can be seen from the above embodiments, by projecting the display interface related to the operation of the command issued by the user onto an appropriate area where the user can view it, the user can intuitively view the execution process of the command, enhancing the interestingness and improving the user experience.

[0142] Embodiment 3

[0143] Embodiment 3 of the present invention provides a vehicle, and the vehicle includes the in-vehicle projection system described in Embodiment 1. Regarding the functions of the in-vehicle projection system, reference can be made to the description in Embodiment 1, and the overlapping content will not be specifically described.

[0144] As can be seen from the above embodiments, by projecting the display interface related to the operation of the command issued by the user onto an appropriate area where the user can view it, the user can intuitively view the execution process of the command, enhancing the interestingness and improving the user experience.

[0145] As described above, the embodiments of the present invention have been described in detail with reference to the drawings, showing the ways in which the principles of the present invention can be utilized. However, it should be understood that the implementation of the present invention is not limited to the forms of the above embodiments, and all modifications, corrections, and equivalents within the scope not departing from the gist of the present invention are included.

Claims

1. A control device that receives a user's command, obtains a display interface related to the operation of the command, and determines the position of the user in the vehicle based on the command; A projection device that projects the display interface onto a predetermined area inside the vehicle corresponding to the position of the user, and The control device starts the execution of the operation of the user's command, and the display interface displays the process in which the control device executes the operation of the user's command. An in-vehicle projection system characterized by this.

2. The display interface includes a first interface before executing the operation of the command, and / or a second interface after completing the execution of the operation of the command, and / or a third interface in the process from before executing the operation of the command to after completing the execution of the operation of the command. The in-vehicle projection system according to claim 1, characterized by this.

3. The predetermined area includes at least one projection area, and the position of the projection area is determined based on the position of the user in the vehicle or the position of the user in the vehicle and the number of users. The in-vehicle projection system according to claim 1, characterized by this.

4. The position of the user includes the area where the user is located in the vehicle and / or the seat where the user is located in the vehicle. The in-vehicle projection system according to claim 1, characterized by this.

5. The predetermined area includes in front of the area where the user is located in the vehicle and / or in front of the seat where the user is located in the vehicle. The in-vehicle projection system according to claim 4, characterized by this.

6. The predetermined area includes a plurality of projection areas, each seat in the vehicle corresponds to one of the projection areas, and when the control device receives a user's command, it determines the corresponding projection area based on the seat where the user is located, and the projection device projects the display interface onto the corresponding projection area. The in-vehicle projection system according to claim 1, characterized by this.

7. The predetermined area includes a plurality of projection areas, the in-vehicle space is virtually divided into a plurality of divided areas, each divided area corresponds to one of the projection areas, and when the control device receives a user's command, it determines the corresponding projection area based on the divided area where the user is located, and the projection device projects the display interface onto the corresponding projection area. The in-vehicle projection system according to claim 1, characterized by this.

8. The control device further acquires the seat and / or the number of the user located within the divided area, and the projection device adjusts the position of the projection area corresponding to the divided area based on the seat and / or the number of the user located within the divided area. The in-vehicle projection system according to claim 7, wherein the in-vehicle projection system is characterized in that.

9. The in-vehicle space is divided into the plurality of divided areas based on the position and / or the number of the user located therein. The in-vehicle projection system according to claim 7, wherein the in-vehicle projection system is characterized in that.

10. The predetermined area includes at least one projection area, and the projection device projects two or more display interfaces simultaneously within the at least one projection area. The in-vehicle projection system according to claim 1, wherein the in-vehicle projection system is characterized in that.

11. The command includes a voice command and / or a gesture command. The in-vehicle projection system according to claim 1, wherein the in-vehicle projection system is characterized in that.

12. The display interface includes an interface related to in-vehicle entertainment equipment, and the control device acquires the interface of the in-vehicle entertainment equipment based on the command. The in-vehicle projection system according to claim 1, wherein the in-vehicle projection system is characterized in that.

13. The in-vehicle projection system further includes a mounting device, on which the projection device is mounted movably and / or rotatably, and the projection device controls the mounting device to move and / or rotate based on the position of the user, and projects the display interface onto the predetermined area. The in-vehicle projection system according to claim 1, wherein the in-vehicle projection system is characterized in that.

14. The specific projection position in the predetermined area of the display interface changes correspondingly based on the change of the user's line of sight and / or the orientation of the user's face, and / or the specific projection position in the predetermined area of the display interface moves to another position based on the user's operation. The in-vehicle projection system according to claim 1, wherein the in-vehicle projection system is characterized in that.

15. When the display interface is projected within the predetermined area for a predetermined time, and it is detected that the user inputs a second command to the display interface projected onto the predetermined area within the predetermined time, a display interface of a process for executing the operation of the second command is displayed in the predetermined area. The in-vehicle projection system according to claim 1, wherein the in-vehicle projection system is characterized in that.

16. The display interface includes a virtual character, and the display interface displays a process in which the virtual character executes an operation of the user's command. The in-vehicle projection system according to claim 1, characterized in that.

17. When the control device receives a plurality of commands from a plurality of users, based on the positions where each user is located, it projects a display interface corresponding to each user's command onto each predetermined area corresponding to the position where each user is located. Or, when the control device receives a plurality of commands from a plurality of users, it projects a plurality of display interfaces corresponding to the commands of the plurality of users onto at least one predetermined area corresponding to the positions where the plurality of users are located. The in-vehicle projection system according to claim 1, characterized in that.

18. Receiving a user's command and obtaining a display interface related to the operation of the command; Determining the user's position based on the command; Projecting the display interface onto a predetermined area inside the vehicle corresponding to the user's position; Executing the operation of the user's command and displaying a process of executing the operation of the user's command on the display interface. A control method for an in-vehicle projection system, characterized by including.

19. A vehicle, characterized by comprising the in-vehicle projection system according to any one of claims 1 to 17.

Images