Screen control method and device, computer equipment and storage medium

Abstract

The invention relates to a screen control method and device, computer equipment and a storage medium. The method comprises the following steps: in response to a control instruction for a virtual screen, controlling an acquisition device in a vehicle to acquire a gesture image for the virtual screen; wherein the virtual screen is formed after light emitted by projection equipment in the vehicle is reflected by a reflection mirror surface; determining an operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type comprises a screen moving operation or a screen clicking operation; and controlling the virtual screen according to the operation type and the operation content. By adopting the method, the function of the vehicle-mounted screen can be used without manually clicking the vehicle-mounted screen by the screen control party, and the vehicle-mounted screen can be randomly moved.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence technology, and in particular to a screen control method, device, computer equipment and storage medium. Background Art

[0002] As a vehicle for humans to obtain vehicle information and realize human-vehicle interaction, in-vehicle screens have developed rapidly in the past decade. At the current stage, in-vehicle screens have the functions of entertainment, informationization, and communication and interaction with the outside world.

[0003] At present, the on-board screen in a vehicle is generally a physical screen fixedly installed near the vehicle dashboard. Therefore, when using and controlling the on-board screen, the screen controller (such as the passenger) needs to manually operate the on-board screen to use some functions of the on-board screen; and due to space limitations in the vehicle, passengers in the back row of the vehicle often have inconveniences when using the on-board screen. Summary of the invention

[0004] Based on this, it is necessary to provide a screen control method, device, computer equipment and storage medium to address the above technical problems, so that the functions of the vehicle screen can be used without the screen controller manually clicking on the vehicle screen, and the vehicle screen can be moved at will.

[0005] In a first aspect, the present application provides a screen control method, comprising:

[0006] In response to a control instruction for a virtual screen, controlling a collection device in the vehicle to collect a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror;

[0007] Determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation;

[0008] The virtual screen is controlled according to the operation type and the operation content.

[0009] In one embodiment, determining the operation type and operation content corresponding to the control instruction according to the gesture image includes:

[0010] Determining a target action according to the gesture image;

[0011] According to the target action, the operation type and operation content corresponding to the control instruction are determined.

[0012] In one embodiment, determining the operation type and operation content corresponding to the control instruction according to the target action includes:

[0013] If the target action is a palm swing action, determining that the operation type corresponding to the control instruction is a screen movement operation;

[0014] The swinging direction of the palm swinging action is determined as the operation content corresponding to the control instruction.

[0015] In one embodiment, controlling the virtual screen according to the operation type and the operation content includes:

[0016] Sending a movement instruction carrying the operation content to a control motor in the vehicle;

[0017] The movement instruction is used to instruct the control motor to move the virtual screen according to the operation content.

[0018] In one embodiment, determining the operation type and operation content corresponding to the control instruction according to the target action further includes:

[0019] If the target action is a finger click action, determining that the operation type corresponding to the control instruction is a screen click operation;

[0020] Determine a click position corresponding to the finger click action on the virtual screen;

[0021] The target function corresponding to the click position is used as the operation content corresponding to the control instruction.

[0022] In one embodiment, controlling the virtual screen according to the operation type and the operation content includes:

[0023] In response to a click operation on the target function in the virtual screen, the virtual screen is controlled to display a function page of the target function.

[0024] In one embodiment, the method further comprises:

[0025] A laser device in the vehicle is controlled to emit laser light at the click position to heat the air at the click position.

[0026] In a second aspect, the present application further provides a screen control device, comprising:

[0027] An image acquisition module, for responding to a control instruction for a virtual screen, controlling an acquisition device in the vehicle to acquire a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror;

[0028] An operation determination module, used to determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation;

[0029] The screen control module is used to control the virtual screen according to the operation type and the operation content.

[0030] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0031] In response to a control instruction for a virtual screen, controlling a collection device in the vehicle to collect a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror;

[0032] Determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation;

[0033] The virtual screen is controlled according to the operation type and the operation content.

[0034] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0035] In response to a control instruction for a virtual screen, controlling a collection device in the vehicle to collect a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror;

[0036] Determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation;

[0037] The virtual screen is controlled according to the operation type and the operation content.

[0038] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0039] In response to a control instruction for a virtual screen, controlling a collection device in the vehicle to collect a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror;

[0040] Determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation;

[0041] The virtual screen is controlled according to the operation type and the operation content.

[0042] The above-mentioned screen control method, device, computer equipment and storage medium can be displayed at any position in the vehicle by introducing a virtual screen formed by light emitted by a projection device in the vehicle after being reflected by a reflective mirror. Compared with the existing physical screen, the flexibility of screen use is improved; further, the acquisition device in the vehicle is controlled to acquire gesture images for the virtual screen, and the operation type and operation content corresponding to the control instruction are determined according to the gesture image, wherein the operation type includes screen movement operation or screen click operation; and the virtual screen is controlled according to the operation type and operation content; there is no need for the screen controller to manually click the physical screen, and the virtual screen can be controlled by making corresponding gestures, and the virtual screen can be moved or clicked by different gestures, which improves the flexibility of virtual screen use and facilitates passengers at any position in the vehicle to use the virtual screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0044] Figure 1 A diagram showing an application environment of a screen control method in an embodiment;

[0045] Figure 2 is a flow chart of a screen control method in one embodiment;

[0046] Figure 3 A schematic diagram of forming a virtual screen in one embodiment;

[0047] Figure 4 A schematic diagram of a flow chart for determining an operation type and operation content corresponding to a control instruction in an embodiment;

[0048] Figure 5 is a schematic diagram of the swing direction of a target action in one embodiment;

[0049] Figure 6 A schematic diagram of a virtual screen movement principle in one embodiment;

[0050] Figure 7A schematic diagram of a screen click action in an embodiment;

[0051] Figure 8 is a flow chart of a screen control method in another embodiment;

[0052] Fig. 9 is a structural block diagram of a screen control device in one embodiment;

[0053] Fig.10 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0055] The screen control method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Wherein, the acquisition device 101 communicates with the virtual screen controller 102 through the network. The acquisition device 101 and the virtual screen controller 102 are both installed in the vehicle, wherein the acquisition device 101 is used to acquire images, and the virtual screen controller 102 is used to control the virtual screen in the vehicle. The data storage system can store data that the virtual screen controller 102 needs to process. The data storage system can be integrated on the virtual screen controller 102, or it can be placed on the cloud or other network servers. Optionally, the virtual screen controller 102 responds to the control instruction for the virtual screen and controls the acquisition device 101 in the vehicle to acquire the gesture image for the virtual screen; wherein the virtual screen is formed by the light emitted by the projection device in the vehicle after being reflected by the reflective mirror; according to the gesture image, the operation type and operation content corresponding to the control instruction are determined; wherein the operation type includes screen movement operation or screen click operation; further, according to the operation type and operation content, the virtual screen is controlled. Wherein, the acquisition device 101 can be a camera. The virtual screen controller 102 can be implemented with an independent server or a server cluster consisting of multiple servers.

[0056] In one embodiment, Figure 2 As shown, a screen control method is provided, which is applied to Figure 1 The virtual screen controller 102 in the example is used as an example to illustrate, and specifically includes the following steps:

[0057] S201 , in response to a control instruction for a virtual screen, controlling a collection device in a vehicle to collect a gesture image for the virtual screen.

[0058] The virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror. The control instruction is an instruction to control the virtual screen. The acquisition device is a device installed in the vehicle for acquiring images; in the embodiment of the present application, the acquisition device may be a camera, specifically a rotatable camera. The gesture image is an image containing the gesture of the virtual screen controller. The screen controller may be any passenger in the vehicle.

[0059] Optionally, the screen controller can wake up the virtual screen through the screen control button on the virtual vehicle. At this time, the virtual screen system can receive control instructions for the virtual screen, and in response to the control instructions, display the virtual screen according to the initial display position of the virtual screen, and control the collection device in the vehicle to rotate to capture the position of the screen controller and collect gesture images for the virtual screen.

[0060] It should be noted that the virtual screen in the embodiment of the present application is a virtual screen formed by mirror reflection technology without a physical screen. Figure 3 , which is a schematic diagram of the formation principle of a virtual screen. 301 is a projection device, 302 is a reflective mirror, and 303 is a virtual screen imaging area. The light emitted by the light source of the projection device is focused by a lens, and then reflected by the reflective mirror to project the projection image to the projection area, forming a virtual screen.

[0061] S202: Determine the operation type and operation content corresponding to the control instruction according to the gesture image.

[0062] The operation type includes a screen movement operation or a screen click operation. The operation content is the specific content of the virtual screen operation.

[0063] Optionally, based on the gesture image, the gesture in the gesture image is extracted, and according to a preset program, the extracted gesture is analyzed to obtain the operation type and operation content corresponding to the control instruction.

[0064] S203: Control the virtual screen according to the operation type and operation content.

[0065] Optionally, the control device corresponding to the control instruction can be determined according to the operation type and operation content, and the operation instruction can be generated according to the operation type and operation content, and the operation instruction can be sent to the corresponding control device so that the control device controls the virtual screen according to the operation instruction.

[0066] It should be noted that the content displayed on the virtual screen in the embodiment of the present application may be the content of the vehicle screen, or the content in the mobile terminal bound to the virtual screen system.

[0067] In the above screen control method, by introducing a virtual screen formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror, the virtual screen can be displayed at any position in the vehicle, which improves the flexibility of screen use compared to the existing physical screen; further, the acquisition device in the vehicle is controlled to acquire gesture images for the virtual screen, and the operation type and operation content corresponding to the control instruction are determined according to the gesture image, wherein the operation type includes screen movement operation or screen click operation; and the virtual screen is controlled according to the operation type and operation content; there is no need for the screen controller to manually click the physical screen, and the virtual screen can be controlled by making corresponding gestures, and the virtual screen can be moved or clicked by different gestures, which improves the flexibility of virtual screen use and facilitates passengers at any position in the vehicle to use the virtual screen.

[0068] Optionally, in one embodiment, Figure 4 As shown, a method for determining the operation type and operation content corresponding to a control instruction is provided, which specifically includes the following steps:

[0069] S401, determining a target action according to the gesture image.

[0070] The target action is a gesture action for controlling the virtual screen. In the embodiment of the present application, the target action includes a palm swing action or a finger click action.

[0071] Optionally, the action features in the gesture image may be extracted according to feature extraction technology as the target action. For example, the palm swinging action represents the movement control of the position of the virtual screen, and the finger clicking action represents the clicking operation on the virtual screen.

[0072] S402: Determine the operation type and operation content corresponding to the control instruction according to the target action.

[0073] Optionally, the target action is input into the action recognition model, so that the action recognition model recognizes and compares the target action from a pre-created gesture library to determine the operation type and operation content corresponding to the control instruction.

[0074] In this embodiment, by introducing a target action and determining the operation type and operation content corresponding to the control instruction according to the target action, the accuracy of the operation type and operation content corresponding to the control instruction is improved.

[0075] Optionally, in an embodiment of the present application, the screen controller can control the movement of the virtual screen by making gestures, that is, performing a screen movement operation, or can click on the virtual screen to use the function of the virtual screen, that is, performing a screen click operation. Therefore, according to the target action, the operation type and operation content corresponding to the control instruction can be first determined, and the virtual screen can be controlled according to the corresponding operation type and operation content. Different operation types and operation contents have different ways of controlling the virtual screen.

[0076] Optionally, if the target action is a palm swinging action, the operation type corresponding to the control instruction is determined to be a screen moving operation; and the swinging direction of the palm swinging action is determined as the operation content corresponding to the control instruction. Specifically, if the target action is a palm swinging action, it can be determined that the screen controller wants to move the virtual screen to a certain position, that is, the operation type is a screen moving operation; further, the palm swinging direction in the target action is identified to determine the moving direction of the virtual screen, and the swinging direction is used as the operation content corresponding to the control instruction. For example, Figure 5 As shown in the figure, it is a schematic diagram of the swing direction of the target action. Figure 5 If the target action is Figure 5 If the target action is a palm swing action, a method for determining an operation type and an operation content is provided.

[0077] Furthermore, a movement instruction carrying the operation content is sent to the control motor in the vehicle; wherein the movement instruction is used to instruct the control motor to move the virtual screen according to the operation content. Figure 6 As shown in the figure, it is the principle diagram of virtual screen movement. Figure 6 It can be seen that the movement of the virtual screen can be controlled by controlling different motors to rotate the reflective mirror and the concave lens. 601 is the light source, the concave lens 602 disperses the light source and then gathers it through the convex lens 603, wherein the concave lens is controlled by the stepper motor 1 to move forward and backward to change the focus position of the light beam (the depth position of the light), and the stepper motor 2 and the stepper motor 3 control the rotation of the reflective mirror 604 to control the movement of the light beam point in the plane. It can be understood that by sending a movement instruction to the control motor and the control motor moving the virtual screen, the accuracy of the movement of the virtual screen is improved.

[0078] Optionally, if the target action is a finger click action, the operation type corresponding to the control instruction is determined to be a screen click operation; the click position corresponding to the finger click action in the virtual screen is determined; and the target function corresponding to the click position is used as the operation content corresponding to the control instruction. The target function can be any function provided in the page displayed on the virtual screen. Specifically, if the target action is a finger click action, it can be determined that the screen controller needs to click the virtual screen, that is, the operation type is a screen click operation; further, the corresponding position in the virtual screen can be determined based on the click position of the finger click action, and then the target function corresponding to the click position is used as the operation content corresponding to the control instruction. For example, Figure 7 The figure shows a schematic diagram of the screen clicking action.

[0079] Further, in response to a click operation on a target function in the virtual screen, the virtual screen is controlled to display a function page of the target function. For example, if the target function is music, in response to a click operation on the music, a function page corresponding to the music is displayed to the user, and the screen click effect can be achieved without the screen controller clicking the physical screen.

[0080] It should be noted that, since the virtual screen provided by the present application does not have a physical screen, the screen controller does not have a real sense of touch when clicking on the virtual screen. Therefore, in order to improve the screen controller's experience in the process of clicking on the virtual screen, after recognizing that the operation type corresponding to the control instruction is a screen click operation, the laser device in the vehicle can be controlled to emit a laser at the click position to heat the air at the click position. Specifically, the laser device in the vehicle is controlled to emit a laser at the click position, and the air is heated by the laser focus, so that the molecules of the substance in the air produce relative movement, so that the fingers of the screen controller have a real sense of contact, and the user experience of the screen controller is improved.

[0081] In an embodiment of the present application, the screen controller can also implement screen clicking operations through voice.

[0082] Figure 8 FIG. 2 is a flow chart of a screen control method in another embodiment. Based on the above embodiment, this embodiment provides an optional example of a screen control method. Figure 8 The specific implementation process is as follows:

[0083] S801, in response to a control instruction for a virtual screen, controlling a collection device in a vehicle to collect a gesture image for the virtual screen.

[0084] Among them, the virtual screen is formed by the light emitted by the projection device in the vehicle and reflected by the reflective mirror.

[0085] S802: Determine a target action according to the gesture image.

[0086] S803, determine whether the target action is a palm swing action; if so, execute S804; if not, determine that the target action is a finger click action, and execute S807.

[0087] S804: Determine whether the operation type corresponding to the control instruction is a screen movement operation.

[0088] S805: Determine the swinging direction of the palm swinging action as the operation content corresponding to the control instruction.

[0089] S806, sending a movement instruction carrying the operation content to the control motor in the vehicle.

[0090] The moving instruction is used to instruct the control motor to move the virtual screen according to the operation content.

[0091] S807: Determine that the operation type corresponding to the control instruction is a screen click operation.

[0092] S808: Determine the click position corresponding to the finger click action on the virtual screen.

[0093] S809: taking the target function corresponding to the clicked position as the operation content corresponding to the control instruction.

[0094] S810, in response to a click operation on a target function in the virtual screen, controlling the virtual screen to display a function page of the target function.

[0095] S811, controlling a laser device in the vehicle to emit laser at the click position to heat the air at the click position.

[0096] The specific process of the above S801-S811 can refer to the description of the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0097] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0098] Based on the same inventive concept, the embodiment of the present application also provides a screen control device for implementing the above-mentioned screen control method. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above-mentioned method, so the specific limitations in one or more screen control device embodiments provided below can refer to the above-mentioned limitations on the screen control method, and will not be repeated here.

[0099] In an exemplary embodiment, Fig. 9 As shown, a screen control device 90 is provided, comprising: an image acquisition module 10, an operation determination module 20 and a screen control module 30, wherein:

[0100] The image acquisition module 10 is used to control the acquisition device in the vehicle to acquire gesture images for the virtual screen in response to the control instruction for the virtual screen; wherein the virtual screen is formed by the light emitted by the projection device in the vehicle and reflected by the reflective mirror.

[0101] The operation determination module 20 is used to determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation.

[0102] The screen control module 30 is used to control the virtual screen according to the operation type and operation content.

[0103] The above-mentioned screen control device, by introducing a virtual screen formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror, can be displayed at any position in the vehicle, thereby improving the flexibility of screen use compared to existing physical screens; further, the acquisition device in the vehicle is controlled to acquire gesture images for the virtual screen, and the operation type and operation content corresponding to the control instruction are determined according to the gesture images, wherein the operation type includes screen movement operation or screen click operation; and the virtual screen is controlled according to the operation type and operation content; there is no need for the screen controller to manually click on the physical screen, and the virtual screen can be controlled by making corresponding gestures, and the virtual screen can be moved or clicked by different gestures, thereby improving the flexibility of virtual screen use and facilitating passengers at any position in the vehicle to use the virtual screen.

[0104] In one embodiment, the operation determination module 20 includes:

[0105] The first determining unit is used to determine a target action according to the gesture image.

[0106] The second determining unit is used to determine the operation type and operation content corresponding to the control instruction according to the target action.

[0107] In one embodiment, the second determining unit is specifically configured to:

[0108] If the target action is a palm swinging action, the operation type corresponding to the control instruction is determined to be a screen moving operation; and the swinging direction of the palm swinging action is determined as the operation content corresponding to the control instruction.

[0109] In one embodiment, the screen control module 30 is specifically used for:

[0110] A movement instruction carrying operation content is sent to a control motor in the vehicle; wherein the movement instruction is used to instruct the control motor to move the virtual screen according to the operation content.

[0111] In one embodiment, the operation determination module 20 includes:

[0112] The third determining unit is used to determine that the operation type corresponding to the control instruction is a screen clicking operation if the target action is a finger clicking action.

[0113] The fourth determining unit is used to determine the click position corresponding to the finger click action on the virtual screen.

[0114] The fifth determining unit is used to use the target function corresponding to the click position as the operation content corresponding to the control instruction.

[0115] In one embodiment, the screen control module 30 is further configured to:

[0116] In response to a click operation on a target function in the virtual screen, the virtual screen is controlled to display a function page of the target function.

[0117] In one embodiment, the screen control module 30 is further configured to:

[0118] A laser device in the vehicle is controlled to emit laser light at the click position to heat the air at the click position.

[0119] Each module in the above screen control device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0120] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Fig.10As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a screen control method is implemented.

[0121] Those skilled in the art will understand that Fig.10 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0122] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0123] In response to a control instruction for a virtual screen, a collection device in the vehicle is controlled to collect a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror;

[0124] Determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation;

[0125] The virtual screen is controlled according to the operation type and operation content.

[0126] In one embodiment, when the processor executes the computer program to determine the operation type and operation content corresponding to the control instruction according to the gesture image, the processor further implements the following steps:

[0127] According to the gesture image, the target action is determined; according to the target action, the operation type and operation content corresponding to the control instruction are determined.

[0128] In one embodiment, when the processor executes the computer program to determine the operation type and operation content corresponding to the control instruction according to the target action, the processor further implements the following steps:

[0129] If the target action is a palm swinging action, the operation type corresponding to the control instruction is determined to be a screen moving operation; and the swinging direction of the palm swinging action is determined as the operation content corresponding to the control instruction.

[0130] In one embodiment, when the processor executes the computer program to control the virtual screen according to the operation type and operation content, the following steps are also implemented:

[0131] A movement instruction carrying operation content is sent to a control motor in the vehicle; wherein the movement instruction is used to instruct the control motor to move the virtual screen according to the operation content.

[0132] In one embodiment, when the processor executes the computer program to determine the operation type and operation content corresponding to the control instruction according to the target action, the processor further implements the following steps:

[0133] If the target action is a finger click action, determine the operation type corresponding to the control instruction as a screen click operation; determine the click position corresponding to the finger click action in the virtual screen; and use the target function corresponding to the click position as the operation content corresponding to the control instruction.

[0134] In one embodiment, when the processor executes the computer program to control the virtual screen according to the operation type and operation content, the following steps are also implemented:

[0135] In response to a click operation on a target function in the virtual screen, the virtual screen is controlled to display a function page of the target function.

[0136] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0137] A laser device in the vehicle is controlled to emit laser light at the click position to heat the air at the click position.

[0138] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0139] In response to a control instruction for a virtual screen, a collection device in the vehicle is controlled to collect a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror;

[0140] Determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation;

[0141] The virtual screen is controlled according to the operation type and operation content.

[0142] In one embodiment, when the computer program determines, based on the gesture image, that the operation type and operation content corresponding to the control instruction are executed by the processor, the computer program further implements the following steps:

[0143] According to the gesture image, the target action is determined; according to the target action, the operation type and operation content corresponding to the control instruction are determined.

[0144] In one embodiment, when the computer program determines, based on the target action, that the operation type and operation content corresponding to the control instruction are executed by the processor, the computer program further implements the following steps:

[0145] If the target action is a palm swinging action, the operation type corresponding to the control instruction is determined to be a screen moving operation; and the swinging direction of the palm swinging action is determined as the operation content corresponding to the control instruction.

[0146] In one embodiment, when the computer program controls the virtual screen according to the operation type and operation content and is executed by the processor, the following steps are also implemented:

[0147] A movement instruction carrying operation content is sent to a control motor in the vehicle; wherein the movement instruction is used to instruct the control motor to move the virtual screen according to the operation content.

[0148] In one embodiment, when the computer program determines, based on the target action, that the operation type and operation content corresponding to the control instruction are executed by the processor, the computer program further implements the following steps:

[0149] If the target action is a finger click action, determine the operation type corresponding to the control instruction as a screen click operation; determine the click position corresponding to the finger click action in the virtual screen; and use the target function corresponding to the click position as the operation content corresponding to the control instruction.

[0150] In one embodiment, when the computer program controls the virtual screen according to the operation type and operation content and is executed by the processor, the following steps are also implemented:

[0151] In response to a click operation on a target function in the virtual screen, the virtual screen is controlled to display a function page of the target function.

[0152] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0153] A laser device in the vehicle is controlled to emit laser light at the click position to heat the air at the click position.

[0154] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0155] In response to a control instruction for a virtual screen, a collection device in the vehicle is controlled to collect a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror;

[0156] Determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation;

[0157] The virtual screen is controlled according to the operation type and operation content.

[0158] In one embodiment, when the computer program determines, based on the gesture image, that the operation type and operation content corresponding to the control instruction are executed by the processor, the computer program further implements the following steps:

[0159] According to the gesture image, the target action is determined; according to the target action, the operation type and operation content corresponding to the control instruction are determined.

[0160] In one embodiment, when the computer program determines, based on the target action, that the operation type and operation content corresponding to the control instruction are executed by the processor, the computer program further implements the following steps:

[0161] If the target action is a palm swinging action, the operation type corresponding to the control instruction is determined to be a screen moving operation; and the swinging direction of the palm swinging action is determined as the operation content corresponding to the control instruction.

[0162] In one embodiment, when the computer program controls the virtual screen according to the operation type and operation content and is executed by the processor, the following steps are also implemented:

[0163] A movement instruction carrying operation content is sent to a control motor in the vehicle; wherein the movement instruction is used to instruct the control motor to move the virtual screen according to the operation content.

[0164] In one embodiment, when the computer program determines, based on the target action, that the operation type and operation content corresponding to the control instruction are executed by the processor, the computer program further implements the following steps:

[0165] If the target action is a finger click action, determine the operation type corresponding to the control instruction as a screen click operation; determine the click position corresponding to the finger click action in the virtual screen; and use the target function corresponding to the click position as the operation content corresponding to the control instruction.

[0166] In one embodiment, when the computer program controls the virtual screen according to the operation type and operation content and is executed by the processor, the following steps are also implemented:

[0167] In response to a click operation on a target function in the virtual screen, the virtual screen is controlled to display a function page of the target function.

[0168] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0169] A laser device in the vehicle is controlled to emit laser light at the click position to heat the air at the click position.

[0170] It should be noted that the data involved in this application (including but not limited to data used for analysis, storage, display, etc.) are all information and data fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0171] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0172] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0173] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A screen control method, It is characterized in that The method comprises: In response to a control instruction for a virtual screen, controlling a collection device in the vehicle to collect a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror; Determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation; The virtual screen is controlled according to the operation type and the operation content.

2. The method according to claim 1, It is characterized in that The step of determining the operation type and operation content corresponding to the control instruction according to the gesture image includes: Determining a target action according to the gesture image; According to the target action, the operation type and operation content corresponding to the control instruction are determined.

3. The method according to claim 2, It is characterized in that The step of determining the operation type and operation content corresponding to the control instruction according to the target action includes: If the target action is a palm swing action, determining that the operation type corresponding to the control instruction is a screen movement operation; The swinging direction of the palm swinging action is determined as the operation content corresponding to the control instruction.

4. The method according to claim 3, It is characterized in that The controlling the virtual screen according to the operation type and the operation content includes: Sending a movement instruction carrying the operation content to a control motor in the vehicle; The movement instruction is used to instruct the control motor to move the virtual screen according to the operation content.

5. The method according to claim 2, It is characterized in that The step of determining the operation type and operation content corresponding to the control instruction according to the target action further includes: If the target action is a finger click action, determining that the operation type corresponding to the control instruction is a screen click operation; Determine a click position corresponding to the finger click action on the virtual screen; The target function corresponding to the click position is used as the operation content corresponding to the control instruction.

6. The method according to claim 5, It is characterized in that The controlling the virtual screen according to the operation type and the operation content includes: In response to a click operation on the target function in the virtual screen, the virtual screen is controlled to display a function page of the target function.

7. The method according to claim 5, It is characterized in that The method further comprises: A laser device in the vehicle is controlled to emit laser light at the click position to heat the air at the click position.

8. A screen control device, It is characterized in that The device comprises: An image acquisition module, for responding to a control instruction for a virtual screen, controlling an acquisition device in the vehicle to acquire a gesture image for the virtual screen; wherein the virtual screen is formed by light emitted by a projection device in the vehicle and reflected by a reflective mirror; An operation determination module, used to determine the operation type and operation content corresponding to the control instruction according to the gesture image; wherein the operation type includes a screen movement operation or a screen click operation; The screen control module is used to control the virtual screen according to the operation type and the operation content.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program. It is characterized in that When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images