Vehicle-mounted camera shooting control method and apparatus, and vehicle-mounted terminal and storage medium

Abstract

The present application is suitable for the technical field of device management. Provided are a vehicle-mounted camera shooting control method and apparatus, and a vehicle-mounted terminal and a storage medium. The method comprises: acquiring a first gesture initiated by a user; if the first gesture is a gesture used for controlling a first camera module, determining a first direction of the first gesture, wherein the first camera module is configured to acquire an image of an external environment of a vehicle; and controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction. In the technical solution provided by the present application, multimedia data in a specified direction can be acquired by determining a first direction of a first gesture, thereby achieving the aim of directionally acquiring multimedia data at a specified angle, and improving the acquisition convenience and the operation efficiency of a first camera module.

Description

A vehicle-mounted camera control method, device, vehicle-mounted terminal and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on August 21, 2023, with application number 202311059326.7 and application name “A control method, device, vehicle-mounted terminal and storage medium for vehicle-mounted cameras”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application belongs to the field of equipment management technology, and in particular relates to a control method, device, vehicle-mounted terminal and storage medium for vehicle-mounted cameras. Background Art

[0003] With the continuous development of society and economy, the popularity of motor vehicles is increasing. Self-driving has become the preferred mode of transportation for users in daily life and travel. To meet the diverse needs of users in using motor vehicles, the number of modules and devices installed in motor vehicles has also increased. For example, external camera modules can be installed to capture environmental images of the scene in which the vehicle is located, allowing users to more intuitively observe the external situation of the vehicle while reversing and driving.

[0004] In existing motor vehicle control methods, when it is necessary to control the camera module configured on the vehicle, it is often necessary to operate through the touch screen configured on the vehicle terminal. However, during the driving of the motor vehicle, the touch screen is generally used to display the navigation route. If it is necessary to control the camera module to obtain an image through the touch screen, it is necessary to exit the original interface and then open the camera operation interface to perform the operation, which greatly reduces the operating efficiency of the camera module and the operation steps are cumbersome.

[0005] Summary of the Invention

[0006] The embodiments of the present application provide a method, device, vehicle-mounted terminal and computer-readable storage medium for controlling a vehicle-mounted camera, which can solve the problems of existing motor vehicle control technology, which requires a touch screen to control the camera module in the motor vehicle, resulting in low operating efficiency and great operating difficulty.

[0007] In a first aspect, an embodiment of the present application provides a method for controlling a vehicle-mounted camera, including: 1. A method for controlling a vehicle-mounted camera, characterized in that it includes: obtaining a first gesture initiated by a user; if the first gesture is a gesture for controlling a first camera module, determining a first direction of the first gesture; the first camera module is used to obtain an image of the outside environment of the vehicle; and controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction.

[0008] Implementing the embodiments of the present application has the following beneficial effects: by initiating a first gesture for controlling the first camera module and determining the first direction corresponding to the first gesture, then determining the second direction for controlling the first camera module to acquire multimedia data, and controlling the first camera module to acquire multimedia data corresponding to the second direction, the purpose of controlling the camera module in a motor vehicle through gestures is achieved. Compared with existing motor vehicle control methods, in the embodiments of the present application, the user can control the first camera module in the motor vehicle to acquire multimedia data without using a touch screen, thereby reducing the need for the user to frequently switch the operating interface within the touch screen and unnecessary operation steps. In addition, in the embodiments of the present application, by determining the first direction of the first gesture, multimedia data in a specified direction can be acquired, thereby achieving the purpose of directionally acquiring multimedia data at a specified angle, and improving the convenience and operational efficiency of the first camera module's acquisition.

[0009] In a possible implementation of the first aspect, after obtaining the first gesture initiated by the user, it also includes: determining the hand posture corresponding to the first gesture; if the first gesture is a gesture for controlling the first camera module, determining the first direction of the first gesture, including: if the hand posture is a preset trigger posture, determining the first direction of the first gesture.

[0010] In a possible implementation of the first aspect, the controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction includes: if it is detected that the user's hand changes from the first gesture to the second gesture, adjusting the shooting direction of the first camera module to the second direction; if it is detected that the user changes from the second gesture to the first gesture, determining the data type of the multimedia data based on the duration of the second gesture; and obtaining the multimedia data corresponding to the data type.

[0011] In a possible implementation of the first aspect, if it is detected that the user changes from the second gesture to the first gesture, the data type of the multimedia data is determined based on the duration of the second gesture, including: if the duration is greater than a preset duration threshold, the data type is determined to be a video data type; if the duration is less than or equal to the duration threshold, the data type is determined to be an image data type.

[0012] In a possible implementation manner of the first aspect, the first gesture is an open-hand gesture; and the second gesture is a fist-clenching gesture.

[0013] In a possible implementation of the first aspect, if the first gesture is a gesture for controlling the first camera module, after determining the first direction of the first gesture, it also includes: displaying a preview picture about the second direction through the vehicle-mounted display module.

[0014] In a possible implementation of the first aspect, before displaying the preview picture about the second direction through the vehicle-mounted display module, it also includes: determining the vehicle-mounted display module associated with the vehicle-mounted position according to the vehicle-mounted position of the user.

[0015] In a possible implementation of the first aspect, obtaining the first gesture initiated by the user includes: obtaining, through a second camera module, an image of the vehicle interior environment including the first gesture;

[0016] If the first gesture is a gesture for controlling the first camera module, determining the first direction of the first gesture includes: performing image recognition on the in-vehicle environment image to determine the first direction of the first gesture.

[0017] In a possible implementation of the first aspect, performing image recognition on the in-vehicle environment image to determine the first direction of the first gesture includes: marking multiple key nodes of the first gesture in the in-vehicle environment image through a gesture key point detection algorithm; and determining the first direction based on the relative position relationship between each of the key nodes.

[0018] In a possible implementation of the first aspect, the key nodes include: a palm base node and a fingertip node;

[0019] If the first direction is determined based on the relative position relationship between each of the key nodes, it includes: counting a first number of the fingertip nodes on the left side of the palm base node in the in-vehicle environment image, and counting a second number of the fingertip nodes on the right side of the palm base node in the in-vehicle environment image; and determining the first direction based on the first number and the second number.

[0020] In a possible implementation of the first aspect, obtaining the first gesture initiated by the user includes: receiving the first gesture fed back by a wearable device worn by the user; the wearable device is configured with a photoelectric sensor; and the wearable device determines the first gesture initiated by the user through the photoelectric sensor.

[0021] In a possible implementation of the first aspect, after controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction, it also includes: displaying the multimedia data through a preset device in response to a first playback instruction of the multimedia data; the preset device includes: a vehicle-mounted display module and / or a vehicle-mounted terminal associated with the user.

[0022] In a possible implementation of the first aspect, controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: recording first environmental information inside the vehicle when acquiring the multimedia data;

[0023] After controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction, it also includes: responding to a second playback instruction of the multimedia data, setting the operating parameters of the environmental module in the vehicle based on the first environmental information; if it is detected that the second environmental information in the vehicle after running the environmental module matches the first environmental information, the multimedia data is displayed through a preset device.

[0024] In a possible implementation of the first aspect, controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: acquiring the multimedia data through the first camera module corresponding to the second direction.

[0025] In a possible implementation of the first aspect, controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction includes: adjusting the shooting direction of the first camera module based on the second direction; and obtaining the multimedia data through the first camera module after adjusting the shooting direction.

[0026] In a possible implementation manner of the first aspect, the first direction is the same as the second direction.

[0027] In a second aspect, an embodiment of the present application provides a vehicle-mounted camera control device, comprising:

[0028] a gesture acquiring unit, configured to acquire a first gesture initiated by a user;

[0029] a direction recognition unit, configured to determine a first direction of the first gesture if the first gesture is a gesture for controlling a first camera module, wherein the first camera module is configured to acquire an image of an environment outside the vehicle;

[0030] The multimedia data acquisition unit is configured to control the first camera module to acquire multimedia data in a second direction corresponding to the first direction.

[0031] In a possible implementation of the second aspect, the control device further includes:

[0032] a posture determination unit, configured to determine a hand posture corresponding to the first gesture;

[0033] The direction recognition unit includes: a first direction recognition unit, configured to determine the first direction of the first gesture if the hand gesture is a preset trigger gesture.

[0034] In a possible implementation of the second aspect, the multimedia data acquiring unit includes:

[0035] a shooting direction adjusting unit, configured to adjust the shooting direction of the first camera module to the second direction if it is detected that the user's hand changes from the first gesture to the second gesture;

[0036] a duration determining unit, configured to determine the data type of the multimedia data according to the duration of the second gesture if it is detected that the user switches from the second gesture to the first gesture;

[0037] The designated type data acquisition unit is configured to acquire the multimedia data corresponding to the data type.

[0038] In a possible implementation manner of the second aspect, the duration determining unit includes:

[0039] a video type data determining unit, configured to determine that the data type is a video data type if the duration is greater than a preset duration threshold;

[0040] The image type data determining unit is configured to determine that the data type is an image data type if the duration is less than or equal to the duration threshold.

[0041] In a possible implementation of the second aspect, the first gesture is an open-hand gesture; and the second gesture is a fist-clenching gesture.

[0042] In a possible implementation of the second aspect, the control device further includes:

[0043] The preview picture display unit is used to display a preview picture about the second direction through the vehicle-mounted display module.

[0044] In a possible implementation of the second aspect, the control device further includes:

[0045] The designated position preview unit is used to determine the vehicle-mounted display module associated with the vehicle position according to the vehicle position of the user.

[0046] In a possible implementation of the second aspect, the gesture acquiring unit includes:

[0047] an in-vehicle environment image acquisition unit, configured to acquire an in-vehicle environment image including the first gesture through a second camera module;

[0048] The direction recognition unit includes:

[0049] An image recognition unit is configured to perform image recognition on the in-vehicle environment image to determine the first direction of the first gesture.

[0050] In a possible implementation of the second aspect, the image recognition unit includes:

[0051] a key node determination unit, configured to mark a plurality of key nodes of the first gesture in the in-vehicle environment image using a gesture key point detection algorithm;

[0052] The node position determining unit is configured to determine the first direction according to the relative position relationship between the key nodes.

[0053] In a possible implementation of the second aspect, the key nodes include: a palm base node and a fingertip node;

[0054] The node position determination unit includes:

[0055] a number counting unit, configured to count a first number of the fingertip nodes on the left side of the palm base node in the in-vehicle environment image, and to count a second number of the fingertip nodes on the right side of the palm base node in the in-vehicle environment image;

[0056] A node quantity comparison unit is configured to determine the first direction according to the first quantity and the second quantity.

[0057] In a possible implementation of the second aspect, the gesture acquiring unit includes:

[0058] A sensor feedback unit is configured to receive the first gesture fed back by a wearable device worn by the user; the wearable device is equipped with a photoelectric sensor; the wearable device determines the first gesture initiated by the user through the photoelectric sensor.

[0059] In a possible implementation of the second aspect, the control device further includes:

[0060] The play response unit is used to display the multimedia data through a preset device in response to the first play instruction of the multimedia data; the preset device includes: a vehicle display module and / or a vehicle terminal associated with the user.

[0061] In a possible implementation of the second aspect, the multimedia data acquiring unit includes:

[0062] an environmental information acquisition unit, configured to record first environmental information in the vehicle when acquiring the multimedia data;

[0063] The control device also includes:

[0064] an operating parameter setting unit, configured to set an operating parameter of an environment module in the vehicle based on the first environment information in response to a second playback instruction of the multimedia data;

[0065] The multimedia data display unit is configured to display the multimedia data through a preset device if it is detected that the second environment information in the vehicle matches the first environment information after the environment module is run.

[0066] In a possible implementation of the second aspect, the multimedia data acquiring unit includes:

[0067] The designated camera module acquisition unit is configured to acquire the multimedia data through a first camera module corresponding to the second direction.

[0068] In a possible implementation of the second aspect, the multimedia data acquiring unit includes:

[0069] a shooting direction adjusting unit, configured to adjust the shooting direction of the first camera module based on the second direction;

[0070] The designated direction acquisition unit is configured to acquire the multimedia data by adjusting the shooting direction of the first camera module.

[0071] In a possible implementation manner of the second aspect, the first direction is the same as the second direction.

[0072] In the third aspect, an embodiment of the present application provides a vehicle-mounted terminal, comprising: a memory, a processor, and a computer program stored in the memory and runnable on the processor, characterized in that when the processor executes the computer program, the control method for the vehicle-mounted camera described in any one of the first or third aspects above is implemented.

[0073] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and is characterized in that when the computer program is executed by a processor, it implements the control method of the vehicle-mounted camera described in any one of the above-mentioned first aspects.

[0074] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when running on a vehicle-mounted terminal, enables the vehicle-mounted terminal to execute the vehicle-mounted camera control method described in any one of the first aspects above.

[0075] In a sixth aspect, an embodiment of the present application provides a chip system, comprising a processor coupled to a memory, wherein the processor executes a computer program stored in the memory to implement a method for controlling a vehicle-mounted camera as described in any one of the first aspects.

[0076] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0077] FIG1 is a schematic structural diagram of a vehicle-mounted terminal provided in an embodiment of the present application;

[0078] FIG2 is a block diagram of the software structure of the vehicle terminal according to an embodiment of the present application;

[0079] FIG3 is a control diagram of a motor vehicle camera module provided in an embodiment of the present application;

[0080] FIG4 is a schematic diagram of a motor vehicle shooting vision according to an embodiment of the present application;

[0081] FIG5 is a schematic diagram of an implementation scenario of a method for controlling a vehicle-mounted camera according to an embodiment of the present application;

[0082] FIG6 is a flowchart of a method for controlling a vehicle-mounted camera according to an embodiment of the present application;

[0083] FIG7 is a schematic diagram of enabling the gesture image acquisition function according to an embodiment of the present application;

[0084] FIG8 is a schematic diagram of a first gesture initiated by a user according to an embodiment of the present application;

[0085] FIG9 is a schematic diagram of a first direction of a first gesture provided by an embodiment of the present application;

[0086] 10 is a flowchart of an implementation of determining a first direction of a first gesture in a method for controlling an in-vehicle camera according to an embodiment of the present application;

[0087] FIG11 is a schematic diagram of key points of a gesture provided by an embodiment of the present application;

[0088] FIG12 is a schematic diagram of key nodes marked with different first gestures provided by an embodiment of the present application;

[0089] FIG13 is a flowchart of an implementation of determining a first direction based on a relative position relationship of key nodes according to an embodiment of the present application;

[0090] FIG14 shows the relative position relationship between the fingertip node and the palm base node when the first gesture is in different directions according to an embodiment of the present application;

[0091] FIG15 is a flowchart showing a specific implementation of S603 in the vehicle-mounted camera control method according to an embodiment of the present application;

[0092] FIG16 is a schematic diagram of the deployment of a first camera module provided in one embodiment of the present application;

[0093] FIG17 is a schematic diagram of a first gesture and a second gesture provided by an embodiment of the present application;

[0094] FIG18 is a schematic diagram of a vehicle-mounted display module provided in one embodiment of the present application;

[0095] FIG19 is a schematic diagram showing the display of multimedia data provided by an embodiment of the present application;

[0096] FIG20 is a schematic diagram showing multimedia data provided by another embodiment of the present application;

[0097] FIG21 is a structural block diagram of a vehicle-mounted camera control device provided in an embodiment of the present application;

[0098] Figure 22 is a structural block diagram of the vehicle terminal provided in one embodiment of the present application. DETAILED DESCRIPTION

[0099] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0100] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0101] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0102] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0103] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0104] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0105] The vehicle-mounted terminal to which the vehicle-mounted camera control method provided in the embodiment of the present application can be applied may be a mobile phone, a tablet computer, a wearable device (such as a sports bracelet and a smart watch, etc.), an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and the like. In particular, the vehicle-mounted terminal control method can be applied to a vehicle-mounted terminal with a touch screen, and the vehicle-mounted terminal with a touch screen can display a first operation interface through the touch screen, and display a cross-device interaction area in the first operation interface, so that the user can simultaneously operate the vehicle-mounted terminal (i.e., the first device) and another vehicle-mounted terminal (i.e., the second device) through the touch screen. The embodiment of the present application does not impose any restrictions on the specific type of the vehicle-mounted terminal.

[0106] Please refer to FIG1 , which shows a schematic diagram of the hardware structure of the vehicle-mounted terminal 100 .

[0107] For example, the vehicle-mounted terminal 100 is configured in a vehicle and can be used to control the vehicle's hardware, such as playing a reversing image, controlling the vehicle's air conditioning, opening the windows, etc., as well as to realize entertainment functions such as playing music and radio broadcasts. In this application, the vehicle-mounted terminal 100 can also realize more extended functions by connecting to the vehicle-mounted terminal 100, which will be described in detail below.

[0108] Please refer to Figure 1, which shows a schematic diagram of the hardware structure of the vehicle-mounted terminal 100. The vehicle-mounted terminal 100 may include a processor 110, a memory 120, a wireless communication module 130, a speaker 140, a microphone 150, a display 160, a camera module 170, a USB interface 180, a positioning device 190, and a power supply 191.

[0109] The processor 110 may include one or more processing units. For example, the processor 110 is a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application, such as one or more microprocessors (digital signal processors, DSPs), or one or more field programmable gate arrays (FPGAs). Different processing units may be independent devices or integrated into one or more processors.

[0110] The memory 120 can be used to store computer executable program code, which includes instructions. The internal memory 120 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the vehicle terminal 100 (such as audio data, video data, etc.), etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the vehicle terminal 100 by running instructions stored in the memory 120, and / or instructions stored in a memory provided in the processor.

[0111] The wireless communication module 130 can provide wireless communication solutions for the vehicle terminal 100, including wireless local area networks (WLAN), such as Wi-Fi networks, Bluetooth, near field communication (NFC), infrared radiation (IR), and other wireless communication solutions. The wireless communication module 130 can be one or more devices that integrate at least one communication processing module. In some embodiments of the present application, the vehicle terminal 100 can establish a wireless communication connection with the vehicle terminal 100 through the wireless communication module 130.

[0112] The speaker 140 , also called a “horn,” is used to convert audio electrical signals into sound signals. The vehicle-mounted terminal 100 can listen to music or make hands-free calls through the speaker 140 .

[0113] The microphone 150, also known as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When the user speaks in the vehicle, the user's sound signal is input into the microphone 150. The vehicle-mounted terminal 100 can be provided with at least one microphone 150. In other embodiments, the vehicle-mounted terminal 100 can be provided with two microphones 150, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the vehicle-mounted terminal 100 can also be provided with three, four or more microphones 150 to realize sound signal collection, noise reduction, and identification of sound sources, and realize directional recording function, etc.

[0114] The display screen 160 is used to display images, videos, and the like. The display screen 160 includes a display panel. The display panel can be a liquid crystal display, an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (LED), a miniLED, a microLED, a micro-oLED, a quantum dot light-emitting diode, or the like. In some embodiments, the vehicle-mounted terminal 100 may include one or N display screens 160 , where N is a positive integer greater than 1. The display screen 160 can be used to display multimedia data captured by the camera module 170 .

[0115] The camera module 170 is used to capture multimedia data, such as still images or videos. The object is projected onto a photosensitive element through a lens to generate an optical image. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to the processor 110 for conversion into a digital image signal, which is then converted into an image signal in a standard RGB, YUV, or other format. In some embodiments, the vehicle-mounted terminal 100 may include one or N camera modules 170, where N is a positive integer greater than 1. Specifically, the camera module 170 can be located inside the vehicle to capture images of the driver and the environment outside the vehicle. Alternatively, the camera module 170 can be located outside the vehicle. For example, it can be located in front of the vehicle to capture images in front of the vehicle, or it can be located in the rear of the vehicle to capture images from the rear of the vehicle. It can also be located on both sides of the vehicle to capture images from both sides of the vehicle. The embodiments of the present application do not limit the location of the camera module.

[0116] The USB interface 180 is an interface that complies with USB standards and specifications, and may specifically be a MiniUSB interface, a MicroUSB interface, a USB Type-C interface, etc. The USB interface 180 can be used to connect to other vehicle-mounted terminals, such as the vehicle-mounted terminal 100. In other words, the vehicle-mounted terminal 100 can also establish a communication connection with the vehicle-mounted terminal 100 via the USB interface 180. In other embodiments, the vehicle terminal 100 also connects to an external camera via the USB interface 180 for image capture.

[0117] The positioning device 190 may provide a solution such as a global positioning system (GPS), a global navigation satellite system (GLONASS), or a BeiDou positioning system to implement the positioning function of the vehicle terminal 100 .

[0118] The power supply 191 supplies power to various components of the vehicle terminal 100 , such as the processor 110 , the memory 120 , the wireless communication module 130 , and the like.

[0119] The vehicle terminal 100 may also include or be connected to an air conditioning system, a lighting system (such as high beam, low beam, position marker lights, ambient lights, etc.), audio, sensors (such as ambient light sensors, rain monitors, acceleration sensors, etc.), a braking system, a throttle and other hardware devices, which are not listed here one by one.

[0120] FIG2 is a software structure block diagram of the vehicle-mounted terminal according to an embodiment of the present application.

[0121] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: from top to bottom, the application layer, the application framework layer, the Android runtime system layer, and the kernel layer.

[0122] The application layer can include a series of application packages.

[0123] As shown in FIG2 , the application package may include applications such as camera, calendar, map, WLAN, Bluetooth, music, video, short message, mailbox, WeChat, and WPS.

[0124] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0125] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0126] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0127] The content provider is used to store and retrieve data and make it accessible to applications. This data can include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and phone books. In this embodiment, this data can be multimedia data captured by the camera module, such as video and image data.

[0128] The view system includes visual controls, such as controls for displaying text and images. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface containing a text notification icon can include views for displaying text and views for displaying images. In this embodiment, these views can be used to display collected multimedia data.

[0129] The phone manager is used to provide communication functions for the vehicle terminal, such as call status management (including answering, hanging up, etc.).

[0130] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0131] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically, without requiring user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the system's top status bar as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include displaying text messages in the status bar, sounding alerts, vibrating the vehicle terminal, and flashing indicator lights.

[0132] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0133] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0134] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0135] The system layer can include multiple functional modules, such as the surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), and 2D graphics engine (such as SGL).

[0136] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0137] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0138] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing and layer processing.

[0139] A 2D graphics engine is a drawing engine for 2D drawings.

[0140] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0141] The following describes the workflow of the software and hardware of the vehicle terminal 100 in combination with the capture and photo shooting scene.

[0142] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, touch operation timestamp, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. For example, if the touch operation is a touch single-click operation and the control corresponding to the single-click operation is the control of the camera application icon, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer to capture a still image or video through the camera 193.

[0143] It is understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the vehicle-mounted terminal 100. In other embodiments of the present application, the vehicle-mounted terminal 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0144] With the widespread adoption of motor vehicles, self-driving has become the preferred mode of transportation for users in daily life and travel. Existing motor vehicles are generally equipped with camera modules that can capture images of the vehicle's exterior. For example, this allows users to easily confirm the vehicle's exterior conditions during reversing and driving, thus assisting in driving.

[0145] In addition to assisting with driving, the camera module in a vehicle can also be used to record image data during driving. This is particularly true in travel scenarios, where users have a strong need for photography. For example, when passing by scenic spots or encountering memorable scenes, users can control the vehicle's camera module to capture images or videos. Therefore, how to effectively and quickly control the vehicle's camera module to capture multimedia data has become a key concern for users.

[0146] Exemplarily, FIG3 shows a control diagram of a motor vehicle camera module provided in an embodiment of the present application. Referring to FIG3 , a vehicle-mounted terminal 31 may be configured in the motor vehicle, and the vehicle-mounted terminal may establish a communication connection with various hardware in the motor vehicle, as shown in FIG3 (a). For example, the vehicle-mounted terminal 31 may establish a communication connection with a camera module 32 in the motor vehicle, and the communication connection may be a wired communication connection or a wireless communication connection. Under normal use, the display screen of the vehicle-mounted terminal 31 is generally in the navigation interface of the navigation application, as shown in FIG3 (b). At this time, if the user needs to use the camera application, he needs to return to the main interface, as shown in FIG3 (c). The main interface of the vehicle-mounted terminal may be configured with a camera application control 33. To control the camera module to acquire an image through the camera application, the following actions need to be performed:

[0147] Action 1: Exit the navigation app.

[0148] Action 2: Click on the Camera app.

[0149] Action 3: Click the virtual shooting button in the camera application's operation interface.

[0150] It can be seen that the existing control technology of motor vehicles often requires more steps to call up the corresponding shooting controls when it is necessary to control the vehicle-mounted camera module, thereby greatly reducing the operating efficiency of the camera module. The operating steps are cumbersome, especially during driving, when opportunities are fleeting. Calling up the shooting controls of the camera module through the existing method and then acquiring images can easily lead to missing the shooting opportunity, affecting the user experience.

[0151] Moreover, the camera module configured in the motor vehicle has a wide shooting angle. In some scenarios, the shooting angle of the camera module can reach 360°. For example, FIG4 shows a schematic diagram of the motor vehicle shooting vision provided by an embodiment of the present application. Referring to FIG4 , a plurality of camera modules can be configured in the motor vehicle, such as camera modules 1 to 4, so as to obtain images of the outside environment of the vehicle at least at four angles, such as image 1 corresponding to the front, image 2 corresponding to the left, image 3 corresponding to the right, and image 4 corresponding to the back. Of course, in some scenarios, the obtained angles can be more than 4. Therefore, after the user enters the shooting operation interface by clicking the shooting control, he still needs to select a suitable shooting angle to obtain multimedia data at the specified angle. For example, the display interface includes angle switching controls 41 and 42. The user adjusts the shooting angle by switching left and right, which further increases the complexity of the shooting operation and prolongs the time required for the shooting operation.

[0152] It can be seen that the existing motor vehicle control technology has the problem of complicated operation steps and long operation time when it needs to control the camera module to obtain multimedia data at a specified angle, which makes it easy to miss the shooting opportunity, affecting the user experience and reducing the utilization rate of the camera module on the motor vehicle.

[0153] Example 1:

[0154] Therefore, in order to solve the above-mentioned problems of cumbersome operating steps and easy missing of shooting opportunities when controlling the vehicle-mounted camera module, the present application provides a method for controlling a vehicle-mounted camera. The method for controlling a vehicle-mounted camera is specifically applied to a vehicle-mounted terminal in a motor vehicle. The vehicle-mounted terminal can control the camera module by running the control method of the embodiment of the present application to achieve the purpose of quickly and conveniently obtaining multimedia data outside the vehicle, thereby reducing the operating steps required for shooting through the vehicle-mounted camera module and improving shooting efficiency.

[0155] For example, FIG5 shows a schematic diagram of an implementation scenario of a method for controlling a vehicle-mounted camera provided in an embodiment of the present application. Referring to FIG5 , a vehicle-mounted terminal 51 is provided in a motor vehicle, and the vehicle-mounted terminal can establish a communication connection with a first camera module 52 in the motor vehicle. The above-mentioned first camera module is specifically used to obtain images of the environment outside the vehicle. A sensing device 53 for obtaining user gestures can also be provided in the motor vehicle, and the vehicle-mounted terminal 51 can also establish a communication connection with the sensing device 53 to receive feedback from the sensing device 53 about the first gesture of the user. The vehicle-mounted terminal 51 can control the first camera module 53 to obtain multimedia data according to the first gesture initiated by the user, and multimedia data can be obtained without going through the touch screen of the vehicle-mounted terminal.

[0156] Specifically, FIG6 shows a flowchart of an implementation method of a vehicle-mounted camera control method provided in an embodiment of the present application. The specific implementation process is described as follows:

[0157] In S601 , a first gesture initiated by a user is acquired.

[0158] In this embodiment, when the vehicle-mounted terminal is in a state where the gesture image acquisition function is turned on, the vehicle-mounted terminal can obtain the first gesture initiated by the user through a preset sensing device. For example, Figure 7 shows a schematic diagram of the gesture image acquisition function turned on provided in an embodiment of the present application. Referring to (a) in Figure 7, the operation interface of the vehicle-mounted terminal may include multiple controls, namely a navigation control 71, an audio control 72, and a setting control 73. If the vehicle-mounted terminal detects that the user clicks on the above-mentioned setting control 73, it can enter the corresponding setting interface of the vehicle-mounted terminal, as shown in (b) in Figure 7. The setting interface contains multiple setting items, including a function setting control 74 for gesture image acquisition. The user can adjust the on state of the gesture image acquisition function by clicking on the function setting control 74.

[0159] In this embodiment, the vehicle terminal can determine the first gesture initiated by the user for shooting through the data fed back by the preset sensing device. The above-mentioned sensing device includes but is not limited to: a second camera module, an infrared sensing module, and a wearable device worn by the user (such as a smart watch, a smart bracelet, etc.). Unlike the first camera module, the second camera module is specifically used to obtain an image of the environment in the vehicle cab. Corresponding to different sensing devices, the method of obtaining the first gesture can be specifically described as follows:

[0160] 1. Use the second camera module to obtain the first gesture: The second camera module captures the in-car environment image containing the car user's hand information, and sends the in-car environment image to the in-car terminal. The in-car terminal determines the first gesture initiated by the user by analyzing the above-mentioned in-car environment image.

[0161] 2. Using the infrared sensor module to obtain the first gesture: The infrared sensor module can obtain infrared sensing data initiated by the user's hand and send the infrared sensing data to the vehicle terminal. The vehicle terminal determines the first gesture initiated by the user by analyzing the above infrared sensing data.

[0162] 3. Using a wearable device to obtain the first gesture: The wearable device can be equipped with a photoelectric sensor, which determines the type of user hand movement through a photoplethysmography (PPG) module and the hand posture through an accelerometer. The first gesture is then determined based on the movement type and hand posture. The vehicle-mounted terminal can receive the first gesture feedback from the wearable device. When a communication connection is established between the vehicle-mounted terminal and the wearable device, the wearable device can obtain the user's gesture information, i.e., the first gesture mentioned above, in real time, and feedback the first gesture to the vehicle-mounted terminal in real time, so that the vehicle-mounted terminal can determine whether it needs to control the first camera module to obtain multimedia data based on the first gesture.

[0163] It should be noted that the vehicle terminal can use one or more of the above methods to determine the user's first gesture, that is, the vehicle terminal can establish a communication connection with multiple sensing devices, and then determine the first gesture initiated by the user in multiple ways.

[0164] In one possible implementation, the vehicle terminal can receive gesture information of the user fed back by multiple sensing devices. The vehicle terminal calculates the confidence of each candidate gesture based on the multiple gesture information, and then selects the candidate gesture with the highest confidence as the first gesture of the target user. For example, if the second camera module determines that the user's gesture is a left gesture, the infrared sensor module determines that the user's gesture is a forward gesture, and the wearable device determines that the gesture is a left gesture, then the confidence of the left gesture can be determined to be 66.7%, and the confidence of the forward gesture is 33.3%. Therefore, the gesture with the highest confidence, that is, the left gesture, can be used as the first gesture initiated by the user.

[0165] In one possible implementation, if there are one or more users in a motor vehicle, each user can initiate a first gesture for controlling the first camera module, and the vehicle-mounted terminal can control the first camera module to collect multimedia data based on the first gesture initiated by each user.

[0166] For example, FIG8 shows a schematic diagram of a user initiating a first gesture according to an embodiment of the present application. Referring to FIG8 (a), a motor vehicle contains a user who is in the front row of the vehicle. The vehicle-mounted terminal of the motor vehicle may be equipped with a sensing device 81, which detects the first gesture of the user in the front row. As described above, the sensing device 81 may be the second camera module or infrared sensor module described above, or a wearable device worn on the user's hand, such as a smartwatch or smart bracelet.

[0167] As shown in (b) of Figure 8, there may be multiple users in a motor vehicle, such as user 1 in the front row and user 2 in the back row. In this case, in addition to the on-board terminal being configured with a sensing device 81, the motor vehicle may also be configured with a sensing device 82 at the roof position, so that the first gesture of the user in the back row can be obtained through the sensing device 82.

[0168] In one possible implementation, if there are multiple users in a motor vehicle, control permissions can be configured for designated users, and then gestures of users with control permissions are collected, while gestures of users without control permissions are not collected. For example, the vehicle-mounted terminal can store the correspondence between faces and control permissions. The vehicle-mounted terminal can identify the user's face to determine whether the user has control permissions, and then collect gestures of the corresponding user. For another example, the vehicle-mounted terminal can determine whether the user has control permissions based on the user's position in the motor vehicle. For example, if the front-row user has control permissions, but the back-row user does not, the vehicle-mounted terminal can only obtain the gestures of the front-row user, but not the gestures of the back-row user. The method of setting control permissions for users is not limited here.

[0169] In one possible implementation, the vehicle-mounted terminal can judge the gesture posture of the first gesture, and different gesture postures can be used to control different modules of the motor vehicle. Therefore, after obtaining the first gesture, the vehicle-mounted terminal can judge the gesture posture of the first gesture, for example, whether it is a gesture with a specified direction, and match the gesture posture of the first gesture with a preset trigger posture to determine whether the first gesture is a gesture for controlling the first camera module. If the above-mentioned recognized gesture posture matches the trigger posture, the operation of S602 is executed; otherwise, if not, it is determined whether the gesture posture matches the gesture template for controlling other modules. If there is other gesture template that matches the gesture posture, the corresponding module is controlled according to the first gesture; if not, the first gesture is not responded to.

[0170] In S602 , if the first gesture is a gesture for controlling a first camera module, a first direction of the first gesture is determined; the first camera module is used to acquire an image of an environment outside the vehicle.

[0171] In this embodiment, when the vehicle-mounted terminal determines that the first gesture is a gesture for controlling the first camera module, it determines the first direction indicated by the first gesture. The vehicle-mounted terminal determines a parsing algorithm for the first gesture based on the sensing device that provides feedback on the first gesture, and determines the first direction of the first gesture based on the corresponding parsing algorithm.

[0172] In this embodiment, since the first camera module has a wide shooting angle, to improve the efficiency of multimedia data acquisition, the first gesture can be used not only to control the acquisition timing of the first camera module, but also to control the shooting angle of the first camera module. The shooting angle is specifically determined based on the first direction of the first gesture. The directions indicated by different gestures can be used to control the first camera module to acquire multimedia data in a specified direction.

[0173] For example, FIG9 shows a schematic diagram of the first direction of the first gesture provided by an embodiment of the present application. Referring to FIG9 , according to the different directions of the palm of the hand, it can be determined as the front direction and the back direction; the front direction includes three directions: the front direction, the left direction of the front and the right direction of the front, and the corresponding gestures are gesture 1, gesture 2 and gesture 3, respectively. The specific direction of the front direction can be determined by the direction of the finger; similarly, the back direction includes three directions: the front back direction, the left direction of the back and the right direction of the back, and the corresponding gestures are gesture 4, gesture 5 and gesture 6, respectively. Of course, if the number of first camera modules configured in the vehicle-mounted terminal exceeds 6, or the shooting angles of the first camera module are greater than 6, then the number of first directions of the recognizable first gesture can match the number of the above-mentioned first camera modules and the shooting angles, and the number of first directions is not limited here.

[0174] In one possible implementation, the first direction determined by the vehicle-mounted terminal can be a specific angle value, that is, it is not a plurality of discrete approximate directions, such as the front direction, the left side of the front direction, and the right side of the front direction, but can be an angle vector value such as 60°, -60°, etc., wherein a positive vector value represents that the shooting direction is on the right side of the front, and a negative vector value represents that the shooting direction is on the left side of the front direction, so that the shooting angle range on the left side is (-180°~0°), and the shooting angle range on the right side is (0°~180°).

[0175] In this embodiment, the method of identifying the first direction varies depending on the type of sensing device that captures the first gesture, as described below:

[0176] 1. If the sensing device for acquiring the first gesture is an infrared sensor module, the acquired first gesture is infrared sensor data. The vehicle-mounted terminal can then construct an infrared sensor image of the user's hand through the corresponding infrared sensor data, and then determine whether the user's first gesture is a gesture for controlling the first camera module through an infrared sensor image analysis algorithm. For example, by comparing it with a preset gesture template, if the two match, the first gesture is identified as a gesture for controlling the first camera module, and it is impossible to continue to analyze the infrared sensor image to determine the first direction of the first gesture.

[0177] 2. If the sensing device for obtaining the first gesture is a wearable device, the wearable device can send the hand motion data and the PPG data fed back by the photoelectric sensor to the vehicle-mounted terminal. The vehicle-mounted terminal can determine the gesture type of the first gesture based on the motion data and the PPG data, and determine whether the gesture type is a gesture for controlling the first camera module. If so, the first direction of the first gesture is determined based on the above two types of data.

[0178] 3. If the sensing device for obtaining the first gesture is a second camera module, the second camera module can send the image of the interior environment of the vehicle with the first gesture to the vehicle-mounted terminal, and then the vehicle-mounted terminal can perform image processing on the image of the interior environment through a preset image analysis algorithm to determine the first direction of the first gesture.

[0179] In one possible implementation, the image parsing algorithm used by the vehicle terminal may be a neural network, which may extract a feature vector about the first gesture from the in-vehicle environment image through a convolutional layer, and calculate the confidence between the feature vector of the first gesture and the standard vectors of each recognizable direction through a fully connected layer, and then select the recognizable direction with the highest confidence as the first direction corresponding to the first gesture, thereby achieving the purpose of direction recognition of the first gesture.

[0180] In one possible implementation, FIG10 shows a flowchart for determining the first direction of a first gesture in a method for controlling an in-vehicle camera provided in an embodiment of the present application. Referring to FIG10 , the sensing device is a second camera module, i.e., the in-vehicle terminal acquires the first gesture through an image of the in-vehicle environment. In this case, determining the first direction of the first gesture may include the following steps, which are described in detail as follows:

[0181] In S6021, a plurality of key nodes of the first gesture are marked in the in-vehicle environment image by using a gesture key point detection algorithm.

[0182] In this embodiment, the vehicle terminal may store a gesture key point detection algorithm, through which the hand area contained in the in-vehicle environment image may be determined, and multiple key nodes in the hand area may be marked. For example, FIG11 shows a schematic diagram of gesture key points provided by an embodiment of the present application. Referring to FIG11 , the above-mentioned key nodes include: fingertip nodes and palm base nodes. Optionally, the above-mentioned key nodes may also include finger joint nodes. The specific number of key nodes may be determined according to actual conditions, and the number and type of key nodes are not limited here.

[0183] It should be noted that due to the angle problem of shooting the user's hand, some of the key nodes that need to be marked in the first gesture in the in-car environment image will be blocked. In this case, the vehicle-mounted terminal will mark the key nodes that are visible in the first gesture in the in-car environment image. For example, Figure 12 shows a schematic diagram of the key nodes marked by different first gestures provided by an embodiment of the present application. Referring to (a) in Figure 12, since the direction of gesture 1 is the front direction, all key nodes in the first gesture in the in-car environment image are visible. In this case, all identifiable key nodes can be marked. Referring to (b) in Figure 12, since the direction of gesture 1 is the left direction, the ring finger in the in-car environment image is partially blocked, so the key nodes identified do not include the key nodes corresponding to the thumb.

[0184] In S6022, the first direction is determined according to the relative position relationship between the key nodes.

[0185] In this embodiment, after identifying the key nodes of the first gesture, the vehicle terminal can determine the posture of the first gesture according to the relative position relationship between the key nodes, thereby determining the corresponding first direction according to the posture of the first gesture.

[0186] Furthermore, as another embodiment of the present application, FIG13 shows a flowchart for determining a first direction based on the relative position relationship of key nodes provided in an embodiment of the present application. Referring to FIG13 , the key nodes identified above include the palm base node and the fingertip node. Determining the first direction specifically includes S1301 to S1303, which are described as follows:

[0187] In S1301 , the palm direction of the first gesture is determined based on whether the palm is visible in the in-vehicle environment image.

[0188] In this embodiment, the vehicle terminal can detect whether the palm of the first gesture is visible in the in-vehicle environment image through an image recognition algorithm. If the palm of the first gesture is visible in the in-vehicle environment image, it means that the palm of the first gesture is facing the front direction, and subsequently the relative position relationship between the fingertip node and the palm base node can be used to determine whether it specifically belongs to the front direction, the left side of the front direction, or the right side of the front direction; conversely, if the palm of the first gesture is not visible in the in-vehicle environment image, it means that the palm of the first gesture is facing the back direction, and subsequently the relative position relationship between the fingertip node and the palm base node can be used to determine whether it specifically belongs to the front back direction, the left side of the back direction, or the right side of the back direction.

[0189] In S1302 , a first number of the fingertip nodes on the left side of the palm base node in the in-vehicle environment image is counted, and a second number of the fingertip nodes on the right side of the palm base node in the in-vehicle environment image is counted.

[0190] In S1303, a first direction is determined according to the palm orientation, the first number, and the second number.

[0191] In this embodiment, the vehicle terminal can determine whether the first gesture is to the right, to the left, or in the middle according to the relative position relationship between each fingertip node and the palm base node.

[0192] When the first gesture is in the middle direction, the fingertips are evenly distributed on the left and right sides of the palm root node. For example, FIG14 shows the relative position relationship between the fingertip node and the palm root node when the first gesture provided by an embodiment of the present application is in different directions. Referring to (a) in FIG14, when the first direction of the first gesture is the forward direction, the thumb tip and the index finger are on the left side of the palm, the ring finger tip and the little finger tip are on the right side of the palm, and the middle finger tip and the palm are on the same vertical line, that is, the first number and the second number are the same. If the number of fingertips on the left side of the palm root node (that is, the first number) is recorded as a negative value, and the number of fingertips on the right side of the palm root node (that is, the second number) is recorded as a positive value, then the above relative position relationship can be expressed as -2+2+0=0. At this time, it can be determined that the first gesture is in the middle direction.

[0193] When the first gesture is in the left direction, the number of fingertip nodes on the left side will be greater than the number of intermediate nodes on the right side, as shown in (b) in Figure 14. When the first direction of the first gesture is the left front, the tip of the thumb, index finger, middle finger and ring finger are on the left side of the palm, and the tip of the little finger is on the right side of the palm, that is, the first number is greater than the second number. The above relative position relationship can be expressed as -4+1=-3. At this time, it can be determined that the first gesture is in the left direction.

[0194] The vehicle terminal can configure corresponding numerical ranges for different directions. According to the numerical range in which the numerical representation of the above relative position relationship falls, it is determined whether the first gesture is in the left, right or middle direction. Then, combined with the above-determined palm direction, the first direction of the first gesture can be determined.

[0195] In the embodiments of the present application, the first direction of the first gesture is determined by identifying the fingertip nodes and the base of the palm nodes based on the relative positional relationship between these two different key nodes, thereby improving the accuracy of first direction recognition. Compared to direction recognition using a neural network, using the positional relationship between key hand nodes requires less computation, thereby further improving the efficiency of first direction recognition and, in turn, the efficiency of multimedia data acquisition.

[0196] In S603, the first camera module is controlled to acquire multimedia data in a second direction corresponding to the first direction.

[0197] In this embodiment, after determining the first direction of the user's first gesture, the vehicle-mounted terminal can determine the second direction based on the correspondence between the first direction and the shooting direction, and then obtain multimedia data of the shooting direction (i.e., the second direction) through the first camera module. The multimedia data includes but is not limited to: image data and video data.

[0198] In one possible implementation, the vehicle-mounted terminal is equipped with multiple first camera modules, each of which is fixedly installed in the vehicle and thus has a corresponding shooting range. The vehicle-mounted terminal can establish a correspondence between the shooting range of the first camera module and the first direction. After the vehicle-mounted terminal recognizes the first direction of the first gesture, it can determine the shooting range to which the first direction belongs based on the above-mentioned correspondence, and then use the first camera module corresponding to the shooting range as the target camera module to be controlled this time, that is, the shooting range of the target camera module is the above-mentioned second direction.

[0199] In a possible implementation, the first direction is the same as the second direction. For example, if the user's first gesture is toward the left side of the front, the vehicle-mounted terminal controls the first camera module to acquire multimedia data on the left side of the vehicle's forward direction.

[0200] In one possible implementation, the first direction is different from the second direction. For example, if the user's first gesture is toward the left side of the front, the vehicle-mounted terminal controls the first camera module to acquire multimedia data on the right side of the vehicle's forward direction. Specifically, the correspondence between the first direction and the second direction can be determined by constructing a correspondence table, and then the correspondence table can be queried to determine the second direction corresponding to the first direction of each first gesture.

[0201] Furthermore, as another embodiment of the present application, FIG15 shows a flowchart of a specific implementation of S603 in the vehicle-mounted camera control method provided in one embodiment of the present application. Referring to FIG15 , S603 in the embodiment of the present application specifically includes S1501 to S1504, which are described in detail as follows:

[0202] In S1501 , if it is detected that the user's hand changes from the first gesture to the second gesture, the shooting direction of the first camera module is adjusted to the second direction.

[0203] In this embodiment, the vehicle terminal can determine the second direction to be shot according to the first direction. At this time, the vehicle terminal does not immediately obtain the multimedia data corresponding to the second direction, but controls the first camera module to adjust its shooting direction to the second direction.

[0204] In one possible implementation, the first camera module is a camera module with an adjustable shooting direction. For example, FIG16 shows a deployment diagram of the first camera module provided by an embodiment of the present application. Referring to (a) in FIG16 , the first camera module 161 is deployed at the roof position of the motor vehicle, and the vehicle-mounted terminal can control the rotation of the first camera module 161. In this case, after determining the second direction corresponding to the first direction, the vehicle-mounted terminal can adjust the shooting direction of the first camera module according to the second direction, so that the shooting direction of the first camera module is consistent with the second direction, or the shooting direction of the first camera module includes the second direction, and then obtain multimedia data through the first camera module after adjusting the shooting direction.

[0205] In one possible implementation, a motor vehicle is equipped with multiple first camera modules, and the shooting direction of each first camera module can be fixed or variable. Referring to (b) in FIG16 , the vehicle-mounted terminal is equipped with six camera modules, namely camera modules 1 to 6, wherein camera module 1 is used to obtain images in the front direction, camera module 2 is used to obtain images in the front left direction, camera module 3 is used to obtain images in the front right direction, camera module 4 is used to obtain images directly behind, camera module 5 is used to obtain images in the rear left direction, and camera module 6 is used to obtain images in the rear right direction. After determining the second direction, the vehicle-mounted terminal can activate the first camera module in the direction and obtain multimedia data through the first camera module corresponding to the second direction. For example, if the second direction is the front left side, multimedia data can be obtained through camera module 2.

[0206] In a possible implementation, after adjusting the shooting direction to the second direction, the first camera module may obtain a corresponding preview image and display the preview image through a corresponding vehicle-mounted display module.

[0207] In one possible implementation, the first gesture is specifically a gesture of an open posture, and the second gesture is a gesture of a fist posture. For example, FIG17 shows a schematic diagram of the first gesture and the second gesture provided in an embodiment of the present application. Referring to FIG17 , the first gesture is a gesture in which the fingers are in an open posture, and the opening can be fully open, as shown in FIG17 (a); the first gesture can also be slightly open, that is, the finger joints are in a slightly flexed state, as shown in FIG17 (b); in the second gesture, all fingers are bent and the palm is not visible, that is, in a fist posture, as shown in FIG17 (c).

[0208] In a possible implementation, the first gesture may be a fist-clenching gesture, and the second gesture may be an open fist gesture. The specific gestures may be determined based on actual conditions, and the two gestures are not limited here.

[0209] In S1502, a preview picture of the second direction is displayed via the vehicle-mounted display module.

[0210] In this embodiment, a vehicle-mounted display module may be configured in the motor vehicle, and the vehicle-mounted display module may be a display module on a vehicle-mounted terminal or other display modules. For example, FIG18 shows a schematic diagram of a vehicle-mounted display module provided in an embodiment of the present application. Referring to FIG18 (a), the vehicle-mounted display module is specifically a display module 181 on the vehicle-mounted terminal, and the vehicle-mounted terminal can display the preview screen corresponding to the second direction through the display module on the vehicle-mounted terminal; referring to FIG18 (b), the above-mentioned vehicle-mounted display module may be a display module 182 configured on the front seat. In this case, if the user in the back row needs to view the preview screen, he or she can view the preview screen corresponding to the second direction through the display module configured on the front seat.

[0211] In a possible implementation, the preview screen may be displayed on all vehicle-mounted display modules of the motor vehicle at the same time, or may be displayed on some vehicle-mounted display modules, and may be specifically set according to the user's usage requirements.

[0212] In one possible implementation, the vehicle terminal can determine the vehicle display module associated with the position in the vehicle based on the position in the vehicle of the user who initiated the first gesture. Continuing with FIG18 , if the user who initiated the first gesture is in the front row of the vehicle, the preview screen can be displayed through the display module 181 of the vehicle terminal as shown in FIG18 (a); if the user who initiated the first gesture is in the back row of the vehicle, the preview screen can be displayed through the display module 182 configured on the corresponding front seat as shown in FIG18 (b). The vehicle terminal can record the correspondence between each position in the vehicle and the vehicle display module, and the vehicle terminal can determine the vehicle display module corresponding to the user's position in the vehicle through the above correspondence.

[0213] In one possible implementation, the vehicle-mounted terminal can determine the user's position in the vehicle in a preset manner. For example, a gravity sensor is provided on the seat of the motor vehicle, and the position in the vehicle of the user who initiated the first gesture can be determined based on the change in the sensing value of the gravity sensor; for example, the position in the vehicle of the user who initiated the first gesture can be determined based on the area where the first gesture is located in the in-vehicle environment image. The specific position can be determined based on actual conditions.

[0214] In S1503 , if it is detected that the user changes from the second gesture to the first gesture, the data type of the multimedia data is determined according to the duration of the second gesture.

[0215] In S1504, the multimedia data corresponding to the data type is acquired.

[0216] In this embodiment, the user can control the first camera module to obtain multimedia data of a specified data type based on the duration of the second gesture. Therefore, after detecting that the second gesture has changed to the first gesture, the vehicle-mounted terminal will detect the duration of the user maintaining the second gesture and determine the data type of the multimedia data based on the duration.

[0217] In a possible implementation, if the duration is greater than a preset duration threshold, it is determined that the user needs to obtain video data, that is, the data type of the multimedia data is a video data type, and then the video data of the second direction is obtained through the first camera module.

[0218] In a possible implementation, if the duration is less than or equal to the duration threshold, it is determined that the user needs to obtain image type data, that is, the data type of the multimedia data is an image data type, and then the image data of the second direction is obtained through the first camera module.

[0219] In an embodiment of the present application, different types of multimedia data can be collected by the duration of gesture changes. The user does not need to set the data type of the multimedia data to be obtained. Instead, the data type can be selected by the duration of the gesture, thereby improving the efficiency of multimedia data collection.

[0220] Furthermore, as another embodiment of the present application, after the vehicle-mounted terminal acquires multimedia data in the second direction through the first camera module, the user can display the multimedia data. There are at least two ways to display multimedia data, namely, a normal display mode and a scene reconstruction display mode, as follows:

[0221] Mode 1: Normal display mode

[0222] The vehicle-mounted terminal responds to a first play instruction initiated by the user and displays the multimedia data through a preset device. The preset device may be an onboard display module configured in the vehicle, such as displaying through the display module of the vehicle-mounted terminal, or displaying through a display module configured on the backrest of a front seat. The preset device may also be an electronic device held by the user, such as a smartphone, tablet computer, smartwatch, etc. After receiving the first play instruction, the vehicle-mounted terminal may transmit the multimedia data to the electronic device via a communication link between the vehicle-mounted terminal and the user's electronic device. For example, the vehicle-mounted terminal may establish a wireless connection with the electronic device via a WIFI module or a Bluetooth module, and then transmit the multimedia data to the electronic device via the wireless link so that the user can view the multimedia data on the electronic device.

[0223] For example, FIG19 shows a schematic diagram of the display of multimedia data provided by an embodiment of the present application. After obtaining the multimedia data, the vehicle terminal can display it on the vehicle terminal, as shown in (a) of FIG19. At this time, if the user clicks the exit-closed control 191, the multimedia data will be stored in the album application of the vehicle terminal. If the user needs to view the multimedia data again, he can click on the album application 192 as shown in (b) of FIG19. In response to the user's album application opening instruction, the vehicle terminal displays the album interface, as shown in (c) of FIG19. The album interface displays thumbnails of multiple acquired multimedia data. If the user needs to view a certain multimedia data, he can click on the corresponding thumbnail, such as thumbnail 193. The vehicle terminal will recognize that the user has initiated the above-mentioned first play instruction and display the multimedia data corresponding to the clicked thumbnail 193 on the vehicle terminal, as shown in (d) of FIG19.

[0224] In the embodiment of the present application, after acquiring multimedia data, the vehicle-mounted terminal can display the multimedia data through a preset device, making it convenient for the user to view the acquired images and improving the user experience.

[0225] Method 2: Scene reconstruction display method

[0226] To reconstruct the scene at the time multimedia data was captured, when the vehicle terminal controls the first camera module to capture multimedia data, it also records first environmental information within the vehicle at the time of acquisition. Exemplarily, this first environmental information includes at least one of the following: vehicle lighting, air conditioning temperature, seat position, and audio playing in the vehicle. The vehicle terminal can determine the type of first environmental information to collect based on user settings and / or vehicle configuration.

[0227] In this embodiment, the vehicle-mounted terminal can establish an association relationship between the multimedia data and the first environmental information. When the user displays the multimedia data through a normal display method (i.e., through a first playback instruction), the vehicle-mounted terminal can read the multimedia data and display it, that is, there is no need to obtain the above-mentioned first environmental information through an association relationship.

[0228] In this embodiment, in response to the second playback instruction of multimedia data initiated by the user, the vehicle terminal obtains the first environmental information corresponding to the multimedia data through the above-mentioned association relationship, and controls the operating parameters of the corresponding environmental module according to the information type contained in the first environmental information.

[0229] For example, the first environmental information includes light information, and the environmental module includes a light module of a motor vehicle. The light information may be used to light up a designated light module and control the brightness of the light module.

[0230] For another example, the first environmental information includes the air-conditioning temperature, and the environmental module includes the air-conditioning equipment of the motor vehicle, and the temperature value of the air-conditioning equipment can be set according to the air-conditioning temperature.

[0231] For another example, the first environmental information includes audio information, and the environmental module includes a vehicle-mounted speaker, and plays the specified audio data through the vehicle-mounted speaker.

[0232] The vehicle-mounted terminal can control the operation of the environmental module corresponding to the environmental dimension according to the environmental dimension contained in the first environmental information, so as to reconstruct the environmental information when acquiring multimedia data, that is, realize "scene recall".

[0233] In this embodiment, after controlling the operating parameters of the environment module based on the first environment information, the vehicle terminal detects whether the second environment information within the vehicle matches the first environment information. For example, whether the temperature within the vehicle has reached the preset air conditioning temperature, whether the audio has been downloaded and is playing, etc. If a match is detected between the two environments, the multimedia data can be displayed through a preset device. The preset device includes but is not limited to: the vehicle display module and / or the electronic device used by the user.

[0234] For example, Figure 20 shows a schematic diagram of the display of multimedia data provided by another embodiment of the present application. Referring to (a) in Figure 20, when the vehicle terminal is in the album interface, the display menu of the multimedia data can be called up by long pressing the thumbnail of the multimedia data, as shown in (b) in Figure 20. The display menu includes a normal display control 201 and a scene recall control 202. If it is detected that the user clicks the above-mentioned control 202, the user is recognized to initiate the above-mentioned second play instruction, and the environment module in the car is controlled to simulate the scene during shooting, and the corresponding reconstruction progress bar is displayed, as shown in (c) in Figure 20. After the scene reconstruction is completed, the above-mentioned multimedia data is displayed, as shown in (d) in Figure 20.

[0235] In an embodiment of the present application, the environment module inside the car is adjusted through scene reconstruction to re-simulate the car environment when the multimedia data was shot, so that the user can return to the scene when the multimedia data is displayed, thereby improving the user's immersion when playing the multimedia data.

[0236] As can be seen from the above, the control method for an in-vehicle camera provided in the embodiment of the present application can achieve the purpose of controlling the camera module in a motor vehicle through gestures by initiating a first gesture for controlling the first camera module and determining the first direction corresponding to the first gesture, and then determining the second direction when controlling the first camera module to obtain multimedia data, and controlling the first camera module to obtain multimedia data corresponding to the second direction. Compared with existing motor vehicle control methods, in the embodiment of the present application, the user can control the first camera module in the motor vehicle to obtain multimedia data without using a touch screen, which reduces the need for the user to frequently switch the operating interface in the touch screen and reduces unnecessary operation steps; and the embodiment of the present application can obtain multimedia data in a specified direction by determining the first direction of the first gesture, thereby achieving the purpose of directionally obtaining multimedia data at a specified angle, and improving the convenience and operational efficiency of the first camera module's acquisition.

[0237] Example 2:

[0238] Corresponding to the control method of the vehicle-mounted camera described in the second embodiment above, Figure 21 shows a structural block diagram of the control device of the vehicle-mounted camera provided in the embodiment of the present application. For the sake of convenience, only the parts related to the embodiment of the present application are shown.

[0239] 21, the vehicle-mounted camera control device includes:

[0240] A gesture acquiring unit 211 is configured to acquire a first gesture initiated by a user;

[0241] a direction recognition unit 212 for determining a first direction of the first gesture if the first gesture is a gesture for controlling a first camera module, wherein the first camera module is used to acquire an image of an environment outside the vehicle;

[0242] The multimedia data acquiring unit 213 is configured to control the first camera module to acquire multimedia data in a second direction corresponding to the first direction.

[0243] Optionally, the control device further includes:

[0244] a posture determination unit, configured to determine a hand posture corresponding to the first gesture;

[0245] The direction recognition unit 212 includes: a first direction recognition unit, configured to determine the first direction of the first gesture if the hand gesture is a preset trigger gesture.

[0246] Optionally, the multimedia data acquisition unit includes:

[0247] a shooting direction adjusting unit, configured to adjust the shooting direction of the first camera module to the second direction if it is detected that the user's hand changes from the first gesture to the second gesture;

[0248] a duration determining unit, configured to determine the data type of the multimedia data according to the duration of the second gesture if it is detected that the user switches from the second gesture to the first gesture;

[0249] The designated type data acquisition unit is configured to acquire the multimedia data corresponding to the data type.

[0250] Optionally, the duration determining unit includes:

[0251] a video type data determining unit, configured to determine that the data type is a video data type if the duration is greater than a preset duration threshold;

[0252] The image type data determining unit is configured to determine that the data type is an image data type if the duration is less than or equal to the duration threshold.

[0253] Optionally, the first gesture is an open-hand gesture; and the second gesture is a fist-clenching gesture.

[0254] Optionally, the control device further includes:

[0255] The preview picture display unit is used to display a preview picture about the second direction through the vehicle-mounted display module.

[0256] Optionally, the control device further includes:

[0257] The designated position preview unit is used to determine the vehicle-mounted display module associated with the vehicle position according to the vehicle position of the user.

[0258] Optionally, the gesture acquiring unit 211 includes:

[0259] an in-vehicle environment image acquisition unit, configured to acquire an in-vehicle environment image including the first gesture through a second camera module;

[0260] The direction identification unit 212 includes:

[0261] An image recognition unit is configured to perform image recognition on the in-vehicle environment image to determine the first direction of the first gesture.

[0262] Optionally, the image recognition unit includes:

[0263] a key node determination unit, configured to mark a plurality of key nodes of the first gesture in the in-vehicle environment image using a gesture key point detection algorithm;

[0264] The node position determining unit is configured to determine the first direction according to the relative position relationship between the key nodes.

[0265] Optionally, the key nodes include: palm base nodes and fingertip nodes;

[0266] The node position determination unit includes:

[0267] a number counting unit, configured to count a first number of the fingertip nodes on the left side of the palm base node in the in-vehicle environment image, and to count a second number of the fingertip nodes on the right side of the palm base node in the in-vehicle environment image;

[0268] A node quantity comparison unit is configured to determine the first direction according to the first quantity and the second quantity.

[0269] Optionally, the gesture acquiring unit 211 includes:

[0270] A sensor feedback unit is configured to receive the first gesture fed back by a wearable device worn by the user; the wearable device is equipped with a photoelectric sensor; the wearable device determines the first gesture initiated by the user through the photoelectric sensor.

[0271] Optionally, the control device further includes:

[0272] The play response unit is used to display the multimedia data through a preset device in response to the first play instruction of the multimedia data; the preset device includes: a vehicle display module and / or a vehicle terminal associated with the user.

[0273] Optionally, the multimedia data acquiring unit 213 includes:

[0274] an environmental information acquisition unit, configured to record first environmental information in the vehicle when acquiring the multimedia data;

[0275] The control device also includes:

[0276] an operating parameter setting unit, configured to set an operating parameter of an environment module in the vehicle based on the first environment information in response to a second playback instruction of the multimedia data;

[0277] The multimedia data display unit is configured to display the multimedia data through a preset device if it is detected that the second environment information in the vehicle matches the first environment information after the environment module is run.

[0278] Optionally, the multimedia data acquiring unit 213 includes:

[0279] The designated camera module acquisition unit is configured to acquire the multimedia data through a first camera module corresponding to the second direction.

[0280] Optionally, the multimedia data acquiring unit 213 includes:

[0281] a shooting direction adjusting unit, configured to adjust the shooting direction of the first camera module based on the second direction;

[0282] The designated direction acquisition unit is configured to acquire the multimedia data by adjusting the shooting direction of the first camera module.

[0283] Optionally, the first direction is the same as the second direction.

[0284] FIG22 is a schematic diagram of the structure of an in-vehicle terminal provided in one embodiment of the present application. As shown in FIG22 , the in-vehicle terminal 22 of this embodiment includes: at least one processor 220 (only one processor is shown in FIG22 ), a memory 221, and a computer program 222 stored in the memory 221 and executable on the at least one processor 220. When the processor 220 executes the computer program 222, the steps of any of the above-mentioned in-vehicle camera control method embodiments are implemented.

[0285] The vehicle-mounted terminal 22 can be a computing device such as a desktop computer, laptop, PDA, or cloud server. The vehicle-mounted terminal can include, but is not limited to, a processor 220 and a memory 221. Those skilled in the art will appreciate that FIG22 is merely an example of a vehicle-mounted terminal 22 and does not limit the vehicle-mounted terminal 22. The vehicle-mounted terminal 22 can include more or fewer components than shown, or a combination of certain components, or different components. For example, it can also include input / output devices, network access devices, etc.

[0286] The processor 220 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. A general-purpose processor may be a microprocessor or any conventional processor.

[0287] In some embodiments, the memory 221 may be an internal storage unit of the vehicle-mounted terminal 22, such as a hard disk or memory of the vehicle-mounted terminal 22. In other embodiments, the memory 221 may also be an external storage device of the vehicle-mounted terminal 22, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the vehicle-mounted terminal 22. Furthermore, the memory 221 may also include both an internal storage unit of the vehicle-mounted terminal 22 and an external storage device. The memory 221 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 221 may also be used to temporarily store data that has been output or is to be output.

[0288] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0289] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0290] An embodiment of the present application also provides a vehicle-mounted terminal, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps of any of the above-mentioned method embodiments when executing the computer program.

[0291] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned various method embodiments can be implemented.

[0292] An embodiment of the present application provides a computer program product. When the computer program product is run on a vehicle-mounted terminal, the vehicle-mounted terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0293] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. Among them, the computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / vehicle terminal, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. For example, USB flash drive, mobile hard disk, magnetic disk or optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0294] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0295] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0296] In the embodiments provided in this application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0297] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0298] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A method for controlling a vehicle-mounted camera, characterized in that: include: Get the first gesture initiated by the user; If the first gesture is a gesture for controlling a first camera module, determining a first direction of the first gesture; The first camera module is used to obtain an image of the environment outside the vehicle; The first camera module is controlled to acquire multimedia data in a second direction corresponding to the first direction.

2. The control method according to claim 1, characterized in that: After obtaining the first gesture initiated by the user, the method further includes: determining a hand posture corresponding to the first gesture; If the first gesture is a gesture for controlling the first camera module, determining a first direction of the first gesture includes: If the hand gesture is a preset trigger gesture, the first direction of the first gesture is determined.

3. The control method according to claim 1, characterized in that: The controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: If it is detected that the user's hand changes from the first gesture to the second gesture, adjusting the shooting direction of the first camera module to the second direction; If it is detected that the user changes from the second gesture to the first gesture, determining the data type of the multimedia data according to the duration of the second gesture; The multimedia data corresponding to the data type is acquired.

4. The control method according to claim 3, characterized in that: If it is detected that the user changes from the second gesture to the first gesture, determining the data type of the multimedia data according to the duration of the second gesture includes: If the duration is greater than a preset duration threshold, determining that the data type is a video data type; If the duration is less than or equal to the duration threshold, it is determined that the data type is an image data type.

5. The control method according to claim 3, characterized in that: The first gesture is an open-arm gesture; the second gesture is a clenched-fist gesture.

6. The control method according to claim 2, characterized in that: After determining the first direction of the first gesture if the first gesture is a gesture for controlling the first camera module, the method further includes: A preview picture about the second direction is displayed through the vehicle-mounted display module.

7. The control method according to claim 6, characterized in that: Before displaying the preview picture about the second direction through the vehicle-mounted display module, the method further includes: According to the in-vehicle position of the user, the in-vehicle display module associated with the in-vehicle position is determined.

8. The control method according to any one of claims 1 to 7, characterized in that: The obtaining of the first gesture initiated by the user includes: Acquiring, by a second camera module, an image of the vehicle interior environment including the first gesture; If the first gesture is a gesture for controlling the first camera module, determining a first direction of the first gesture includes: Perform image recognition on the in-vehicle environment image to determine the first direction of the first gesture.

9. The control method according to claim 8, characterized in that: The performing image recognition on the in-vehicle environment image to determine the first direction of the first gesture includes: Marking a plurality of key nodes of the first gesture in the in-vehicle environment image by using a gesture key point detection algorithm; The first direction is determined according to the relative position relationship between the key nodes.

10. The control method according to claim 9, characterized in that: The key nodes include: palm base nodes and fingertip nodes; The determining the first direction according to the relative position relationship between the key nodes includes: Counting a first number of the fingertip nodes on the left side of the palm root node in the in-vehicle environment image, and counting a second number of the fingertip nodes on the right side of the palm root node in the in-vehicle environment image; The first direction is determined according to the first number and the second number.

11. The control method according to any one of claims 1 to 7, characterized in that: The obtaining of the first gesture initiated by the user includes: The first gesture fed back by a wearable device worn by the user is received; the wearable device is equipped with a photoelectric sensor; the wearable device determines the first gesture initiated by the user through the photoelectric sensor.

12. The control method according to any one of claims 1 to 7, characterized in that: After controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction, the method further includes: In response to a first play instruction of the multimedia data, the multimedia data is displayed through a preset device; the preset device includes: a vehicle display module and / or a vehicle terminal associated with the user.

13. The control method according to any one of claims 1 to 7, characterized in that: The controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: Recording first environment information in the vehicle when acquiring the multimedia data; After controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction, the method further includes: In response to a second playback instruction of the multimedia data, setting an operating parameter of an environment module in the vehicle based on the first environment information; If it is detected that the second environment information in the vehicle matches the first environment information after the environment module is run, the multimedia data is displayed through a preset device.

14. The control method according to any one of claims 1 to 7, characterized in that: The controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: The multimedia data is acquired through a first camera module corresponding to the second direction.

15. The control method according to any one of claims 1 to 7, characterized in that: The controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: adjusting a shooting direction of the first camera module based on the second direction; The multimedia data is acquired by the first camera module after adjusting the shooting direction.

16. The control method according to any one of claims 1 to 15, characterized in that: The first direction is the same as the second direction.

17. A vehicle-mounted terminal, characterized in that: The vehicle-mounted terminal includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor executes the steps of the method according to any one of claims 1 to 16 when executing the computer program.

18. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.

Images