Vehicle-mounted camera shooting control method and device, vehicle-mounted terminal and storage medium

Abstract

The invention is suitable for the technical field of equipment management, and provides a vehicle-mounted camera control method and device, a vehicle-mounted terminal and a storage medium, and the method comprises the steps: obtaining a first gesture initiated by a user; if the first gesture is used for controlling a first camera module, determining a first direction of the first gesture; the first camera module is used for acquiring an environment image outside the vehicle; and controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction. According to the technical scheme provided by the invention, the multimedia data in the specified direction can be obtained by determining the first direction of the first gesture, so that the purpose of directionally obtaining the multimedia data in the specified angle is achieved, and the collection convenience and the operation efficiency of the first camera module are improved.

Description

Technical Field

[0001] The present application belongs to the technical field of equipment management, and in particular, relates to a control method, device, vehicle-mounted terminal and storage medium for vehicle-mounted camera. Background Art

[0002] With the continuous development of social economy, the popularity of motor vehicles is increasing, and self-driving has become the preferred mode of travel for users in their daily lives and when traveling. In order to meet the different needs of users in the process of using motor vehicles, the number of modules and devices configured in motor vehicles has also increased. For example, an external camera module can be configured to obtain environmental images of the scene where the motor vehicle is located, so that users can more intuitively view the situation outside the car during reversing and driving.

[0003] In the existing control method of motor vehicles, when it is necessary to control the camera module configured on the vehicle, it is often necessary to operate through the touch screen configured on the vehicle terminal. However, during the driving of the motor vehicle, the touch screen is generally used to display the navigation route. If it is necessary to control the camera module to acquire an image through the touch screen, it is necessary to exit the original interface and then open the camera operation interface to perform the operation, which greatly reduces the operating efficiency of the camera module and the operating steps are cumbersome. Summary of the invention

[0004] The embodiments of the present application provide a method and device for controlling a vehicle-mounted camera, a vehicle-mounted terminal, and a computer-readable storage medium, which can solve the problems of existing motor vehicle control technology, which requires a touch screen to control the camera module in the motor vehicle, has low operating efficiency and is difficult to operate.

[0005] In a first aspect, an embodiment of the present application provides a method for controlling a vehicle-mounted camera, comprising: 1. A method for controlling a vehicle-mounted camera, characterized in that it comprises: obtaining a first gesture initiated by a user; if the first gesture is a gesture for controlling a first camera module, determining a first direction of the first gesture; the first camera module is used to obtain an image of the outside environment of the vehicle; and controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction.

[0006] The implementation of the embodiment of the present application has the following beneficial effects: by initiating a first gesture for controlling the first camera module and determining the first direction corresponding to the first gesture, and then determining the second direction when controlling the first camera module to obtain multimedia data, and controlling the first camera module to obtain multimedia data corresponding to the second direction, the purpose of controlling the camera module in the motor vehicle through gestures is achieved. Compared with the existing motor vehicle control method, in the embodiment of the present application, the user can control the first camera module in the motor vehicle to obtain multimedia data without using a touch screen, reducing the situation where the user needs to frequently switch the operation interface in the touch screen, and reducing unnecessary operation steps; and the embodiment of the present application can obtain multimedia data in a specified direction by determining the first direction of the first gesture, achieving the purpose of directionally obtaining multimedia data at a specified angle, and improving the convenience and operation efficiency of the first camera module acquisition.

[0007] In a possible implementation of the first aspect, after obtaining the first gesture initiated by the user, it also includes: determining a hand posture corresponding to the first gesture; if the first gesture is a gesture for controlling a first camera module, determining a first direction of the first gesture, including: if the hand posture is a preset trigger posture, determining the first direction of the first gesture.

[0008] In a possible implementation of the first aspect, controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: if it is detected that the user's hand changes from the first gesture to the second gesture, adjusting the shooting direction of the first camera module to the second direction; if it is detected that the user changes from the second gesture to the first gesture, determining the data type of the multimedia data based on the duration of the second gesture; and acquiring the multimedia data corresponding to the data type.

[0009] In a possible implementation of the first aspect, if it is detected that the user changes from the second gesture to the first gesture, the data type of the multimedia data is determined according to the duration of the second gesture, including: if the duration is greater than a preset duration threshold, the data type is determined to be a video data type; if the duration is less than or equal to the duration threshold, the data type is determined to be an image data type.

[0010] In a possible implementation manner of the first aspect, the first gesture is an open-arm gesture; and the second gesture is a fist-clenching gesture.

[0011] In a possible implementation of the first aspect, if the first gesture is a gesture for controlling the first camera module, after determining the first direction of the first gesture, it also includes: displaying a preview picture about the second direction through the vehicle-mounted display module.

[0012] In a possible implementation of the first aspect, before displaying the preview picture about the second direction through the vehicle-mounted display module, it also includes: determining the vehicle-mounted display module associated with the vehicle-mounted position according to the vehicle-mounted position of the user.

[0013] In a possible implementation of the first aspect, acquiring the first gesture initiated by the user includes: acquiring, through a second camera module, an image of the vehicle interior environment including the first gesture;

[0014] If the first gesture is a gesture for controlling a first camera module, determining a first direction of the first gesture includes: performing image recognition on the in-vehicle environment image to determine the first direction of the first gesture.

[0015] In a possible implementation of the first aspect, performing image recognition on the in-vehicle environment image to determine the first direction of the first gesture includes: marking multiple key nodes of the first gesture in the in-vehicle environment image through a gesture key point detection algorithm; and determining the first direction based on the relative position relationship between each of the key nodes.

[0016] In a possible implementation of the first aspect, the key nodes include: a palm base node and a fingertip node;

[0017] If the first direction is determined based on the relative position relationship between each of the key nodes, it includes: counting a first number of the fingertip nodes on the left side of the palm base node in the in-vehicle environment image, and counting a second number of the fingertip nodes on the right side of the palm base node in the in-vehicle environment image; determining the first direction based on the first number and the second number.

[0018] In a possible implementation of the first aspect, obtaining a first gesture initiated by a user includes: receiving the first gesture fed back by a wearable device worn by the user; the wearable device is configured with a photoelectric sensor; and the wearable device determines the first gesture initiated by the user through the photoelectric sensor.

[0019] In a possible implementation of the first aspect, after controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction, it also includes: in response to a first playback instruction of the multimedia data, displaying the multimedia data through a preset device; the preset device includes: a vehicle-mounted display module and / or a vehicle-mounted terminal associated with the user.

[0020] In a possible implementation of the first aspect, controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: recording first environmental information in the vehicle when acquiring the multimedia data;

[0021] After controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction, it also includes: responding to a second playback instruction of the multimedia data, setting operating parameters of the environmental module in the vehicle based on the first environmental information; if it is detected that the second environmental information in the vehicle matches the first environmental information after running the environmental module, displaying the multimedia data through a preset device.

[0022] In a possible implementation manner of the first aspect, controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: acquiring the multimedia data through the first camera module corresponding to the second direction.

[0023] In a possible implementation of the first aspect, controlling the first camera module to obtain multimedia data in a second direction corresponding to the first direction includes: adjusting a shooting direction of the first camera module based on the second direction; and obtaining the multimedia data through the first camera module after adjusting the shooting direction.

[0024] In a possible implementation manner of the first aspect, the first direction is the same as the second direction.

[0025] In a second aspect, an embodiment of the present application provides a vehicle-mounted camera control device, comprising:

[0026] A gesture acquisition unit, used to acquire a first gesture initiated by a user;

[0027] a direction recognition unit, configured to determine a first direction of the first gesture if the first gesture is a gesture for controlling a first camera module; the first camera module is configured to acquire an image of an environment outside the vehicle;

[0028] The multimedia data acquisition unit is used to control the first camera module to acquire multimedia data in a second direction corresponding to the first direction.

[0029] In a possible implementation manner of the second aspect, the control device further includes:

[0030] a gesture determining unit, configured to determine a hand gesture corresponding to the first gesture;

[0031] The direction recognition unit includes: a first direction recognition unit, configured to determine the first direction of the first gesture if the hand gesture is a preset trigger gesture.

[0032] In a possible implementation manner of the second aspect, the multimedia data acquisition unit includes:

[0033] a shooting direction adjusting unit, configured to adjust the shooting direction of the first camera module to the second direction if it is detected that the user's hand changes from the first gesture to the second gesture;

[0034] a duration determining unit, configured to determine the data type of the multimedia data according to the duration of the second gesture if it is detected that the user changes from the second gesture to the first gesture;

[0035] The designated type data acquisition unit is used to acquire the multimedia data corresponding to the data type.

[0036] In a possible implementation manner of the second aspect, the duration determining unit includes:

[0037] a video type data determining unit, configured to determine that the data type is a video data type if the duration is greater than a preset duration threshold;

[0038] The image type data determining unit is configured to determine that the data type is an image data type if the duration is less than or equal to the duration threshold.

[0039] In a possible implementation manner of the second aspect, the first gesture is an open-arm gesture; and the second gesture is a fist-clenching gesture.

[0040] In a possible implementation manner of the second aspect, the control device further includes:

[0041] The preview picture display unit is used to display a preview picture about the second direction through the vehicle-mounted display module.

[0042] In a possible implementation manner of the second aspect, the control device further includes:

[0043] The designated position preview unit is used to determine the vehicle display module associated with the vehicle position according to the vehicle position of the user.

[0044] In a possible implementation manner of the second aspect, the gesture acquiring unit includes:

[0045] An in-vehicle environment image acquisition unit, configured to acquire an in-vehicle environment image including the first gesture through a second camera module;

[0046] The direction recognition unit includes:

[0047] An image recognition unit is used to perform image recognition on the in-vehicle environment image to determine the first direction of the first gesture.

[0048] In a possible implementation manner of the second aspect, the image recognition unit includes:

[0049] A key node determination unit, configured to mark a plurality of key nodes of the first gesture in the in-vehicle environment image by using a gesture key point detection algorithm;

[0050] A node position determination unit is used to determine the first direction according to the relative position relationship between each of the key nodes.

[0051] In a possible implementation of the second aspect, the key nodes include: a palm base node and a fingertip node;

[0052] The node position determination unit includes:

[0053] a number counting unit, configured to count a first number of the fingertip nodes on the left side of the palm root node in the in-vehicle environment image, and to count a second number of the fingertip nodes on the right side of the palm root node in the in-vehicle environment image;

[0054] A node quantity comparison unit is used to determine the first direction according to the first quantity and the second quantity.

[0055] In a possible implementation manner of the second aspect, the gesture acquiring unit includes:

[0056] A sensor feedback unit is used to receive the first gesture fed back by a wearable device worn by the user; the wearable device is equipped with a photoelectric sensor; the wearable device determines the first gesture initiated by the user through the photoelectric sensor.

[0057] In a possible implementation manner of the second aspect, the control device further includes:

[0058] The play response unit is used to respond to the first play instruction of the multimedia data and display the multimedia data through a preset device; the preset device includes: a vehicle display module and / or a vehicle terminal associated with the user.

[0059] In a possible implementation manner of the second aspect, the multimedia data acquisition unit includes:

[0060] An environmental information acquisition unit, used for recording first environmental information in the vehicle when acquiring the multimedia data;

[0061] The control device also includes:

[0062] an operating parameter setting unit, configured to set an operating parameter of an environment module in the vehicle based on the first environment information in response to a second playback instruction of the multimedia data;

[0063] The multimedia data display unit is used to display the multimedia data through a preset device if it is detected that the second environment information in the vehicle matches the first environment information after the environment module is run.

[0064] In a possible implementation manner of the second aspect, the multimedia data acquisition unit includes:

[0065] The designated camera module acquisition unit is configured to acquire the multimedia data through a first camera module corresponding to the second direction.

[0066] In a possible implementation manner of the second aspect, the multimedia data acquisition unit includes:

[0067] a shooting direction adjusting unit, configured to adjust the shooting direction of the first camera module based on the second direction;

[0068] The designated direction acquisition unit is used to acquire the multimedia data by adjusting the shooting direction of the first camera module.

[0069] In a possible implementation manner of the second aspect, the first direction is the same as the second direction.

[0070] In the third aspect, an embodiment of the present application provides a vehicle-mounted terminal, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the vehicle-mounted camera control method described in any one of the first aspect or the third aspect when executing the computer program.

[0071] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and wherein when the computer program is executed by a processor, the control method for the vehicle-mounted camera described in any one of the first aspects above is implemented.

[0072] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on a vehicle-mounted terminal, the vehicle-mounted terminal executes the vehicle-mounted camera control method described in any one of the first aspects above.

[0073] In a sixth aspect, an embodiment of the present application provides a chip system, including a processor, the processor being coupled to a memory, the processor executing a computer program stored in the memory to implement a vehicle-mounted camera control method as described in any one of the first aspects.

[0074] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0075] Figure 1 is a schematic diagram of the structure of the vehicle-mounted terminal provided in an embodiment of the present application;

[0076] Figure 2 is a software structure block diagram of the vehicle-mounted terminal of an embodiment of the present application;

[0077] Figure 3 is a control schematic diagram of a motor vehicle camera module provided in an embodiment of the present application;

[0078] Figure 4 is a schematic diagram of a motor vehicle shooting vision provided by an embodiment of the present application;

[0079] Figure 5 This is a schematic diagram of an implementation scenario of a vehicle-mounted camera control method provided in an embodiment of the present application;

[0080] Figure 6 is a flow chart of an implementation method of a vehicle-mounted camera control method provided in an embodiment of the present application;

[0081] Figure 7 is a schematic diagram of enabling a gesture image acquisition function provided by an embodiment of the present application;

[0082] Figure 8 is a schematic diagram of a user initiating a first gesture provided by an embodiment of the present application;

[0083] Fig. 9 is a schematic diagram of a first direction of a first gesture provided by an embodiment of the present application;

[0084] Fig.10 is a flowchart for implementing determining a first direction of a first gesture in a method for controlling an in-vehicle camera provided by an embodiment of the present application;

[0085] Fig.11 is a schematic diagram of key points of gestures provided by an embodiment of the present application;

[0086] Fig.12 is a schematic diagram of key nodes marked by different first gestures provided in an embodiment of the present application;

[0087] Fig.13 is a flowchart for determining a first direction based on a relative position relationship of key nodes provided by an embodiment of the present application;

[0088] Fig.14 The relative position relationship between the fingertip node and the palm root node when the first gesture is in different directions provided by an embodiment of the present application;

[0089] Fig.15 This is a specific implementation flow chart of S603 in the vehicle-mounted camera control method provided in one embodiment of the present application;

[0090] Fig.16 is a schematic diagram of the deployment of a first camera module provided in an embodiment of the present application;

[0091] Fig.17 is a schematic diagram of a first gesture and a second gesture provided by an embodiment of the present application;

[0092] Fig.18 is a schematic diagram of a vehicle-mounted display module provided in an embodiment of the present application;

[0093] Fig.19 is a schematic diagram of displaying multimedia data provided by an embodiment of the present application;

[0094] Fig. 20 is a schematic diagram of displaying multimedia data provided by another embodiment of the present application;

[0095] Fig.21 is a structural block diagram of a vehicle-mounted camera control device provided in an embodiment of the present application;

[0096] Fig. 22 It is a structural block diagram of a vehicle-mounted terminal provided in one embodiment of the present application. DETAILED DESCRIPTION

[0097] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0098] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0099] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0100] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0101] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0102] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0103] The vehicle-mounted terminal to which the vehicle-mounted camera control method provided in the embodiment of the present application can be applied may be a mobile phone, a tablet computer, a wearable device (such as a sports bracelet and a smart watch, etc.), an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and other vehicle-mounted terminals. In particular, the vehicle-mounted camera control method can be applied to a vehicle-mounted terminal with a touch screen, and the vehicle-mounted terminal with a touch screen can display a first operation interface through the touch screen, and display a cross-device interaction area in the first operation interface, so that the user can simultaneously operate the vehicle-mounted terminal (i.e., the first device) and another vehicle-mounted terminal (i.e., the second device) through the touch screen. The embodiment of the present application does not impose any restrictions on the specific type of the vehicle-mounted terminal.

[0104] See also Figure 1 , Figure 1 A schematic diagram of the hardware structure of the vehicle-mounted terminal 100 is shown.

[0105] For example, the vehicle terminal 100 is configured in a car and can be used to control the car's own hardware, such as playing reversing images, controlling the air conditioner in the car, opening the windows, etc., as well as playing music and radio broadcasts and other entertainment functions. In this application, the vehicle terminal 100 can also achieve more extended functions by connecting to the vehicle terminal 100, which will be described in detail below.

[0106] See also Figure 1 , Figure 1 1 shows a schematic diagram of the hardware structure of the vehicle terminal 100. The vehicle terminal 100 may include a processor 110, a memory 120, a wireless communication module 130, a speaker 140, a microphone 150, a display screen 160, a camera module 170, a USB interface 180, a positioning device 190, and a power supply 191.

[0107] The processor 110 may include one or more processing units. For example, the processor 110 is a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application, such as one or more microprocessors (digital signal processors, DSPs), or one or more field programmable gate arrays (FPGAs). Different processing units may be independent devices or integrated into one or more processors.

[0108] The memory 120 can be used to store computer executable program codes, which include instructions. The internal memory 120 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the vehicle terminal 100 (such as audio data, video data, etc.), etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the vehicle terminal 100 by running instructions stored in the memory 120, and / or instructions stored in a memory provided in the processor.

[0109] The wireless communication module 130 can provide wireless communication solutions including wireless local area network (WLAN), such as Wi-Fi network, Bluetooth, near field communication (NFC), infrared (IR), etc., applied to the vehicle terminal 100. The wireless communication module 130 can be one or more devices integrating at least one communication processing module. In some embodiments of the present application, the vehicle terminal 100 can establish a wireless communication connection with the vehicle terminal 100 through the wireless communication module 130.

[0110] The speaker 140 , also called a “speaker”, is used to convert an audio electrical signal into a sound signal. The vehicle-mounted terminal 100 can listen to music or listen to a hands-free call through the speaker 140 .

[0111] The microphone 150, also called a "microphone" or "microphone", is used to convert sound signals into electrical signals. When a user speaks in the vehicle, the user's sound signal is input into the microphone 150. The vehicle-mounted terminal 100 may be provided with at least one microphone 150. In other embodiments, the vehicle-mounted terminal 100 may be provided with two microphones 150, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the vehicle-mounted terminal 100 may also be provided with three, four or more microphones 150 to realize sound signal collection, noise reduction, and identification of sound sources, and realize directional recording function, etc.

[0112] The display screen 160 is used to display images, videos, etc. The display screen 160 includes a display panel. The display panel can be a liquid crystal display, an organic light emitting diode, an active matrix organic light emitting diode or an active matrix organic light emitting diode, a flexible light emitting diode, a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diode, etc. In some embodiments, the vehicle terminal 100 may include 1 or N display screens 160, where N is a positive integer greater than 1. The above-mentioned display screen 160 can be used to display multimedia data acquired by the camera module 170.

[0113] The camera module 170 is used to capture multimedia data, such as static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the processor 110 to convert it into a digital image signal, and then converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the vehicle-mounted terminal 100 may include 1 or N camera modules 170, where N is a positive integer greater than 1. Specifically, the camera module 170 can be set in the vehicle to collect the driver's picture and the image of the outside environment. And / or, the camera module 170 can also be set outside the vehicle. For example, it is set in front of the vehicle to collect the picture in front of the vehicle, and it can also be set at the rear of the vehicle to collect the picture behind the vehicle. It can also be set on both sides of the vehicle to collect the pictures on both sides of the vehicle. The embodiment of the present application does not limit the setting position of the camera module.

[0114] The USB interface 180 is an interface that complies with the USB standard specification, and specifically can be a MiniUSB interface, a MicroUSB interface, a USB Type C interface, etc. The USB interface 180 can be used to connect other vehicle terminals, such as the vehicle terminal 100, etc. In other words, the vehicle terminal 100 can also establish a communication connection with the vehicle terminal 100 through the USB interface 180. In some other embodiments, the vehicle terminal 100 is also connected to an external camera through the USB interface 180 for collecting images.

[0115] The positioning device 190 can provide solutions such as the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), or the Beidou Positioning System to achieve the positioning function of the vehicle terminal 100 .

[0116] The power supply 191 supplies power to various components of the vehicle terminal 100 , such as the processor 110 , the memory 120 , the wireless communication module 130 , etc.

[0117] The vehicle terminal 100 may also include or be connected to an air conditioning system, a lighting system (such as a high-beam headlight, a low-beam headlight, a clearance light, an ambient light, etc.), audio, sensors (such as an ambient light sensor, a rain monitor, an acceleration sensor, etc.), a braking system, a throttle and other hardware devices, which are not listed here one by one.

[0118] Figure 2 It is a software structure block diagram of the vehicle terminal of an embodiment of the present application.

[0119] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the system layer of the Android runtime (Android runtime), and the kernel layer.

[0120] The application layer can include a series of application packages.

[0121] like Figure 2 As shown, the application package may include camera, calendar, map, WLAN, Bluetooth, music, video, short message, mailbox, WeChat, WPS and other applications.

[0122] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0123] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0124] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0125] The content provider is used to store and obtain data and make the data accessible to the application. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc. In this embodiment, the data may be multimedia data collected by the camera module, such as video data and image data.

[0126] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures. In this embodiment, it can be used to display the collected multimedia data.

[0127] The phone manager is used to provide communication functions for the vehicle terminal, such as the management of call status (including answering, hanging up, etc.).

[0128] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0129] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, the vehicle terminal vibrates, the indicator light flashes, etc.

[0130] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0131] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0132] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0133] The system layer may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0134] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0135] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0136] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis and layer processing, etc.

[0137] A 2D graphics engine is a drawing engine for 2D drawings.

[0138] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0139] The following is an example of the workflow of the software and hardware of the vehicle terminal 100 in conjunction with the capture and photo shooting scene.

[0140] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, timestamp of the touch operation, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. For example, if the touch operation is a touch single-click operation and the control corresponding to the single-click operation is the control of the camera application icon, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer to capture static images or videos through the camera 193.

[0141] It is understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the vehicle-mounted terminal 100. In other embodiments of the present application, the vehicle-mounted terminal 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0142] With the popularity of motor vehicles, self-driving has become the preferred mode of travel for users in their daily lives and travel. Existing motor vehicles are generally equipped with camera modules, which can obtain images of the external environment of the vehicle. For example, during reversing and driving, it is convenient for users to confirm the situation outside the vehicle to assist driving.

[0143] In addition to assisting driving, the camera module on a motor vehicle can also be used to record image data during driving. Especially in the use scenario of travel, users have a greater demand for photography. For example, when passing by scenic spots or encountering memorable scenes, users can control the camera module on the motor vehicle to capture images or videos when they need to take pictures. Therefore, how to effectively and quickly control the camera module on the motor vehicle to obtain multimedia data has gradually become the focus of users.

[0144] For example, Figure 3 Schematic diagram of the control of the vehicle camera module provided by the embodiment of the present application is shown. Figure 3 As shown, a vehicle terminal 31 may be configured in the vehicle, and the vehicle terminal may establish a communication connection with various hardware in the vehicle, such as Figure 3As shown in (a), for example, the vehicle terminal 31 can establish a communication connection with the camera module 32 in the vehicle, and the communication connection can be a wired communication connection or a wireless communication connection. In normal use, the display screen of the vehicle terminal 31 is generally in the navigation interface of the navigation application. Figure 3 As shown in (b) in the figure, at this time, if the user needs to use the camera application, he needs to return to the main interface, such as Figure 3 As shown in (c), the main interface of the vehicle terminal may be configured with a camera application control 33. To control the camera module to acquire an image through the camera application, the following actions are required:

[0145] Action 1: Exit the navigation app.

[0146] Action 2: Click on the Camera app.

[0147] Action 3: Click the virtual shooting button in the camera application's operation interface.

[0148] It can be seen that the existing control technology of motor vehicles often requires more steps to invoke the corresponding shooting controls when it is necessary to control the on-board camera module, thereby greatly reducing the operating efficiency of the camera module. The operating steps are cumbersome, especially during driving, when opportunities are fleeting. In order to obtain images, the existing method of invoking the shooting controls of the camera module can easily lead to missing the shooting opportunity, affecting the user experience.

[0149] Furthermore, the camera module installed in the motor vehicle has a wide shooting angle. In some scenes, the shooting angle of the camera module can reach 360°. Figure 4 FIG. 1 is a schematic diagram showing a motor vehicle capturing vision provided by an embodiment of the present application. Figure 4 As shown, a plurality of camera modules, such as camera modules 1 to 4, can be configured in a motor vehicle, so as to obtain images of the vehicle's exterior environment at at least four angles, such as image 1 corresponding to the front, image 2 corresponding to the left, image 3 corresponding to the right, and image 4 corresponding to the back. Of course, in some scenes, more than four angles can be obtained. Therefore, after the user enters the shooting operation interface by clicking the shooting control, he still needs to select a suitable shooting angle to obtain multimedia data at the specified angle. For example, the display interface includes angle switching controls 41 and 42. The user adjusts the shooting angle by switching left and right, which further increases the complexity of the shooting operation and prolongs the time required for the shooting operation.

[0150] It can be seen that the existing motor vehicle control technology has the problem of complicated operation steps and long operation time when it needs to control the camera module to obtain multimedia data at a specified angle, which makes it easy to miss the shooting opportunity, affecting the user experience and reducing the utilization rate of the camera module on the motor vehicle.

[0151] Embodiment 1:

[0152] Therefore, in order to solve the problems of cumbersome operating steps and easy missing of shooting opportunities when controlling the vehicle-mounted camera module, the present application provides a method for controlling a vehicle-mounted camera. The method for controlling a vehicle-mounted camera is specifically applied to a vehicle-mounted terminal in a motor vehicle. The vehicle-mounted terminal can control the camera module by running the control method of an embodiment of the present application to achieve the purpose of quickly and conveniently acquiring multimedia data outside the vehicle, thereby reducing the operating steps required for shooting through the vehicle-mounted camera module and improving shooting efficiency.

[0153] For example, Figure 5 The following is a schematic diagram showing an implementation scenario of a vehicle-mounted camera control method provided by an embodiment of the present application. Figure 5 As shown, a vehicle terminal 51 is configured in the motor vehicle, and the vehicle terminal can establish a communication connection with a first camera module 52 in the motor vehicle. The above-mentioned first camera module is specifically used to obtain an image of the environment outside the vehicle. A sensing device 53 for obtaining a user's gesture can also be configured in the motor vehicle, and the vehicle terminal 51 can also establish a communication connection with the sensing device 53 to receive the first gesture of the user fed back by the sensing device 53. The vehicle terminal 51 can control the first camera module 53 to obtain multimedia data according to the first gesture initiated by the user, and multimedia data can be obtained without using the touch screen of the vehicle terminal.

[0154] Specifically, Figure 6 The following is a flowchart of a method for controlling a vehicle-mounted camera according to an embodiment of the present application. The specific implementation process is described as follows:

[0155] In S601, a first gesture initiated by a user is acquired.

[0156] In this embodiment, when the gesture image acquisition function is turned on, the vehicle terminal can acquire the first gesture initiated by the user through a preset sensing device. For example, Figure 7 FIG. 1 is a schematic diagram showing the activation of the gesture image acquisition function provided by an embodiment of the present application. Figure 7 As shown in (a) of FIG. 1 , the operation interface of the vehicle terminal may include multiple controls, namely, a navigation control 71, an audio control 72, and a setting control 73. If the vehicle terminal detects that the user clicks the setting control 73, the corresponding setting interface of the vehicle terminal may be entered, such as Figure 7The setting interface includes a plurality of setting items, including a function setting control 74 for acquiring images through gestures. The user can adjust the enabling state of the function for acquiring images through gestures by clicking the function setting control 74.

[0157] In this embodiment, the vehicle terminal can determine the first gesture initiated by the user for shooting through the data fed back by the preset sensing device. The sensing device includes but is not limited to: a second camera module, an infrared sensing module, and a wearable device worn by the user (such as a smart watch, a smart bracelet, etc.). Unlike the first camera module, the second camera module is specifically used to obtain an environmental image in the driving room of a motor vehicle. Corresponding to different sensing devices, the method of obtaining the first gesture can be specifically described as:

[0158] 1. Use the second camera module to obtain the first gesture: The second camera module captures the in-vehicle environment image containing the hand information of the vehicle user, and sends the in-vehicle environment image to the vehicle terminal. The vehicle terminal determines the first gesture initiated by the user by analyzing the in-vehicle environment image.

[0159] 2. Using an infrared sensor module to obtain the first gesture: The infrared sensor module can obtain infrared sensing data of the user's hand and send the infrared sensing data to the vehicle terminal. The vehicle terminal determines the first gesture initiated by the user by analyzing the infrared sensing data.

[0160] 3. Use a wearable device to obtain the first gesture: The wearable device can be equipped with a photoelectric sensor, which determines the type of user's hand movement through a photoplethysmography (PPG) module and the hand posture through an acceleration sensor, and then determines the first gesture through the movement type and hand posture. The vehicle-mounted terminal can receive the first gesture feedback from the wearable device. When the vehicle-mounted terminal and the wearable device have established a communication connection, the wearable device can obtain the user's gesture information, that is, the above-mentioned first gesture, in real time, and feedback the first gesture to the vehicle-mounted terminal in real time, so that the vehicle-mounted terminal can determine whether it is necessary to control the first camera module to obtain multimedia data according to the first gesture.

[0161] It should be noted that the vehicle terminal can determine the user's first gesture by one or more of the above methods, that is, the vehicle terminal can establish a communication connection with multiple sensing devices, and then determine the first gesture initiated by the user by multiple methods.

[0162] In a possible implementation, the vehicle terminal can receive gesture information of the user fed back by multiple sensing devices. The vehicle terminal calculates the confidence of each candidate gesture through multiple gesture information, and then selects the candidate gesture with the highest confidence as the first gesture of the target user. For example, the second camera module determines that the user's gesture is a left gesture, the infrared sensor module determines that the user's gesture is a forward gesture, and the wearable device determines that the gesture is a left gesture. It can be determined that the confidence of the left gesture is 66.7%, and the confidence of the forward gesture is 33.3%. Therefore, the gesture with the highest confidence, that is, the left gesture, can be used as the first gesture initiated by the user.

[0163] In a possible implementation, if there are one or more users in the motor vehicle, each user can initiate a first gesture for controlling the first camera module, and the vehicle-mounted terminal can control the first camera module to collect multimedia data according to the first gesture initiated by each user.

[0164] For example, Figure 8 FIG. 1 is a schematic diagram showing a user initiating a first gesture provided by an embodiment of the present application. Figure 8 As shown in (a), a motor vehicle includes a user who is in the front row of the motor vehicle. The vehicle-mounted terminal of the motor vehicle may be equipped with a sensing device 81, and the first gesture of the user in the front row is obtained through the sensing device 81. As described above, the sensing device 81 may be the second camera module or infrared sensor module, or a wearable device worn on the user's hand, such as a smart watch or a smart bracelet.

[0165] See also Figure 8 As shown in (b), there may be multiple users in the motor vehicle, such as user 1 in the front row and user 2 in the back row. In this case, in addition to the on-board terminal that can be configured with a sensing device 81, the motor vehicle can also be configured with a sensing device 82 at the roof position, so that the first gesture of the user in the back row can be obtained through the sensing device 82.

[0166] In one possible implementation, if there are multiple users in a motor vehicle, control authority can be configured for a designated user, and then the gestures of the user with control authority are collected, while the gestures of the user without control authority are not collected. For example, the vehicle-mounted terminal can store the correspondence between faces and control authority, and the vehicle-mounted terminal can determine whether the user has control authority by identifying the user's face, and then collect the gestures of the corresponding user. For another example, the vehicle-mounted terminal can determine whether the user has control authority based on the user's position in the motor vehicle. For example, if the front-row user has control authority, but the back-row user does not have control authority, the vehicle-mounted terminal can only obtain the gestures of the front-row user, but not the gestures of the back-row user. The way to set control authority for users is not limited here.

[0167] In a possible implementation, the vehicle-mounted terminal can judge the gesture posture of the first gesture, and different gesture postures can be used to control different modules of the motor vehicle. Therefore, after obtaining the first gesture, the vehicle-mounted terminal can judge the gesture posture of the first gesture, for example, whether it is a gesture with a specified direction, and match the gesture posture of the first gesture with a preset trigger posture to determine whether the first gesture is a gesture for controlling the first camera module. If the above-identified gesture posture matches the trigger posture, the operation of S602 is executed; otherwise, if not, it is determined whether the gesture posture matches the gesture template for controlling other modules. If there are other gesture templates that match the gesture posture, the corresponding module is controlled according to the first gesture; if not, the first gesture is not responded to.

[0168] In S602, if the first gesture is a gesture for controlling a first camera module, a first direction of the first gesture is determined; the first camera module is used to acquire an image of an external environment of the vehicle.

[0169] In this embodiment, when the vehicle terminal determines that the first gesture is a gesture for controlling the first camera module, it will determine the first direction indicated by the first gesture. The vehicle terminal determines the analysis algorithm of the first gesture based on the sensing device that feeds back the first gesture, and determines the first direction of the first gesture based on the corresponding analysis algorithm.

[0170] In this embodiment, since the shooting angle of the first camera module is relatively wide, in order to improve the efficiency of acquiring multimedia data, the first gesture can be used not only to control the acquisition timing of the first camera module, but also to control the shooting angle of the first camera module, and the shooting angle is specifically determined according to the first direction of the first gesture. The directions indicated by different gestures can be used to control the first camera module to acquire multimedia data in a specified direction.

[0171] For example, Fig. 9FIG. 1 is a schematic diagram showing a first direction of a first gesture provided by an embodiment of the present application. Fig. 9 As shown, the front direction and the back direction can be determined according to the different directions of the palm of the hand; the front direction includes the three directions of the front direction, the left direction of the front direction and the right direction of the front direction, and the corresponding gestures are gesture 1, gesture 2 and gesture 3 respectively, and the specific direction of the front direction can be determined by the direction of the finger; similarly, the back direction includes the three directions of the front back direction, the left direction of the back direction and the right direction of the back direction, and the corresponding gestures are gesture 4, gesture 5 and gesture 6 respectively. Of course, if the number of first camera modules configured in the vehicle terminal exceeds 6, or the first camera module can shoot more than 6 angles, the number of first directions of the identifiable first gesture can match the number of the above-mentioned first camera modules and the shooting angles, and the number of first directions is not limited here.

[0172] In one possible implementation, the first direction determined by the vehicle-mounted terminal can be a specific angle value, that is, it is not a plurality of discrete approximate directions, such as the front direction, the left side of the front direction, and the right side of the front direction, but can be an angle vector value such as 60°, -60°, etc., wherein a positive vector value represents that the shooting direction is on the right side of the front direction, and a negative vector value represents that the shooting direction is on the left side of the front direction, so that the shooting angle range on the left side is (-180°~0°), and the shooting angle range on the right side is (0°~180°).

[0173] In this embodiment, the method of identifying the first direction varies according to the type of the sensing device for collecting the first gesture, which is described in detail as follows:

[0174] 1. If the sensing device for acquiring the first gesture is an infrared sensor module, the acquired first gesture is infrared sensor data. The vehicle-mounted terminal can construct an infrared sensor image of the user's hand through the corresponding infrared sensor data, and then determine whether the user's first gesture is a gesture for controlling the first camera module through the infrared sensor image analysis algorithm, for example, by comparing it with a preset gesture template. If the two match, the first gesture is identified as a gesture for controlling the first camera module, and the infrared sensor image cannot be further analyzed to determine the first direction of the first gesture.

[0175] 2. If the sensing device for obtaining the first gesture is a wearable device, the wearable device can send the hand motion data and the PPG data fed back by the photoelectric sensor to the vehicle-mounted terminal. The vehicle-mounted terminal can determine the gesture type of the first gesture based on the motion data and the PPG data, and judge that the gesture type is a gesture for controlling the first camera module. If so, determine the first direction of the first gesture based on the above two types of data.

[0176] 3. If the sensing device for acquiring the first gesture is a second camera module, the second camera module can send the in-vehicle environment image captured with the first gesture to the vehicle terminal, and then the vehicle terminal can perform image processing on the in-vehicle environment image through a preset image analysis algorithm to determine the first direction of the first gesture.

[0177] In one possible implementation, the image analysis algorithm used by the vehicle terminal may be a neural network, which may extract a feature vector about the first gesture from the in-vehicle environment image through a convolutional layer, and calculate the confidence between the feature vector of the first gesture and the standard vectors of each recognizable direction through a fully connected layer, and then select the recognizable direction with the highest confidence as the first direction corresponding to the first gesture, thereby achieving the purpose of direction recognition of the first gesture.

[0178] In one possible implementation, Fig.10 FIG. 1 is a flowchart of an implementation of determining a first direction of a first gesture in a vehicle-mounted camera control method provided by an embodiment of the present application. Fig.10 As shown, the sensing device is a second camera module, that is, the vehicle-mounted terminal obtains the first gesture through the in-vehicle environment image. In this case, determining the first direction of the first gesture may specifically include the following steps, which are specifically described as follows:

[0179] In S6021, a plurality of key nodes of the first gesture are marked in the in-vehicle environment image by using a gesture key point detection algorithm.

[0180] In this embodiment, the vehicle terminal may store a gesture key point detection algorithm, through which the hand area contained in the in-vehicle environment image may be determined, and multiple key nodes in the hand area may be marked. For example, Fig.11 A schematic diagram of gesture key points provided by an embodiment of the present application is shown. Fig.11 As shown, the above-mentioned key nodes include: fingertip nodes and palm base nodes. Optionally, the above-mentioned key nodes may also include finger joint nodes. The specific number of key nodes may be determined according to actual conditions, and the number and type of key nodes are not limited here.

[0181] It should be noted that due to the angle of the user's hand, some key nodes that need to be marked in the first gesture in the in-vehicle environment image will be blocked. In this case, the in-vehicle terminal will mark the key nodes in the in-vehicle environment image where the first gesture is visible. Fig.12 A schematic diagram showing key nodes of different first gesture markers provided by an embodiment of the present application is shown. Fig.12As shown in (a) in FIG, since the direction of gesture 1 is the front direction, all key nodes in the first gesture in the in-vehicle environment image are visible. In this case, all identifiable key nodes can be marked. Fig.12 As shown in (b), since the direction of gesture 1 is to the left, the ring finger in the in-car environment image is partially blocked, so the key nodes identified do not include the key nodes corresponding to the thumb.

[0182] In S6022, the first direction is determined according to the relative position relationship between the key nodes.

[0183] In this embodiment, after identifying each key node of the first gesture, the vehicle terminal can determine the posture of the first gesture according to the relative position relationship between the key nodes, so as to determine the first direction corresponding to the posture of the first gesture.

[0184] Further, as another embodiment of the present application, Fig.13 FIG. 1 shows a flowchart of an implementation of determining a first direction based on the relative position relationship of key nodes provided by an embodiment of the present application. Fig.13 As shown, the key nodes obtained by the above identification include the palm base node and the fingertip node, and determining the first direction specifically includes S1301 to S1303, which are specifically described as follows:

[0185] In S1301, the palm direction of the first gesture is determined according to whether the palm is visible in the in-vehicle environment image.

[0186] In this embodiment, the vehicle terminal can use an image recognition algorithm to detect whether the palm of the first gesture is visible in the in-vehicle environment image. If the first gesture is visible in the palm of the hand in the in-vehicle environment image, it means that the palm of the first gesture is facing the front direction, and the relative position relationship between the fingertip node and the palm root node can be used to determine whether it specifically belongs to the front direction, the left side of the front direction, or the right side of the front direction; conversely, if the palm of the first gesture is not visible in the in-vehicle environment image, it means that the palm of the first gesture is facing the back direction, and the relative position relationship between the fingertip node and the palm root node can be used to determine whether it specifically belongs to the front back direction, the left side of the back direction, or the right side of the back direction.

[0187] In S1302, a first number of the fingertip nodes on the left side of the palm root node in the in-vehicle environment image is counted, and a second number of the fingertip nodes on the right side of the palm root node in the in-vehicle environment image is counted.

[0188] In S1303, a first direction is determined according to the palm orientation, the first number, and the second number.

[0189] In this embodiment, the vehicle terminal can determine whether the first gesture is on the right side, on the left side, or in the middle direction according to the relative position relationship between each fingertip node and the palm base node.

[0190] When the first gesture is in the middle direction, the fingertips are evenly distributed on the left and right sides of the palm root node. For example, Fig.14 FIG. 1 shows the relative position relationship between the fingertip node and the palm root node in the case of different directions of the first gesture provided by an embodiment of the present application. Fig.14 As shown in (a), when the first direction of the first gesture is the forward direction, the tip of the thumb and the index finger are on the left side of the palm, the tip of the ring finger and the tip of the little finger are on the right side of the palm, and the tip of the middle finger and the palm are on the same vertical line, that is, the first number is the same as the second number. If the number of fingertips on the left side of the palm root node (that is, the first number) is recorded as a negative value, and the number of fingertips on the right side of the palm root node (that is, the second number) is recorded as a positive value, then the above relative position relationship can be expressed as -2+2+0=0, and it can be determined that the first gesture is in the middle direction.

[0191] When the first gesture is biased to the left, the number of fingertip nodes on the left side will exceed the number of nodes between the fingers on the right side, see Fig.14 As shown in (b), when the first direction of the first gesture is the left front, the tip of the thumb, the tip of the index finger, the tip of the middle finger and the tip of the ring finger are on the left side of the palm, and the tip of the little finger is on the right side of the palm, that is, the first number is greater than the second number. The above relative position relationship can be expressed as -4+1=-3. At this time, it can be determined that the first gesture is in the left direction.

[0192] The vehicle terminal can configure corresponding numerical ranges for different directions, and determine whether the first gesture is in the left, right or middle direction based on the numerical range in which the numerical representation of the above relative position relationship falls. Then, combined with the above-determined palm direction, the first direction of the first gesture can be determined.

[0193] In the embodiment of the present application, by identifying the fingertip node and the palm base node, the first direction of the first gesture is determined according to the relative position relationship between the two different key nodes, thereby improving the accuracy of the first direction recognition. Compared with direction recognition through a neural network, the calculation amount through the position relationship between the key nodes of the hand is small, thereby further improving the recognition efficiency of the first direction, and then improving the efficiency of acquiring multimedia data.

[0194] In S603, the first camera module is controlled to acquire multimedia data in a second direction corresponding to the first direction.

[0195] In this embodiment, after determining the first direction of the user's first gesture, the vehicle-mounted terminal can determine the second direction based on the correspondence between the first direction and the shooting direction, and then obtain multimedia data of the shooting direction (i.e., the second direction) through the first camera module. The multimedia data includes but is not limited to: image data and video data.

[0196] In a possible implementation, the vehicle terminal is equipped with a plurality of first camera modules, and each first camera module is fixedly installed in the motor vehicle, and thus has a corresponding shooting range. The vehicle terminal can establish a corresponding relationship between the shooting range of the first camera module and the first direction. After the vehicle terminal recognizes the first direction of the first gesture, the shooting range to which the first direction belongs can be determined through the above-mentioned corresponding relationship, and then the first camera module corresponding to the shooting range is used as the target camera module to be controlled this time, that is, the shooting range of the target camera module is the above-mentioned second direction.

[0197] In a possible implementation, the first direction is the same as the second direction. For example, if the user's first gesture is toward the left side of the front, the vehicle-mounted terminal controls the first camera module to acquire multimedia data on the left side of the vehicle's forward direction.

[0198] In a possible implementation, the first direction is different from the second direction. For example, if the user's first gesture is toward the left side of the front, the vehicle-mounted terminal controls the first camera module to obtain multimedia data on the right side of the vehicle's forward direction. Specifically, the correspondence between the first direction and the second direction can be determined by constructing a correspondence list, and then the correspondence table can be queried to determine the second direction corresponding to the first direction of each first gesture.

[0199] Further, as another embodiment of the present application, Fig.15 The specific implementation flow chart of S603 in the vehicle-mounted camera control method provided by an embodiment of the present application is shown. Fig.15 As shown, S603 in the embodiment of the present application specifically includes S1501 to S1504, which are specifically described as follows:

[0200] In S1501, if it is detected that the user's hand changes from the first gesture to the second gesture, the shooting direction of the first camera module is adjusted to the second direction.

[0201] In this embodiment, the vehicle terminal can determine the second direction to be shot according to the first direction. At this time, the vehicle terminal does not immediately obtain the multimedia data corresponding to the second direction, but controls the first camera module to adjust its shooting direction to the second direction.

[0202] In a possible implementation, the first camera module is a camera module with an adjustable shooting direction. Fig.16 FIG. 1 shows a schematic diagram of the deployment of a first camera module provided by an embodiment of the present application. Fig.16 As shown in (a), the first camera module 161 is deployed on the roof of the motor vehicle, and the vehicle-mounted terminal can control the rotation of the first camera module 161. In this case, after determining the second direction corresponding to the first direction, the vehicle-mounted terminal can adjust the shooting direction of the first camera module according to the second direction, so that the shooting direction of the first camera module is consistent with the second direction, or the shooting direction of the first camera module includes the second direction, and then obtain multimedia data through the first camera module after adjusting the shooting direction.

[0203] In a possible implementation, the motor vehicle is equipped with a plurality of first camera modules, and the shooting direction of each first camera module may be fixed or variable. Fig.16 As shown in (b), the vehicle terminal is equipped with 6 camera modules, namely, camera modules 1 to 6, wherein camera module 1 is used to obtain images in the front front direction, camera module 2 is used to obtain images in the front left direction, camera module 3 is used to obtain images in the front right direction, camera module 4 is used to obtain images directly behind, camera module 5 is used to obtain images in the rear left direction, and camera module 6 is used to obtain images in the rear right direction. After determining the second direction, the vehicle terminal can start the first camera module of the direction and obtain multimedia data through the first camera module corresponding to the second direction. For example, the second direction is the front left side, and multimedia data can be obtained through camera module 2 at this time.

[0204] In a possible implementation, after the first camera module adjusts the shooting direction to the second direction, it can obtain a corresponding preview image and display the preview image through a corresponding vehicle-mounted display module.

[0205] In a possible implementation, the first gesture is specifically an open-hand gesture, and the second gesture is a fist-clenching gesture. Fig.17 FIG. 1 shows a schematic diagram of a first gesture and a second gesture provided by an embodiment of the present application. Fig.17 As shown, the first gesture is a gesture in which the fingers are in an open position, and the opening can be completely open, such as Fig.17 As shown in (a) in FIG. 1 ; the first gesture may also be slightly open, that is, the finger joints are in a slightly flexed state, such as Fig.17 As shown in (b) in FIG. 1 ; in the second gesture, all fingers are bent and the palm is not visible, that is, in a fist posture, as shown in FIG. Fig.17 As shown in (c) in .

[0206] In a possible implementation, the first gesture may be a fist-clenching gesture, and the second gesture may be an open fist gesture. The specific gestures may be determined based on actual conditions, and the two gestures are not limited here.

[0207] In S1502, a preview picture about the second direction is displayed through the vehicle-mounted display module.

[0208] In this embodiment, a vehicle-mounted display module may be configured in the motor vehicle, and the vehicle-mounted display module may be a display module on a vehicle-mounted terminal or other display modules. Fig.18 FIG. 1 is a schematic diagram of a vehicle-mounted display module provided by an embodiment of the present application. Fig.18 As shown in (a), the vehicle display module is specifically a display module 181 on the vehicle terminal, and the vehicle terminal can display a preview screen corresponding to the second direction through the display module on the vehicle terminal; see Fig.18 As shown in (b), the above-mentioned vehicle-mounted display module can be a display module 182 configured on the front seat. In this case, if the user in the back row needs to view the preview picture, he or she can view the preview picture corresponding to the second direction through the display module configured on the front seat.

[0209] In a possible implementation, the preview screen may be displayed on all vehicle-mounted display modules of the motor vehicle at the same time, or may be displayed on some vehicle-mounted display modules, and may be specifically set according to the user's usage requirements.

[0210] In a possible implementation, the vehicle terminal may determine the vehicle display module associated with the vehicle position according to the vehicle position of the user who initiated the first gesture. Fig.18 As shown in FIG. 1 , if the user who initiates the first gesture is in the front seat of the motor vehicle, the user can Fig.18 The display module 181 of the vehicle terminal in (a) displays the preview screen; if the user who initiates the first gesture is in the back seat of the vehicle, the user can Fig.18 In (b), the display module 182 configured on the corresponding front seat displays the preview screen. The vehicle terminal may record the correspondence between each in-vehicle position and the in-vehicle display module, and the vehicle terminal may determine the in-vehicle display module corresponding to the in-vehicle position of the user through the above correspondence.

[0211] In one possible implementation, the vehicle-mounted terminal can determine the user's position in the vehicle in a preset manner. For example, if a gravity sensor is provided on the seat of the motor vehicle, the position of the user who initiated the first gesture in the vehicle can be determined based on changes in the sensing value of the gravity sensor. For another example, the position of the user who initiated the first gesture in the vehicle can be determined based on the area where the first gesture is located in the in-vehicle environment image. The specific position can be determined based on actual conditions.

[0212] In S1503, if it is detected that the user changes from the second gesture to the first gesture, the data type of the multimedia data is determined according to the duration of the second gesture.

[0213] In S1504, the multimedia data corresponding to the data type is obtained.

[0214] In this embodiment, the user can control the first camera module to obtain multimedia data of a specified data type according to the duration of the second gesture. Therefore, after detecting that the second gesture changes to the first gesture, the vehicle terminal will detect the duration of the user maintaining the second gesture, and determine the data type of the multimedia data based on the duration.

[0215] In a possible implementation, if the duration is greater than a preset duration threshold, it is determined that the user needs to obtain video data, that is, the data type of the multimedia data is a video data type, and then the video data of the second direction is obtained through the first camera module.

[0216] In a possible implementation, if the duration is less than or equal to the duration threshold, it is determined that the user needs to obtain image type data, that is, the data type of the multimedia data is the image data type, and then the image data of the second direction is obtained through the first camera module.

[0217] In an embodiment of the present application, different types of multimedia data can be collected by the duration of gesture changes. There is no need for the user to set the data type of the multimedia data to be obtained. Instead, the data type can be selected by the duration of the gesture, thereby improving the efficiency of multimedia data collection.

[0218] Further, as another embodiment of the present application, after the vehicle terminal acquires the multimedia data of the second direction through the first camera module, the user can display the multimedia data. There are at least two ways to display the multimedia data, namely, a normal display mode and a scene reconstruction display mode, which are as follows:

[0219] Mode 1: Normal display mode

[0220] The vehicle terminal responds to the first play instruction initiated by the user and displays the multimedia data through a preset device. The preset device may be a vehicle display module configured in the motor vehicle, such as displaying through the display module of the vehicle terminal, or displaying through a display module configured on the backrest of the front seat; the preset device may also be an electronic device held by the user, such as a smart phone, a tablet computer, a smart watch, etc. After receiving the first play instruction, the vehicle terminal may send the multimedia data to the electronic device through a communication link between the electronic device of the user, for example, the vehicle terminal may establish a wireless connection with the electronic device through a WIFI module or a Bluetooth module, and then send the multimedia data to the electronic device through a wireless link, so that the user can view the multimedia data on the electronic device.

[0221] For example, Fig.19 FIG. 2 shows a schematic diagram of displaying multimedia data provided by an embodiment of the present application. After acquiring the multimedia data, the vehicle-mounted terminal can display the multimedia data on the vehicle-mounted terminal, such as Fig.19 As shown in (a) in FIG. 1 , at this time, if the user clicks the exit-closed control 191, the multimedia data will be stored in the album application of the vehicle-mounted terminal. If the user needs to view the multimedia data again, he can click as shown in FIG. Fig.19 The photo album application 192 in (b) of FIG. 192. The vehicle terminal responds to the user's photo album application opening instruction and displays the photo album interface, such as Fig.19 As shown in (c) in FIG. 1 , the album interface displays thumbnails of multiple acquired multimedia data. If the user needs to view a certain multimedia data, the user can click on the corresponding thumbnail, such as thumbnail 193. The vehicle terminal will recognize that the user initiated the first play instruction, and display the multimedia data corresponding to the clicked thumbnail 193 on the vehicle terminal, such as Fig.19 As shown in (d) in .

[0222] In the embodiment of the present application, after acquiring the multimedia data, the vehicle-mounted terminal can display the multimedia data through a preset device, which is convenient for the user to view the acquired images and improves the user experience.

[0223] Method 2: Scene reconstruction display method

[0224] In order to achieve scene reconstruction at the time of shooting multimedia data, when the vehicle-mounted terminal controls the first camera module to obtain multimedia data, the vehicle-mounted terminal will also record the first environmental information in the vehicle when the multimedia data is obtained. Exemplarily, the above-mentioned first environmental information includes at least one of the following: lighting information in the vehicle, air conditioning temperature, seat position, and audio information played in the vehicle. The vehicle-mounted terminal can determine the type of first environmental information to be collected based on user settings and / or vehicle configuration.

[0225] In this embodiment, the vehicle terminal can establish an association relationship between the multimedia data and the first environmental information. When the user displays the multimedia data through a normal display method (i.e., through a first playback instruction), the vehicle terminal can read the multimedia data and display it, i.e., there is no need to obtain the above-mentioned first environmental information through an association relationship.

[0226] In this embodiment, in response to the second playback instruction of multimedia data initiated by the user, the vehicle terminal obtains the first environmental information corresponding to the multimedia data through the above-mentioned association relationship, and controls the operating parameters of the corresponding environmental module according to the information type contained in the first environmental information.

[0227] For example, the first environmental information includes lighting information, and the environmental module includes a lighting module of a motor vehicle. The lighting information can be used to light up a designated lighting module and control the brightness of the lit lighting module.

[0228] For another example, the first environmental information includes the air-conditioning temperature, and the environmental module includes the air-conditioning equipment of the motor vehicle, and the temperature value of the air-conditioning equipment can be set according to the air-conditioning temperature.

[0229] For another example, the first environmental information includes audio information, and the environmental module includes a vehicle-mounted speaker, and the specified audio data is played through the vehicle-mounted speaker.

[0230] The vehicle-mounted terminal can control the operation of the environmental module corresponding to the environmental dimension according to the environmental dimension included in the first environmental information, so as to reconstruct the environmental information when acquiring multimedia data, that is, to realize "scene recall".

[0231] In this embodiment, the vehicle terminal will detect whether the second environment information in the motor vehicle matches the first environment information after controlling the operating parameters of the environment module based on the first environment information, such as whether the temperature in the vehicle has reached the preset air-conditioning temperature, whether the audio has been downloaded and is being played, etc. If the above two environment information are detected to match, the multimedia data can be displayed through the preset device. The preset device includes but is not limited to: the vehicle display module and / or the electronic device used by the user.

[0232] For example, Fig. 20 FIG. 2 shows a schematic diagram of displaying multimedia data provided by another embodiment of the present application. Fig. 20 As shown in (a) in FIG. 1 , when the vehicle terminal is in the album interface, the display menu of the multimedia data can be called up by long pressing the thumbnail of the multimedia data, such as Fig. 20As shown in (b) of FIG. 1 , the display menu includes a normal display control 201 and a scene recall control 202. If it is detected that the user clicks the above-mentioned control 202, the user is identified to initiate the above-mentioned second play instruction, and the environment module in the car is controlled to simulate the scene during shooting, and the corresponding reconstruction progress bar is displayed, as shown in FIG. Fig. 20 As shown in (c) in FIG. 1 , after the scene reconstruction is completed, the above multimedia data is displayed, such as Fig. 20 As shown in (d) in .

[0233] In an embodiment of the present application, the environment module inside the car is adjusted through scene reconstruction to re-simulate the environment inside the car when the multimedia data was shot, so that the user can return to the scene when the multimedia data was shot when the multimedia data was displayed, thereby improving the user's sense of immersion when playing the multimedia data.

[0234] It can be seen from the above that the control method of a vehicle-mounted camera provided in the embodiment of the present application can achieve the purpose of controlling the camera module in the motor vehicle through gestures by initiating a first gesture for controlling the first camera module and determining the first direction corresponding to the first gesture, and then determining the second direction when controlling the first camera module to obtain multimedia data, and controlling the first camera module to obtain multimedia data corresponding to the second direction. Compared with the existing motor vehicle control method, in the embodiment of the present application, the user can control the first camera module in the motor vehicle to obtain multimedia data without using a touch screen, which reduces the situation where the user needs to frequently switch the operation interface in the touch screen and reduces unnecessary operation steps; and the embodiment of the present application can obtain multimedia data in a specified direction by determining the first direction of the first gesture, thereby achieving the purpose of directionally obtaining multimedia data at a specified angle and improving the convenience and operation efficiency of the first camera module acquisition.

[0235] Embodiment 2:

[0236] Corresponding to the vehicle-mounted camera control method described in the second embodiment above, Fig.21 A structural block diagram of a vehicle-mounted camera control device provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0237] Reference Fig.21 , the vehicle-mounted camera control device comprises:

[0238] A gesture acquisition unit 211, configured to acquire a first gesture initiated by a user;

[0239] a direction recognition unit 212, configured to determine a first direction of the first gesture if the first gesture is a gesture for controlling a first camera module; the first camera module is configured to acquire an image of an environment outside the vehicle;

[0240] The multimedia data acquisition unit 213 is used to control the first camera module to acquire multimedia data in a second direction corresponding to the first direction.

[0241] Optionally, the control device further comprises:

[0242] a gesture determining unit, configured to determine a hand gesture corresponding to the first gesture;

[0243] The direction recognition unit 212 includes: a first direction recognition unit, configured to determine the first direction of the first gesture if the hand gesture is a preset trigger gesture.

[0244] Optionally, the multimedia data acquisition unit includes:

[0245] a shooting direction adjusting unit, configured to adjust the shooting direction of the first camera module to the second direction if it is detected that the user's hand changes from the first gesture to the second gesture;

[0246] a duration determining unit, configured to determine the data type of the multimedia data according to the duration of the second gesture if it is detected that the user changes from the second gesture to the first gesture;

[0247] The designated type data acquisition unit is used to acquire the multimedia data corresponding to the data type.

[0248] Optionally, the duration determination unit includes:

[0249] a video type data determining unit, configured to determine that the data type is a video data type if the duration is greater than a preset duration threshold;

[0250] The image type data determining unit is configured to determine that the data type is an image data type if the duration is less than or equal to the duration threshold.

[0251] Optionally, the first gesture is an open-arm gesture; and the second gesture is a fist-clenching gesture.

[0252] Optionally, the control device further comprises:

[0253] The preview picture display unit is used to display a preview picture about the second direction through the vehicle-mounted display module.

[0254] Optionally, the control device further comprises:

[0255] The designated position preview unit is used to determine the vehicle display module associated with the vehicle position according to the vehicle position of the user.

[0256] Optionally, the gesture acquiring unit 211 includes:

[0257] An in-vehicle environment image acquisition unit, configured to acquire an in-vehicle environment image including the first gesture through a second camera module;

[0258] The direction identification unit 212 includes:

[0259] An image recognition unit is used to perform image recognition on the in-vehicle environment image to determine the first direction of the first gesture.

[0260] Optionally, the image recognition unit includes:

[0261] A key node determination unit, configured to mark a plurality of key nodes of the first gesture in the in-vehicle environment image by using a gesture key point detection algorithm;

[0262] A node position determination unit is used to determine the first direction according to the relative position relationship between each of the key nodes.

[0263] Optionally, the key nodes include: palm base nodes and fingertip nodes;

[0264] The node position determination unit includes:

[0265] a number counting unit, configured to count a first number of the fingertip nodes on the left side of the palm root node in the in-vehicle environment image, and to count a second number of the fingertip nodes on the right side of the palm root node in the in-vehicle environment image;

[0266] A node quantity comparison unit is used to determine the first direction according to the first quantity and the second quantity.

[0267] Optionally, the gesture acquiring unit 211 includes:

[0268] A sensor feedback unit is used to receive the first gesture fed back by a wearable device worn by the user; the wearable device is equipped with a photoelectric sensor; the wearable device determines the first gesture initiated by the user through the photoelectric sensor.

[0269] Optionally, the control device further comprises:

[0270] The play response unit is used to respond to the first play instruction of the multimedia data and display the multimedia data through a preset device; the preset device includes: a vehicle display module and / or a vehicle terminal associated with the user.

[0271] Optionally, the multimedia data acquisition unit 213 includes:

[0272] An environmental information acquisition unit, used for recording first environmental information in the vehicle when acquiring the multimedia data;

[0273] The control device also includes:

[0274] an operating parameter setting unit, configured to set an operating parameter of an environment module in the vehicle based on the first environment information in response to a second playback instruction of the multimedia data;

[0275] The multimedia data display unit is used to display the multimedia data through a preset device if it is detected that the second environment information in the vehicle matches the first environment information after the environment module is run.

[0276] Optionally, the multimedia data acquisition unit 213 includes:

[0277] The designated camera module acquisition unit is configured to acquire the multimedia data through a first camera module corresponding to the second direction.

[0278] Optionally, the multimedia data acquisition unit 213 includes:

[0279] a shooting direction adjusting unit, configured to adjust the shooting direction of the first camera module based on the second direction;

[0280] The designated direction acquisition unit is used to acquire the multimedia data by adjusting the shooting direction of the first camera module.

[0281] Optionally, the first direction is the same as the second direction.

[0282] Fig. 22 This is a schematic diagram of the structure of a vehicle-mounted terminal provided in one embodiment of the present application. Fig. 22 As shown, the vehicle terminal 22 of this embodiment includes: at least one processor 220 ( Fig. 22 Only one processor is shown in the figure), a memory 221, and a computer program 222 stored in the memory 221 and executable on the at least one processor 220, wherein the processor 220 implements the steps in any of the above-mentioned vehicle-mounted camera control method embodiments when executing the computer program 222.

[0283] The vehicle terminal 22 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The vehicle terminal may include, but is not limited to, a processor 220 and a memory 221. Those skilled in the art will appreciate that Fig. 22 It is only an example of the vehicle-mounted terminal 22 and does not constitute a limitation on the vehicle-mounted terminal 22. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components, for example, it may also include input and output devices, network access devices, etc.

[0284] The processor 220 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0285] In some embodiments, the memory 221 may be an internal storage unit of the vehicle terminal 22, such as a hard disk or memory of the vehicle terminal 22. In other embodiments, the memory 221 may also be an external storage device of the vehicle terminal 22, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the vehicle terminal 22. Further, the memory 221 may also include both an internal storage unit of the vehicle terminal 22 and an external storage device. The memory 221 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 221 may also be used to temporarily store data that has been output or is to be output.

[0286] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0287] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0288] An embodiment of the present application also provides a vehicle-mounted terminal, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps in any of the above-mentioned method embodiments when executing the computer program.

[0289] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0290] An embodiment of the present application provides a computer program product. When the computer program product runs on a vehicle-mounted terminal, the vehicle-mounted terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0291] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera device / vehicle terminal, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, RandomAccess Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0292] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0293] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0294] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0295] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0296] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for controlling a vehicle-mounted camera, characterized in that: include: Get the first gesture initiated by the user; If the first gesture is a gesture for controlling a first camera module, determining a first direction of the first gesture; The first camera module is used to obtain an image of the environment outside the vehicle; The first camera module is controlled to acquire multimedia data in a second direction corresponding to the first direction.

2. The control method according to claim 1, characterized in that: After obtaining the first gesture initiated by the user, the method further includes: determining a hand posture corresponding to the first gesture; If the first gesture is a gesture for controlling the first camera module, determining a first direction of the first gesture includes: If the hand gesture is a preset trigger gesture, the first direction of the first gesture is determined.

3. The control method according to claim 1, characterized in that: The controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: If it is detected that the user's hand changes from the first gesture to the second gesture, adjusting the shooting direction of the first camera module to the second direction; If it is detected that the user changes from the second gesture to the first gesture, determining the data type of the multimedia data according to the duration of the second gesture; The multimedia data corresponding to the data type is acquired.

4. The control method according to claim 3, characterized in that: If it is detected that the user changes from the second gesture to the first gesture, determining the data type of the multimedia data according to the duration of the second gesture includes: If the duration is greater than a preset duration threshold, determining that the data type is a video data type; If the duration is less than or equal to the duration threshold, it is determined that the data type is an image data type.

5. The control method according to claim 3, characterized in that: The first gesture is an open-arm gesture; the second gesture is a clenched-fist gesture.

6. The control method according to claim 2, characterized in that: After determining the first direction of the first gesture if the first gesture is a gesture for controlling the first camera module, the method further includes: A preview picture about the second direction is displayed through the vehicle-mounted display module.

7. The control method according to claim 6, characterized in that: Before displaying the preview picture about the second direction through the vehicle-mounted display module, the method further includes: According to the in-vehicle position of the user, the in-vehicle display module associated with the in-vehicle position is determined.

8. The control method according to any one of claims 1 to 7, characterized in that: The obtaining of the first gesture initiated by the user includes: Acquiring, by a second camera module, an image of the vehicle interior environment including the first gesture; If the first gesture is a gesture for controlling the first camera module, determining a first direction of the first gesture includes: Perform image recognition on the in-vehicle environment image to determine the first direction of the first gesture.

9. The control method according to claim 8, characterized in that: The performing image recognition on the in-vehicle environment image to determine the first direction of the first gesture includes: Marking a plurality of key nodes of the first gesture in the in-vehicle environment image by using a gesture key point detection algorithm; The first direction is determined according to the relative position relationship between the key nodes.

10. The control method according to claim 9, characterized in that: The key nodes include: palm base nodes and fingertip nodes; The determining the first direction according to the relative position relationship between the key nodes includes: Counting a first number of the fingertip nodes on the left side of the palm root node in the in-vehicle environment image, and counting a second number of the fingertip nodes on the right side of the palm root node in the in-vehicle environment image; The first direction is determined according to the first number and the second number.

11. The control method according to any one of claims 1 to 7, characterized in that: The obtaining of the first gesture initiated by the user includes: The first gesture fed back by a wearable device worn by the user is received; the wearable device is equipped with a photoelectric sensor; the wearable device determines the first gesture initiated by the user through the photoelectric sensor.

12. The control method according to any one of claims 1 to 7, characterized in that: After controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction, the method further includes: In response to a first play instruction of the multimedia data, the multimedia data is displayed through a preset device; the preset device includes: a vehicle display module and / or a vehicle terminal associated with the user.

13. The control method according to any one of claims 1 to 7, characterized in that: The controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: Recording first environment information in the vehicle when acquiring the multimedia data; After controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction, the method further includes: In response to a second playback instruction of the multimedia data, setting an operating parameter of an environment module in the vehicle based on the first environment information; If it is detected that the second environment information in the vehicle matches the first environment information after the environment module is run, the multimedia data is displayed through a preset device.

14. The control method according to any one of claims 1 to 7, characterized in that: The controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: The multimedia data is acquired through a first camera module corresponding to the second direction.

15. The control method according to any one of claims 1 to 7, characterized in that: The controlling the first camera module to acquire multimedia data in a second direction corresponding to the first direction includes: adjusting a shooting direction of the first camera module based on the second direction; The multimedia data is acquired by the first camera module after adjusting the shooting direction.

16. The control method according to any one of claims 1 to 15, characterized in that: The first direction is the same as the second direction.

17. A vehicle-mounted terminal, characterized in that: The vehicle-mounted terminal includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor executes the steps of the method according to any one of claims 1 to 16 when executing the computer program.

18. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.

Images