Data processing method and device for vehicle cabin, electronic equipment and chip

Abstract

The present disclosure provides a data processing method and device for a vehicle cabin, an electronic device, a chip and a storage medium. The method comprises: determining at least one type of data stream that needs to be acquired, the type of data stream comprising at least one of preview data stream, algorithm data stream, recording data stream, live data stream and photographing data stream; and acquiring the data stream from an image acquisition device of the vehicle cabin according to the at least one type of data stream that needs to be acquired. The method can realize the acquisition of multiple types of data streams at the same time, reduce the hardware cost, and improve the user experience by improving the data stream acquisition efficiency.

Description

Technical Field

[0001] This disclosure relates to the field of data processing, and more particularly to a data processing method, apparatus, electronic device, chip, and storage medium for an in-vehicle cockpit. Background Technology

[0002] Occupant Monitoring System (OMS) is a system used to monitor passenger status and is of vital importance to driving safety. For example, OMS can use sensors and cameras to identify passenger behavior, location, etc., making it easier to provide personalized services to passengers and improve the user's travel experience. Summary of the Invention

[0003] This disclosure provides a data processing method, apparatus, electronic device, chip, and storage medium for an in-vehicle cockpit to solve problems in the related art.

[0004] The first aspect of this disclosure provides a data processing method for an in-vehicle cockpit, the method comprising: determining at least one type of data stream to be acquired, the data stream type including at least one of preview data stream, algorithm data stream, recording data stream, live streaming data stream, and photo capture data stream; and acquiring the data stream from an image acquisition device in the in-vehicle cockpit according to the at least one type of data stream to be acquired.

[0005] In some embodiments of this disclosure, determining the type of at least one data stream to be acquired includes any of the following: receiving an indication message sent by an upper-layer application module and determining the type of at least one data stream to be acquired based on the indication message; acquiring configuration information and determining the type of at least one data stream to be acquired based on the configuration information.

[0006] In some embodiments of this disclosure, acquiring a data stream from an image acquisition device in a vehicle cockpit includes: determining parameter information of the data stream to be acquired based on an instruction message or configuration information, wherein the parameter information includes at least one of frame rate and resolution; instructing the image acquisition device in the vehicle cockpit to acquire the data stream according to the parameter information; and acquiring the data stream acquired by the image acquisition device in the vehicle cockpit according to the parameter information.

[0007] In some embodiments of this disclosure, the method further includes at least one of the following: receiving a data stream call instruction, the data stream call instruction including at least one of a preview data stream call instruction, an algorithm data stream call instruction, a recording data stream call instruction, a live streaming data stream call instruction, and a photo capture data stream call instruction; preprocessing the data stream according to the data stream call instruction; and writing the preprocessed data stream into a call buffer.

[0008] In some embodiments of this disclosure, preprocessing includes at least one of the following: format conversion; data stream encryption; and adding tags.

[0009] In some embodiments of this disclosure, the method further includes: receiving a data stream reacquisition request; determining the type and / or parameter information of the data stream that needs to be reacquisitioned based on the data stream reacquisition request; and reacquiring the data stream from the image acquisition device of the vehicle cockpit as needed based on the type and / or parameter information of the data stream to be reacquisitioned.

[0010] A second aspect of this disclosure provides a data processing apparatus for an in-vehicle cockpit, the apparatus comprising: a first processing unit configured to determine at least one type of data stream to be acquired, the data stream type including at least one of preview data stream, algorithm data stream, recording data stream, live streaming data stream, and photo capture data stream; and a second processing unit configured to acquire data streams from an image acquisition device in the in-vehicle cockpit according to the at least one type of data stream to be acquired.

[0011] A third aspect of this disclosure provides an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the methods described in the first aspect of this disclosure.

[0012] A fourth aspect of this disclosure provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to perform the methods described in the first aspect of this disclosure.

[0013] A fifth aspect of this disclosure provides a chip characterized by including at least one processor and a communication interface; the communication interface is used to receive signals input to the chip or signals output from the chip, and the processor communicates with the communication interface and implements the method described in the first aspect of this disclosure through logic circuits or executing code instructions.

[0014] A sixth aspect of this disclosure provides a computer program product including a computing program stored on a computer-readable storage medium. The computer program includes program instructions that, when executed by a computer, cause the computer to perform the method in any implementation of the first aspect described above.

[0015] In summary, the data processing method for the vehicle cockpit proposed in this disclosure can acquire multiple different types of data streams simultaneously as needed. It enables the OMS system to output multiple data streams at the same time for application processing, providing services to users more quickly through the acquired data streams, improving user experience. The data streams output by the OMS system can be flexibly controlled according to requirements, avoiding the need for multiple OMS systems to acquire data streams and reducing hardware costs.

[0016] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0018] Figure 1 A schematic flowchart illustrating a data processing method for an in-vehicle cockpit provided in an embodiment of this disclosure;

[0019] Figure 2 A schematic flowchart illustrating a data processing method for an in-vehicle cockpit provided in an embodiment of this disclosure;

[0020] Figure 3 A schematic flowchart illustrating a data processing method for an in-vehicle cockpit provided in an embodiment of this disclosure;

[0021] Figure 4 An architecture diagram of an OMS system provided in this disclosure embodiment;

[0022] Figure 5 This is a schematic diagram of the structure of a data processing device for an in-vehicle cockpit provided in an embodiment of the present disclosure;

[0023] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure;

[0024] Figure 7 This is a schematic diagram of the chip structure provided in an embodiment of this disclosure. Detailed Implementation

[0025] Embodiments of this disclosure are described in detail below. Examples of these embodiments are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this disclosure, and should not be construed as limiting this disclosure.

[0026] In autonomous vehicles, the Onboard Monitoring System (OMS) collects and analyzes in-vehicle image and sensor data to monitor passenger status. This includes detecting whether passengers are wearing seatbelts, their emotional state, and whether they are engaging in dangerous behavior. Therefore, the OMS system is crucial for ensuring passenger safety. However, current OMS systems can only output one type of data stream at a time. This means the OMS output can only be processed by one application. For example, when transmitting photo data, the OMS cannot simultaneously transmit recording or live streaming data. This means that when passenger or autonomous driving issues arise, the system cannot promptly obtain real-time information about the vehicle's status, affecting the timeliness of problem-solving and impacting the user experience. Furthermore, solutions that attempt to transmit multiple types of data streams simultaneously require deploying multiple OMS systems, leading to high costs.

[0027] Therefore, in order to solve the above problems, this disclosure proposes a data processing method for use in the field of vehicle cockpits. This method can acquire multiple different types of data streams at the same time, and can enable the OMS system to output multiple data streams simultaneously for application processing.

[0028] The specific details of this method are as follows.

[0029] Figure 1 This is a flowchart illustrating a data processing method for an in-vehicle cockpit provided in an embodiment of this disclosure. Figure 1 As shown, the method may include the following steps.

[0030] Step 101: Determine at least one type of data stream that needs to be acquired.

[0031] In some embodiments, the data stream type includes at least one of preview data stream, algorithm data stream, recording data stream, live streaming data stream, and photo data stream. The preview data stream can be the data stream acquired before taking a photo, recording, or live streaming data stream; for example, a mobile phone can display a real-time preview before taking a photo. The algorithm data stream can be a YUV data stream, i.e., a data stream related to chroma and brightness, which can be used to analyze the state inside the vehicle. For example, the algorithm data stream can be used to determine whether passengers are wearing seat belts, whether there is any dangerous behavior, etc.

[0032] In some embodiments, multiple types of data streams can be acquired simultaneously. The popularity of the data streams to be acquired can be determined as needed, and the relevant types of data streams can be acquired in a targeted manner. Optionally, in an autonomous vehicle, a 3-channel OMS system can be deployed. The 3-channel OMS system can output at least one type of data stream mentioned above simultaneously, or can enable the output of any one of the above types of data streams as needed. Specifically, determining at least one type of data stream to be acquired includes any of the following: receiving an instruction message sent by an upper-layer application module and determining at least one type of data stream to be acquired based on the instruction message; acquiring configuration information and determining at least one type of data stream to be acquired based on the configuration information.

[0033] Optionally, a session connection can be established with the upper-layer application module. The upper-layer application module can send indication messages through the established session. The indication messages can indicate information related to the data stream to be acquired, such as the type of data stream, resolution, frame rate, and other parameter information. For example, the upper-layer application module can instruct the OMS to output both algorithm data stream and live data stream simultaneously through the indication message, which can facilitate the upper-layer application module in determining the real-time status inside the vehicle.

[0034] Optionally, the type of data stream to be acquired can be configured in advance. For example, the OMS can be configured to continuously output an algorithm stream, or the recording can be configured to start when a passenger boards the vehicle, i.e., the recording data stream is output as soon as the passenger boards the vehicle, etc.

[0035] Optionally, OMS can be configured to periodically acquire recording data streams to achieve segmented recording. For example, OMS can be configured to acquire recording data streams every 30 seconds, which means that OMS can be controlled to periodically enable and disable the acquisition of recording streams.

[0036] In other words, the output of any type of data stream can be turned on or off in real time via instruction messages, and the type of output data stream can also be controlled through configuration information. This improves the flexibility of the output data stream type configuration, allowing the data stream output by OMS to adapt to different scenarios, making it easier to provide personalized services to passengers and improve the user experience.

[0037] Step 102: Acquire a data stream from the image acquisition device in the vehicle cabin, based on at least one type of data stream that needs to be acquired.

[0038] In some embodiments, the image acquisition device may optionally be a camera, such as an onboard camera of an autonomous vehicle, which can be used to acquire information related to in-vehicle images.

[0039] In some embodiments, after determining the type of data stream to be acquired, a list of data streams to be acquired (surfaceList) can be constructed. This list may contain the types of data streams to be acquired, such as preview data stream (PreviewSurface), algorithm data stream (YUVSurface), recording data stream (RecordSurface), live data stream (LiveSurface), and photo data stream (CaptureSurface). Optionally, the corresponding data stream to be acquired can be obtained according to the data stream list.

[0040] Specifically, acquiring data streams from the image acquisition device in the vehicle cockpit includes: determining the parameter information of the data stream to be acquired based on the message or configuration information, wherein the parameter information includes at least one of frame rate and resolution; instructing the image acquisition device in the vehicle cockpit to acquire data streams according to the parameter information; and acquiring the data streams acquired by the image acquisition device in the vehicle cockpit according to the parameter information.

[0041] In other words, the image acquisition device can be instructed on parameters such as resolution and frame rate of the data stream to be acquired. This allows the image acquisition device to acquire data accordingly based on the indicated parameters. In other words, the parameters of the acquired data stream can be adjusted, which facilitates performance optimization, and so on.

[0042] In summary, the above embodiments of this disclosure can independently control the output of each type of data stream according to needs, enabling the simultaneous output of multiple types of data streams. This allows the data streams output by the OMS to adapt to different scenarios, facilitating better personalized services for passengers and improving user experience.

[0043] Figure 2 This is a flowchart illustrating a data processing method for an in-vehicle cockpit provided in an embodiment of this disclosure. Figure 2 As shown, based on Figure 1 The illustrated embodiment shows that the method includes the following steps.

[0044] Step 201: Receive data stream call instruction.

[0045] In some embodiments, the data stream invocation indication includes at least one of the following: preview data stream invocation indication, algorithm data stream invocation indication, recording data stream invocation indication, live streaming data stream invocation indication, and photo capture data stream invocation indication.

[0046] Optionally, upper-layer applications can call data streams. Different applications can call different types of data streams for analysis. When a data stream call instruction is received, the data stream can be preprocessed according to the instruction, and the preprocessed data can be written into the corresponding call buffer.

[0047] In some embodiments, multiple application data stream invocation instructions can be received, meaning that multiple types of data streams acquired simultaneously can be invoked by different applications. In autonomous vehicles, the acquired multiple data streams can be analyzed to determine the in-vehicle status, enabling faster service to passengers and improving their riding experience.

[0048] Step 202: Preprocess the data stream according to the data stream call instruction.

[0049] In some embodiments, preprocessing can be used to convert the data stream into a format suitable for application calls and processing.

[0050] In some embodiments, preprocessing includes at least one of the following: format conversion; data stream encryption; and adding tags.

[0051] Optionally, format conversion can be performed, for example, the format of the algorithm stream can be converted from 420_888 to NV21 format; encryption can be performed, for example, the live algorithm stream can be encrypted to ensure the security of data stream transmission; and marking can be added, for example, watermarks, timestamps and other marking information can be added to the recorded data stream.

[0052] Step 203: Write the preprocessed data stream into the call buffer.

[0053] In some embodiments, the preprocessed data stream can be written to a buffer for easy use by the application. Optionally, when the data stream is a live data stream, the data stream can be written to the call buffer frame by frame according to the video frame rate during writing.

[0054] In summary, the above embodiments of this application can preprocess data streams, making them easier for applications to call and analyze, thereby improving data processing efficiency, providing users with personalized services more quickly, and enhancing user experience.

[0055] Figure 3 This is a flowchart illustrating a data processing method for an in-vehicle cockpit provided in an embodiment of this disclosure. Figure 3 As shown, based on Figure 1 The illustrated embodiment shows that the method includes the following steps.

[0056] Step 301: Receive a request to reacquire the data stream.

[0057] In some embodiments, when the OMS system experiences an abnormal disconnection, data stream acquisition may fail. In such cases, it is necessary to restore data stream acquisition according to the recovery mechanism.

[0058] Specifically, when data stream acquisition fails, the upper-layer application or other devices can send a data stream reacquisition request. Upon receiving this request, the OMS system can re-acquire the data stream from the image acquisition device, thus reconnecting. Alternatively, when data stream acquisition fails, the OMS system can restart according to its configuration and re-determine the data stream to be acquired, i.e., based on... Figure 1 The embodiment shown re-acquires the data stream, which will not be described in detail here.

[0059] Step 302: Determine the type and / or parameter information of the data stream that needs to be reacquired based on the data stream reacquisition request.

[0060] In some embodiments, upon receiving a reacquisition request, it is necessary to re-determine the type of the data stream to be acquired, as well as related parameter information, such as resolution and frame rate. Therefore, the type and / or parameter information of the data stream can be reacquired based on the indication message or configuration information. Optionally, it can be based on... Figure 1 The embodiment shown redetermines the type and parameters of the data stream to be acquired, which will not be elaborated here.

[0061] Step 303: Reacquire the data stream from the image acquisition device in the vehicle cabin as needed, based on the type and / or parameter information of the data stream to be reacquired.

[0062] In some embodiments, after determining the type and / or parameter information of the data stream that needs to be reacquired, the corresponding data stream can be reacquired from the image acquisition device in the vehicle cockpit, so as to automatically recover when the OMS output data stream status is abnormal and avoid affecting the acquisition of the data stream.

[0063] In summary, the above embodiments of this disclosure can determine the output status of the data stream when the OMS abnormally disconnects, and reacquire the data stream according to the type and parameter information of the data stream needed when the data stream acquisition fails, thereby achieving automatic recovery from the abnormality, avoiding impact on providing services to passengers, and improving the user experience.

[0064] The technical solutions of this disclosure will be further described in detail below with reference to specific application embodiments.

[0065] The following is a design method for an intelligent cockpit vehicle-mounted system OMS provided by an embodiment of this disclosure. This system can simultaneously output multiple types of data streams, that is, it can simultaneously output multiple data streams for application invocation. The specific process of implementing simultaneous output of multiple data streams is as follows:

[0066] OMS driving process

[0067] The driver module (MAX9296) and driver adapter chip (SM8475) complete the driver integration for Camera Serial Interface (CSI) to Gigabit Multimedia Serial Link (GMSL).

[0068] After power-on, the chip (SNM960) automatically completes the driver loading for OMS solver 1 (9296_1). CSI and I2C communication between the chip and OMS solver 1 is normal, and OMS solver 1 initialization is completed. Similarly, after power-on, the chip (SNM960) automatically completes the driver loading for OMS solver 2 (9296_2). CSI and I2C communication between the chip and OMS solver 2 is normal, and OMS solver 2 initialization is completed. Finally, after power-on, the chip (SNM960) automatically completes the driver loading for OMS solver 3 (9296_3). CSI and I2C communication between the chip and OMS solver 3 is normal, and OMS solver 3 initialization is completed.

[0069] The above driving process requires the clock frequency and general-purpose input / output port configuration to be correct, and the power-on timing must meet the specifications.

[0070] The camera parameter adaptation process, such as the adaptation work of the Mobile Industry Processor Interface (MIPI) Digital Physical Layer (DPHY).

[0071] Refer to the following register configuration to complete the OMS camera initialization, enabling the driver module (9296) and camera decoder (96717F) to properly encrypt (lock). The camera data is transmitted to the Infotainment Head Unit (IHU) via GMSL, and the image can be opened through the Android camera application.

[0072] Use case configuration

[0073] The use case configuration for supporting 3 cameras and multiple applications is adjustable. Support for 3 OMS can include: each OMS simultaneously outputting YUV stream (algorithm stream), recording stream, live stream, photo stream, and preview stream, or any of the above streams can be flexibly enabled or disabled according to business requirements.

[0074] Optionally, you can set the corresponding image resolution and frame rate for each data stream. For example, you can set the resolution of the YUV stream to 720P and the frame rate to no less than 10; the image resolution of the recording stream to 720P and the frame rate to no less than 25; the image resolution of the live stream to 720P and the frame rate to no less than 15, and so on.

[0075] Optionally, each OMS can be turned on or off independently using the switch control function in the camera function, and the three OMSs will not affect each other; or any of the above streams can be turned on and off independently using the switch control function in the camera function.

[0076] Optionally, when an OMS experiences an abnormal disconnection, a monitoring mechanism can be applied to determine the output status of the three OMS streams, and a recovery mechanism can be used to address the fault.

[0077] like Figure 4 The diagram shown is an architecture diagram of the aforementioned OMS system, which is explained below:

[0078] 1. Obtain a Camera Service Implementation (CameraServiceImpl) instance, open the camera with the specified identifier (ID) using the openCamera command, and return a Camera Device (DCameraDevice) instance.

[0079] 2. The camera device implementation (DCameraDeviceImpl) is a DCameraDevice implementation class that implements functions such as parameter setting, preview on / off, recording on / off, live stream on / off, sub-stream, and photo taking.

[0080] 3. When the above functions are enabled, such as recording, live streaming, and YUV functions, it is desirable for the camera to capture images without interruption. Therefore, a stream list (Surface List) needs to be built all at once, as shown in the "Pre-built surfaceList" above. It can include: Preview stream (PreviewSurface), YUV algorithm stream (YUVSurface), Record stream (RecordSurface), Live stream (LiveSurface), and Capture stream (CaptureSurface, which can be used alone when there is no preview).

[0081] In summary, according to the above examples disclosed herein, the OMS system can output multiple types of data streams simultaneously, and can independently enable and disable each type of data stream. It can flexibly control the acquisition of at least one type of data stream according to needs, enabling faster service to users through the acquired data streams and improving user experience.

[0082] Figure 5This is a structural schematic diagram of a data processing device 500 for a vehicle-mounted cockpit provided in an embodiment of this disclosure. Figure 5 As shown, the device includes: a first processing unit 510, configured to determine at least one type of data stream to be acquired, the data stream type including at least one of preview data stream, algorithm data stream, recording data stream, live streaming data stream, and photo capture data stream; and a second processing unit 520, configured to acquire data streams from the image acquisition device in the vehicle cabin according to the at least one type of data stream to be acquired.

[0083] In some embodiments, the first processing unit is further configured to receive an instruction message sent by an upper-layer application module, determine at least one type of data stream to be acquired based on the instruction message, acquire configuration information, and determine at least one type of data stream to be acquired based on the configuration information.

[0084] In some embodiments, the second processing unit is further configured to determine, based on an instruction message or configuration information, parameter information including at least one of frame rate and resolution; instruct the image acquisition device of the vehicle cockpit to acquire the data stream according to the parameter information; and acquire the data stream acquired by the image acquisition device of the vehicle cockpit according to the parameter information.

[0085] In some embodiments, the data processing device for the vehicle cockpit further includes a third processing unit for receiving a data stream call instruction, the data stream call instruction including at least one of a preview data stream call instruction, an algorithm data stream call instruction, a recording data stream call instruction, a live streaming data stream call instruction, and a photo capture data stream call instruction; preprocessing the data stream according to the data stream call instruction; and writing the preprocessed data stream into a call buffer.

[0086] In some embodiments, preprocessing includes at least one of the following: format conversion; data stream encryption; and adding tags.

[0087] In some embodiments, the third processing unit is further configured to receive a data stream reacquisition request; determine the type and / or parameter information of the data stream that needs to be reacquisitioned based on the data stream reacquisition request; and reacquire the data stream from the image acquisition device in the vehicle cabin as needed based on the type and / or parameter information of the data stream to be reacquisitioned.

[0088] In summary, the vehicle-mounted cockpit data processing device 500 can simultaneously output multiple types of data streams, and can independently turn each type of data stream on and off. It can flexibly control the acquisition of at least one type of data stream according to needs, enabling faster service to users through the acquired data streams and improving user experience.

[0089] The methods and apparatus provided in the embodiments of this application have been described above. To implement the functions of the methods provided in the embodiments of this application, the electronic device may include a hardware structure and software modules, and may implement the above functions in the form of a hardware structure, software modules, or a hardware structure plus software modules. One of the above functions may be executed in the form of a hardware structure, software modules, or a hardware structure plus software modules.

[0090] Figure 6 This is a block diagram illustrating an electronic device 600 for implementing the above-described method according to an exemplary embodiment. For example, the electronic device 600 may be a mobile phone, computer, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0091] Reference Figure 6 The electronic device 600 may include one or more of the following components: a processing component 602, a memory 604, a power supply component 606, a multimedia component 608, an audio component 610, an input / output (I / O) interface 612, a sensor component 614, and a communication component 616.

[0092] Processing component 602 typically controls the overall operation of electronic device 600, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 602 may include one or more processors 620 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 602 may include one or more modules to facilitate interaction between processing component 602 and other components. For example, processing component 602 may include a multimedia module to facilitate interaction between multimedia component 608 and processing component 602.

[0093] Memory 604 is configured to store various types of data to support the operation of electronic device 600. Examples of this data include instructions for any application or method operating on electronic device 600, contact data, phonebook data, messages, pictures, videos, etc. Memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0094] Power supply component 606 provides power to various components of electronic device 600. Power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 600.

[0095] Multimedia component 608 includes a screen that provides an output interface between electronic device 600 and user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 608 includes a front-facing camera and / or a rear-facing camera. When electronic device 600 is in an operating mode, such as a shooting mode or video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0096] Audio component 610 is configured to output and / or input audio signals. For example, audio component 610 includes a microphone (MIC) configured to receive external audio signals when electronic device 600 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 604 or transmitted via communication component 616. In some embodiments, audio component 610 also includes a speaker for outputting audio signals.

[0097] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0098] Sensor assembly 614 includes one or more sensors for providing state assessments of various aspects of electronic device 600. For example, sensor assembly 614 may detect the on / off state of electronic device 600, the relative positioning of components such as the display and keypad of electronic device 600, changes in position of electronic device 600 or a component of electronic device 600, the presence or absence of user contact with electronic device 600, orientation or acceleration / deceleration of electronic device 600, and temperature changes of electronic device 600. Sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 614 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0099] Communication component 616 is configured to facilitate wired or wireless communication between electronic device 600 and other devices. Electronic device 600 can access wireless networks based on communication standards, such as WiFi, 2G or 3G, 4G LTE, 5G NR (NewRadio), or combinations thereof. In one exemplary embodiment, communication component 616 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 616 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0100] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0101] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, which can be executed by a processor 620 of an electronic device 600 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0102] Embodiments of this disclosure also provide a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to perform the methods described in the above embodiments of this disclosure.

[0103] Embodiments of this disclosure also provide a computer program product, including a computer program that is executed by a processor using the methods described in the above embodiments of this disclosure.

[0104] Figure 7 This is a schematic diagram illustrating the structure of a chip 700 for implementing the above method according to an exemplary embodiment. (Refer to...) Figure 7 The chip 700 includes a communication interface 701 and at least one processor 702. The communication interface 701 is used to receive signals input to the chip 700 or signals output from the chip 700. The processor 702 communicates with the communication interface 701 and implements the methods described in the above embodiments of this disclosure through logic circuits or executing code instructions.

[0105] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0106] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with an embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in at least one embodiment or example.

[0107] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of the invention includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as will be understood by those skilled in the art to which embodiments of the invention pertain.

[0108] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processing module, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having at least one wiring (control method), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which programs can be printed, because programs can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0109] It should be understood that various parts of the embodiments of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0110] Those skilled in the art will understand that all or part of the steps of the methods described in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0111] Furthermore, the functional units in the various embodiments of the present invention can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc.

[0112] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. A data processing method for an in-vehicle cockpit, characterized in that, The method includes: Determine at least one type of data stream to be acquired, wherein the data stream type includes at least one of preview data stream, algorithm data stream, recording data stream, live streaming data stream, and photo data stream; The data stream is acquired from the image acquisition device in the vehicle cockpit, depending on the type of at least one required data stream.

2. The method according to claim 1, characterized in that, Determining the type of at least one data stream to be acquired includes any of the following: Receive an instruction message sent by an upper-layer application module, and determine at least one type of data stream that needs to be acquired based on the instruction message; Obtain configuration information and determine at least one type of data stream to be acquired based on the configuration information.

3. The method according to claim 2, characterized in that, The process of acquiring the data stream from the image acquisition device in the vehicle cockpit includes: Based on the instruction message or the configuration information, determine the parameter information of the data stream to be acquired, wherein the parameter information includes at least one of frame rate and resolution; The image acquisition device in the vehicle cabin is instructed to acquire a data stream according to the parameter information; The data stream acquired by the image acquisition device of the vehicle cockpit according to the parameter information is obtained.

4. The method according to claim 1, characterized in that, The method further includes at least one of the following: Receive a data stream call instruction, the data stream call instruction including at least one of a preview data stream call instruction, an algorithm data stream call instruction, a recording data stream call instruction, a live streaming data stream call instruction, and a photo capture data stream call instruction; The data stream is preprocessed according to the data stream invocation instruction; The preprocessed data stream is written into the call buffer.

5. The method according to claim 4, characterized in that, The preprocessing includes at least one of the following: Format conversion; Data stream encryption; Add a marker.

6. The method according to claim 3, characterized in that, The method further includes: Receive data stream reacquisition request; Determine the type and / or parameter information of the data stream that needs to be reacquired based on the data stream reacquisition request; Based on the type and / or parameter information of the data stream that needs to be reacquired, the data stream is reacquired from the image acquisition device in the vehicle cabin.

7. A data processing device for a vehicle-mounted cockpit, the device comprising: The first processing unit is configured to determine at least one type of data stream to be acquired, wherein the data stream type includes at least one of preview data stream, algorithm data stream, recording data stream, live streaming data stream, and photo data stream. The second processing unit is used to acquire the data stream from the image acquisition device of the vehicle cockpit according to the type of the at least one data stream that needs to be acquired.

8. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.

9. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-6.

10. A chip, characterized in that, It includes at least one processor and a communication interface; the communication interface is used to receive signals input to the chip or signals output from the chip, and the processor communicates with the communication interface and implements the method as described in any one of claims 1 to 6 through logic circuits or executing code instructions.

11. A computer program product comprising a computer program, wherein, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 6.

Images