A control method and device of a vehicle-mounted equipment, an electronic equipment and a storage medium

Abstract

The application discloses a control method and device of a vehicle-mounted equipment, electronic equipment and a storage medium, and belongs to the technical field of vehicles. An intelligent cockpit host is installed on a vehicle, and the intelligent cockpit host is connected with at least one output device. Each output device corresponds to a seat. The method comprises the following steps: the intelligent cockpit host can acquire passenger state representation information, analyzes the passenger state representation information, obtains the ride state of each passenger in the vehicle, then determines the output control strategy corresponding to the ride state of the passenger based on the corresponding relationship between the ride state and the output control strategy established in advance, and further controls the output state of the output device corresponding to the seat of the passenger according to the determined output control strategy. In this way, an intelligent cockpit design scheme for passengers is provided, the intelligent cockpit host independently operates, does not need to be connected to a vehicle machine system, and therefore, the implementation of the intelligent cockpit design scheme for passengers is not limited.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicles, in particular to a control method and device of a vehicle-mounted equipment, an electronic device and a storage medium. BACKGROUND

[0002] With the rapid development of vehicle technology, various vehicle-mounted equipment has emerged, all of which aim to bring better user experience.

[0003] In the prior art, intelligent cockpit solutions are mainly designed for drivers, and there is no design solution for passengers. Moreover, intelligent cockpit solutions need to be connected to the car system when implemented. However, due to the technical limitations of the host factory, the car system is not open enough and cannot be freely customized, which to some extent limits the implementation of the intelligent cockpit solution. In addition, most car chips lack computing power, which further limits the implementation of the intelligent cockpit solution.

[0004] Therefore, the prior art has the problems of no intelligent cockpit solution for passengers and limited implementation of the intelligent cockpit solution. SUMMARY

[0005] The embodiments of the present application provide a control method of a vehicle-mounted equipment to solve the problems of no intelligent cockpit solution for passengers and limited implementation of the intelligent cockpit solution in the prior art.

[0006] In a first aspect, the embodiments of the present application provide a control method of a vehicle-mounted equipment. An intelligent cockpit host is installed on a vehicle, the intelligent cockpit host is connected with at least one output device, each output device corresponds to a seat, and the method comprises the following steps.

[0007] The intelligent cockpit host acquires passenger state representation information.

[0008] The passenger state representation information is analyzed to obtain the ride state of each passenger in the vehicle.

[0009] Based on a pre-established corresponding relationship between the ride state and the output control strategy, the output control strategy corresponding to the ride state of the passenger is determined.

[0010] The output state of the output device corresponding to the seat of the passenger is controlled according to the determined output control strategy.

[0011] In some embodiments, the passenger state representation information includes a sequence of in-vehicle images, and the analysis of the passenger state representation information to obtain the ride state of each passenger in the vehicle comprises the following steps.

[0012] performing human body recognition on each of the in-vehicle image sequence to determine whether there is a passenger on each seat; if there is a passenger on any seat, determining that the corresponding passenger is in a seated state, and if there is no passenger on the seat, determining that the corresponding passenger is in an unseated state; and / or

[0013] performing face analysis on each of the in-vehicle image sequence to determine whether each passenger is watching the output device, and if it is determined that the same passenger is not watching the output device for N consecutive times, determining that the passenger is in a non-watching state, N being an integer greater than 1.

[0014] In some embodiments, the passenger state representation information includes sensing information of each seat sensor, and analyzing the passenger state representation information to obtain the riding state of each passenger in the vehicle, including:

[0015] if it is determined based on the sensing information of any seat sensor that there is a passenger on the seat, determining that the passenger is in a seated state;

[0016] if it is determined based on the sensing information of the seat sensor that there is no passenger on the seat, determining that the corresponding passenger is in an unseated state.

[0017] In some embodiments, after determining that the riding state of any passenger is in a stable sitting posture state, further comprising:

[0018] determining head pitch information of the passenger;

[0019] based on the head pitch information, determining angle adjustment information of the output device corresponding to the seat on which the passenger is seated;

[0020] based on the angle adjustment information, adjusting the angle of the corresponding output device.

[0021] In some embodiments, before determining the head pitch information of the passenger, further comprising:

[0022] based on the sensing information of the seat sensor corresponding to the passenger, determining that the sitting posture of the passenger meets the stable sitting posture condition.

[0023] In some embodiments, after determining that the riding state of any passenger is in a seated state, further comprising:

[0024] obtaining multimedia data from a local or a server;

[0025] playing the multimedia data through the output device corresponding to the seat on which the passenger is seated.

[0026] In some embodiments, obtaining multimedia data from a server, comprising:

[0027] sending user portrait data of the passenger to the server, and selecting multimedia data matching the passenger based on the user portrait data by the server;

[0028] receiving the multimedia data sent by the server.

[0029] In some embodiments, after determining that the riding state of any passenger is the seated state, the method further comprises:

[0030] receiving a screen projection request sent by the passenger through a terminal;

[0031] playing multimedia data obtained from the terminal through an output device in front of the seat where the passenger is seated.

[0032] In a second aspect, the embodiments of the present application provide a control device of a vehicle-mounted device, a smart cockpit host is installed on a vehicle, the smart cockpit host is connected with at least one output device, each output device corresponds to a seat, the device is arranged in the smart cockpit host, and the device comprises:

[0033] an acquisition module configured to acquire passenger state representation information;

[0034] an analysis module configured to analyze the passenger state representation information to obtain a riding state of each passenger in the vehicle;

[0035] a determination module configured to determine an output control strategy corresponding to the riding state of the passenger based on a pre-established corresponding relationship between the riding state and the output control strategy;

[0036] a control module configured to control an output state of an output device corresponding to the seat where the passenger is seated according to the determined output control strategy.

[0037] In some embodiments, the passenger state representation information comprises a vehicle image sequence, and the analysis module is specifically configured to:

[0038] perform human body recognition on each vehicle image in the vehicle image sequence to determine whether there is a passenger on each seat, and if there is a passenger on any seat, determine that the corresponding passenger is in the seated state, and if there is no passenger on the seat, determine that the corresponding passenger is in the unseated state; and / or

[0039] perform face analysis on each vehicle image in the vehicle image sequence to determine whether each passenger watches the output device, and if it is determined that the same passenger does not watch the output device for N consecutive times, determine that the passenger is in the non-watching state, where N is an integer greater than 1.

[0040] In some embodiments, the passenger state representation information comprises sensing information of each seat sensor, and the analysis module is specifically configured to:

[0041] If it is determined that there is a passenger on the seat based on the sensing information of any seat sensor, it is determined that the corresponding passenger is in a seated state;

[0042] If it is determined that there is no passenger on the seat based on the sensing information of the seat sensor, it is determined that the corresponding passenger is in an unseated state.

[0043] In some embodiments, further comprising an adjusting module configured to:

[0044] After determining that the riding state of any passenger is in a seated state, determining head pitch information of the passenger;

[0045] Based on the head pitch information, determining angle adjustment information of an output device corresponding to the seat on which the passenger is seated;

[0046] Based on the angle adjustment information, adjusting the angle of the corresponding output device.

[0047] In some embodiments, the adjusting module is further configured to:

[0048] Before determining the head pitch information of the passenger, determining, based on the sensing information of the seat sensor corresponding to the passenger, that the sitting posture of the passenger meets a stable sitting posture condition.

[0049] In some embodiments, further comprising an output module configured to:

[0050] After determining that the riding state of any passenger is in a seated state, obtaining multimedia data from a local or a server;

[0051] Playing the multimedia data through an output device corresponding to the seat on which the passenger is seated.

[0052] In some embodiments, the output module is specifically configured to:

[0053] Sending user portrait data of the passenger to the server, and selecting, by the server, multimedia data matching the passenger based on the user portrait data;

[0054] Receiving the multimedia data sent by the server.

[0055] In some embodiments, further comprising a screen projection module configured to:

[0056] After determining that the riding state of any passenger is in a seated state, receiving a screen projection request sent by the passenger through a terminal;

[0057] Playing multimedia data obtained from the terminal through an output device in front of the seat on which the passenger is seated.

[0058] In a third aspect, an electronic device is provided, including at least one processor, and a memory connected with the at least one processor in communication, wherein:

[0059] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the control of the vehicle-mounted device.

[0060] In a fourth aspect, a storage medium is provided, and when a computer program in the storage medium is executed by a processor of an electronic device, the electronic device can perform the control of the vehicle-mounted device.

[0061] In the embodiments of the present application, a smart cockpit host is installed on a vehicle, the smart cockpit host is connected with at least one output device, each output device corresponds to a seat, the smart cockpit host can obtain passenger state representation information, analyze the passenger state representation information to obtain a ride state of each passenger in the vehicle, then, based on a pre-established corresponding relationship between the ride state and an output control strategy, determine an output control strategy corresponding to the ride state of the passenger, and further control an output state of the output device corresponding to the seat of the passenger according to the determined output control strategy. In this way, a smart cockpit design scheme for passengers is provided, and the smart cockpit host operates independently without accessing the vehicle system, so the implementation of the smart cockpit design scheme for passengers is not limited. BRIEF DESCRIPTION OF DRAWINGS

[0062] The accompanying drawings, which are included to provide a further understanding of the present application, constitute a part of this application and illustrate embodiments of the present application and together with the description serve to explain the present application. In the drawings:

[0063] Figure 1 An application scenario diagram of a control method of a vehicle-mounted device provided by the embodiments of the present application;

[0064] Figure 2 A flowchart of a control method of a vehicle-mounted device provided by the embodiments of the present application;

[0065] Figure 3 A flowchart of another control method of a vehicle-mounted device provided by the embodiments of the present application;

[0066] Figure 4 A structural schematic diagram of a control device of a vehicle-mounted device provided by the embodiments of the present application;

[0067] Figure 5 A hardware structural schematic diagram of an electronic device for implementing a control method of a vehicle-mounted device provided by the embodiments of the present application. DETAILED DESCRIPTION

[0068] In order to solve the problem that there is no intelligent cockpit scheme for passengers in the prior art and the implementation of the intelligent cockpit scheme is limited, the embodiments of the present application provide a control method and device of a vehicle-mounted equipment, an electronic device and a storage medium.

[0069] The preferred embodiments of the present application will be described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present application, and are not used to limit the present application, and the embodiments in the present application and the features in the embodiments can be combined with each other without conflict.

[0070] First of all, it should be pointed out that the control method of the vehicle-mounted equipment provided by the embodiments of the present application can be applied to both online car-hailing scenarios and non-online car-hailing scenarios. In the following, the application in online car-hailing scenarios will be described as an example.

[0071] In order to make up for the lack of intelligent cockpit schemes for passengers in the related art, the embodiments of the present application provide a vehicle-mounted equipment independent of the car system, which includes an intelligent cockpit host and at least one output device connected to the intelligent cockpit host. The intelligent cockpit host can obtain passenger state representation information, analyze the passenger state representation information, obtain the ride state of each passenger in the vehicle, determine the output control strategy corresponding to the ride state of the passenger based on the pre-established corresponding relationship between the ride state and the output control strategy, and then control the output state of the output device corresponding to the seat of the passenger according to the determined output control strategy.

[0072] The intelligent cockpit host can be powered by a 12V vehicle-mounted power supply, and the number of output devices connected to the intelligent cockpit host can be flexibly configured according to the number of seats, such as setting output devices in front of the front passenger seat, not setting output devices in front of the front passenger seat, setting output devices in front of all seats except the front passenger seat, setting output devices in front of some seats except the front passenger seat, etc.

[0073] Figure 1 The application scenario diagram of the control method of the vehicle-mounted equipment provided by the embodiments of the present application includes one intelligent cockpit host and three output devices: output device 1, output device 2 and output device 3. The intelligent cockpit host is connected to the output device 1 and the output device 2 through two MIPI interfaces, and is connected to the output device 3 through an HDMI interface. With the aid of the three interfaces, the intelligent cockpit host can control the output state (screen off, sound off, screen on, etc.) and the output multimedia content of the three output devices.

[0074] In addition, the vehicle is also provided with a camera, such as a camera arranged at the front of the vehicle, a plurality of cameras arranged at different positions in the vehicle, etc., and the arrangement position and number of the camera are appropriate to cover all the visual angles in the vehicle. In addition, each seat is also provided with a seat sensor. The intelligent cockpit host can regularly acquire the in-vehicle images collected by the camera and the sensing information collected by the seat sensor, and control the output state and the output multimedia content of each output device based on the acquired information.

[0075] After introducing the application scenarios of the embodiments of the present application, the control method of the vehicle-mounted device proposed by the present application will be described in detail. Figure 2 The flowchart of the control method of the vehicle-mounted device provided by the embodiments of the present application, the method is applied to Figure 1 the intelligent cockpit host in , and the method comprises the following steps.

[0076] In step 201, passenger state representation information is acquired.

[0077] In some embodiments, the passenger state representation information can include an in-vehicle image sequence; in some embodiments, the passenger state representation information can include sensing information of each seat sensor.

[0078] In step 202, the passenger state representation information is analyzed to obtain the ride state of each passenger in the vehicle.

[0079] The ride state of each passenger includes, for example, a seated state, an unseated state, a watching state, and an unwatching state.

[0080] The intelligent cockpit host can locally deploy some visual analysis algorithms for different analysis purposes, such as a human body recognition algorithm for analyzing whether there is a person on the seat, and a visual line analysis algorithm for analyzing whether the passenger watches the display screen of the output device. In addition, the intelligent cockpit host can also not deploy or deploy part of the visual analysis algorithm, and call the corresponding visual analysis algorithm from the server when visual analysis of a certain purpose is needed.

[0081] In some embodiments, the passenger state representation information includes an in-vehicle image sequence.

[0082] In this case, the human body recognition algorithm locally or the human body recognition algorithm on the server side can be used to perform human body recognition on each in-vehicle image in the in-vehicle image sequence to determine whether there is a passenger on each seat; if there is a passenger on any seat, it is determined that the corresponding passenger is in a seated state, and if there is no passenger on any seat, it is determined that the corresponding passenger is in an unseated state.

[0083] In specific implementation, the position of the seat headrest in the image in the vehicle can be calibrated in advance according to the vehicle type, for example, the face detection frame is set above the shoulder and neck key points, and the x coordinate of the face detection frame is set in the x coordinate range of the left and right shoulders. If the overlapping area of the headrest frame and the face detection frame is greater than 50%, it is determined that there is a passenger on the corresponding seat. Subsequently, the intelligent cabin host analyzes the positional relationship between the face detection frame and the headrest frame in the vehicle image when performing human body recognition on each vehicle image, and can determine whether there is a passenger on a seat.

[0084] In some embodiments, the passenger state representation information includes sensing information of the seat sensor.

[0085] In this case, the sensing information of the seat sensor can be analyzed to determine whether there is a passenger on each seat; if there is a passenger on any seat, it is determined that the corresponding passenger is in a seated state, and if there is no passenger on any seat, it is determined that the corresponding passenger is in an unseated state.

[0086] The sensing information of each seat sensor can include pressure information, and if it is determined that the pressure indicated by the pressure information is greater than a preset value, it is determined that there is a passenger on the seat, and if it is determined that the pressure indicated by the pressure information is not greater than the preset value, it is determined that there is no passenger on the seat.

[0087] In this case, the line-of-sight analysis algorithm locally or the line-of-sight analysis algorithm on the server side can also be used to perform face analysis on each vehicle image to determine whether each passenger is watching the output device. When it is determined based on any vehicle image that a passenger is watching the output device, it is determined that the passenger is in a watching state, and if it is determined that the same passenger is not watching the output device for N consecutive times, it is determined that the passenger is in an unwatching state.

[0088] The condition that the passenger is not watching the output device means that the passenger's line of sight is not on the display screen of the output device, such as the passenger closing his eyes or turning his head to one side.

[0089] In step 203, based on the pre-established corresponding relationship between the passenger state and the output control strategy, the output control strategy corresponding to the passenger state of the passenger is determined.

[0090] In specific implementation, the corresponding relationship between the passenger state and the output control strategy is as follows: the seated state corresponds to the screen being on, the unseated state corresponds to the screen being off and the sound being off, the unwatching state corresponds to the screen being off, the unwatching state corresponds to the screen being off and the sound being off, and the watching state corresponds to the screen being on and the sound not being off.

[0091] The output state corresponding to the non-watching state can be determined according to the currently played multimedia content. For example, if the currently played multimedia content is music, the output state corresponding to the non-watching state can be screen-off, so that the user can still listen to the music in the screen-off state. For another example, if the currently played multimedia content is a video, the output state corresponding to the non-watching state can be screen-off and muting, so that the user can not be affected.

[0092] In step 204, the output state of the output device corresponding to the seat ridden by the passenger is controlled according to the determined output control strategy.

[0093] That is, the output state of the output device corresponding to the seat ridden by the passenger is controlled according to the determined screen-off and muting, screen-on, screen-off, and the like.

[0094] Figure 3 Another flowchart of a control method of a vehicle-mounted device provided by an embodiment of the present application is provided. The method is applied to an intelligent cockpit host in Figure 1 and the method includes the following steps.

[0095] In step 301, passenger state representation information is acquired in real time.

[0096] In step 302, the passenger state representation information is analyzed to obtain the ride state of each passenger in the vehicle.

[0097] The implementation of this step can be referred to the implementation of step 202, which will not be described here.

[0098] In step 303, if it is determined that the ride state of the passenger is the seated state, the display screen of the output device corresponding to the seat ridden by the passenger is turned on.

[0099] In step 304, multimedia data is acquired from a local or a server.

[0100] In some embodiments, the intelligent cockpit host can store some multimedia data such as introduction videos of scenic spots along the way, music, and the like.

[0101] In some embodiments, the intelligent cockpit host can acquire multimedia data from a server, and in order to make personalized recommendations, the intelligent cockpit host can also send user portrait data of the current passenger to the server, so that the server can select multimedia data that meets the passenger's preferences according to the user portrait data, and the selected multimedia data is used as the multimedia data matched with the passenger.

[0102] In step 305, the acquired multimedia data is played through the output device corresponding to the seat ridden by the passenger.

[0103] In step 306, it is determined whether the sitting posture of the passenger meets the stable sitting posture condition based on the sensing information of the seat sensor of the seat in which the passenger is seated. If yes, step 307 is entered. If no, step 306 is continuously executed.

[0104] In some embodiments, the sitting posture determination can be performed by means of the seat sensor.

[0105] For example, the sensing information of each seat sensor can further include the contact area of the passenger with the seat cushion and whether the passenger is in contact with the seat back. Accordingly, the stable sitting posture condition can be, for example, that the contact area of the passenger with the seat cushion is not less than two-thirds, that the contact area of the passenger with the seat cushion is not less than two-thirds and the passenger is in contact with the seat back, and the like.

[0106] In some embodiments, the sitting posture determination can be performed by means of the in-vehicle image.

[0107] Generally, after determining the seat in which the passenger is seated based on each in-vehicle image, the sitting posture of each passenger can be determined in combination with the positional relationship between the coordinates of the upper body key points of the human body and the position of the face detection frame in the in-vehicle image. Accordingly, the stable sitting posture condition can be, for example, that the passenger leans against the seat back.

[0108] In step 307, the head pitch information of the passenger is determined.

[0109] In specific implementation, the intelligent cockpit host can determine the face area from each in-vehicle image by using a corresponding visual analysis algorithm, analyze and determine the head pitch angle in the face area, and further use the head pitch angle as the head pitch information of the corresponding passenger.

[0110] In step 308, the angle adjustment information of the output device corresponding to the seat in which the passenger is seated is determined based on the head pitch information of the passenger.

[0111] For example, if the head pitch information of the passenger indicates that the head pitch angle is pitch, -pitch can be used as the angle adjustment information of the output device corresponding to the seat in which the passenger is seated.

[0112] In step 309, the angle of the corresponding output device is adjusted based on the angle adjustment information.

[0113] In step 310, if it is determined that the passenger state of the passenger is the non-viewing state or the off-seat state, the output device corresponding to the seat in which the passenger is seated is controlled to turn off the screen and the sound.

[0114] It should be noted that in the above process, steps 301-302 are periodically executed, steps 303-310 are selectively executed based on the result obtained each time step 302 is executed, and there is no strict sequence relationship between steps 304-305 and steps 306-309.

[0115] In actual application, after the passenger gets on the vehicle, the passenger can also connect the terminal to the intelligent cockpit host through 4G, 5G or in-vehicle wireless Wi-Fi, send a screen projection request to the intelligent cockpit host through the terminal, and the intelligent cockpit host can obtain multimedia data from the terminal after receiving the screen projection request, and then play the obtained multimedia data through the output device in front of the seat where the passenger is located.

[0116] In addition, the intelligent cockpit host can also be connected to a server through 4G, 5G, Wi-Fi, etc., obtain a network car-hailing trip state event from the server, and control the multimedia content output by the corresponding output device by means of the network car-hailing trip state event, wherein the network car-hailing trip state event is, for example, the passenger getting on the vehicle or the passenger getting off the vehicle.

[0117] For example, when it is determined that any passenger gets on the vehicle, the output device corresponding to the seat where the passenger is located is controlled to play a welcome speech welcoming the passenger and display a smiling face on the display screen of the output device, and when it is determined that the passenger gets off the vehicle, the output device corresponding to the seat where the passenger is located is controlled to play a goodbye.

[0118] By means of the scheme provided in the embodiments of the present application, in the network car-hailing scenario, when there is a passenger on a certain seat, the display screen of the output device corresponding to the seat can be automatically controlled to be turned on, and then the output device can be controlled to play multimedia content, and if it is detected that the passenger on the seat is resting or there is no passenger on the seat, the display screen of the output device can be automatically controlled to be turned off. Moreover, if there are multiple passengers in the vehicle, the passengers can autonomously control the multimedia content played by the output device in front of their own seats, or passively let the output device intelligently play trip-related information and video content, and the passengers can also turn off and / or turn on the corresponding display screen through the keys of the output device.

[0119] In this way, when the passenger takes a network car-hailing vehicle, the passenger can experience personalized intelligent cockpit services no matter which seat the passenger sits in, the user experience is good, and it is also beneficial to save power and prolong the service life of the output device.

[0120] Based on the same technical concept, the embodiments of the present application also provide a screen control device, and the principle of the screen control device for solving the problem is similar to the control of the vehicle-mounted device described above, so the implementation of the screen control device can be referred to the implementation of the control of the vehicle-mounted device, and the repeated parts will not be described herein.

[0121] Figure 4 A structural schematic diagram of a vehicle-mounted device control device provided in the embodiments of the present application includes an acquisition module 401, an analysis module 402, a determination module 403 and a control module 404.

[0122] The acquisition module 401 is configured to acquire passenger state representation information.

[0123] The analysis module 402 is configured to analyze the passenger state representation information to obtain a ride state of each passenger in the vehicle.

[0124] The determination module 403 is configured to determine an output control strategy corresponding to the ride state of the passenger based on a pre-established corresponding relationship between the ride state and the output control strategy.

[0125] The control module 404 is configured to control an output state of an output device corresponding to the seat of the passenger according to the determined output control strategy.

[0126] In some embodiments, the passenger state representation information includes a sequence of in-vehicle images, and the analysis module 402 is specifically configured to:

[0127] perform human body recognition on each in-vehicle image in the sequence of in-vehicle images to determine whether there is a passenger on each seat; if there is a passenger on any seat, it is determined that the corresponding passenger is in a seated state, and if there is no passenger on the seat, it is determined that the corresponding passenger is in an unseated state; and / or

[0128] perform face analysis on each in-vehicle image in the sequence of in-vehicle images to determine whether each passenger is watching the output device; if it is determined that the same passenger is not watching the output device for N consecutive times, it is determined that the passenger is in a non-watching state, and N is an integer greater than 1.

[0129] In some embodiments, the passenger state representation information includes sensing information of each seat sensor, and the analysis module 402 is specifically configured to:

[0130] if it is determined based on the sensing information of any seat sensor that there is a passenger on the seat, it is determined that the corresponding passenger is in a seated state;

[0131] if it is determined based on the sensing information of the seat sensor that there is no passenger on the seat, it is determined that the corresponding passenger is in an unseated state.

[0132] In some embodiments, the adjustment module 405 is further configured to:

[0133] determine head pitch information of any passenger after determining that the ride state of the passenger is in a seated state;

[0134] determine angle adjustment information of an output device corresponding to the seat of the passenger based on the head pitch information;

[0135] adjust the angle of the corresponding output device based on the angle adjustment information.

[0136] In some embodiments, the adjustment module 405 is further configured to:

[0137] Before determining the head pitch information of the passenger, it is determined, based on sensing information of a seat sensor corresponding to the passenger, that a sitting posture of the passenger meets a stable sitting posture condition.

[0138] In some embodiments, the output module 406 is further included for:

[0139] After determining that the riding state of any passenger is the seated state, multimedia data is acquired from a local or a server;

[0140] The multimedia data is played through an output device corresponding to the seat of the passenger.

[0141] In some embodiments, the output module 406 is specifically used for:

[0142] The user portrait data of the passenger is sent to the server, and the server selects multimedia data matching the passenger based on the user portrait data;

[0143] The multimedia data sent by the server is received.

[0144] In some embodiments, the screen projection module 407 is further included for:

[0145] After determining that the riding state of any passenger is the seated state, a screen projection request sent by the passenger through a terminal is received;

[0146] Multimedia data acquired from the terminal is played through an output device in front of the seat of the passenger.

[0147] The division of the modules in the embodiments of the present application is illustrative, and is merely a logical function division. In actual implementation, another division manner can be used. In addition, the function modules in each embodiment of the present application can be integrated in one processor, or can be physically separated, or two or more modules can be integrated in one module. The coupling between the modules can be realized through some interfaces. The interfaces are usually electrical communication interfaces, but can also be mechanical interfaces or other form interfaces. Therefore, the modules described as separate components can be or can not be physically separated, and can be located in one place or distributed to different locations of the same or different devices. The integrated modules can be realized in the form of hardware or software function modules.

[0148] After introducing the control and device of the vehicle-mounted device in the example embodiment of the present application, next, an electronic device according to another example embodiment of the present application is introduced.

[0149] The electronic device 130 realized according to this embodiment of the present application is described below with reference to Figure 5 .Figure 5 The electronic device 130 is merely an example and should not limit the function and usage range of the embodiments of the present application.

[0150] As shown in Figure 5 The electronic device 130 is in the form of a general electronic device. The components of the electronic device 130 can include, but are not limited to, the at least one processor 131, the at least one memory 132, and a bus 133 connecting different system components, including the memory 132 and the processor 131.

[0151] The bus 133 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a processor or local bus using any of a variety of bus architectures.

[0152] The memory 132 can include a readable medium in the form of volatile memory, such as a random access memory (RAM) 1321 and / or a cache memory 1322, and can further include a read-only memory (ROM) 1323.

[0153] The memory 132 can also include a program / utility 1325 having a set of program modules 1324, including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or a combination can include an implementation of a network environment.

[0154] The electronic device 130 can also communicate with one or more external devices 134 (such as a keyboard or a pointing device, etc.), and can also communicate with one or more devices that enable a user to interact with the electronic device 130, and / or any devices (such as a router, a modem, etc.) that enable the electronic device 130 to communicate with one or more other electronic devices. Such communication can be carried out through an input / output (I / O) interface 135. Furthermore, the electronic device 130 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 136. As shown, the network adapter 136 communicates with other modules for the electronic device 130 through the bus 133. It should be understood that although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device 130, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0155] In an example embodiment, a storage medium is also provided, when a computer program in the storage medium is executed by a processor of an electronic device, the electronic device can perform the control of the vehicle-mounted device described above. Optionally, the storage medium can be a non-transitory computer readable storage medium, for example, the non-transitory computer readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, and the like.

[0156] In an example embodiment, the electronic device of the present application can at least include at least one processor, and a memory connected in communication with the at least one processor, wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the steps of the control of any vehicle-mounted device provided by the embodiments of the present application.

[0157] In an example embodiment, a computer program product is also provided, when the computer program product is executed by an electronic device, the electronic device can implement any example method provided by the present application.

[0158] Furthermore, the computer program product can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination of the above.

[0159] The program product for implementing the control method of the vehicle-mounted device in the embodiments of the present application can adopt a storage card and include program codes, and can run on a computing device. However, the program product of the present application is not limited thereto, and in this document, the readable storage medium can be any tangible medium containing or storing a program, which can be used or combined with an instruction execution system, device or apparatus.

[0160] The readable signal medium can include a data signal propagating in a baseband or as a part of a carrier wave, in which readable program codes are borne. Such a propagating data signal can adopt various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The readable signal medium can also be any readable medium other than the readable storage medium, which can send, propagate or transmit a program for use by or in connection with an instruction execution system, device or apparatus.

[0161] The program codes contained on the readable medium can be transmitted by any suitable medium, including but not limited to wireless, wired, optical cable, radio frequency (RF), and the like, or any suitable combination of the above.

[0162] Program code implementing the application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++, or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computing device, partly on the user's computing device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device or entirely on the remote computing device or server. In the latter scenario, the remote computing device can be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computing device, such as through the Internet using an Internet Service Provider (ISP). It will be appreciated that program components implementing the present application can be implemented in hardware, software, or a combination thereof.

[0163] It should be noted that, although several units or sub-units of the apparatus are mentioned in the above detailed description, such division into units or sub-units is merely exemplary and not mandatory. Indeed, according to an embodiment of the application, features and functions of two or more units described above can be embodied in one unit. Conversely, features and functions of one unit described above can be further divided into a plurality of units.

[0164] Moreover, while operations of the methods of the present application are described in a particular order in the figures, this is not required or implied in any particular order of operations or that all operations be performed to achieve desirable results. Additionally or alternatively, certain steps can be omitted, combined, performed in a different order, and / or split into multiple steps.

[0165] Those skilled in the art will appreciate that embodiments of the present application can be devised for a method, a system, or a computer program product. Accordingly, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) embodying computer readable program code.

[0166] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 means for functionally implementing the steps listed in the flowchart block or blocks.

[0167] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 means for functionally implementing the steps listed in the flowchart block or blocks.

[0168] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 means for functionally implementing the steps listed in the flowchart block or blocks.

[0169] While the preferred embodiments of the application have been described, additional variations and modifications can be employed by those skilled in the art. Therefore, the appended claims intend to cover all such modifications and variations as fall within the true spirit and scope of the application.

[0170] Obviously, numerous modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims and their equivalents, the application can be practiced otherwise than as specifically described.

Claims

1. A control method of a vehicle-mounted device, characterized by, A smart cockpit host is installed on a vehicle, the smart cockpit host is connected with at least one output device, each output device corresponds to a seat, the vehicle is a network car, and the method comprises the following steps: The smart cockpit host periodically performs the following steps: obtaining passenger state representation information, analyzing the passenger state representation information, and obtaining the riding state of each passenger in the vehicle; When it is determined that the riding state of any passenger is a seated state, the display screen of the output device corresponding to the seat of the passenger is controlled to be lit, multimedia data is obtained from a server, and the multimedia data is played through the output device corresponding to the seat of the passenger; Based on the sensing information of the seat sensor corresponding to the passenger, it is determined whether the sitting posture of the passenger meets the stable sitting posture condition, the sensing information includes the contact area of the passenger and the seat cushion and whether the passenger and the seat back are in contact, and the stable sitting posture condition includes that the contact area of the passenger and the seat cushion is not less than two-thirds, and the contact area of the passenger and the seat cushion is not less than two-thirds and the passenger and the seat back are in contact; After it is determined that the sitting posture of the passenger meets the stable sitting posture condition, the head pitch information of the passenger is determined, based on the head pitch information, the angle adjustment information of the output device corresponding to the seat of the passenger is determined, and based on the angle adjustment information, the angle of the corresponding output device is adjusted; When it is determined that the riding state of the passenger is an unwatched state or an unseated state, the output device corresponding to the seat of the passenger is controlled to be turned off and the sound is turned off.

2. The method of claim 1, wherein, The passenger state representation information includes a sequence of in-vehicle images, the analysis of the passenger state representation information obtains the riding state of each passenger in the vehicle, which comprises: Human body recognition is performed on each in-vehicle image in the sequence of in-vehicle images to determine whether there is a passenger on each seat; if there is a passenger on any seat, it is determined that the corresponding passenger is in a seated state, and if there is no passenger on the seat, it is determined that the corresponding passenger is in an unseated state; and / or Face analysis is performed on each in-vehicle image in the sequence of in-vehicle images to determine whether each passenger watches the output device, if the same passenger is determined to not watch the output device for N consecutive times, it is determined that the passenger is in an unwatched state, N is an integer greater than 1.

3. The method according to claim 1, wherein The passenger state representation information includes the sensing information of each seat sensor, the analysis of the passenger state representation information obtains the riding state of each passenger in the vehicle, which comprises: If it is determined based on the sensing information of any seat sensor that there is a passenger on the seat, it is determined that the corresponding passenger is in a seated state; If it is determined based on the sensing information of the seat sensor that there is no passenger on the seat, it is determined that the corresponding passenger is in an unseated state.

4. The method of claim 1, wherein, Obtaining multimedia data from a server comprises: Sending user portrait data of the passenger to the server, selecting multimedia data matching the passenger based on the user portrait data by the server; Receiving the multimedia data sent by the server.

5. The method of claim 1, wherein, Further comprising: Receiving a screen projection request sent by the passenger through a terminal; Playing multimedia data obtained from the terminal through the output device in front of the seat where the passenger is located.

6. A control device of a vehicle-mounted apparatus, characterized by comprising: The vehicle is provided with an intelligent cockpit host, and the intelligent cockpit host is connected with at least one output device, and each output device corresponds to a seat, characterized in that the device is arranged in the intelligent cockpit host, the vehicle is a network car, and the device comprises: An acquisition module is configured to periodically acquire passenger state representation information. An analysis module is configured to periodically analyze the acquired passenger state representation information to obtain a ride state of each passenger in the vehicle. A control module is configured to, when determining that the ride state of any passenger is a seated state, control a display screen of an output device corresponding to a seat of the passenger to light up, acquire multimedia data from a server, and play the multimedia data through the output device corresponding to the seat of the passenger; determine whether a sitting posture of the passenger meets a stable sitting posture condition based on sensing information of a seat sensor corresponding to the seat of the passenger, the sensing information including a contact area of the passenger and a seat cushion and whether the passenger and a seat back are in contact, and the stable sitting posture condition including that the contact area of the passenger and the seat cushion is not less than two-thirds and that the contact area of the passenger and the seat cushion is not less than two-thirds and the passenger and the seat back are in contact. An adjustment module is configured to, when determining that the sitting posture of the passenger meets the stable sitting posture condition, determine head pitch information of the passenger, determine angle adjustment information of the output device corresponding to the seat of the passenger based on the head pitch information, and adjust an angle of the corresponding output device based on the angle adjustment information. The control module is further configured to, when determining that the ride state of the passenger is an unwatched state or an unseated state, control the output device corresponding to the seat of the passenger to turn off the screen and mute the sound.

7. An electronic device, comprising: The device comprises: At least one processor and a memory connected in communication with the at least one processor, wherein: The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the method of any one of claims 1-5.

8. A storage medium, characterized by When the computer program in the storage medium is executed by the processor of the electronic device, the electronic device can execute the method of any one of claims 1-5.

Images