Ceiling screen control method, electronic equipment and vehicle

Abstract

The invention provides a ceiling screen control method, electronic equipment and a vehicle, which can preferentially ensure the use experience of a high-priority user by determining an effective following target in the vehicle in a following mode. And the effectiveness of the moving action needs to be judged before following, so that the influence of the interference action on the following of the ceiling screen is avoided. And when the moving action is effective, following is performed according to the target angle of the ending position of the moving action, so that following of the ceiling screen is realized, and a user is ensured to have comfortable viewing experience. And when the moving action is invalid, controlling the ceiling screen to stay at the temporary stay angle so as to avoid wrong following caused by the interference scene. By judging the validity and adopting different control strategies for different conditions, the following sensitivity of the ceiling screen is ensured, wrong following is avoided, and the user experience is improved.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a control method for a ceiling-mounted screen, electronic equipment, and a vehicle. Background Technology

[0002] With the continuous upgrading of intelligent driving and intelligent cockpit, more and more high-end models are equipped with ceiling-mounted screens. However, the existing ceiling-mounted screens are fixed in position after opening / closing and cannot be adjusted according to the status of the people in the car. Passengers need to adjust their positions when watching movies, resulting in a poor comfort experience. Summary of the Invention

[0003] In view of this, the purpose of this application is to provide a control method, electronic device and vehicle for a ceiling-mounted screen, which enables the ceiling-mounted screen to automatically adjust its angle according to the user's movement, so as to provide the user with a comfortable viewing experience.

[0004] To achieve the above objectives, this application provides a control method for a ceiling-mounted screen, comprising:

[0005] In response to receiving an unfolding command from the ceiling-mounted screen, and the current operating mode of the ceiling-mounted screen is follow mode, a valid follow target is determined, the movement action of the valid follow target is determined, and the validity of the movement action is judged based on the movement speed of the valid follow target and the followable range of the ceiling-mounted screen.

[0006] In response to the effective movement action, a target angle corresponding to the end position of the movement action is determined, and the ceiling-mounted screen is controlled to follow the effective target according to the target angle;

[0007] In response to the invalidation of the movement action, a temporary stopping angle corresponding to the last valid position of the movement action is determined, and the ceiling screen is controlled to stop at the temporary stopping angle.

[0008] Based on the same inventive concept, this disclosure also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein the processor implements the method described above when executing the computer program.

[0009] Based on the same inventive concept, this disclosure also provides a vehicle including the electronic equipment described above.

[0010] As can be seen from the above, the ceiling-mounted screen control method, electronic device, and vehicle provided in this application, in follow mode, prioritize the user experience of high-priority users by identifying a valid following target inside the vehicle. Before following, the validity of the movement action needs to be judged to avoid interference from other actions affecting the ceiling-mounted screen's following. When the movement action is valid, following is performed based on the target angle at the end position of the movement action, achieving true following of the ceiling-mounted screen and ensuring a comfortable viewing experience for the user. When the movement action is invalid, the ceiling-mounted screen is controlled to remain at a temporary stopping angle to avoid erroneous following caused by interference from the scene. By judging the validity, different control strategies are adopted for different situations, ensuring the ceiling-mounted screen's following sensitivity while avoiding erroneous following and improving the user experience. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in this application or related technologies, the drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 This is a flowchart of the control method for the ceiling-mounted screen according to an embodiment of this application;

[0013] Figure 2 This is a schematic diagram of the ceiling-mounted screen in a fully reclaimed state according to an embodiment of this application;

[0014] Figure 3 This is a flowchart illustrating how to determine a valid following target based on an in-vehicle scan image from a ceiling-mounted screen, as described in this application.

[0015] Figure 4 This is a schematic diagram of a third-row seating scenario according to an embodiment of this application;

[0016] Figure 5 A flowchart for determining the validity of embodiments of this application;

[0017] Figure 6 This is a schematic diagram of the control device for the ceiling-mounted screen according to an embodiment of this application;

[0018] Figure 7 This is a schematic diagram of the structure of an electronic device according to an embodiment of this application. Detailed Implementation

[0019] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with specific embodiments and the accompanying drawings.

[0020] It should be noted that, unless otherwise defined, the technical or scientific terms used in the embodiments of this application should have the ordinary meaning understood by one of ordinary skill in the art to which this application pertains. The terms "first," "second," and similar terms used in the embodiments of this application do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as "comprising" or "including" mean that the element or object preceding the word encompasses the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Terms such as "connected" or "linked" are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as "upper," "lower," "left," and "right" are only used to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0021] In this article, it is important to understand that any number of elements in the accompanying figures is for illustrative purposes and not for limitation, and any naming is for distinction only and has no limiting meaning.

[0022] Based on the above background description, the following situations also exist in the related technologies:

[0023] The ceiling-mounted screen acts as a living room television within the car. Firstly, the screen adheres to the ceiling, taking up no interior space. Secondly, once opened, it reveals a large screen (e.g., 15.6 inches). Opening is simple: just press the open button, and the screen slowly pops out. Second-row passengers need to manually adjust it to a comfortable position after it's partially opened. Then, passengers can choose their preferred apps to watch on the screen. This ceiling-mounted screen technology does indeed provide a good viewing experience for second and third-row passengers. It's large enough, has high resolution, and most importantly, is multi-angle adjustable, allowing passengers to find a comfortable position anytime, anywhere, resulting in a great experience.

[0024] However, while vehicle seats can be adjusted within a certain angle range, allowing users to rest in different positions, such as a reclining position, thus improving comfort, adjusting the seat angle alters the user's field of vision. This means the ceiling-mounted screen may no longer provide a comfortable viewing angle, requiring manual adjustment. Since the user's posture during manual adjustment may differ from their usual posture, they may not be able to achieve the optimal angle in one go, leading to multiple adjustments and a poor user experience.

[0025] The ceiling-mounted screen control method, electronic device, and vehicle provided in this application, in follow mode, prioritize the user experience of high-priority users by determining a valid following target inside the vehicle. Before following, the validity of the movement action needs to be determined to avoid interference from other actions affecting the ceiling-mounted screen's following. When the movement action is valid, following is performed based on the target angle of the ending position of the movement action, achieving true following of the ceiling-mounted screen and ensuring a comfortable viewing experience for the user. When the movement action is invalid, the ceiling-mounted screen is controlled to remain at a temporary stopping angle to avoid erroneous following caused by interference from the scene. By determining the validity, different control strategies are adopted for different situations, ensuring the ceiling-mounted screen's following sensitivity while avoiding erroneous following and improving the user experience.

[0026] The control method for the ceiling-mounted screen provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0027] In some embodiments, such as Figure 1 As shown, the control method for the ceiling-mounted screen includes:

[0028] Step 101: In response to receiving the unfolding command of the ceiling screen, and the current operating mode of the ceiling screen is the follow mode, determine the effective follow target based on the in-vehicle scanning image of the ceiling screen, determine the movement action of the effective follow target, and judge the validity of the movement action based on the movement speed of the effective follow target and the followable range of the ceiling screen.

[0029] In practice, when the user controls the ceiling-mounted screen by opening the motor on the central control display or by using the voice command "Open ceiling-mounted screen," the Central Electronic Module (CEM) receives the opening command for the ceiling-mounted screen. The CEM, also known as the body controller or body electronic control unit, is a crucial module in the vehicle used to manage and control body-related functions. It is typically located inside the vehicle and is responsible for integrating and controlling multiple systems and devices, such as door locking, window control, lighting control, anti-theft systems, seat adjustment, wiper control, and ceiling-mounted screen opening.

[0030] The Vehicle Electronics Manager (CEM) communicates with other electronic modules, such as the Engine Control Unit (ECU), Instrument Cluster Control Unit (ICU), and body sensors, to coordinate the operation of various vehicle systems. It receives input information from sensors and controls and operates the vehicle's electronic equipment according to commands from the driver or system automation. In addition to basic body control functions, the CEM can also perform other auxiliary functions, such as providing diagnostic interfaces for fault diagnosis, recording vehicle data, and interacting with onboard communication systems. It plays a crucial role in the vehicle's electronic systems, ensuring the vehicle's safety, comfort, and functionality.

[0031] After CEM receives the command to unfold the ceiling screen, it determines that the user needs to unfold the ceiling screen for use. At this time, it is necessary to determine the current operating mode of the ceiling screen to meet the viewing needs under different circumstances.

[0032] If the current operating mode is follow mode, it indicates that the user has a need to follow. Therefore, the first step is to identify the effective follow target in follow mode. The effective follow target is the user with the highest priority within the followable range. After identifying the effective follow target, the movement of the effective follow target is monitored in real time. The effectiveness of the movement is judged based on the effective follow target's movement speed and the followable range of the ceiling-mounted screen. This is because the effective follow target may perform distracting actions such as "looking down to pick something up" or "turning around to talk," making it impossible to identify the effective follow target's eyes within the followable range, thus preventing follow-up. Furthermore, if the effective follow target's movement speed is too fast, it may lead to delayed follow-up, resulting in failure to follow. Therefore, it is necessary to judge the effectiveness of the movement to ensure the effectiveness of follow-up.

[0033] In some embodiments, the control method for the ceiling-mounted screen further includes:

[0034] In response to the current operating mode being fixed, the historical control angle of the ceiling screen is determined, the ceiling screen is extended to the historical control angle, and the ceiling screen is kept at the historical control angle.

[0035] In practice, after confirming the user's need to unfold the ceiling-mounted screen, if the current operating mode is fixed, to ensure the unfolding conforms to the user's usage habits, it's necessary to determine the historical control angle of the ceiling-mounted screen. The historical control angle is the control angle of the ceiling-mounted screen before the user last retracted it. This control angle includes two dimensions: the unfolding angle and the rotation angle. For example, the ceiling-mounted screen in its fully retracted state is as follows: Figure 2 As shown, an angle control mechanism connected to the vehicle roof is installed between the ceiling-mounted screen and the roof. This mechanism includes a hinge shaft connected to the roof and a rotation shaft connecting the ceiling-mounted screen and the hinge shaft. The hinge shaft adjusts the unfolding angle, and the rotation shaft adjusts the rotation angle. The unfolding angle is the angle between the plane of the ceiling-mounted screen and the plane of the vehicle roof when the ceiling-mounted screen's rotation angle is 0, i.e., the angle of rotation of the hinge shaft relative to the roof (assuming the unfolding angle is 0 when the ceiling-mounted screen is fully retracted). The rotation angle is the angle of rotation of the rotation shaft (assuming the rotation angle is 0 when the ceiling-mounted screen is fully retracted).

[0036] Therefore, the historical control angle includes the historical unfolding angle and the historical rotation angle. Unfolding the ceiling screen to the historical control angle can include two processes: keeping the rotation angle at 0, unfolding the ceiling screen to the historical unfolding angle, and then controlling the ceiling screen to rotate to the historical rotation angle after unfolding to the historical unfolding angle. Since the historical control angle is the control angle when the user last used the ceiling screen, it is more in line with the user's recent usage habits of the ceiling screen, thus improving the user experience.

[0037] After confirming that the current operating mode is fixed, it indicates that the user does not have a need for following the user's preferences. Therefore, the ceiling-mounted screen can be kept at its historical control angle, ensuring it is controlled at an angle consistent with the user's habits. If the user selects the one-click restore function, the ceiling-mounted screen will unfold to a preset default control angle; for example, an unfolding angle of 45° and a rotation angle of 0° will be set as the default control angle. Then, in fixed mode, the user can manually adjust the display's control angle to a comfortable position, improving control flexibility.

[0038] Step 102: In response to the effective movement action, determine the target angle corresponding to the end position of the movement action, and control the ceiling screen to follow the effective target according to the target angle.

[0039] In practice, if the movement is effective, it is necessary to further determine how to adjust the angle to achieve eye tracking of the target. The process of determining the target angle is as follows:

[0040] In some embodiments, determining the target angle corresponding to the end position of the movement action includes:

[0041] Step 1021: Determine the initial following area within the followable range based on the ending position.

[0042] In practice, the tracking range is pre-divided into multiple areas, each corresponding to a different control angle. The more areas there are, the more precise the angle adjustment, and the more obvious the tracking effect. The division process can be as follows: 40-50 cm above the rear seats is a small range 1, and above 50 cm is a small range 2; 40-50 cm above the second rear seats is a small range 3, and above 50 cm is a small range 4. Each small range is further divided into three sub-ranges: left, center, and right, resulting in 12 areas, each corresponding to a control angle.

[0043] After the movement ends, the eye position of the target is determined by facial recognition at the end position, and the sub-region containing the eye position is used as the initial following region.

[0044] Step 1022: Determine the initial control angle corresponding to the initial following area based on the preset regional angle relationship.

[0045] In practice, the regional angle relationship refers to the relationship between different sub-regions and their corresponding most comfortable control angles when the seat is not adjusted in the test scenario. Therefore, after determining the initial following region, the initial control angle corresponding to the initial following region is determined as the most comfortable control angle at that time.

[0046] Step 1023: Correct the initial control angle based on the current seat angle to obtain the target angle.

[0047] In practice, the initial control angle is the most comfortable control angle when the seat angle is not adjusted under test conditions. During actual follow-up, users can adjust the corresponding seat angle at any time to switch between sitting, semi-reclining, and fully reclining postures. Therefore, the initial control angle needs to be corrected according to different user postures. The user posture is reflected by the current seat angle. The more detailed the posture classification, the higher the accuracy of the angle correction, and the better the final follow-up effect. For example, if the current seat angle is 0-25°, the user's current posture is determined to be sitting, and the initial control angle can be maintained. If the current seat angle is 25°-50°, and the user's current posture is determined to be semi-reclined, the initial control angle's unfolding angle is slightly increased (e.g., using a correction factor of 1.1) (the rotation angle can also be changed synchronously, or it can remain unchanged; this is not limited here), to obtain the target angle. If the current seat angle is 50-75°, and the user's current posture is determined to be fully reclined, the initial control angle's unfolding angle is increased by a larger margin (e.g., using a correction factor of 1.3) (the rotation angle can also be changed synchronously, or it can remain unchanged; this is not limited here), to obtain the target angle. By correcting the initial control angle, it is ensured that the target angle allows the ceiling-mounted screen to provide a comfortable viewing experience for users in different sitting postures.

[0048] Once the target angle is determined, the ceiling-mounted screen can follow the target effectively. It can automatically adjust the control angle of the ceiling-mounted screen according to the user's movement. In follow mode, the opening and closing angle of the ceiling-mounted screen can be automatically adjusted according to the user's eye angle when sitting, so as to provide the user with a comfortable viewing experience.

[0049] Step 103: In response to the invalidation of the movement action, determine the temporary stopping angle corresponding to the last valid position of the movement action, and control the ceiling screen to stay at the temporary stopping angle.

[0050] In practice, if a movement action is invalid, it indicates that the target being followed has performed a disruptive action such as "looking down to pick something up" or "turning around to talk." In this case, it is necessary to determine the temporary stopping angle corresponding to the last valid position of the movement action. The last valid position is the last position identified before the movement action was determined to be invalid. For example, if the user performs a disruptive action such as "looking down to pick something up," the movement action is determined to be invalid when the distance between the target's eyes and the seat is less than 40cm (out of the followable range). The sub-area corresponding to when the user moves out of the valid range is then determined as the target area, and the control angle corresponding to this target area is taken as the temporary stopping angle. The ceiling-mounted screen is controlled to stay at the temporary stopping angle until a new valid movement action is detected, after which the target is followed again to ensure the viewing experience of the target being followed.

[0051] In summary, the ceiling-mounted screen control method provided in this application, in follow mode, prioritizes the user experience of high-priority users by determining a valid following target inside the vehicle. Before following, the validity of the movement action is judged to avoid interference from other actions affecting the ceiling-mounted screen's following. When the movement action is valid, following is performed based on the target angle at the end position of the movement action, achieving true following of the ceiling-mounted screen and ensuring a comfortable viewing experience for the user. When the movement action is invalid, the ceiling-mounted screen is controlled to remain at a temporary stopping angle to avoid erroneous following caused by interference. By judging validity, different control strategies are adopted for different situations, ensuring the ceiling-mounted screen's following sensitivity while avoiding erroneous following and improving the user experience.

[0052] In some embodiments, such as Figure 3 As shown, valid tracking targets are determined based on the in-vehicle scanning images from the ceiling-mounted screen, including:

[0053] Step 301: Determine the in-vehicle scan image, identify at least one object by recognizing the in-vehicle scan image, and determine the relative height of the eye of each object relative to the upper surface of the seat support.

[0054] In practice, determining the effective target to follow first requires acquiring image information from inside the vehicle. This image information is typically a scanned image of the vehicle's interior from the ceiling-mounted screen. Using the ceiling-mounted screen itself to determine the corresponding in-vehicle scan image ensures the best recognition effect for the effective target to follow. If in-vehicle scan images from other cameras are used to determine the effective target to follow, the resolution and other parameters of the ceiling-mounted screen's cameras may differ from those of other cameras. Therefore, the in-vehicle scan images acquired by other cameras may have poor compatibility with the facial recognition algorithm within the ceiling-mounted screen. Thus, using the in-vehicle scan images acquired by the ceiling-mounted screen itself to determine the effective target to follow is the most accurate method.

[0055] In some embodiments, the in-vehicle scan image is obtained by the ceiling-mounted screen during the process of rotating from the historical control angle as the starting angle to the maximum limit angle and then rotating in the opposite direction to the reverse maximum limit angle.

[0056] In specific implementation, Figure 4 Taking the three-row seating scenario shown as an example, a three-row seat vehicle includes the driver's seat on the left side of the first row, the front passenger seat on the right side of the first row, two separate independent seats in the rear row, namely the left independent seat on the left side of the vehicle and the right independent seat on the right side of the vehicle, and the second row of seats in the third row, which is the last row. The second row of seats is a one-piece seat. A ceiling-mounted screen is installed between the rear row of seats and the first row of seats to meet the viewing needs of the rear row users and the second row users.

[0057] To ensure scanning quality and avoid missed scans, the ceiling-mounted screen needs to be rotated in one direction to its maximum limit angle (e.g., 45°), and then rotated in the opposite direction to its maximum limit angle (e.g., -45°). The camera must remain on during the rotation process, and the image captured during the rotation will be the in-vehicle scan image.

[0058] The process of determining a valid following target includes the following two scenarios. For example, if the historical control angle is the default control angle, after the ceiling-mounted screen is extended to the default control angle, it rotates 45° to the left and then 90° to the right to obtain an in-vehicle scan image. Then, facial recognition is performed on the rear row users and the second-to-last row users in the in-vehicle scan image (priority given to the second-to-last row users). If the captured facial information is already recorded in the system, the priority is determined according to the order of recording (the following target can be changed via voice). If the captured facial information is not in the system, priority is given to following the passenger on the left side of the rear row, sitting in the left independent seat (the following target can be changed via voice).

[0059] If the historical control angle is not the default control angle, after the ceiling screen is unfolded to the default control angle, it rotates 45° to the left and then 90° to the right to obtain the in-vehicle scan image. Then, facial recognition is performed on the rear row users and the second-to-last row users in the in-vehicle scan image (prioritizing the second-to-last row users). If the captured facial information has been recorded in the system, the priority is determined according to the order of recording, and the user whose facial information was recorded first is taken as the effective tracking target (the tracking target can be changed by voice). If the captured facial information is not in the system, the passenger sitting on the left side of the rear row in the left independent seat is taken as the effective tracking target (the tracking target can be changed by voice).

[0060] When performing facial recognition on rear-row and second-row users in the in-vehicle scan image, only facial information of users whose eyes are a certain distance above the seat (e.g., 40 cm) needs to be recognized. This is to avoid the impact on the use of the rear-row and second-row seats caused by children frequently rotating the ceiling screen due to their active nature when sitting in the seat and watching it.

[0061] After determining the in-vehicle scan image, facial recognition is performed on it. If there are users in both the first and right independent seats in the second row, and one user on the left side of the second row, then three users can be identified through facial recognition. Each user is then evaluated for validity to avoid interference from moving children on the ceiling-mounted screen. Since children and adults have significant height differences, their facial height while seated varies considerably. Therefore, the relative height of each user's eyes to the seat's upper surface is used to determine their validity, thus preventing children from affecting the screen's tracking ability. The seat's upper surface refers to the plane containing the seat's support structure, which can be simply understood as the upper surface of the seat cushion.

[0062] Step 302: Identify objects with a relative height greater than or equal to a preset height threshold as followable objects, and determine whether there is facial recognition information corresponding to the followable objects.

[0063] In practice, if the relative height is greater than or equal to a preset height threshold (e.g., 40 cm), the user is considered a valid followable object and is thus designated as such. After identifying a followable object, there may be more than one. In this case, it is necessary to determine the target object with the highest following priority among the followable objects and designate it as the wired following target.

[0064] First, it is determined whether there is facial recognition information corresponding to the followable object. Since only the vehicle owner and users authorized by the vehicle owner can register facial information, users with facial recognition information have a higher follow priority.

[0065] Step 303: In response to the presence of face registration information, determine the valid follow target among the followable objects based on the face registration information.

[0066] In practice, if facial recognition information exists, it means that the vehicle owner or a user authorized by the vehicle owner exists among the followable targets. In this case, it is necessary to determine the following priority of at least one followable target corresponding to the facial recognition information to identify the valid followable target with the highest following priority. The process of determining the valid followable target among the followable objects based on facial recognition information is as follows:

[0067] In some embodiments, determining a valid tracking target among trackable objects based on facial recognition information includes:

[0068] Step 3031: Determine the face registration time of each followable object based on the face registration information, and determine the earliest face registration time among multiple face registration times.

[0069] In practice, the face registration time of each followable object is used as the basis for determining the following priority. Since the vehicle owner usually registers various privacy information (such as fingerprints, faces, etc.) to ensure vehicle security, it is believed that the earlier the face registration time, the higher the following priority of the corresponding followable object. Therefore, after determining the face registration time of each followable object with face registration information, the earliest face registration time needs to be determined among multiple face registration times. The earliest face registration time corresponds to the highest following priority in this judgment.

[0070] For example, if the followable objects include User 1 sitting in the left individual seat, User 2 sitting in the right individual seat, and User 3 sitting on the left side of the second row of seats. If User 1's face registration time is May 13, XXXX, User 2's face registration time is April 15, XXXX, and User 3's face registration time is July 13, XXXX, then User 2's face registration time is earlier than User 1's face registration time, earlier than User 3's face registration time, and the earliest face registration time is User 2's April 15, XXXX.

[0071] Step 3032: Identify the followable object corresponding to the earliest face registration time as the effective follow target.

[0072] In practice, since earlier face registration times correspond to higher follow priority, the earliest face registration time corresponds to the highest follow priority. Therefore, the followable object corresponding to the earliest face registration time is determined as the effective follow target, ensuring that the car owner can be prioritized for follow control, thus improving the car owner's user experience. For example, if User 2's face registration time is earlier than User 1's face registration time and earlier than User 3's face registration time, and the earliest face registration time is User 2's April 15th, then User 2 is the effective follow target.

[0073] Step 304: In response to the absence of face registration information, determine the valid follow target based on the seat position of the followable object.

[0074] In practice, if the followable targets include User 1 sitting in the left independent seat, User 2 sitting in the right independent seat, and User 3 sitting on the left side of the second row of seats, and none of Users 1, 2, or 3 have pre-registered their facial information, it means that the followable targets are all new users. In this case, it is necessary to use other follow priority sorting methods to determine the effective follow targets. By assigning a corresponding follow priority to each seat, the followable targets can be prioritized based on the user's seat position. The process of determining the effective follow targets based on the seat position of the followable targets is as follows:

[0075] In some embodiments, determining a valid following target based on the seating position of the followable object includes:

[0076] Step 3041: Determine the following priority of each seat position according to the preset seat priority sequence, and determine the highest following priority among multiple following priorities.

[0077] In practice, the distance from the driver's seat can be used as the criterion for determining the following priority of seat positions. The following priority of the first-row seats is higher than that of the second-to-last-row seats, and the following priority of the seat behind the driver's seat (usually on the left) is higher than that of the seat behind the front passenger seat (usually on the right). Therefore, the preset seat priority sequence can be: the following priority of the left-side independent seat is higher than that of the right-side independent seat, which is higher than that of the second-to-last-row seats. Within the second-to-last-row seats, the following priority of the left-side position is higher than that of the right-side position.

[0078] For example, if the followable objects include user 1 sitting in the left independent seat, user 2 sitting in the right independent seat, user 3 sitting on the left side of the second row of seats, and user 4 sitting on the left side of the second row of seats, and user 1, user 2, user 3, and user 4 have not registered their facial information in advance, then user 1 has a higher follow priority than user 2, user 2 has a higher follow priority than user 3, user 3 has a higher follow priority than user 4, and the highest follow priority among the multiple follow priorities is user 1.

[0079] Step 3042: Determine the followable object corresponding to the highest follow priority as the effective follow target.

[0080] In practice, the user with the highest following priority among the followable objects is identified as the effective following target. The ceiling-mounted screen is controlled to follow the user's angle adjustment first, so as to ensure the user experience of the user with high following priority.

[0081] By prioritizing the target to follow, interference from users (such as children) can be avoided. At the same time, when there are multiple users, it can ensure that the user with the highest priority is followed, avoiding repeated switching of the target during the following process, ensuring the effectiveness of the ceiling-mounted screen follow and improving the user experience.

[0082] In some embodiments, such as Figure 5 As shown, the validity of a movement action is determined based on the movement speed of the target being effectively followed and the tracking range of the ceiling-mounted screen, including:

[0083] Step 501: In response to the absence of an effective target eye within the followable range, determine the duration of disappearance. If the duration of disappearance is greater than or equal to a preset first duration threshold, determine that the range following condition is not met; if the duration of disappearance is less than the preset first duration threshold, determine that the range following condition is met.

[0084] In practice, when controlling the ceiling-mounted screen to follow, it is necessary to avoid interfering actions such as "looking down to pick something up" or "turning around to talk" of the target being followed. Therefore, the effectiveness of the movement action is judged based on the moving speed of the target being followed and the following range of the ceiling-mounted screen.

[0085] First, it's necessary to determine if there's a valid target's eye within the tracking range. If not, it indicates the user may have performed distracting actions like "looking down to pick something up" or "turning around to talk," causing their eye to move out of the tracking range and the ceiling-mounted screen to lose its target. In this case, it's necessary to further determine the duration of the eye's disappearance. If the duration is greater than or equal to a preset first duration threshold, it means the user has been performing distracting actions for an extended period and has no need to view the ceiling-mounted screen; in this case, the tracking can be paused, confirming that the range tracking condition is not met. If the duration is less than the preset first duration threshold, it means the user has only performed a brief distracting action and still has a need to view the ceiling-mounted screen; in this case, the tracking control of the ceiling-mounted screen should continue based on the movement to confirm that the range tracking condition is met.

[0086] Step 502: In response to the presence of an eye with a valid target within the tracking range and a movement speed greater than or equal to a preset speed threshold, determine the duration of overspeed. If the duration of overspeed is greater than or equal to a preset second duration threshold, determine that the speed tracking condition is not met; if the duration of overspeed is less than the preset second duration threshold, determine that the speed tracking condition is met.

[0087] In practice, if there is an eye of the target within the tracking range, it means that the user has not performed any interfering actions that would cause them to leave the tracking range, such as "looking down to pick something up" or "turning around to talk." However, there may be rapid movement. If the user follows the rapid movement, the rapid rotation of the ceiling-mounted screen may damage the angle control mechanism of the screen. However, if the rapid movement is short, the ending position of the movement will not be affected by the short-term rapid movement. The user can follow the movement based on the ending position of the movement. Therefore, it is necessary to determine whether the movement will damage the angle control mechanism based on the duration of the overspeed movement. If the duration of the overspeed movement is greater than or equal to the preset second duration threshold, it indicates that the user's prolonged rapid movement may cause frequent changes in the ending position within a short period of time, which could damage the angle control mechanism. Furthermore, the user moving rapidly does not have a need to view the ceiling-mounted screen, thus the speed following condition is not met. If the duration of the overspeed movement is less than the preset second duration threshold, it indicates that the user only performed rapid movement for a short period of time, and the ending position will not change frequently within that short period of time. The ceiling-mounted screen does not need to perform frequent rapid following actions, thus it will not damage the angle control mechanism. Furthermore, the user may still have a need to view the ceiling-mounted screen after the rapid movement ends, thus the speed following condition is met.

[0088] Step 503: In response to the existence of a valid target within the followable range and the moving speed being less than a preset speed threshold, determine that the speed following condition is met.

[0089] In practice, if there is a valid target within the tracking range, it means that the valid target has not made any interference actions and has a need to view the ceiling screen. If the movement speed is less than the preset speed threshold, it means that the user has not moved quickly and will not move the ceiling screen frequently, which will not damage the angle control mechanism. If the speed tracking condition is met, the movement of the priority target should be followed to ensure the viewing experience of the valid target.

[0090] Step 504: In response to the simultaneous satisfaction of the speed following condition and the range following condition, determine that the movement action is valid.

[0091] In practice, if both speed following and range following conditions are met, it means that the eyes of the target being followed are within the following range and there is a need to continue watching the ceiling screen. Furthermore, the target being followed has not moved rapidly for an extended period of time, so it will not damage the angle control mechanism. This confirms that the movement is effective and can be followed based on the movement, thus avoiding the need for the target being followed to manually adjust the angle of the ceiling screen and improving the viewing experience of the target being followed.

[0092] Step 505: In response to the existence of unmet conditions in the speed follow condition and range follow condition, determine that the movement action is invalid.

[0093] In practice, if any of the speed following conditions or range following conditions are not met, it means that the user does not have a need to view the ceiling screen or frequently rotate the ceiling screen. In this case, there is no need to follow, and the movement action is determined to be invalid.

[0094] It should be noted that the method in this embodiment can be executed by a single device, such as a computer or server. The method can also be applied in a distributed scenario, where multiple devices cooperate to complete the task. In such a distributed scenario, one of these devices may execute only one or more steps of the method in this embodiment, and the multiple devices will interact with each other to complete the method described.

[0095] It should be noted that the above description describes some embodiments of this application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in a different order than that shown in the above embodiments and still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0096] Based on the same inventive concept, and corresponding to any of the above embodiments, this application also provides a control device for a ceiling-mounted screen.

[0097] refer to Figure 6 The control device for the ceiling-mounted screen includes:

[0098] The action judgment module 10 is configured to: in response to receiving the unfolding command of the ceiling screen and the current operating mode of the ceiling screen is the follow mode, determine the effective follow target based on the in-vehicle scanning image of the ceiling screen, determine the movement action of the effective follow target, and judge the effectiveness of the movement action based on the movement speed of the effective follow target and the followable range of the ceiling screen.

[0099] The target following module 20 is configured to: in response to a valid movement action, determine the target angle corresponding to the end position of the movement action, and control the ceiling screen to follow the valid target based on the target angle;

[0100] The stay-follow module 30 is configured to: in response to an invalid movement action, determine a temporary stay angle corresponding to the last valid position of the movement action, and control the ceiling screen to stay at the temporary stay angle.

[0101] For ease of description, the above devices are described in terms of function, divided into various modules. Of course, in implementing this application, the functions of each module can be implemented in one or more software and / or hardware.

[0102] The apparatus described above is used to implement the control method of the corresponding ceiling screen in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0103] Based on the same inventive concept, corresponding to the methods of any of the above embodiments, this application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the control method of the ceiling-mounted screen described in any of the above embodiments.

[0104] Figure 7 This embodiment illustrates a more specific hardware structure of an electronic device, which may include a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, memory 1020, input / output interface 1030, and communication interface 1040 are interconnected internally via the bus 1050.

[0105] The processor 1010 can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0106] The memory 1020 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program code is stored in the memory 1020 and is called and executed by the processor 1010.

[0107] The input / output interface 1030 is used to connect input / output modules to realize information input and output. Input / output modules can be configured as components within the device (not shown in the figure) or externally connected to the device to provide corresponding functions. Input devices may include keyboards, mice, touchscreens, microphones, various sensors, etc., while output devices may include displays, speakers, vibrators, indicator lights, etc.

[0108] The communication interface 1040 is used to connect a communication module (not shown in the figure) to enable communication between this device and other devices. The communication module can communicate via wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).

[0109] Bus 1050 includes a pathway for transmitting information between various components of the device, such as processor 1010, memory 1020, input / output interface 1030, and communication interface 1040.

[0110] It should be noted that although the above-described device only shows the processor 1010, memory 1020, input / output interface 1030, communication interface 1040, and bus 1050, in specific implementations, the device may also include other components necessary for normal operation. Furthermore, those skilled in the art will understand that the above-described device may only include the components necessary for implementing the embodiments of this specification, and not necessarily all the components shown in the figures.

[0111] The electronic devices described above are used to implement the control methods of the corresponding ceiling-mounted screens in any of the foregoing embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0112] Based on the same inventive concept, corresponding to the methods of any of the above embodiments, this application also provides a non-transitory computer-readable storage medium that stores computer instructions for causing the computer to execute the ceiling-mounted screen control method as described in any of the above embodiments.

[0113] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transfer medium that can be used to store information accessible by a computing device.

[0114] The computer instructions stored in the storage medium of the above embodiments are used to cause the computer to execute the control method of the ceiling screen as described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0115] Based on the same inventive concept, corresponding to any of the above embodiments, this application also provides a vehicle, including the electronic device or ceiling screen control device of the above embodiments, and executes the ceiling screen control method as described in any of the above embodiments through the electronic device or ceiling screen control device of the above embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0116] It is understood that before using the technical solutions of the various embodiments in this disclosure, users will be informed of the type, scope of use, and usage scenarios of the personal information involved in an appropriate manner, and user authorization will be obtained.

[0117] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose, based on the prompt message, whether to provide personal information to the software or hardware such as electronic devices, applications, servers, or storage media performing the operations of this disclosed technical solution.

[0118] As an optional but not limited implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0119] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0120] Those skilled in the art should understand that the discussion of any of the above embodiments is merely exemplary and is not intended to imply that the scope of this application is limited to these examples; under the concept of this application, the technical features of the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations of different aspects of the embodiments of this application as described above, which are not provided in detail for the sake of brevity.

[0121] Additionally, to simplify the description and discussion, and to avoid obscuring the embodiments of this application, the well-known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided drawings. Furthermore, the apparatus may be shown in block diagram form to avoid obscuring the embodiments of this application, and this also takes into account the fact that the details of the implementation of these block diagram apparatuses are highly dependent on the platform on which the embodiments of this application will be implemented (i.e., these details should be fully understood by those skilled in the art). While specific details (e.g., circuits) have been set forth to describe exemplary embodiments of this application, it will be apparent to those skilled in the art that the embodiments of this application can be implemented without these specific details or with variations thereof. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0122] Although this application has been described in conjunction with specific embodiments thereof, many substitutions, modifications, and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may be used with the embodiments discussed.

[0123] The embodiments of this application are intended to cover all such substitutions, modifications, and variations that fall within the broad scope of the claims of this application. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the embodiments of this application should be included within the protection scope of this application.

Claims

1. A control method for a ceiling-mounted screen, characterized in that, include: In response to receiving an unfolding command from the ceiling-mounted screen, and the current operating mode of the ceiling-mounted screen is follow mode, a valid follow target is determined, the movement action of the valid follow target is determined, and the validity of the movement action is judged based on the movement speed of the valid follow target and the followable range of the ceiling-mounted screen. In response to the effective movement action, a target angle corresponding to the end position of the movement action is determined, and the ceiling-mounted screen is controlled to follow the effective target according to the target angle; In response to the invalidation of the movement action, a temporary stopping angle corresponding to the last valid position of the movement action is determined, and the ceiling screen is controlled to stop at the temporary stopping angle.

2. The control method for a ceiling-mounted screen according to claim 1, characterized in that, The determination of a valid following target includes: The in-vehicle scan image is determined, and at least one object is identified by recognizing the in-vehicle scan image, and the relative height of the eye of each object relative to the upper surface of the seat is determined; The identification object whose relative height is greater than or equal to a preset height threshold is identified as a followable object, and it is determined whether there is facial recognition information corresponding to the followable object; In response to the existence of the facial recognition information, the effective following target is determined from the followable objects based on the facial recognition information; In response to the absence of the facial recognition information, the effective following target is determined based on the seat position of the followable object.

3. The control method for a ceiling-mounted screen according to claim 2, characterized in that, The in-vehicle scan image is obtained by the ceiling screen during the process of rotating from the historical control angle to the maximum limit angle and then rotating in the opposite direction to the reverse maximum limit angle.

4. The control method for a ceiling-mounted screen according to claim 2, characterized in that, The step of determining the effective tracking target among the trackable objects based on the facial recognition information includes: The face registration time of each followable object is determined based on the face registration information, and the earliest face registration time is determined among multiple face registration times. The followable object corresponding to the earliest face registration time is determined as the effective follow target.

5. The control method for a ceiling-mounted screen according to claim 2, characterized in that, Determining the effective following target based on the seat position of the followable object includes: The following priority is determined for each seat position according to the preset seat priority sequence, and the highest following priority is determined among multiple following priorities; The followable object corresponding to the highest follow priority is determined as the effective follow target.

6. The control method for a ceiling-mounted screen according to claim 1, characterized in that, The determination of the effectiveness of the movement action based on the moving speed of the effective target and the tracking range of the ceiling-mounted screen includes: In response to the absence of the eye of the effective target within the trackable range, the duration of disappearance is determined. If the duration of disappearance is greater than or equal to a preset first duration threshold, the range tracking condition is determined not to be met; if the duration of disappearance is less than the preset first duration threshold, the range tracking condition is determined to be met. In response to the presence of the eye of the effective target within the trackable range, and the movement speed being greater than or equal to a preset speed threshold, the duration of overspeed is determined. If the duration of overspeed is greater than or equal to a preset second duration threshold, the speed tracking condition is determined not to be met; if the duration of overspeed is less than the preset second duration threshold, the speed tracking condition is determined to be met. In response to the existence of the effective target within the followable range and the movement speed being less than a preset speed threshold, it is determined that the speed following condition is met; In response to the simultaneous satisfaction of the speed following condition and the range following condition, the movement action is determined to be valid; If any of the speed following conditions and the range following conditions are not met, the movement action is determined to be invalid.

7. The control method for a ceiling-mounted screen according to claim 1, characterized in that, Determining the target angle corresponding to the end position of the movement includes: The initial following area is determined based on the ending position within the following range; The initial control angle corresponding to the initial following area is determined based on the preset regional angle relationship; The initial control angle is corrected based on the current seat angle to obtain the target angle.

8. The control method for a ceiling-mounted screen according to claim 1, characterized in that, Also includes: In response to the current operating mode being a fixed mode, the historical control angle of the ceiling screen is determined, the ceiling screen is unfolded to the historical control angle, and the ceiling screen is controlled to remain at the historical control angle.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the program, it implements the method as described in any one of claims 1 to 8.

10. A vehicle, characterized in that, Including the electronic device as described in claim 9.

Images