Control method and device for lighting equipment of vehicle door panel

By setting up a light effect interaction area on the vehicle door panel, collecting and recognizing the user's hand movements, and determining the optical parameters of the light effect display area, the problem of the difficulty in finely controlling lighting equipment in the existing technology is solved, personalized light effect display is realized, and the user interaction experience is improved.

CN122009014AActive Publication Date: 2026-05-12YANFENG INTERNATIONAL AUTOMOTIVE TECHNOLOGY CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
YANFENG INTERNATIONAL AUTOMOTIVE TECHNOLOGY CO LTD
Filing Date
2026-04-14
Publication Date
2026-05-12

AI Technical Summary

Technical Problem

Existing vehicle interior lighting equipment is difficult to control precisely, making it inconvenient for users in non-driver positions to adjust, thus affecting the user experience.

Method used

By setting up a light effect interaction area on the vehicle door panel, the interaction signals of the user's hand movements are collected, the finger position coordinates are identified, the optical parameters of the light effect display area are determined using the interaction model, and the lighting equipment is controlled to achieve personalized light effect display.

Benefits of technology

It improves the vehicle's interactive perception capabilities and real-time response characteristics, enhances the user's interactive experience while riding in the vehicle, and creates a fun and interesting light and shadow atmosphere.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122009014A_ABST
    Figure CN122009014A_ABST
Patent Text Reader

Abstract

The invention relates to a control method and device for lighting equipment of a vehicle door panel. The control method comprises the following steps: in response to a hand action of a user in a lighting effect interaction area of a door plate, collecting an interaction signal of the user for the door plate; based on the interaction signal, identifying a position coordinate of a finger of the user relative to the light effect interaction area; determining optical parameters of a lighting effect display area of the door panel based on the interaction signals and the position coordinates by using an interaction model; and controlling a lighting device of the door panel based on the optical parameter. Based on action interaction between the user and the door panel area, the corresponding lighting device is controlled to present the lighting effect pattern, so that the lighting effect of the vehicle is improved, and the interaction experience between the user and the vehicle is optimized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of vehicles, and more specifically, to a control method and apparatus for lighting devices for vehicle door panels, a vehicle, a computing device, a storage medium, and a program product. Background Technology

[0002] With the continuous development of the automotive industry, vehicles are no longer merely seen as a means of transportation, but have gradually evolved into personalized mobile spaces that integrate travel, rest, and entertainment. To create a more comfortable, pleasant, and stylish driving environment, interior lighting equipment is increasingly being used in modern cars. This lighting equipment typically includes LED light strips embedded in door panels, center consoles, and footwells, creating various colors and brightness levels of light effects at different points in the occupants' field of vision. Through precise control of these light patterns, the visual depth and design aesthetics of the interior can be enhanced, providing users with a superior travel experience. Summary of the Invention

[0003] The purpose of this disclosure is to provide a control method for a lighting device for a vehicle door panel, so as to improve the user's interactive experience when using the vehicle's lighting function.

[0004] According to a first aspect of this disclosure, a method for controlling a lighting device for a vehicle door panel is provided, comprising: acquiring an interaction signal from a user to the door panel in response to a hand movement in a light effect interaction area of ​​the door panel; identifying the position coordinates of the user's finger relative to the light effect interaction area based on the interaction signal; determining optical parameters of the light effect display area of ​​the door panel based on the interaction signal and the position coordinates using an interaction model; and controlling the lighting device of the door panel based on the optical parameters.

[0005] In some embodiments, hand actions include contact with a pressure sensing device on the door panel, and acquiring user interaction signals with the door panel includes: determining interaction signals based on sensing data identified by the pressure sensing device, wherein the interaction signals include the pressing position and / or pressure value of the finger.

[0006] In some embodiments, determining the optical parameters of the light effect display area of ​​the door panel includes: determining the display position of the interactive pattern in the light effect display area based on the pressing position; and / or determining at least one of the shape, brightness, and color of the interactive pattern based on the pressure value.

[0007] In some embodiments, the hand action includes approaching a capacitive sensing device on a door panel, and the interaction signal includes a capacitive signal determined by the capacitive sensing device based on a detection interval.

[0008] In some embodiments, identifying the position coordinates of a user's finger relative to the light effect interaction area includes: calculating the proximity distance of the finger relative to the light effect interaction area and the projection position coordinates of the finger in the light effect interaction area based on the capacitance signal.

[0009] In some embodiments, determining the optical parameters of the light effect display area of ​​the door panel includes: determining the display position of the interactive pattern in the light effect display area based on the projection position coordinates; and / or determining at least one of the shape, brightness, and color of the interactive pattern based on the proximity distance.

[0010] In some embodiments, acquiring user interaction signals with the door panel includes: determining interaction signals based on images of hand movements acquired by an imaging device of the door panel, wherein the interaction signals include the imaging position of the finger at the time of image acquisition.

[0011] In some embodiments, identifying the position coordinates of a user's finger relative to the light effect interaction area includes: calculating the proximity distance of the finger relative to the light effect interaction area and the projection position coordinates of the finger in the light effect interaction area based on the imaging position.

[0012] In some embodiments, the interaction model defines the interaction pattern in the light effect display area, and determining the optical parameters of the light effect display area of ​​the door panel includes: processing the position coordinates based on the type of the interaction pattern to determine the display position of the interaction pattern in the light effect display area.

[0013] In some embodiments, the type of interactive pattern includes at least one of normal distribution, parabolic, chordal, and pulse patterns.

[0014] In some embodiments, a gesture recognition model is used to identify interaction signals and position coordinates to obtain the user's command gestures; the command gestures are subjected to area dwell determination to determine the dwell state of the command gestures within a preset spatial area; and based on the dwell state and the movement parameters of the command gestures, a mapping output based on the preset spatial area is executed to generate control commands for the vehicle.

[0015] In some embodiments, the mapping output includes a preset event code corresponding to a specified optical parameter; and the control instructions include instructions to adjust the parameters of the lighting device based on the preset event code.

[0016] According to a second aspect of this disclosure, a lighting device control apparatus for a vehicle door panel is provided, comprising: a data acquisition module configured to acquire user interaction signals with the door panel in response to a user's hand movement in a light effect interaction area of ​​the door panel; a calculation module configured to identify the position coordinates of the user's finger relative to the light effect interaction area based on the interaction signals; a determination module configured to determine optical parameters of the light effect display area of ​​the door panel based on the interaction signals and the position coordinates using an interaction model; and a control module configured to control the lighting device of the door panel based on the optical parameters.

[0017] According to a third aspect of this disclosure, a vehicle is provided, comprising: a lighting device disposed at a position corresponding to a light effect display area of ​​a door panel; and a control device configured to perform a control method according to a first aspect of this disclosure.

[0018] According to a fourth aspect of this disclosure, a computing device is provided, comprising: a processor; and a memory storing computer-executable instructions, which, when executed by the processor, cause the processor to perform a method according to a first aspect of this disclosure.

[0019] According to a fifth aspect of this disclosure, a computer-readable storage medium is provided having computer-executable instructions stored thereon, which, when executed by a computer, cause the computer to perform the method according to a first aspect of this disclosure.

[0020] According to a sixth aspect of this disclosure, a computer program product is provided, the computer program product including instructions that, when executed by a processor, implement the method according to a first aspect of this disclosure.

[0021] Other features and advantages of this disclosure will become clearer from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0022] The foregoing and other features and advantages of this disclosure will become clear from the following description of embodiments illustrated in conjunction with the accompanying drawings. The drawings, incorporated herein and forming a part of the specification, are further used to explain the principles of this disclosure and to enable those skilled in the art to make and use it. Wherein: Figure 1 A schematic flowchart of a control method for a lighting device for a vehicle door panel according to some embodiments of the present disclosure is shown; Figures 2A to 2B A schematic diagram of a light effect display area and a light effect interaction area of ​​a vehicle door panel according to some embodiments of the present disclosure is shown; Figures 3A to 3D A schematic diagram of a pressure sensing device for a vehicle door panel according to some embodiments of the present disclosure is shown; Figure 4 A schematic diagram of a capacitive sensing device for a vehicle door panel according to some embodiments of the present disclosure is shown; Figure 5 A schematic diagram of an imaging device for a vehicle door panel according to some embodiments of the present disclosure is shown; Figures 6A to 6C A schematic diagram showing the formation of interactive patterns in a light effect display area according to some embodiments of the present disclosure is shown; Figures 7A to 7E A schematic diagram is shown of an interactive pattern in a light effect display area defined by an interactive model according to some embodiments of the present disclosure; Figures 8A to 8E A schematic diagram is shown of an interactive pattern in a light effect display area defined by an interactive model according to some other embodiments of the present disclosure; Figures 9A to 9E A schematic diagram is shown of an interactive pattern in a light effect display area defined by an interactive model according to further embodiments of the present disclosure; Figure 10 A flowchart illustrating a non-limiting example process of a control method for a lighting device for a vehicle door panel according to some embodiments of the present disclosure is shown; Figure 11 A flowchart illustrating a non-limiting example process for invoking vehicle infotainment system functions according to some embodiments of this disclosure is shown; Figure 12 A schematic block diagram of a lighting device control apparatus for a vehicle door panel according to some embodiments of the present disclosure is shown; Figure 13 A schematic block diagram of a vehicle according to some embodiments of the present disclosure is shown; Figure 14 A schematic block diagram of a computing device according to some embodiments of the present disclosure is shown; Figure 15 A schematic block diagram of a computer system on which embodiments of the present disclosure may be implemented is shown.

[0023] Note that in the embodiments described below, the same reference numerals are sometimes used across different figures to denote the same parts or parts having the same function, and repeated descriptions are omitted. In this specification, similar reference numerals and letters are used to denote similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0024] For ease of understanding, the positions, dimensions, and extents of the structures shown in the accompanying drawings and other materials may not represent actual positions, dimensions, and extents. Therefore, the disclosed invention is not limited to the positions, dimensions, and extents disclosed in the accompanying drawings and other materials. Furthermore, the drawings are not necessarily drawn to scale, and some features may be enlarged to show details of specific components.

[0025] The reference numerals for the main structures or devices in the figure are as follows: 11: Lighting equipment; 20: Light effect display area; 21: Light effect interactive area; 30: Contact surface; 31: Contact surface support layer; 32: Pressure diaphragm; 33: Pressure diaphragm positioning layer; 302: Pressure detection point; 321: Flexible membrane; 322: Identification element; 40: Sensing surface; 41: Sensing surface support layer; 42: Capacitive diaphragm; 43: Capacitive diaphragm positioning layer; 51: Imaging device. Detailed Implementation

[0026] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present disclosure.

[0027] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit this disclosure or its application or use. Those skilled in the art will understand that they merely illustrate exemplary ways that can be used to implement this disclosure, and are not exhaustive.

[0028] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0029] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0030] In related technologies, lighting equipment used for vehicle interiors typically includes ambient lighting that decorates the vehicle and creates an atmosphere. Its main forms of expression are color changes, breathing rhythms, and audio rhythms. When users are in the car, they can control the ambient lighting to turn on / off, adjust brightness, and switch colors via switches on the control panel. These operations require users to press the switches on the control panel, which is usually located near the driver. This makes it difficult for passengers in other seats to make convenient adjustments. Furthermore, the light effect change patterns are preset and fixed, making it difficult to achieve refined lighting effects and affecting the user's interaction experience with the vehicle.

[0031] Based on the above, this disclosure provides a control method for lighting equipment on vehicle door panels. This method identifies the user's hand movements within the corresponding light effect interaction area on the door panel, recognizes the user's input signals to the door panel, identifies the position coordinates of the user's fingers based on the interaction signals, and then determines the specific optical parameters for displaying light effect patterns on the door panel based on these position coordinates. This approach improves the vehicle's interactive perception and real-time response capabilities, including enabling designated light effect display areas such as vehicle door panels to display rich light effects that follow the user's movements. It achieves personalized control of the lighting equipment, creates an engaging light and shadow atmosphere, and enhances the user's interactive experience while riding in the vehicle.

[0032] The control method for lighting equipment used in vehicle interiors will now be described in detail with reference to the accompanying drawings. It will be understood that the actual method may include other steps, but to avoid obscuring the key points of this disclosure, these other steps are not shown in the drawings and will not be discussed herein.

[0033] Please refer to the following first. Figure 1 The diagram illustrates a schematic flowchart of a control method 100 for a lighting device for a vehicle door panel according to some embodiments of the present disclosure. Specifically, the control method 100 includes steps S102 to S108. In step S102, in response to a user's hand movement in the light effect interaction area of ​​the door panel, an interaction signal from the user to the door panel is acquired. In step S104, based on the interaction signal, the position coordinates of the user's finger relative to the light effect interaction area are identified. In step S106, using an interaction model, based on the interaction signal and the position coordinates, optical parameters of the light effect display area of ​​the door panel are determined. And in step S108, based on the optical parameters, the lighting device of the door panel is controlled.

[0034] In this article, "occupant" refers to a person located inside the vehicle, including but not limited to the driver and passengers. "User" refers to an occupant who uses the light-effect interaction function of the vehicle door panel. It is understood that, considering driving safety requirements and the distance between the passenger seat and the door panel, the user who interacts with the door panel usually refers to the passenger seated by the window.

[0035] refer to Figure 2A and Figure 2BThe diagram illustrates a light effect display area and a light effect interaction area on a vehicle door panel according to some embodiments of the present disclosure. Generally, lighting devices for vehicle interiors can be distributed in multiple locations within the vehicle, including but not limited to the door panel (DP) area, instrument panel (IP) area, roof area, and footwell, etc., with each lighting device having fixed three-dimensional coordinates within the vehicle interior space. In the embodiments of the present disclosure, the lighting devices that form interactive light effects on the door panel are typically located near the door panel DP area; however, it is understood that lighting devices in other areas of the vehicle interior can also be used to output light effect patterns on the door panel, which will not be elaborated upon here.

[0036] Specifically, Figure 2A A perspective view of a vehicle door panel is shown, in which a light effect display area 20 is disposed on the inner surface of the door panel, between the window (not shown) and the door retractor structure. Figure 2B It is along Figure 2A The cross-sectional view in the direction of the arrow shows that lighting devices 11-1 and 11-2 (collectively referred to as lighting device 11) are arranged in the upper and lower parts of the light effect display area 20, respectively. In some embodiments, the lighting device 11 may include a sequential array of light sources, which can be controlled individually or in groups to achieve the effect of illuminating the entire light effect display area 20 or illuminating a specific area therein. Further, the light effect interaction area 21 refers to the spatial area for collecting, sensing, or recognizing user hand movements, and can be located near the light effect display area 20 and corresponding to the size dimensions of the light effect display area 20 (e.g., ...). Figure 2B (As shown), it can also be placed in a wider range of spaces inside the vehicle, as long as the boundaries are clear and it is convenient for users to make movements while riding.

[0037] In some embodiments, user hand gestures in the light effect interaction area 21 include both contactless proximity sensing and contact touch operations. The light effect display area 20 can be a soft surface or a hard surface to match the recognition method of the user's hand gestures. Specifically, when the hand gesture to be recognized is a touch operation, the light effect display area 20 needs to be equipped with internal devices such as pressure sensing devices, and the surface material of the light effect display area 20 should be determined in conjunction with the sensitivity of the pressure sensing device; when the hand gesture to be recognized is proximity sensing, the requirements for the surface material of the light effect display area 20 will be reduced accordingly.

[0038] For details, please refer to Figures 3A to 3D The diagram illustrates a pressure sensing device for a vehicle door panel according to some embodiments of the present disclosure. In some embodiments, a user's hand movements in the light-effect interaction area include touching the pressure sensing device of the door panel. Figure 1Step S102, which involves collecting user interaction signals with the door panel, may include determining the interaction signal based on sensing data identified by the pressure sensing device. The interaction signal includes the pressing position and / or pressure value of the finger, wherein the pressing position corresponds to the position coordinates of the user's finger relative to the light effect interaction area.

[0039] like Figure 3A As shown, the pressure sensing device includes a contact surface 30 disposed on the door panel and a pressure diaphragm 32 disposed inside the door panel corresponding to the contact surface 30. In a non-limiting embodiment, the contact surface 30 may be made of a hard 3D textured surface material to improve the sensitivity of pressure sensing. Figure 3B It shows Figure 3A The enlarged structure of the dashed frame includes a contact surface 30 fixedly supported by a contact surface support layer 31, and a pressure diaphragm 32 positioned and supported by a pressure diaphragm positioning layer 33. These four layers are arranged in sequence to form a pressure sensing device for recognizing touch actions.

[0040] Furthermore, Figure 3C A planar schematic diagram of a pressure diaphragm 32 is shown. The pressure diaphragm 32 includes a flexible membrane 321 and an identification element 322 disposed thereon. In a non-limiting embodiment, the number and distribution of the identification elements 322 can be determined based on at least one of factors such as the area of ​​the pressure diaphragm 32, the sensing accuracy of the identification element 322, and the material of the contact surface 30. Figure 3C A non-limiting example of an array of recognition elements 322 disposed on a flexible membrane 321 is shown. Additionally, Figure 3D A perspective view of the contact surface 30 is shown, on which pressure detection points 302 are provided for detecting the pressure position of the user's touch action. It is understood that the number and distribution of the pressure detection points 302 should be the same as or correspond to the recognition element 322 in order to improve the sensing accuracy of the pressure sensing device.

[0041] Alternatively, please refer to Figure 4 The diagram illustrates a capacitive sensing device for a vehicle door panel according to some embodiments of the present disclosure. In some embodiments, a user's hand movement in the light effect interaction area includes approaching the capacitive sensing device of the door panel. Figure 1 Step S102 may further include using a capacitance sensing device as an interaction signal sensing device, and using a capacitance signal determined based on a detection interval as an interaction signal.

[0042] Specifically, the capacitive sensing device includes a sensing surface 40 disposed on the door panel and a capacitive diaphragm 42 disposed inside the door panel corresponding to the sensing surface 40. It is understood that, since the user may not directly contact the door panel surface, the sensing surface 40 can be made of a soft 3D textured material. Similar to... Figure 3BThe structure includes a sensing surface 40 fixedly supported by a sensing surface support layer 41, and a capacitor diaphragm 42 positioned and supported by a capacitor diaphragm positioning layer 43. When a user's finger approaches the sensing surface 40, the original electric field of the capacitor diaphragm 42 changes, and the resulting change in capacitance can be output as a capacitance signal.

[0043] In some embodiments, the capacitance signal can be used to calculate the proximity distance of the user's finger relative to the light effect interaction area and the coordinates of the finger's projected position in the light effect interaction area. For example, in a spatial rectangular coordinate system, the direction of the proximity distance can be taken as the Y-axis, and the coordinates of the projected position can be marked as (X, Z). In a non-limiting embodiment, the process of obtaining the aforementioned coordinates based on the capacitance signal may include: periodically acquiring electrode capacitance signals by the capacitor diaphragm 42 according to a resident detection interval; calculating capacitance data in real time and determining whether the capacitance change corresponding to the capacitance signal triggers a threshold; in response to the capacitance signal reaching the threshold, calculating the distance between the user's finger and the capacitor diaphragm, and then, in combination with the signal distribution of the electrodes on the capacitor diaphragm 42, outputting the detailed position coordinates of the finger.

[0044] Alternatively, please refer to Figure 5 The diagram illustrates an imaging device for a vehicle door panel according to some embodiments of the present disclosure. In some embodiments, a user's hand movements in the light effect interaction area can be captured by the imaging device. Specifically, imaging devices 51-1 and 51-2 (collectively referred to as imaging device 51) are respectively provided on the upper and lower parts corresponding to the light effect display area 20 of the vehicle door panel. It is understood that the number and position of the imaging devices 51 can be customized while meeting the requirements of the vehicle's interior structure and without affecting the light effect pattern of the lighting equipment.

[0045] In a non-limiting embodiment, when a user makes a hand gesture within the light effect interaction area, the imaging device 51 acquires an image of the hand in real time and performs data analysis to determine the imaging position of the finger at the moment of image acquisition as an interaction signal. Figure 4 Similar to the implementation, based on the interaction signal, the proximity distance of the finger relative to the light effect interaction area and the coordinates of the finger's projection position in the light effect interaction area can be calculated.

[0046] Continue to refer to Figure 1 Next, in step S106, based on the interaction signal collected by the aforementioned sensing device and the position coordinates identified by the corresponding data processing operation, the optical parameters of the light effect display area are determined to form an interactive pattern. In some embodiments, the interactive pattern in the light effect display area is defined using an interaction model, and determining its optical parameters includes processing the position coordinates based on the type of the interactive pattern to determine the display position of the interactive pattern in the light effect display area.

[0047] For details, please refer to Figures 6A to 6C The illustration shows a schematic diagram of forming an interactive pattern in a light effect display area according to some embodiments of the present disclosure. Figure 6A The initial state of the light effect display area is shown, where the projection of the light effect interaction area onto the light effect display area determines the size of the area ABDC. Figure 2B The lighting devices 11 shown are located at the top of side AB and the bottom of side CD in the area, forming the initial lighting area EFHG (i.e., the shadowed part and the unshadowed part show different lighting effects). Figure 6B The coordinates P of the user's finger relative to the light effect interaction area are shown, denoted as (X0, Z0). When the finger approaches or touches the light effect interaction area, the light effect display area can be presented as follows: Figure 6C The pattern, in which the two sides EF and GH of the initial light area EFHG form a change in light effect near the position coordinate P.

[0048] In a non-limiting embodiment, such as Figure 6C As shown, the endpoints A of the light effect display area are denoted as (X1, Z1), B as (X2, Z2), C as (X3, Z3), and D as (X4, Z4); the endpoints E of the initial light area are denoted as (X5, Z5), F as (X6, Z6), G as (X7, Z7), and H as (X8, Z8); the endpoints M of the light effect change area are denoted as (X9, Z9), and N as (X1, Z2). 10 Z 10 ), I is denoted as (X 11 Z 11 J is denoted as (X) 12 Z 12 K is denoted as (X 13 Z 13 L is denoted as (X) 14 Z 14 The positions of M and N can be determined using the following relationship:

[0049] Therefore, endpoints M and N, and their coordinate distances from endpoints I, J, K, and L, can affect the shape and area of ​​the light effect variation region. That is, the pattern dividing the light effect variation region with the finger coordinate position P as the origin can be represented by the trajectory from I to M as , the trajectory from M to J as , the trajectory from K to N as , and the trajectory from N to L as .

[0050] The changes in the light effect above the light effect display area can be controlled according to the following expression:

[0051] The changes in light effects below the light effect display area can be controlled using the following expression:

[0052] Furthermore, in some embodiments, the type of interaction pattern can be defined by the interaction model as at least one of pulse type, parabolic type, normal distribution type, and chord curve type.

[0053] Specifically, Figures 7A to 7E The diagram illustrates an interaction pattern defined by a pulse-type interaction model, where the presented pulse interaction pattern primarily comprises rectangular square waves. It can be understood that the coordinates of points M and N are used to define the pulse width (or duty cycle) of the upper light effect change and its amplitude; and to define the pulse width of the lower light effect change and its amplitude. Specifically, Figure 7A The diagram shows pulse-shaped interactive patterns with opposite directions formed by the changes in light effects above and below the light effect display area. This can produce the effect that the peak positions of the two square waves move from the top and bottom towards the center line and follow point P.

[0054] Alternatively, Figure 7B and Figure 7C Another non-limiting example of a pulsed interactive pattern is shown, wherein when the finger position coordinate P is above the horizontal midline of the light effect display area ABDC, only the lower light effect changes to form the pulsed pattern, while the upper light remains unchanged; when point P is below the horizontal midline, only the upper light effect changes to form the pulsed pattern, while the lower light remains unchanged. Alternatively, Figure 7D and Figure 7E Another non-limiting example of a pulse interaction pattern is shown, wherein when the finger position coordinate P moves in the light effect display area, and specifically moves to a range outside the initial light area EFHG, the upper and lower light effect changes form pulse-shaped patterns with the same direction, and the peak direction is from the center line toward the position of point P.

[0055] In other embodiments, Figures 8A to 8E The diagram shows a set of interactive patterns defined by normal distribution or parabolic interaction models. Referring to the aforementioned expression, controlling the change in light effect must satisfy the following:

[0056] Similarly, Figure 8A The pattern shows that the light effect changes in opposite directions on both sides of the light effect display area, wherein the peak position of the light effect pattern moves from the top and bottom towards the center line and follows point P. Figure 8B and 8C A pattern showing a unilateral change in the light effect display area is illustrated; and Figure 8D and Figure 8E The diagram shows patterns on both sides of the light effect display area where the direction of light effect change is the same, and the direction of the peak of the light effect pattern is from the center line toward point P.

[0057] In yet other embodiments, Figures 9A to 9E A set of schematic diagrams defining interaction patterns using a chord-curve type interaction model is shown. For illustrative purposes, trigonometric functions (such as sin) are used in this disclosure. x cos x (etc.) and functions with similar oscillatory properties composed of trigonometric functions (such as sinc) x ,cosc x The graphs of (etc.) are collectively referred to as chord curve type. Figures 9A to 9E The interactive pattern is a non-limiting example of the latter. Referring to the aforementioned expression, controlling the change in light effect can satisfy any of the following relationships: or

[0058] Alternatively, controlling the change in light effect can also satisfy other functional relationships:

[0059] Similarly, Figure 9A It is a pattern in which the light effect changes in opposite directions on both sides of the light effect display area, wherein the peak position of the chord curve pattern moves from the top and bottom towards the center line and does not exceed the horizontal line where point P is located; Figure 9B and 9C A pattern showing a unilateral change in light effect in the light effect display area is shown; Figure 9D The diagram shows a pattern where the direction of light effect change is the same on both sides of the light effect display area, wherein the direction of the peak of the chord curve is from the midline towards point P; and Figure 9E It shows Figure 9AAnother form of interactive pattern in which the peak of the chord curve pattern is directed from the upper and lower sides AB and CD of the light effect display area toward point P, and exceeds the horizontal line where point P is located, thus forming a light effect pattern in which the curves overlap.

[0060] In some embodiments, the optical parameters of the light effect display area include, in addition to the display position of the interactive pattern, the shape, brightness, and color of the interactive pattern. Specifically, the optical parameters such as the shape of the interactive pattern can be determined based on the intensity of the interactive signal, such as in... Figure 8A In the example shown in 9A, the stronger the collected interactive signal, the higher the peak value of the displayed interactive pattern can be controlled, thereby enhancing the interactive experience of the light effect display function for the user.

[0061] In a non-limiting embodiment, reference is made to Figure 3A In the example, when the recognized user hand action includes touching the pressure sensing device on the door panel, the collected interaction signal includes the pressing position and / or pressure value of the user's finger, wherein the pressing position determines the display position of the interactive pattern, and / or the pressure value determines at least one of the shape, brightness, and color of the interactive pattern. For example, in response to greater user pressure, the interactive pattern may be brighter, have a larger peak value, and a deeper color. It is understood that the correspondence between pressure values ​​and different optical parameters can be personalized and preset according to requirements.

[0062] In another non-limiting embodiment, reference is made to... Figure 4 or Figure 5 For example, when the detected user hand movement is not in contact with the door panel, the collected interaction signals include the proximity distance of the user's finger and the coordinates of its projected position. The projection position coordinates determine the display position of the interactive pattern, and / or the proximity distance determines other optical parameters of the interactive pattern. For instance, the closer the user's finger is to the door panel, the brighter and larger the peak value of the interactive pattern can be. Furthermore, if the user's finger continuously changes its proximity distance during movement, the light color of the interactive pattern can change accordingly.

[0063] For the purpose of non-restrictive description, Figure 10 A flowchart illustrating a non-limiting example process 1000 of a control method for a lighting device for a vehicle door panel according to some embodiments of the present disclosure is shown. Figure 10 As shown, process 1000 includes steps S1001 to S1008.

[0064] In step S1001, the lighting equipment on the vehicle door panel is powered on, and the user can begin using the interactive function. When no user hand gestures are detected, the corresponding lighting equipment remains in its normal state, such as maintaining the preset light color and not displaying any light effect patterns (see reference). Figure 6A (Example). In step S1002, in response to the user's hand movement in the light effect interaction area of ​​the door panel, the user's interaction signal with the door panel is acquired. Next, in step S1003, the position coordinates of the user's finger are identified based on the acquired interaction signal.

[0065] Further, in step S1004, using an interactive model, the optical parameters of the light effect display area of ​​the door panel are determined based on the interactive signal acquired in step S1002 and the position coordinates identified in step S1003. Then, in step S1006, the lighting device of the door panel is controlled to form a corresponding light effect pattern according to the determined optical parameters.

[0066] Additionally, in step S1007, the interactive model can be personalized to generate light effect patterns of different shapes. Furthermore, in step S1008, the interactive signal (denoted as 1002) acquired in step S1002 and the finger position coordinates (denoted as 1003) identified in step S1003 can be further processed for invoking vehicle system functions, specifically including invoking the function of controlling the in-vehicle lighting equipment (i.e., the operation in step S1006).

[0067] Furthermore, Figure 11 A flowchart illustrating a non-limiting example of invoking the vehicle's infotainment system (step S1008) in process 1000 described above is shown. Data processing of the interaction signal 1002 and position coordinates 1003 includes steps S1101 to S1105. Specifically, in step S1101, the received signal is filtered to suppress environmental noise, jitter interference, and invalid spurious signals during vehicle movement, avoiding misjudgments and false triggers. Next, in step S1102, a gesture recognition algorithm is used to identify the command gestures represented by the interaction signal 1002 and position coordinates 1003 to distinguish different action types and exclude invalid actions. The gesture recognition algorithm can use template matching, feature classification, or deep learning models. In step S1103, a dynamic threshold is set to adapt to changes in the vehicle's environment and user differences, ensuring the stability of action recognition.

[0068] Subsequently, in step S1104, the identified command gesture is subjected to a region dwell determination to determine the dwell state of the command gesture within a preset spatial area, thereby confirming that the user's gesture is a conscious pause rather than an accidental swipe (i.e., the validity of the command). Then, in step S1105, based on the dwell state and the movement parameters of the command gesture, a spatial region-based mapping output is executed, including mapping different spatial regions and command gestures to specific function parameters according to a preset vehicle system function mapping table or function retrieval command, thereby outputting the corresponding control command.

[0069] Additionally, the mapping output may include preset event codes corresponding to optical parameters. In some embodiments, different user gestures for the lighting device can be mapped to specific parameter adjustment events, such as a swipe gesture from bottom to top in the corresponding light effect interaction area of ​​the door panel, which corresponds to an event of increasing the brightness of the light effect display area; a swipe gesture from left to right, which corresponds to an event of switching colors, etc. Based on this, the control commands output in step S1105 include commands for adjusting the parameters of the lighting device based on the aforementioned preset event codes.

[0070] In some embodiments, control commands may include, but are not limited to, commands for controlling windows and sunshades, commands for adjusting comfort seats, commands for adjusting air conditioning and ventilation, commands for adjusting multimedia volume, and other commands personalized by the user, to complete the interaction loop. In particular, these vehicle infotainment functions also include the ability to display lighting effects on the door panels, meaning that corresponding lighting devices can be controlled by recognizing the user's gesture commands.

[0071] On the other hand, this disclosure also provides another lighting control device for vehicle door panels. Figure 12 A schematic block diagram of a control device 1200 according to some embodiments of the present disclosure is shown. The control device 1200 includes a data acquisition module 1202, a calculation module 1204, a determination module 1206, and a control module 1208. The data acquisition module 1202 is configured to acquire user interaction signals with the door panel in response to a user's hand movement in the light effect interaction area of ​​the door panel. The calculation module 1204 is configured to identify the position coordinates of the user's finger relative to the light effect interaction area based on the interaction signals. The determination module 1206 is configured to determine the optical parameters of the light effect display area of ​​the door panel using an interaction model, based on the interaction signals and position coordinates. The control module 1208 is configured to control the lighting device of the door panel based on the optical parameters.

[0072] In another aspect, this disclosure provides a vehicle. Figure 13 A schematic block diagram of a vehicle 1300 according to some embodiments of the present disclosure is shown. The vehicle 1300 includes a lighting device 11 for a vehicle door panel, a controller 1304, and a signal acquisition device 1306 for interactive signals, etc. The controller 1304 is configured to execute the aforementioned control method for the lighting device 11 for the vehicle door panel. The signal acquisition device 1306 is located at a position corresponding to the light effect interaction area of ​​the door panel and includes at least one of a pressure sensing device, a capacitance sensing device, and an imaging device.

[0073] The control device 1200 and the vehicle 1300 can refer to the various embodiments of the control method 100 mentioned above, which will not be repeated here.

[0074] This disclosure also provides a computing device that may include one or more processors and a memory storing computer-executable instructions, which, when executed by the one or more processors, cause the one or more processors to perform the methods described according to any of the foregoing embodiments of this disclosure. Figure 14 As shown, computing device 1400 may include one or more processors 1402 and memory 1404 storing computer-executable instructions that, when executed by processor 1402, cause processor 1402 to perform the methods described according to any of the foregoing embodiments of this disclosure. Processor 1402 may be, for example, a central processing unit (CPU) of computing device 1400. Processor 1402 may be any type of general-purpose processor, or it may be a processor specifically designed for the control of lighting equipment in vehicle interiors, such as an application-specific integrated circuit (“ASIC”). Memory 1404 may be coupled to processor 1402 and may include various computer-readable media accessible by processor 1402. In various embodiments, memory 1404 described herein may include volatile and non-volatile media, removable and non-removable media. For example, memory 1404 may include any combination of random access memory (“RAM”), dynamic RAM (“DRAM”), static RAM (“SRAM”), read-only memory (“ROM”), flash memory, cache memory, and / or any other type of non-transitory computer-readable media. The memory 1404 may store instructions that, when executed by the processor 1402, cause the processor 1402 to execute the method described according to any of the foregoing embodiments of this disclosure.

[0075] This disclosure also provides a computer-readable storage medium having computer-executable instructions stored thereon, which, when executed by a computer, cause the computer to perform the methods described according to any of the foregoing embodiments of this disclosure.

[0076] This disclosure also provides a computer program product that may include instructions that, when executed by a processor, can implement the methods described according to any of the foregoing embodiments of this disclosure. The instructions may be any set of instructions that will be executed directly by one or more processors, such as machine code, or any set of instructions that will be executed indirectly, such as a script. The instructions may be stored in an object code format for direct processing by one or more processors, or stored in any other computer language, including scripts or sets of independent source code modules that are interpreted on demand or compiled in advance.

[0077] Figure 15This is a schematic block diagram illustrating a computer system 1500 on which embodiments of the present disclosure may be implemented. The computer system 1500 includes a bus 1502 or other communication mechanism for transmitting information, and a processing means 1504 coupled to the bus 1502 for processing information. The computer system 1500 also includes a memory 1506 coupled to the bus 1502 for storing instructions to be executed by the processing means 1504. The memory 1506 may be random access memory (RAM) or other dynamic storage device. The memory 1506 may also be used to store temporary variables or other intermediate information during the execution of instructions to be executed by the processing means 1504. The computer system 1500 also includes a read-only memory (ROM) 1508 or other static storage device coupled to the bus 1502 for storing static information and instructions for the processing means 1504. A storage device 1510, such as a magnetic disk or optical disk, is provided and coupled to the bus 1502 for storing information and instructions. Computer system 1500 may be coupled via bus 1502 to output device 1512 for providing output to a user, such as, but not limited to, a display (such as a cathode ray tube (CRT) or liquid crystal display (LCD)), speakers, etc. Input device 1514, such as a keyboard, mouse, microphone, etc., is coupled to bus 1502 for transmitting information and command selections to processing device 1504. Computer system 1500 may perform embodiments of this disclosure. Consistent with certain implementations of this disclosure, computer system 1500 provides results in response to processing device 1504 executing one or more sequences of one or more instructions contained in memory 1506. Such instructions may be read into memory 1506 from another computer-readable medium, such as storage device 1510. Execution of the sequence of instructions contained in memory 1506 causes processing device 1504 to perform the methods described herein. Alternatively, hard-wired circuitry may be used in place of or in combination with software instructions to implement the teachings. Therefore, implementations of this disclosure are not limited to any particular combination of hardware circuitry and software. In various embodiments, computer system 1500 may be connected across a network to one or more other computer systems, such as computer system 1500, to form a networked system via network interface 1516. This network may include a private network or a public network such as the Internet. In a networked system, one or more computer systems may store data and supply data to other computer systems. As used herein, the term "computer-readable medium" refers to any medium that participates in providing instructions to processing device 1504 for execution. Such media may take many forms, including but not limited to non-volatile media, volatile media, and transmission media. Non-volatile media include, for example, optical discs or magnetic disks such as storage device 1510. Volatile media include dynamic memory such as memory 1506.Transmission media include coaxial cable, copper wire, and optical fiber, including cabling containing bus 1502. Common forms of computer-readable media or computer program products include, for example, floppy disks, flexible disks, hard disks, magnetic tape, or any other magnetic media, CD-ROMs, digital video discs (DVDs), Blu-ray discs, any other optical media, thumb drives, memory cards, RAM, PROMs and EPROMs, fast EPROMs, any other memory chips or cartridges, or any other tangible media from which a computer can read. Various forms of computer-readable media may be involved when carrying one or more sequences of one or more instructions to processing device 1504 for execution. For example, instructions may initially be carried on a disk of a remote computer. The remote computer may load the instructions into its dynamic memory and transmit the instructions over a telephone line using a modem. A modem local to computer system 1500 may receive data over a telephone line and convert the data into an infrared signal using an infrared transmitter. An infrared detector coupled to bus 1502 may receive the data carried in the infrared signal and place the data on bus 1502. Bus 1502 carries data to memory 1506, and processing device 1504 retrieves instructions from memory 1506 and executes the instructions. Optionally, instructions received by memory 1506 may be stored on storage device 1510 before or after execution by processing device 1504.

[0078] According to various embodiments, instructions configured to be executed by a processing device to perform a method are stored on a computer-readable medium. The computer-readable medium may be a device for storing digital information. For example, a computer-readable medium includes a compact disc read-only memory (CD-ROM) as known in the art for storing software. The computer-readable medium is accessed by a processor adapted to execute the instructions configured to be executed.

[0079] The foregoing has described one or more exemplary embodiments of this disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0080] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or physical entities, or by products with certain functions. A typical implementation device is a server system. Of course, this disclosure does not exclude the possibility that, with the future development of computer technology, the computer implementing the functions of the above embodiments may be, for example, a personal computer, a laptop computer, an in-vehicle human-machine interaction device, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a game console, a tablet computer, a wearable device, or any combination thereof.

[0081] The terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, product, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, product, or apparatus. Without further limitation, the presence of other identical or equivalent elements in the process, method, product, or apparatus that includes said elements is not excluded. For example, the use of terms such as "first" or "second" to denote names does not indicate any particular order.

[0082] For ease of description, the above devices are described in terms of function, divided into various modules. Of course, when implementing one or more embodiments of this disclosure, the functions of each module can be implemented in one or more software and / or hardware, or a module that performs the same function can be implemented by a combination of multiple sub-modules or sub-units. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division; in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual couplings, direct couplings, or communication connections may be through some interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.

[0083] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.

[0084] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0085] Those skilled in the art will understand that one or more embodiments of this disclosure may take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, one or more embodiments of this disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0086] One or more embodiments of this disclosure can be described in the general context of computer-executable instructions, such as program modules, that are executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a particular task or implement a particular abstract data type. One or more embodiments of this disclosure can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In a distributed computing environment, program modules can reside in local and remote computer storage media, including storage devices.

[0087] The same or similar parts between the various embodiments of this disclosure can be referred to mutually, and each embodiment focuses on describing the differences from other embodiments. In particular, for the apparatus embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to the description of the method embodiments. In the description of this disclosure, the reference to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," "exemplary," etc., means that the specific feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of this disclosure. In this disclosure, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples. Furthermore, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this disclosure and the features of different embodiments or examples.

[0088] Additionally, when used in this disclosure, the terms “here,” “above,” “below,” “below,” “in the following,” “overall,” and similar terms should refer to the entirety of this disclosure and not any particular part thereof. Furthermore, unless expressly stated otherwise or otherwise understood in the context in which they are used, conditional language used herein, such as “may,” “possibly,” “for example,” “like,” etc., is generally intended to express that certain embodiments include, while other embodiments do not, certain features, elements, and / or states. Therefore, such conditional language is not generally intended to imply that one or more embodiments require features, elements, and / or states in any way, or whether such features, elements, and / or states are included or performed in any particular embodiment.

[0089] The above description is merely an embodiment of one or more embodiments of this disclosure and is not intended to limit the scope of the one or more embodiments of this disclosure. Various modifications and variations can be made to the one or more embodiments of this disclosure by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this disclosure should be included within the scope of the claims.

Claims

1. A control method for a lighting device for a vehicle door panel, characterized in that, The control method includes: In response to a user's hand movements in the light effect interaction area of ​​the door panel, the system collects the user's interaction signals with the door panel. Based on the interaction signal, identify the position coordinates of the user's finger relative to the light effect interaction area; Using an interactive model, based on the interactive signals and the position coordinates, the optical parameters of the light effect display area of ​​the door panel are determined; and The lighting device of the door panel is controlled based on the optical parameters.

2. The control method according to claim 1, characterized in that, The hand gestures include contact with the pressure sensing device on the door panel, and the acquisition of user interaction signals with the door panel includes: Based on the sensing data identified by the pressure sensing device, the interaction signal is determined, wherein the interaction signal includes the pressing position and / or pressure value of the finger.

3. The control method according to claim 2, characterized in that, Determining the optical parameters of the light effect display area of ​​the door panel includes: Based on the pressing position, determine the display position of the interactive pattern in the light effect display area; and / or Based on the pressure value, at least one of the shape, brightness, and color of the interactive pattern is determined.

4. The control method according to claim 1, characterized in that, The hand movement includes approaching the capacitive sensing device on the door panel, and The interaction signal includes the capacitance signal determined by the capacitance sensing device based on the detection interval.

5. The control method according to claim 4, characterized in that, Identifying the position coordinates of the user's finger relative to the light effect interaction area includes: Based on the capacitance signal, the proximity distance of the finger relative to the light effect interaction area and the coordinates of the projection position of the finger in the light effect interaction area are calculated.

6. The control method according to claim 5, characterized in that, Determining the optical parameters of the light effect display area of ​​the door panel includes: Based on the projection position coordinates, determine the display position of the interactive pattern in the light effect display area; and / or Based on the proximity distance, at least one of the shape, brightness, and color of the interactive pattern is determined.

7. The control method according to claim 1, characterized in that, The collection of user interaction signals with the door panel includes: Based on the image of the hand movement acquired by the imaging device of the door panel, the interaction signal is determined, wherein the interaction signal includes the imaging position of the finger at the time of image acquisition.

8. The control method according to claim 7, characterized in that, Identifying the position coordinates of the user's finger relative to the light effect interaction area includes: Based on the imaging position, the proximity distance of the finger relative to the light effect interaction area and the coordinates of the projection position of the finger in the light effect interaction area are calculated.

9. The control method according to claim 1, characterized in that, The interaction model defines the interactive patterns in the light effect display area, and determines the optical parameters of the light effect display area of ​​the door panel, including: The position coordinates are processed based on the type of the interactive pattern to determine the display position of the interactive pattern in the light effect display area.

10. The control method according to claim 9, characterized in that, The types of interactive patterns include at least one of the following: normal distribution, parabolic, chordal, and pulse.

11. The control method according to claim 1, characterized in that, The control method further includes: A gesture recognition model is used to identify the interaction signals and the location coordinates in order to obtain the user's command gestures; The command gesture is subjected to a region dwell determination to determine the dwell state of the command gesture within a preset spatial area; and Based on the dwell state and the movement parameters of the command gesture, a mapping output based on the preset spatial region is executed to generate control commands for the vehicle.

12. The control method according to claim 11, characterized in that, The mapping output includes a preset event code corresponding to the specified optical parameters; and The control commands include commands to adjust the parameters of the lighting device based on the preset event codes.

13. A lighting control device for a vehicle door panel, characterized in that, The control device includes: The acquisition module is configured to acquire the user's interaction signals with the door panel in response to the user's hand movements in the light effect interaction area of ​​the door panel; The calculation module is configured to identify the position coordinates of the user's finger relative to the light effect interaction area based on the interaction signal; The determining module is configured to use an interaction model to determine the optical parameters of the light effect display area of ​​the door panel based on the interaction signal and the position coordinates; and The control module is configured to control the lighting device of the door panel based on the optical parameters.

14. A vehicle, characterized in that, The vehicles include: Lighting equipment, wherein the lighting equipment is positioned corresponding to the light effect display area of ​​the door panel; and A control device is configured to perform the control method according to any one of claims 1 to 12.

15. The vehicle according to claim 14, characterized in that, The vehicle also includes: A signal acquisition device is installed at a position corresponding to the light effect interaction area of ​​the door panel. The signal acquisition device includes at least one of a pressure sensing device, a capacitance sensing device, and an imaging device.

16. A computing device, characterized in that, The computing device includes: Processor; and A memory storing computer-executable instructions, which, when executed by the processor, cause the processor to perform the control method according to any one of claims 1 to 12.

17. A computer-readable storage medium having computer-executable instructions stored thereon, characterized in that, When executed by a computer, the computer-executable instructions cause the computer to perform the control method according to any one of claims 1 to 12.

18. A computer program product, characterized in that, The computer program product includes instructions that, when executed by a processor, implement the control method according to any one of claims 1 to 12.