Display control system, vehicle, and display control method

Abstract

A display control system according to an embodiment of the present disclosure comprises: an information acquisition unit configured to acquire code information; a display unit configured to externally display the code information acquired by the information acquisition unit; an estimation unit configured to estimate a reading-side viewing direction for reading the display image of the code information by the reading device when display request information of the code information has been detected; and a display control unit configured to control the display operation of the display unit so that the display position of the code information changes according to the reading-side viewing direction estimated by the estimation unit.

Description

Display control system, vehicle, and display control method

[0001] The present disclosure relates to a display control system, a vehicle, and a display control method.

[0002] Various technologies have been disclosed as display control systems and display control methods for controlling the display of various code information (see, for example, Patent Document 1).

[0003] JP 2016-18438 A

[0004] A display control system according to one embodiment of the present disclosure includes an information acquisition unit configured to acquire code information, a display unit configured to externally display the code information acquired by the information acquisition unit, an estimation unit configured to estimate a reading-side viewing direction when a display image of the code information is read by a reading device when display request information for the code information is detected, and a display control unit configured to control the display operation of the display unit so that the display position of the code information changes according to the reading-side viewing direction estimated by the estimation unit.

[0005] A vehicle according to an embodiment of the present disclosure includes a display control system including an information acquisition unit configured to acquire code information, a display unit configured to externally display the code information acquired by the information acquisition unit, an estimation unit configured to estimate a reading-side viewing direction when a display image of the code information is read by a reading device when display request information for the code information is detected, and a display control unit configured to control a display operation of the display unit so that a display position of the code information changes according to the reading-side viewing direction estimated by the estimation unit.

[0006] A display control method according to one embodiment of the present disclosure includes acquiring code information, externally displaying the acquired code information, estimating a reading-side viewing direction when a display image of the code information is read by a reading device when display request information for the code information is detected, and controlling a display operation such that the display position of the code information changes according to the estimated reading-side viewing direction.

[0007] The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate one embodiment and, together with the description, serve to explain the principles of the disclosure.

[0008] FIG. 1 is a schematic diagram illustrating an example of a general configuration of a vehicle or the like to which a display control system according to an embodiment of the present disclosure is applied. FIG. 2 is a block diagram illustrating an example of a detailed configuration of the vehicle shown in FIG. 1. FIG. 3 is a flowchart illustrating an example of a process according to the embodiment. FIG. 4 is a flowchart illustrating a detailed example of the display control process shown in FIG. 3. FIG. 5 is a schematic diagram for explaining the example of the process shown in FIGS. 3 and 4. FIG. 6 is another schematic diagram for explaining the example of the process shown in FIGS. 3 and 4. FIG. 7 is another schematic diagram for explaining the example of the process shown in FIGS. 3 and 4. FIG. 8 is another schematic diagram for explaining the example of the process shown in FIGS. 3 and 4. FIG. 9 is a block diagram illustrating an example of the configuration of a vehicle and a server according to a modified example.

[0009] In a display control system or the like that controls the display of various code information, for example, there is a demand for improved convenience. It is desirable to provide a display control system, a vehicle, and a display control method that can improve convenience when using code information.

[0010] Some exemplary embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that the following description illustrates one specific example of the present disclosure and should not be construed as limiting the present disclosure. For example, each element, including numerical values, shapes, materials, parts, the position of each part, and the connection method of each part, is merely an example and should not be construed as limiting the present disclosure. Furthermore, in the following exemplary embodiments, components not described in independent claims based on the highest concept of the present disclosure are optional and may be provided as needed. The drawings are schematic and are not intended to be drawn to scale. Throughout this specification and the drawings, components having substantially the same function and configuration are designated by the same reference numerals, and redundant description will be omitted. Furthermore, components not directly related to one embodiment of the present disclosure are not shown in the drawings.

[0011] 1. Embodiment> [Configuration] Fig. 1 is a schematic diagram illustrating an example of the overall configuration of a vehicle 1 (vehicle 1 and a store 7 described later) to which a display control system according to an embodiment of the present disclosure is applied. Fig. 2 is a block diagram illustrating an example of the detailed configuration of the vehicle 1 shown in Fig. 1.

[0012] 1 and 2, the vehicle 1 includes a vehicle control unit 11, a battery 12, a communication device 13, a camera 14, and a projection display unit 15. In the example shown in Fig. 1, an electronic device 8 is installed inside the vehicle 1 at a location away from the user 9 (such as a passenger including the driver of the vehicle 1). The electronic device 8 is, for example, a device owned by or loaned to the user 9, and is configured as, for example, a smartphone, a tablet, or the like.

[0013] 1, a payment terminal 71 is installed in the store 7, which performs a predetermined payment process using code information Ic (described later), and a reader 72 is connected to the payment terminal 71 for reading the code information Ic. The payment terminal 71 also includes a payment unit 710 for performing such payment processing. The reader 72 is configured using a code reader, a camera, etc., and is operated by an operator 70a to read the code information Ic based on a display image (projected image) by a projection display unit 15 (described later) in the vehicle 1 (see FIG. 1). In the example of FIG. 1, a nearby person 70b (e.g., a worker in the store 7) different from the operator 70a of the payment terminal 71 and the reader 72 is present in the store 7 near the operator 70a.

[0014] 1 , while the user 9 is in the vehicle 1 at a drive-through, a parking lot exit, or the like, a payment process using the code information Ic is executed using the payment terminal 71 and the reading device 72 in the store 7. Also, in the example of FIG. 1 , as described above, the electronic device 8 storing the code information Ic is installed in a location in the vehicle 1 away from the user 9. That is, for example, the electronic device 8 is placed in a bag, and the bag is placed in a location in the vehicle 1 away from the user 9. In this way, in the example of FIG. 1 , in a situation where the electronic device 8 cannot be instantly made available to the user 9, a display image including the code information Ic is displayed (projected) from the electronic device 8 to the inside or outside of the vehicle 1 via the projection display unit 15, while preventing a third party from seeing the payment status.

[0015] (Vehicle Control Unit 11) The vehicle control unit 11 is a component (control unit) that controls various operations and performs various arithmetic processing in the vehicle 1. Specifically, the vehicle control unit 11 includes, for example, one or more processors (CPUs: Central Processing Units) that execute programs and one or more memories communicatively connected to these processors. Furthermore, such memories include, for example, RAMs (Random Access Memory) that temporarily store processing data and ROMs (Read Only Memory) that store programs.

[0016] In the example shown in Figure 2, the vehicle control unit 11 has a driving control unit 111, a battery control unit 112, a communication control unit 113, an information acquisition unit 114, a display request detection unit 115, a viewing direction estimation unit 116, an external display determination unit 117, and a display control unit 118.

[0017] Here, vehicle 1 corresponds to a specific example of "vehicle" in an embodiment of the present disclosure, and electronic device 8 corresponds to a specific example of "electronic device" in an embodiment of the present disclosure. Furthermore, information acquisition unit 114, viewing direction estimation unit 116, display control unit 118, and projection display unit 15 correspond to a specific example of "display control system" in an embodiment of the present disclosure. Furthermore, projection display unit 15 corresponds to a specific example of "display unit" in an embodiment of the present disclosure, and viewing direction estimation unit 116 corresponds to a specific example of "estimation unit" in an embodiment of the present disclosure.

[0018] The driving control unit 111 is a component that controls the driving operation of the vehicle 1, and performs overall control over the driving of the vehicle 1. Specifically, the driving control unit 111 controls, for example, the drive system, braking system, steering system, etc. of the vehicle 1. The battery control unit 112 is a unit that controls the operation (charging operation, discharging operation, etc.) of the battery 12, which will be described later. The communication control unit 113 is a unit that controls the communication operation of the communicator 13, which will be described later.

[0019] The information acquisition unit 114 is a unit that acquires various information (vehicle data) related to the vehicle 1. Specifically, the information acquisition unit 114 acquires the above-mentioned code information Ic from the electronic device 8, for example, via in-vehicle wireless communication (see FIG. 2). Examples of the code information Ic include various types of code information for payment, such as a one-dimensional code (barcode) or a two-dimensional code (e.g., QR Code (registered trademark)). Furthermore, code information included in various types of point cards or insurance cards may also be used as the code information Ic.

[0020] The display request detection unit 115 is a unit that detects a display request from the user 9 for the code information Ic (display request information input by an instruction or setting from the user 9). Specifically, the display request detection unit 115 detects the display request information for the code information Ic when, for example, the user 9 performs an operation input on an in-vehicle device (a steering switch or an in-vehicle navigation system) having a projection request button or display. The display request detection unit 115 may also detect the display request information for the code information Ic by, for example, recognizing the voice of the user 9 using a microphone in the vehicle 1. The display request detection unit 115 may also detect the display request information for the code information Ic in response to, for example, a predetermined trigger (a predetermined operation on the vehicle 1) that is set in advance (by the electronic device 8, etc.).

[0021] The viewing direction estimation unit 116 is a unit that estimates a reading-side viewing direction dr when the display image of the code information Ic (the image projected by the projection display unit 15) is read by the reading device 72 described above when the display request information of the code information Ic is detected by the display request detection unit 115. In the example of FIG. 1 , the reading-side viewing direction dr refers to the line of sight of the operator 70a of the reading device 72 (the line of sight direction when viewing the display image of the code information Ic). Note that if the reading device 72 is not a device operated by the operator 70a but is, for example, an unmanned device (a device that automatically reads the display image of the code information Ic), the direction in which the reading device 72 as the unmanned device is facing (the reading direction of the code information Ic) becomes the reading-side viewing direction dr. The viewing direction estimation unit 116 is configured to estimate the reading-side viewing direction dr by detecting the operator 70a or the like using, for example, an image (stereo image) captured by a camera 14 (exterior camera or interior camera) described later that is installed in the vehicle 1. The viewing direction estimation unit 116 may also estimate the reading-side viewing direction dr by utilizing, for example, a camera installed outside the vehicle 1 (such as a security camera installed in the store 7) and using an image captured by the security camera or the like. Details of the process of estimating the reading-side viewing direction dr by the viewing direction estimation unit 116 will be described later.

[0022] The external display determination unit 117, details of which will be described later, is a unit that makes a determination regarding permission to display the code information Ic externally, for example, when the code information Ic is to be displayed outside the vehicle 1, based on the pre-settings or approval information by the user 9 of the electronic device 8.

[0023] The display control unit 118 is a unit that controls the display operation (projection operation) of the projection display unit 15 so that the display position (projection position) of the code information Ic changes in accordance with the reading-side viewing direction dr estimated by the viewing direction estimation unit 116. Specifically, the display control unit 118 controls the display operation of the projection display unit 15 by supplying a control signal CTL to the projection display unit 15 via, for example, in-vehicle wireless communication (see FIG. 2). Details of the display control process performed by the display control unit 118 will be described later.

[0024] (Battery 12, Communicator 13, Camera 14) The battery 12 is a component that functions as a power source for the vehicle 1, and is configured using various types of secondary batteries such as lithium ion batteries. The communicator 13 is a device that performs various types of communication with the outside of the vehicle 1 (for example, an information processing device such as a server, or other vehicles other than the vehicle 1).

[0025] The camera 14 is a component that acquires imaging data relating to the exterior (such as the surrounding environment of the vehicle 1) and interior (such as the occupants of the vehicle 1) of the vehicle 1. The imaging data acquired in this manner is supplied to, for example, the vehicle control unit 11 (such as the information acquisition unit 114 described above).

[0026] (Projection display unit 15) The projection display unit 15 is a component that displays various types of information and is configured using various types of projectors. As described above in the example of Fig. 1, the projection display unit 15 displays the code information Ic acquired by the information acquisition unit 114 in response to the control signal CTL supplied from the display control unit 118.

[0027] [Operation, Function, and Effect] Next, the operation, function, and effect of this embodiment will be described in detail.

[0028] (A. Conventional Method) First, there is a technique (conventional method) in which, when performing payment processing using code information, the location where the code information is projected is changed depending on the surrounding environment (brightness), for example. This is because when the interior of a car is bright due to sunlight or the like, if the code information is projected inside the car, the displayed image of the code information may be difficult to see depending on the location.

[0029] However, if the projection location is changed based solely on the brightness of the location, the code information may be projected in a distant location, making it difficult for the reader (recipient) to see the code information. In this case, the reader cannot accurately read the code information, making it impossible to execute the payment process. In this way, conventional methods may reduce the convenience of using code information.

[0030] (B. Processing example of this embodiment) Therefore, in this embodiment, when using code information Ic (performing payment processing using code information Ic, etc.), various processes are performed, for example, as follows.

[0031] (B-1. Overview of Processing) Here, Fig. 3 is a flowchart showing a processing example (an example of a payment process using code information Ic) according to this embodiment. Fig. 4 is a flowchart showing a detailed processing example of the display control process (step S14 described later) shown in Fig. 3. Figs. 5 to 8 are schematic diagrams for explaining the processing examples shown in Figs. 3 and 4, respectively.

[0032] First, the processing example shown in FIG. 3 (outline of the entire processing described above) will be described.

[0033] 3, first, the viewing direction estimation unit 116 determines whether or not the above-described display request information has been detected by the display request detection unit 115 (step S11). If it is determined that such display request information has not been detected (step S11: N), the determination process in step S11 is performed again.

[0034] On the other hand, if it is determined that such display request information has been detected (step S11: Y), the information acquisition unit 114 acquires the code information Ic from the electronic device 8 (step S12). Next, the viewing direction estimation unit 116 estimates the reading-side viewing direction dr when the reading device 72 reads the display image of the code information Ic (step S13). Specifically, as shown in FIG. 5 , the viewing direction estimation unit 116 first estimates an intersection Pa between the line of sight da of the operator 70a, which is estimated by image processing using the captured image, and a predetermined object in the vehicle 1. Note that in the example of FIG. 5 (and FIGS. 6 to 8 described below), a seat 191 on which the user 9 sits in the vehicle 1 and a seat belt 192 attached to the seat 191 are each schematically illustrated. The viewing direction estimation unit 116 also estimates an area within a predetermined distance centered on the intersection Pa (for example, a circular area with a radius of 5 m centered on the intersection Pa) as an area where the code information Ic is easily visible to the operator 70a (visible area Aa by the operator 70a) (see FIG. 5 ). In this way, the viewing direction estimation unit 116 estimates the direction of the line of sight da of the operator 70a in this case as the reading-side viewing direction dr, thereby performing a viewing direction estimation process.

[0035] Next, the display control unit 118 controls the display operation of the projection display unit 15 so that the display position of the code information Ic changes in accordance with the reading-side viewing direction dr estimated by the viewing direction estimation unit 116 (step S14). Details of the process in step S14 (display control process by the display control unit 118) will be described later (see FIG. 4).

[0036] Next, the projection display unit 15 displays the code information Ic externally in accordance with the display position etc. determined in step S14 (step S15). That is, the projection display unit 15 starts the display process of such code information Ic.

[0037] Next, the payment terminal 71 (payment unit 710) in the store 7 executes a predetermined payment process based on the code information Ic read by the reader 72 (step S16). The display control unit 118 then determines whether a payment completion notice has been received from the payment terminal 71 via the communicator 13 (e.g., in-vehicle wireless communication) (step S17). If it is determined that a payment completion notice has not been received (step S17: N), the determination process in step S17 is performed again. On the other hand, if it is determined that a payment completion notice has been received (step S17: Y), the projection display unit 15 ends the display process of the code information Ic described above in accordance with the display control by the display control unit 118 (step S18).

[0038] This completes the series of processing steps shown in FIG.

[0039] (B-2. Details of Display Control Processing) Next, the processing example shown in FIG. 4 (a detailed processing example of the above-mentioned display control processing) will be described.

[0040] In the display control process shown in FIG. 4 , the viewing direction estimation unit 116 first determines whether a nearby person 70b other than the operator 70a of the reading device 72 is present near the reading device 72 (step S141). Specifically, the viewing direction estimation unit 116 determines the presence of the nearby person 70b by, for example, using the captured image used in step S13, taking into consideration whether another person (or machine) is present near the operator 70a and whether the other person's line of sight is directed toward the vehicle 1. An example of the area in the captured image that is near the operator 70a is an area within a predetermined threshold (e.g., 40 pixels) centered on the operator 70a. Furthermore, the viewing direction estimation unit 116 may determine the presence of the nearby person 70b by using voice data detected near the operator 70a to estimate the source of a predetermined voice that is expected to be emitted during the payment process.

[0041] If it is determined that such a nearby person 70b does not exist (step S141: N), the process proceeds to step S143, which will be described later. On the other hand, if it is determined that such a nearby person 70b exists (step S141: Y), the display control unit 118 changes the display position of the code information Ic, taking into consideration the visible area Ab of the nearby person 70b relative to the display image of the code information Ic (step S142).

[0042] Specifically, first, the viewing direction estimation unit 116 estimates the visible area Ab of the nearby person 70b, for example, by using the captured image described above (see FIG. 6 ). At this time, the viewing direction estimation unit 116 assumes a predetermined viewing angle (for example, approximately 100° horizontally and approximately 70° vertically) based on the direction of the line of sight db of the nearby person 70b. The viewing direction estimation unit 116 also takes into consideration the positional relationship between the vehicle 1 and people (neighbors 70b) around the operator 70a, as well as the assumed viewing angle, and estimates the visible area Ab as the area that is visible when the nearby person 70b faces the vehicle 1. Then, when the viewable area Ab of the nearby person 70b estimated in this manner overlaps with the viewable area Aa of the operator 70a based on the reading-side viewing direction dr estimated in step S13 (see overlapping area Aab in FIG. 6 ), the display control unit 118 performs the following display control: That is, in such a case, the display control unit 118 changes (moves) the display position of the code information Ic in a direction to avoid the overlapping area Aab (see arrow ds in FIG. 6 ).

[0043] Next, the display control unit 118 changes the display position of the code information Ic depending on the display environment of the code information Ic (e.g., the illuminance, background color, shape, etc. around the display position) (step S143). This is because if the display position of the code information Ic is bright due to sunlight or illumination light from the vehicle 1, the brightness of the code information Ic will affect the reading of the code information Ic. Specifically, the display control unit 118 estimates the illuminance at the display position by calculating the RGB values ​​at the display position of the code information Ic, for example, using the captured image described above. If the estimated illuminance is equal to or greater than a predetermined threshold (e.g., approximately 50 lux), the display control unit 118 determines that the reading of the code information Ic will be affected, and changes the display position of the code information Ic. Specifically, in the example shown in FIG. 7 , the display position (display area) of the code information Ic is changed so that the display area Aa1 based on the visible area Aa of the operator 70a described above is reduced (selected) to the display area Aa2.

[0044] Next, the display control unit 118 makes a final determination of the display position of the code information Ic based on the display positions of the code information Ic obtained up to step S143 (step S144). The final determination method may be, for example, randomly determining the display position, or determining the display position according to a predetermined rule that facilitates clear display of the code information Ic. Examples of such predetermined rules include determining the color closest to white, determining the color with minimal irregularities, or determining the color with the highest occupancy rate. In the example shown in FIG. 8 , the "black" area with the highest occupancy rate (the area within the seat belt 192) near the display area Aa2 is determined as the final display position (display area Aa3) of the code information Ic. It should be noted that the size of the display area Aa3 is set in advance to a predetermined range (e.g., 10 cm vertically and 10 cm horizontally).

[0045] Furthermore, in step S144, the display control unit 118 performs display control so that the display position of the code information Ic is located inside or outside the vehicle 1. Furthermore, when the code information Ic is to be displayed outside the vehicle 1 (for example, on the outside of the door on the operator 70a's side of the vehicle 1), the display control unit 118 displays the code information Ic outside the vehicle 1, for example, in accordance with a pre-setting or approval information by the user 9 of the electronic device 8. This is because when the code information Ic is displayed outside the vehicle 1, the code information Ic is more easily visible to third parties than when the code information Ic is displayed inside the vehicle 1, and therefore the user 9's consent is obtained in advance. However, for example, the user 9 may perform a pre-setting so that the display position of the code information Ic is limited to the inside of the vehicle 1. Note that the determination as to whether to permit external display of the code information Ic in accordance with a pre-setting or approval information by the user 9 is made by the external display determination unit 117 described above.

[0046] Next, the display control unit 118 determines the display color of the code information Ic by changing the display color of the code information Ic according to the display environment of the code information Ic (step S145). Specifically, the display control unit 118 calculates a background color for display based on, for example, the RGB values ​​at the display position of the code information Ic calculated using the captured image. Generally, the opposite color of the background color is a color that is easy to see as a displayed image. Therefore, the display control unit 118 determines (selects), for example, the opposite color of the background color calculated as described above as the display color of the code information Ic. Note that the above-mentioned opposite colors may be prepared in advance, for example, as a table, or, for example, if the vehicle 1 is capable of Internet communication, the opposite colors may be searched for each time.

[0047] Next, the display control unit 118 determines the size of the code information Ic by changing the size of the code information Ic when displayed according to the distance Lc between the display position of the code information Ic finally determined in step S144 and the reading device 72 (step S146). Specifically, the display control unit 118 first estimates the distance Lc between the display position of the finally determined code information Ic and the reading device 72 using the captured image described above. Then, if the estimated distance Lc is equal to or greater than a predetermined threshold Lth (e.g., approximately 2 m), the display control unit 118 changes the size of the display area of ​​the finally determined code information Ic (e.g., the display area Aa3 described above) according to the distance Lc.

[0048] Here, the change rate (enlargement rate) X of the display area of ​​the code information Ic is defined, for example, as in the following formula (1) using the estimated distance Lc and the above-mentioned threshold value Lth: X=1+0.25×(Lc−Lth) 2 …(1)

[0049] For example, if the display position of the code information Ic is located outside the vehicle 1 (near the driver's door), the display position may be too close to the reading device 72 and may not fit within the angle of view of the camera when the code information Ic is read by the reading device 72. Therefore, in such a case, it is desirable that the display control unit 118 change the size of the display area of ​​the code information Ic by reducing it rather than enlarging it.

[0050] This completes the display control process shown in FIG.

[0051] (C. Actions and Effects) In this embodiment, the reading-side viewing direction dr when the reading device 72 reads the display image of the code information Ic is estimated, and the display position of the code information Ic by the projection display unit 15 is controlled to change according to the estimated reading-side viewing direction dr. This makes it easier for the reading side (operator 70a) to recognize the code information when it is read by the reading device 72. As a result, in this embodiment, payment processing and the like using the code information Ic can be smoothly executed, and convenience when using the code information Ic can be improved.

[0052] Furthermore, as described above, even in a situation where the user 9 does not have the electronic device 8 at hand, the payment process and the like can be smoothly executed using the code information Ic, which makes it possible to obtain the following effects, for example: For example, even in a situation where there is a following vehicle behind the vehicle 1, the driver of the vehicle 1 (user 9, etc.) does not need to panic, and as a result, it is possible to reduce erroneous starts and the like caused by the driver of the vehicle 1 being impatient.

[0053] Furthermore, in this embodiment, when a nearby person 70b other than the operator 70a of the reading device 72 is present near the reading device 72, the display position of the code information Ic is changed taking into consideration the visible area Ab of the nearby person 70b with respect to the displayed image of the code information Ic, as follows: Since the code information Ic becomes less visible to such nearby person 70b (third party), security can be ensured during the payment process using the code information Ic, and the convenience of using the code information Ic can be further improved.

[0054] Furthermore, in this embodiment, at least one of the display position and the display color of the code information Ic (both the display position and the display color in the example of FIG. 4) is changed depending on the display environment of the code information Ic, resulting in the following: That is, the code information becomes easier for the reader to recognize, and as a result, it is possible to further improve the convenience when using the code information Ic. Note that, for example, unlike the example of FIG. 4, the display control unit 118 may change only one of the display position and the display color of the code information Ic depending on the display environment of the code information Ic.

[0055] Additionally, in this embodiment, the size of the code information Ic when displayed is changed depending on the distance Lc between the display position of the code information Ic and the reader 72, resulting in the following: The code information becomes easier for the reader to recognize, which further improves the convenience of using the code information Ic.

[0056] Furthermore, in this embodiment, the code information Ic is displayed on the outside of the vehicle 1 in accordance with the pre-setting or approval information by the user 9 of the electronic device 8, resulting in the following: When the code information Ic is displayed on the outside of the vehicle 1, the code information Ic is more easily visible to third parties than when the code information Ic is displayed inside the vehicle 1. However, the code information Ic can be displayed externally only after obtaining the consent of the user 9 in advance. As a result, it is possible to further improve the convenience of using the code information Ic.

[0057] 2. Modifications Next, modifications of the above-described embodiment will be described. Note that, in the following, the same components as those in the embodiment will be given the same reference numerals, and descriptions thereof will be omitted as appropriate.

[0058] Fig. 9 is a block diagram showing an example of the configuration of a vehicle 1A and a server 2 according to a modified example. In the modified example shown in Fig. 9, a vehicle 1A is provided instead of the vehicle 1 in the embodiment shown in Fig. 2, and a server 2 is added external to the vehicle 1, but the other configurations are basically the same.

[0059] (Vehicle 1A) Vehicle 1A is configured by replacing vehicle control unit 11 with vehicle control unit 11A in vehicle 1 shown in FIG. 2, but other configurations are basically the same.

[0060] The vehicle control unit 11A has a configuration that does not include the information acquisition unit 114, the viewing direction estimation unit 116, and the display control unit 118 in the vehicle control unit 11 shown in Figure 2, but the other configurations are basically the same.

[0061] (Server 2) The server 2 is an information processing device (electronic device) provided outside the vehicle 1, and includes the information acquisition unit 114, the viewing direction estimation unit 116, and the display control unit 118 described in the embodiment.

[0062] 9, various data (such as the code information Ic and control signal CTL) are transmitted and received between the server 2 and the vehicle 1A (communicator 13). Specifically, the information acquisition unit 114 in the server 2 acquires the code information Ic from the electronic device 8 in the vehicle 1A via the communicator 13. The control signal CTL output from the display control unit 118 in the server 2 is supplied to the projection display unit 15 in the vehicle 1A via the communicator 13.

[0063] As described above, in the above embodiment, information acquisition unit 114, viewing direction estimation unit 116, and display control unit 118 are each provided in vehicle 1 (vehicle control unit 11), whereas in this modified example, the configuration is as described above. That is, in this modified example, projection display unit 15 is provided in vehicle 1A, and information acquisition unit 114, viewing direction estimation unit 116, and display control unit 118 are each built into server 2 provided outside vehicle 1.

[0064] In this modification, similarly to the above embodiment, the information acquisition unit 114, the viewing direction estimation unit 116, the display control unit 118, and the projection display unit 15 correspond to a specific example of a "display control system" in an embodiment of the present disclosure. Meanwhile, unlike the above embodiment, in this modification, the server 2 corresponds to a specific example of an "electronic device" in an embodiment of the present disclosure.

[0065] In this modified example having such a configuration, basically, the same effects as those of the above embodiment can be obtained by the same actions.

[0066] 3. Other Modifications The present disclosure has been described above by giving embodiments and modifications, but the present disclosure is not limited to these embodiments and can be modified in various ways.

[0067] For example, the configuration (type, arrangement, number, etc.) of each component in the vehicle, electronic device, payment terminal, server, etc. is not limited to that described in the above embodiment. That is, the configuration of each component may be of a different type, arrangement, number, etc. Specifically, for example, in the above embodiment, an example has been described in which the "display unit" in one embodiment of the present disclosure is a projection display unit (projector), but this example is not limiting. That is, the "display unit" in one embodiment of the present disclosure may be a display unit that directly displays on a monitor, etc. (a display unit that uses a method other than projection).

[0068] Furthermore, in the above embodiments, various processing examples (the aforementioned viewing direction estimation processing, display control processing, display processing, payment processing, etc.) have been specifically described, but the methods are not limited to those described in the above embodiments, and other methods may be used, for example.

[0069] Furthermore, the values, ranges, magnitude relationships, etc. of the various parameters described in the above embodiments, etc. are not limited to those described in the above embodiments, etc., and may be other values, ranges, magnitude relationships, etc.

[0070] Additionally, in the above-described embodiments, the vehicle 1, 1A is provided with a battery 12 as a power source. That is, in the above-described embodiments, the vehicle 1, 1A is an electric vehicle (EV) or a hybrid electric vehicle (HEV), but the present invention is not limited to this example. That is, the vehicle 1, 1A may be, for example, a gasoline-powered vehicle or a fuel-powered vehicle.

[0071] Furthermore, the series of processes described in the above embodiments may be performed by hardware (circuits), software (programs), or a combination of hardware and software. When performed by software, the software is composed of a group of programs for causing a computer to execute each function. Each program may be, for example, pre-installed in the computer, or may be installed on the computer from a network or recording medium.

[0072] Furthermore, the various examples described above may be applied in any combination.

[0073] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0074] The present disclosure may also be configured as follows: (1) A display control system comprising: an information acquisition unit configured to acquire code information; a display unit configured to externally display the code information acquired by the information acquisition unit; an estimation unit configured to estimate a reading-side viewing direction when a display image of the code information is read by a reading device when display request information for the code information is detected; and a display control unit configured to control a display operation of the display unit so that a display position of the code information changes according to the reading-side viewing direction estimated by the estimation unit. (2) The display control system described in (1) above, wherein the display control unit is configured to change the display position of the code information when a nearby person other than the operator of the reading device is present near the reading device, taking into account a visible area of ​​the nearby person with respect to the display image of the code information. (3) The display control system described in (1) or (2) above, wherein the display control unit is configured to change at least one of the display position and the display color of the code information according to a display environment of the code information. (4) The display control system according to any one of (1) to (3), wherein the display control unit is configured to change the size of the code information when displayed depending on the distance between the display position of the code information and the reading device. (5) The display control system according to any one of (1) to (4), wherein the information acquisition unit is configured to acquire the code information from an electronic device, and the electronic device is installed in a location away from a user of the electronic device. (6) The display control system according to (5), wherein the electronic device is installed in a location inside a vehicle away from the user, and the display control unit is configured to control the display operation of the display unit so that the display position of the code information is located inside the vehicle.(7) The display control system according to (5), wherein the electronic device is installed inside the vehicle at a location remote from the user, and the display control unit is configured to display the code information outside the vehicle according to pre-setting or approval information by the user of the electronic device. (8) The display control system according to any of (1) to (7), wherein the display unit is provided inside the vehicle, and the information acquisition unit, the estimation unit, and the display control unit are each provided outside the vehicle. (9) A vehicle equipped with the display control system according to any of (1) to (8). (10) A display control method including: acquiring code information; displaying the acquired code information outside; and, when display request information for the code information is detected, estimating a reading-side viewing direction when a display image of the code information is read by a reading device; and controlling a display operation so that a display position of the code information changes according to the estimated reading-side viewing direction.

[0075] The vehicle control unit 11 shown in FIGS. 1 and 2 , the settlement unit 710 shown in FIG. 1 , the vehicle control unit 11A shown in FIG. 9 , the information acquisition unit 114, the viewing direction estimation unit 116, and the display control unit 118 can each be implemented by a circuit including at least one semiconductor integrated circuit, such as at least one processor (e.g., a central processing unit (CPU)), at least one application-specific integrated circuit (ASIC), and / or at least one field-programmable gate array (FPGA). The at least one processor can be configured to execute all or part of the various functions of the vehicle control unit 11 shown in FIGS. 1 and 2 , the settlement unit 710 shown in FIG. 1 , the vehicle control unit 11A shown in FIG. 9 , the information acquisition unit 114, the viewing direction estimation unit 116, and the display control unit 118, by reading instructions from at least one non-transitory, tangible computer-readable medium. Such a medium can take various forms, including, but not limited to, various magnetic media such as a hard disk, various optical media such as a CD or DVD, and various semiconductor memories (i.e., semiconductor circuits) such as volatile or non-volatile memories. The volatile memory may include DRAM and SRAM. The non-volatile memory may include ROM and NVRAM. The ASIC is an integrated circuit (IC) specialized to execute all or part of the various functions of the vehicle control unit 11 shown in FIGS. 1 and 2 , the settlement unit 710 shown in FIG. 1 , the vehicle control unit 11A shown in FIG. 9 , the information acquisition unit 114, the viewing direction estimation unit 116, and the display control unit 118. The FPGA is an integrated circuit designed to be configurable after manufacture to execute all or part of the various functions of the vehicle control unit 11 shown in FIGS. 1 and 2 , the settlement unit 710 shown in FIG. 1 , the vehicle control unit 11A shown in FIG. 9 , the information acquisition unit 114, the viewing direction estimation unit 116, and the display control unit 118.

Claims

1. A display control system comprising: an information acquisition unit configured to acquire code information; a display unit configured to externally display the code information acquired by the information acquisition unit; an estimation unit configured to estimate a reading-side viewing direction when a display image of the code information is read by a reading device when display request information for the code information is detected; and a display control unit configured to control the display operation of the display unit so that the display position of the code information changes according to the reading-side viewing direction estimated by the estimation unit.

2. The display control system of claim 1, wherein the display control unit is configured to change the display position of the code information when a nearby person other than the operator of the reading device is present near the reading device, taking into account the visible area of ​​the nearby person with respect to the displayed image of the code information.

3. A display control system as described in claim 1 or claim 2, wherein the display control unit is configured to change at least one of the display position and display color of the code information depending on the display environment of the code information.

4. A display control system as described in claim 1 or claim 2, wherein the display control unit is configured to change the size of the code information when displayed depending on the distance between the display position of the code information and the reading device.

5. A display control system as described in claim 1 or claim 2, wherein the information acquisition unit is configured to acquire the code information from an electronic device, and the electronic device is installed in a location away from a user of the electronic device.

6. The display control system according to claim 5, wherein the electronic device is installed inside the vehicle at a location away from the user, and the display control unit is configured to control the display operation of the display unit so that the display position of the code information is located inside the vehicle.

7. The display control system according to claim 5, wherein the electronic device is installed inside the vehicle at a location away from the user, and the display control unit is configured to display the code information outside the vehicle according to pre-settings or approval information by the user of the electronic device.

8. A display control system according to claim 1 or claim 2, wherein the display unit is provided inside the vehicle, and the information acquisition unit, the estimation unit and the display control unit are each provided outside the vehicle.

9. A vehicle equipped with the display control system according to claim 1 or claim 2.

10. A display control method including: acquiring code information; externally displaying the acquired code information; when display request information for the code information is detected, estimating a reading-side viewing direction when a display image of the code information is read by a reading device; and controlling a display operation so that a display position of the code information changes according to the estimated reading-side viewing direction.

Images