Video display system

Abstract

The present invention provides an image generation device, etc., that can obtain images that change according to the surrounding environment of a moving object. [Solution] A video display system is provided comprising a first display unit, a second display unit, and at least one control unit, wherein the first and second display units are configured to display a single continuous image as a whole, the virtual space defined by the continuous image is defined to include autonomously movable dynamic objects, the first and second display units are arranged along an inner wall defining the space, and the control unit is configured to execute a program so that the following steps are performed: in the designation acquisition step, a designation operation of the first and second display units is acquired, the designation operation is an operation to designate a point indicating the destination of a representative position in the virtual space, and in the movement step, the dynamic objects are continuously moved so that the representative position moves toward the designation point.

Description

Technical Field

[0001] The present invention relates to a video display system.

Background Art

[0002] Patent Document 1 discloses a technique for providing an image generation device or the like that can obtain an image that changes according to the surrounding environment of a moving object. The image generation device includes an information generation unit (parameter generation unit) that generates environment information (for example, a complexity parameter) representing the degree of change in the surrounding environment of the moving object, and an image generation unit that controls image processing according to the environment information and generates an image that changes according to the environment information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, there is still room for improvement in technologies related to the interior decoration of spaces where users can stay, such as the interior space of a moving object.

Means for Solving the Problems

[0005] According to one aspect of the present invention, a video display system is provided for the interior of a space in which a user can stay, comprising a first display unit, a second display unit, and at least one control unit, wherein the first and second display units are configured to display a single continuous image as a whole, the virtual space defined by the continuous image is defined to include autonomously moving dynamic objects, the dynamic objects are defined to behave autonomously by a set of target points arranged around a certain representative position, the first and second display units are arranged along an interior wall defining the space such that when the user is looking at one display unit from a reference position in which the user is staying, the other display unit is outside the user's field of view, and the control unit is configured to execute a program so that the following steps are performed: in the designation acquisition step, the system acquires a designation operation of the user to the first and second display units, the designation operation is an operation to designate a designated point that indicates the destination of the representative position in the virtual space, and in the movement step, the system continuously moves the dynamic object so that the representative position moves toward the designated point.

[0006] With such a configuration, for example, it is possible to enhance the sense of familiarity with dynamic objects in the space and provide a more comfortable environment for the user to stay in. [Brief explanation of the drawing]

[0007] [Figure 1] This is a diagram illustrating the configuration of the video display system 1. [Figure 2] This is a block diagram showing the hardware configuration of the video display device 8. [Figure 3] This is an activity diagram showing an example of the information processing flow performed in the video display system 1. [Figure 4] This activity demonstrates an example of the object movement process in Action A3. [Figure 5] This activity demonstrates an example of the background processing flow in Action A4. [Figure 6]This figure shows an example of the interior space SP of a vehicle 2 where the dynamic object Ob1 is displayed in the front display panel 5. [Figure 7] This figure shows an example of the behavior of the dynamic object Ob1 when a specified operation is performed on the right display panel 6 in the internal space SP shown in Figure 6. [Figure 8] This figure shows an example of how a composite image is displayed when a fish-like appearance is assigned. [Figure 9] This figure shows an example of a composite image display where trace processing can be visually observed. [Figure 10] This figure shows an example of how the generated composite image is displayed. [Modes for carrying out the invention]

[0008] Embodiments of the present invention will be described below with reference to the drawings. The various features shown in the embodiments below can be combined with each other.

[0009] Incidentally, the program for implementing the software appearing in one embodiment may be provided as a non-transitory computer-readable medium, or it may be provided as a downloadable medium from an external server, or it may be provided so that the program is launched on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0010] Furthermore, in various information processing according to one embodiment, an input and an output corresponding to the input can be realized. Here, as long as an output is obtained as a result of the input, the form of the information referenced in such information processing (hereinafter referred to as "reference information") is not limited. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression equation constructed by a statistical method), or a pre-trained model that has learned the correlation between input and output in advance, or a large-scale language model that can output a desired result by inputting a prompt.

[0011] Furthermore, in one embodiment, "part" may include, for example, hardware resources implemented by a circuit in a broad sense, and the information processing of software that can be specifically realized by these hardware resources. Also, in one embodiment, various types of information are handled, and this information can be represented, for example, by the physical values ​​of signal values ​​representing voltage and current, the high or low values ​​of signal values ​​as a set of binary bits composed of 0s or 1s, or by quantum superposition (so-called qubits), and communication and calculations can be performed on a circuit in a broad sense.

[0012] Furthermore, a circuit in a broad sense is a circuit realized by combining at least a suitable combination of circuits, circuits, processors, and memory. The processor may be a general-purpose processor or a dedicated circuit. In other words, it includes application-specific integrated circuits (ASICs), programmable logic devices (for example, simple programmable logic devices (SPLDs), complex programmable logic devices (CPLDs), and field programmable gate arrays (FPGAs)), etc.

[0013] 1. Hardware Configuration This section describes the hardware configuration.

[0014] <Video Display System 1> FIG. 1 is a configuration diagram showing a video display system 1. The video display system 1 is a system for displaying a specific video to a driver U, who is an example of a user, in the interior of a space where the driver U can stay. As an example, the video display system 1 includes a vehicle 2, which is an example of a moving body that the driver U can board (get in), and the space is the interior space SP of the vehicle 2 where the driver U can board.

[0015] The vehicle 2 includes a vehicle body 21, two front doors 22a and 22b, two rear doors 22c and 22d, a plurality of seats 3, an in-vehicle camera 4, a front display panel 5, a right display panel 6, a left display panel 7, and a video display device 8.

[0016] The vehicle body 21 is an example of an inner wall that defines the interior space SP of the vehicle 2. Note that the vehicle body 21 is not limited to defining the interior space SP as a closed space. For example, in the case where the vehicle 2 is an open car, it may be defined as an open space with an opening at the top.

[0017] The front doors 22a and 22b define an entrance / exit for a user such as the driver U to enter the interior space SP and board the front part of the vehicle 2.

[0018] The rear doors 22c and 22d are located behind the front doors 22a and 22b and define an entrance / exit for boarding the rear seat 3c, which will be described later.

[0019] The seating area 3 may include a driver's seat 3a, a passenger seat 3b, and a rear seat 3c. The driver's seat 3a is located near the front door 22a and is configured so that a driver U can sit in it. While seated in the driver's seat 3a, the driver U faces forward and performs operations related to the driving of the vehicle 2 (for example, steering with the steering wheel, acceleration and deceleration with the pedals, etc.). The field of view R in Figure 1 conceptually shows the range that the driver U can see when the driver U is facing forward. The passenger seat 3b is located near the front door 22b and next to the front door 22a (in this case, to the left). The rear seat 3c is located behind the driver's seat 3a and passenger seat 3b and is configured so that a passenger can board the vehicle 2 through the rear doors 22c and 22d.

[0020] The in-vehicle camera 4 is configured to generate an in-vehicle image by capturing images of at least a portion of the area around the vehicle 2. The in-vehicle camera 4 in this embodiment is a so-called front camera, configured to capture images in front of the vehicle 2. The in-vehicle camera 4 may also be a so-called rear camera, configured to capture images behind the vehicle 2 when driving in reverse, or a combination of both.

[0021] In-vehicle images can change over time. These temporal changes in the in-vehicle image can be caused by the relative movement of objects within the imaging range of the in-vehicle camera 4 relative to the vehicle 2. For example, the temporal changes in the in-vehicle image tend to increase as the speed of the vehicle 2 increases. Furthermore, the temporal changes in the in-vehicle image tend to increase in proportion to the change in the direction of travel of the vehicle 2, such as due to sharp turns. Additionally, the temporal changes in the in-vehicle image tend to increase in the area corresponding to the wall, as the proximity of surrounding objects, such as a wall, to the vehicle 2 increases. Therefore, the temporal changes in the in-vehicle image tend to increase when the driver U is required to pay relatively high attention while operating the vehicle 2.

[0022] The front display panel 5, the right display panel 6, and the left display panel 7 are configured to display a single continuous image as a whole. The specific configuration of the front display panel 5, the right display panel 6, and the left display panel 7 is arbitrary as long as it can display an image, but in this embodiment, multiple displays DS are arranged side by side. Each of the displays DS includes a light source unit LS and a contact sensor TS.

[0023] The light source unit LS is a light source capable of emitting light to display an image, and is, for example, an array of LEDs arranged in a two-dimensional plane. The light source unit LS may be provided in a curved manner along the inner wall of the vehicle body 21.

[0024] The contact sensor TS is configured to detect contact between the driver U and the display DS by a user. In this embodiment, the contact sensor TS may be configured to detect not only contact between the user and the display DS, but also proximity (for example, when the driver U's fingers are within a predetermined distance from the display DS). The specific form of the contact sensor TS is arbitrary, but for example, the contact sensor TS can detect contact and proximity of the driver U to the display DS based on changes in capacitance between the transparent electrodes by providing transparent electrodes on both sides of a transparent plate (for example, an acrylic plate) and electrically connecting the transparent electrodes to a detection circuit (not shown) capable of detecting the capacitance between the transparent electrodes. In this embodiment, the contact sensor TS preferentially extracts and amplifies the frequency components induced by the human body (for example, 60 Hz and its harmonics) from the change in capacitance as an analog signal. Subsequently, the detection circuit converts the extracted and amplified analog signal into a digital signal, and the value of the digital signal is converted to an absolute value and used as a time-averaged DC value over a predetermined period. This DC value can be used as an indicator to determine whether the user is close to the display DS, in contact with it, or neither close nor in contact with it. As described above, the contact sensor TS in this embodiment is configured to perform detection using a so-called quasi-electrostatic field method, which amplifies the induced signal. In this embodiment, the contact sensors TS are arranged to correspond to each of the light source units LS and are configured to generate a signal that can detect which contact sensor TS the user has touched. The contact sensors TS may also be configured to detect the position of contact made by the user at one of the light source units LS. However, this is not limited to the above, and the contact sensors TS may, for example, generate a signal to detect the manner in which the user touches the display DS using a capacitive method. Furthermore, the front display panel 5, etc., is not limited to being divided by multiple light source units LS, but may be configured to be divided and arranged around a single continuous light source unit LS.

[0025] Here, the positional relationships of the front display panel 5, the right display panel 6, and the left display panel 7 will be described. The front display panel 5 is an example of the first display unit and is positioned to face the driver U seated in the driver's seat 3a. As an example, the front display panel 5 may be positioned to extend laterally in front of both the driver's seat 3a and the passenger seat 3b. The specific position of the front display panel 5 is arbitrary, but for example, the front display panel 5 is provided along the inner wall of the vehicle body 21 so as to cross below the instrument panel located at the front of the vehicle 2.

[0026] The right display panel 6 is an example of a second display unit and is positioned facing the side (right side) of the driver U seated in the driver's seat 3a. For example, the right display panel 6 is positioned to extend laterally along the area of ​​the inner wall of the vehicle body 21 located on the right side of the driver's seat 3a. For example, the right display panel 6 is positioned to cross the front door 22a. In this embodiment, the right display panel 6 is further positioned along the area of ​​the inner wall of the vehicle body 21, extending from the area on the right side of the driver's seat 3a to the area on the right side of the rear seat 3c. Also, for example, the left end of the right display panel 6 is connected to the right end of the front display panel 5. This allows the front display panel 5 and the right display panel 6 to function as an integrated display panel.

[0027] The left display panel 7 is an example of a second display unit and is positioned facing the side (left side) of the driver U seated in the driver's seat 3a. It is positioned to extend laterally along the area of ​​the interior wall of the vehicle body 21 located on the left side of the passenger seat 3b. For example, the left display panel 7 is positioned to cross the front door 22b. In this embodiment, the left display panel 7 is further positioned along the interior wall of the vehicle body 21, extending from the area on the left side of the passenger seat 3b to the area on the left side of the rear seat 3c. Also, for example, the right end of the left display panel 7 is connected to the left end of the front display panel 5. This allows the front display panel 5 and the right display panel 6 to function as an integrated display panel.

[0028] Thus, at least a portion of the right display panel 6 and the left display panel 7 may be positioned along the rear door 22c. With this configuration, the enjoyment of users riding in the rear seats 3c, such as children or friends, while staying inside the vehicle 2 during travel can be improved. Furthermore, each of the front display panel 5, the right display panel 6, and the left display panel 7 may be part of a single display panel that displays the entire continuous image. With this configuration, the movement of dynamic objects displayed in the continuous image between the front display panel 5, the right display panel 6, and the left display panel 7 can be displayed continuously, thus reducing the sense of incongruity caused by, for example, discontinuous movement of dynamic objects or temporary absence from any display panel. Therefore, the driver U can feel a greater sense of familiarity with the dynamic objects.

[0029] Thus, the front display panel 5, the right display panel 6, and the left display panel 7 are arranged along the inner wall of the vehicle body 21 that defines the interior space SP, such that when the driver U is looking at any one of the display panels (e.g., the front display panel 5) from a certain reference position where the driver U is located, the other display panels (e.g., the right display panel 6 or the left display panel 7) are outside the driver U's field of vision R. Note that "outside the driver U's field of vision R" does not mean that the entire display panel is outside the field of vision, but also that a part of the field of vision R is outside the field of vision. The reference position is a reference position that is predetermined when viewing at least one of the front display panel 5, the right display panel 6, and the left display panel 7. In this embodiment, the reference position is defined based on the position of the passenger seats, such as the driver's seat 3a, the passenger seat 3b, and the rear seat 3c. With this configuration, the area around the passenger seats can be made more visually appealing to the user, thereby improving the comfort of staying inside the vehicle 2. For example, the reference position corresponds to the typical eye level of driver U when seated in driver's seat 3a.

[0030] The video display device 8 is configured to control the content of the video displayed on the front display panel 5, the right display panel 6, and the left display panel 7 of the video display system 1. Figure 2 is a block diagram showing the hardware configuration of the video display device 8. The video display device 8 comprises a communication unit 81, a storage unit 82, a processor 83, a processing display unit 84, and an input unit 85, and these components are electrically connected within the video display device 8 via a communication bus 20. Each component will be described further.

[0031] The communication unit 81 preferably uses wired communication methods such as USB, IEEE1394, Thunderbolt®, and wired LAN network communication, but may also include wireless LAN network communication, mobile communication such as 3G / LTE / 5G, and Bluetooth® communication as needed. In other words, it is more preferable to implement it as a collection of these multiple communication methods. That is, the video display device 8 may communicate various information from the outside via the communication unit 81 and the network.

[0032] The memory unit 82 stores various types of information as defined above. This can be done, for example, as a storage device such as a solid-state drive (SSD) that stores various programs related to the video display device 8 executed by the processor 83, or as memory such as random access memory (RAM) that stores temporarily necessary information (arguments, arrays, etc.) related to program calculations. The memory unit 82 stores various programs and variables related to the video display device 8 executed by the processor 83.

[0033] The processor 83 performs processing and control of the overall operation related to the video display device 8. The processor 83 is, for example, a central processing unit (CPU) not shown. The processor 83 realizes various functions related to the video display device 8 by reading predetermined programs stored in the memory unit 82. That is, information processing by software stored in the memory unit 82 is concretely realized by the processor 83, which is an example of hardware, and can be executed as each functional unit included in the processor 83. These will be described in more detail in the next section. Note that the processor 83 is not limited to being a single unit, and may be implemented with multiple processors 83 for each function, or a combination thereof.

[0034] The processing and display unit 84 may be included in the housing of the video display device 8, or it may be an external unit. The processing and display unit 84 displays a graphical user interface (GUI) screen that can be operated by the user. This is preferably done by appropriately using different display devices such as a CRT display, liquid crystal display, organic EL display, and plasma display.

[0035] The input unit 85 is configured to accept input from the user. The input unit 85 may be included in the housing of the video display device 8 or it may be external. For example, the input unit 85 may be implemented as a touch panel integrated with the processing display unit 84. If it is a touch panel, the user can input tap operations, swipe operations, etc. Of course, instead of a touch panel, a switch button, mouse, QWERTY keyboard, voice recognition device, gesture detection device, gaze detection device, biosignal detection device, imaging device, etc. may be used. In other words, the input unit 85 accepts operation input made by the user. In response, the input unit 85 transmits a signal corresponding to the operation input to the processor 83 via the communication bus 80. The processor 83 can perform predetermined controls and calculations as needed.

[0036] The processor 83 is configured as an acquisition unit to acquire information from various devices. The processor 83 is configured to acquire various information by reading various information stored in the storage area, which is at least a part of the memory unit 82, and writing the read information to the work area, which is at least a part of the memory unit 82. The storage area is, for example, the area of ​​the memory unit 82 that is implemented as a storage device such as an SSD. The work area is, for example, the area that is implemented as memory such as RAM. The acquisition by the processor 83 includes acquiring the output results of each functional unit included in the processor 83.

[0037] The processor 83 is configured as a display processing unit to display various types of information. This information can be presented to the user through a processing display unit 84 or the like. In such a case, for example, the processor 83 controls the display of visual information such as images including still images or moving images, icons, and messages. The processor 83 may generate only rendering information for displaying the visual information.

[0038] In this embodiment, the processor 83 is configured as a display processing unit to display a single continuous image on the front display panel 5, the right display panel 6, and the left display panel 7 as a whole. The content of the image and the method of displaying it will be described later.

[0039] 2. An example of information processing This section describes the information processing performed in the aforementioned video display system 1. This information processing is for displaying a single continuous video as a whole on the front display panel 5, the right display panel 6, and the left display panel 7. The continuous video is configured to define a virtual space in which objects can be placed and moved. The virtual space defined by the continuous video is defined to include a dynamic object Ob1 (see Figures 6 to 10 described later) that can move autonomously. The specific form of the continuous video will be described in detail after the flow of this information processing is explained.

[0040] 2.1. Overview of the Information Processing Flow Figure 3 is an activity diagram showing an example of the information processing flow performed in the video display system 1. Note that this information processing may include any exception handling not shown. Exception handling includes interrupting the information processing or omitting individual processes. The selections or inputs made in this information processing may be based on user operation or performed automatically without user operation.

[0041] [Action A1] As shown in Figure 3, first, in action A1, the processor 83 acquires an in-vehicle image from the in-vehicle camera 4. The in-vehicle image may change over time in response to the movement of the vehicle 2 or changes in external conditions. The processor 83 acquires the latest image contained in the in-vehicle image and the image immediately preceding the latest image in the in-vehicle image. The difference between these images may indicate a temporal change in the in-vehicle image.

[0042] Next, in action A2, the processor 83 calculates a complexity parameter based on the in-vehicle image acquired in action A1. The complexity parameter indicates the complexity of the time change of the in-vehicle image. For example, the processor 83 calculates the complexity parameter based on the difference between the latest image in the in-vehicle image and an image in the in-vehicle image from a predetermined period prior to a certain image (e.g., the current image). With this configuration, the difference between an image from a predetermined period prior and the current image can be visually grasped. If the temporal element is represented using frames, the predetermined period is specifically, for example, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 frames, and may be within the range of any two of the numbers exemplified here. In this embodiment, the processor 83 calculates the complexity parameter based on the difference between the latest image in the in-vehicle image and the image immediately preceding the latest image in the in-vehicle image (in other words, the image one frame prior). Specifically, the processor 83 identifies the number of pixels that differ between the latest image and the previous image, and calculates the complexity parameter from a relational expression relating the number of pixels to the complexity parameter. The complexity parameter in this embodiment is a scalar value. The relationship is defined such that the complexity parameter increases as the number of pixels increases. When the in-vehicle image does not change, the number of pixels is approximately 0, and as the changes in the in-vehicle image become more complex, the number of pixels increases. Therefore, nearly different numbers of pixels correlate with the complexity of the changes in the in-vehicle image. Note that the method of calculating the complexity parameter is not limited to this and is arbitrary; for example, the complexity parameter may be calculated using a pre-trained model that takes multiple images (e.g., two) as input and outputs the complexity parameters for those multiple images.

[0043] [Action A3] Next, in action A3, processor 83 executes object movement processing. Object movement processing is the process of autonomously moving the dynamic object Ob1, which is placed within the continuous video. As a result, the position of the dynamic object Ob1 within the continuous video is updated.

[0044] [Action A4] Next, in action A4, processor 83 performs background processing. Background processing is the process of generating or updating background images that make up the background of the dynamic object Ob1 displayed in the continuous video.

[0045] [Action A5] Next, in action A5, processor 83 performs a compositing process. The compositing process involves compositing the dynamic object Ob1, whose position was updated in action A3, with the latest background image generated or updated in action A4, thereby generating a composite image that visually represents the virtual space to be displayed on the front display panel 5, the right display panel 6, and the left display panel 7.

[0046] [Action A6] Next, in action A6, the processor 83 processes the composite image generated in action A5 for display on the front display panel 5, the right display panel 6, and the left display panel 7. Here, the processor 83 allocates a virtual space area to be displayed on each of the front display panel 5, the right display panel 6, and the left display panel 7, and coordinates control these display panels 5 to 7 so that a single continuous image is displayed as a whole.

[0047] If the information processing is to be continued, the processor 83 will execute the process again starting from action A1, sequentially updating the position of the dynamic object Ob1 and the background image, and displaying the latest composite image. On the other hand, if an operation is performed to terminate the information processing, the processor 83 will stop displaying the continuous video and terminate the information processing.

[0048] 2.2. Object movement processing Next, we will explain an example of object movement processing in action A3 of the activity shown in Figure 3. Figure 4 is an activity that shows an example of the flow of object movement processing in action A3. The dynamic object Ob1 that is the target of the object movement processing is defined to behave autonomously by a set of multiple target points arranged around a certain representative position. Hereafter, for the sake of explanation, the set of multiple target points that make up the dynamic object Ob1 will be called the target point group.

[0049] [Action A30] As shown in Figure 4, first, in action A30, the processor 83 obtains the position of the latest target point that constitutes the dynamic object Ob1. The position of this point cloud can be described, for example, as a 3D position coordinate in virtual space. If the target point cloud does not exist in virtual space, the processor 83 can appropriately determine the initial placement of the target point cloud and generate the target point cloud.

[0050] [Action A31] Next, in action A31, the amount of movement of the target point cloud from its previous position to its latest position is calculated. This amount of movement is, for example, the amount of movement of each target point that makes up the target point cloud per unit time in the virtual space, and the processor 83 can calculate the velocity vector and acceleration vector of the target points based on this amount of movement.

[0051] [Action A32] Next, in action A32, the processor 83 sets a predetermined specific point in the virtual space. More specifically, the processor 83 sets a specific point in the virtual space based on the position coordinates of at least one target point. In this embodiment, the processor 83 sets a specific point by comparing the number of target points included in multiple sub-regions obtained by dividing the virtual space. More specifically, the processor 83 sets a specific point by comparing the number of target points included in the two-dimensional region of the image projected when the virtual space is displayed on the front display panel 5, etc. If the sub-regions are closed regions of equal size, it can also be said that the processor 83 sets a specific point based on the number density of target points in the two-dimensional region. More specifically, the processor 83 sets one of the target points as the specific point.

[0052] [Action A33] Next, in action A33, processor 83 sets the target force field F. The target force field F is a force field that acts on target points in virtual space, causing acceleration at the target points. As a result, the position coordinates of each target point change. The change in position coordinate r due to the action of the target force field F can be calculated using known analytical mechanics relationships. Through the action of such a target force field, the dynamic object Ob1 is defined to behave autonomously as a set of multiple target points arranged around a certain representative position. The representative position indicates the core position of the dynamic object Ob1 and can be arbitrarily set, for example, the centroid position of the group of target points, the position of one of the target points, etc. As an example, the target force field F may include a first force field F1 and a second force field F2.

[0053] The first force field F1 is configured such that multiple target points move away from a designated specific point. Therefore, the first force field F1 is configured to act at least repulsively between the target points and the specific point. As a result, the first force field F1 functions to diffuse the target points away from the specific point. The direction of the first force field F1 is parallel to the direction r01 from the specific point toward the target points on which the first force field F1 acts. This direction r01 can be expressed in vector notation as r1-r0, where r0 is the position coordinate r of the specific point and r1 is the position coordinate r1 of the target points.

[0054] In this embodiment, the magnitude of the first force field F1 acting on the target point is set according to the positional relationship between the specific point and the target point. For example, the magnitude of the first force field F1 acting on the target point decreases as the distance between the specific point and the target point increases. That is, as the distance between the specific point and the target point decreases, the specific point and the target point repel each other more strongly. In this embodiment, the first force field F1 is configured as a central force centered on the specific point. Note that if the target point has a finite size in virtual space, the above distance may be the distance between the centers of each point or the distance between the surfaces of each point.

[0055] The first force field F1 acting on the target point is configured to change over time in the virtual space. Specifically, the first force field F1 acting on the target point is configured to alternate between repulsive and attractive forces over time. This allows multiple target points to not only expand due to repulsion but also contract due to attraction. As a result, the representation of the actions of multiple target points becomes more diverse.

[0056] In this embodiment, the first force field F1 acting on the target point is configured to change periodically with respect to time. This reduces the amount of information required to set the first force field F1 acting on the target point, thereby reducing the processing load on the processor 23. The specific manner in which the first force field F1 changes over time is arbitrary, but for example, the waveform of the first force field F1 can be any, such as a square wave, triangular wave, sawtooth wave, or sine wave, with time t as a parameter. The period of the first force field F1 is arbitrary. In this embodiment, the first force field F1 increases so as time progresses in the virtual space that it switches almost continuously from an attractive force to a repulsive force on the target point. Subsequently, when the first force field F1 reaches a predetermined value, the sign of the first force field F1 is reversed. The waveform of such a first force field F1 is, for example, a sawtooth wave.

[0057] Next, using two points of interest, the first and second points of interest, we will explain how the second force field F2 acts on the first and second points of interest. For the sake of explanation, we will assume that the displacement of the first point of interest is negligibly small compared to the displacement dr of the second point of interest.

[0058] A second force field F2 may be configured to attract two object points to each other. In other words, the second force field F2 acts attractively between the two object points. The magnitude of the second force field F2 increases with increasing distance between the two object points. More specifically, the second force field F2 is configured to attract two object points to each other when they move away from each other. In this embodiment, the orientation of the second force field F2 is parallel to the orientation from one object point to the other. In other words, the second force field F2 acts as a reaction force that inhibits the movement of the two object points away from each other. In this embodiment, the change in distance between the first and second object points is equal to the displacement dr of the second object point. Therefore, it can also be said that the magnitude of the second force field F2 increases with increasing displacement dr of the object points. The relationship between the second force field F2 and the displacement dr of the second object point is arbitrary, but can be expressed, for example, as F2 = k × dr using a coefficient k. As a result, the second force field F2 acts like a spring between the first and second target points, suppressing the dispersal of the first and second target points. The second force field F2 may include higher-order terms with respect to dr. In this embodiment, the second force field F2 acts on both the first and second target points in a substantially antiparallel direction. When both the first and second target points move, the second force field F2 can be applied by setting the amount of movement dr of the second target point to the relative amount of movement between the first and second target points.

[0059] For example, the second force field F2 may be defined so as not to act repulsively between two object points. In other words, the second force field F2 may be configured to act only attractively between two object points. For example, if the amount of movement dr of the second object point relative to the first object point is negative, the second force field F2 ≥ 0 (specifically, the second force field F2 = 0). This prevents the first and second object points from diffusing due to the reaction force of the second force field F2. Through the action of such a force field, the dynamic object Ob1 may be displayed as moving autonomously by the repeated diffusion and condensation of object points around a specific point defined based on the position of the object points. Note that the above configuration of the force field F is merely an example and is not limited to it.

[0060] The processor 83 may further change the variation of the force field F based on a complexity parameter. For example, the processor 83 may make the behavior of the dynamic object Ob1 faster as the complexity parameter increases. Faster behavior may include, for example, increasing the rate of change of the force field per unit time to increase the amount of movement of the target point per unit time (i.e., velocity), or making the change in the direction of movement more complex by shortening the period for reversing the force field.

[0061] [Action A34] Next, in action A34, the processor 83 calculates the next displacement of the target points based on the positions of the latest target point cloud acquired in action A30 and the target force field set in action A33. This displacement can be calculated, for example, according to the dynamic equations of motion for the target points moving in virtual space, based on the position coordinates of the target points, the previous displacement corresponding to the velocity vector of the target points, and the acceleration of each target point caused by the target force field.

[0062] [Action A35] Next, in action A35, the processor 83 acquires the detection results of the contact sensors TS (for example, the DC values ​​of each contact sensor TS). Each DC value is associated with each of the contact sensors TS. Each contact sensor TS is assigned a corresponding region of a continuous virtual space. Contact of a contact sensor TS by a user is an example of a user-specified operation by the driver U or other user to the front display panel 5, right display panel 6, or left display panel 7, and acquiring the detection results of the contact sensors TS is an example of acquiring such a specified operation.

[0063] [Action A36] Next, in action A36, the processor 83 sets a designated point according to the detection result obtained in action A35. Therefore, the above designation operation is an example of an operation to designate a designated point that indicates the destination of a representative position in the virtual space. For example, if the processor 83 obtains a DC value indicating that the user has made contact, it sets one of the points in the virtual space displayed on the display DS corresponding to the contact sensor TS as the designated point. On the other hand, when no designation operation is performed, the processor 83 moves the dynamic object Ob1 by randomly updating the designated point whenever a predetermined update condition is met. With this configuration, the possibility of the dynamic object Ob1 losing its sense of dynamism due to remaining stationary in a specific location can be reduced. Therefore, it is possible to create a sense of life for the dynamic object Ob1 and further enhance the driver U's sense of familiarity with the dynamic object Ob1. The update conditions are arbitrary, such as the passage of a certain period of time or the degree of diffusion or condensation of the target point cloud, as long as the representative position is set to be movable so that the dynamic object Ob1 exhibits autonomous behavior using the entire front display panel 5, right display panel 6, and left display panel 7.

[0064] [Action A37] Next, in action A37, processor 83 calculates the amount of translational movement of the target point cloud so that the representative position of the target point cloud moves closer to the specified point. The amount of translational movement is a movement that uniformly translates the entire target point cloud within the virtual space displayed in the front display panel 5, the right display panel 6, and the left display panel 7, separate from the movement amount based on the target force field described above. The movement to bring the representative position closer to the specified point is not limited to a uniform translational movement, but may also be performed by generating an additional force field.

[0065] [Action A38] Next, in action A38, processor 83 updates the position of the target point cloud based on the movement amount calculated in action A34 and the translational movement amount calculated in action A37. For example, processor 83 updates the position of the target point cloud by adding a movement amount obtained by combining the above movement amounts to the position of the latest target point obtained in action A30. In this embodiment, by adding the above-mentioned translational movement amount, processor 83 can continuously move the dynamic object Ob1 so that the representative position of the target point cloud moves toward the specified point.

[0066] [Action A39] Next, in action A39, the processor 83 determines the display mode of the dynamic object Ob1. For example, the processor 83 may display the target points as simple dots distinct from the background, or it may display each target point connected by a line. Alternatively, the processor 83 may extract the target points to be displayed as the dynamic object Ob1 from among the target points included in the target point group, and determine the display mode of the dynamic object Ob1 by assigning shapes such as fish to the extracted target points. The processor 83 may also change the display mode of the target points based on the complexity parameter. With such a configuration, the complexity of the vehicle 2's movement can be visually perceived as the appearance of the target object, so, for example, abrupt changes in the degree of change of the environment around the vehicle 2 can be presented to the driver U as a sense of incongruity in the continuous video. For example, the processor 83 may change the color scheme of the dynamic object Ob1 so that it stands out against the background image described later as the complexity parameter increases.

[0067] Subsequently, processor 83 completes the object movement process and proceeds to action A4 shown in Figure 3.

[0068] 2.3. Background Processing Next, we will explain an example of the background processing flow in Action A4 of the activity shown in Figure 3. Figure 5 is an activity that shows an example of the background processing flow in Action A4.

[0069] [Action A40] First, in action A40, processor 83 sets the basic state of the background image. Background processing may be defined to change the background image as a video by performing various image processing and image modulation on the basic state. The background image may be defined to include background objects. Background objects may be defined by a set of points, for example, similar to a target point cloud. Points may be described, for example, as particles floating in the background image.

[0070] [Action A41] Next, in action A41, the processor 83 changes the display mode of the background image based on the complexity parameter. For example, as the complexity parameter increases, the processor 83 may modulate the background image to make the pattern finer or change the movement of particles in the background image to make it more intense. For example, the processor 83 may change the background image so that the value corresponding to the complexity parameter is the principal component of the frequency spectrum. In this case, the background image is a pseudo-pattern image obtained by forming a random pattern that has the principal frequency component. Each pixel position in the background image is assigned an RGB value to form the random pattern. The background image may also be a pattern image having periodicity corresponding to the principal frequency component. Furthermore, the background image is not limited to a color image to which RGB values ​​are assigned, but may also be a monochrome image or a binary image. In this way, the processor 83 can change the display mode of the background image of the target point based on the complexity parameter.

[0071] [Action A42] Next, in action A42, processor 83 may perform trace processing based on the behavior of the dynamic object Ob1. Trace processing is a process that represents the traces of the behavior of the dynamic object Ob1 (e.g., movement or deformation) through changes in the background image. For example, processor 83 may perform trace processing by displacing patterns or objects in the background image that are located at the position where the dynamic object Ob1 collides with the dynamic object Ob1 so as to move them away from the position where the dynamic object Ob1 moved. Alternatively, processor 83 may perform trace processing that shows the trajectory of the dynamic object Ob1 for a certain period of time by leaving the displacement of patterns or objects in the background image based on the past movement history of the dynamic object Ob1.

[0072] [Action A43] Next, in action A43, processor 83 generates or updates the background image to be displayed based on the result of the change in the display mode of the background image in action A41 and the result of the trace processing in action A42. After that, processor 83 finishes the background processing and proceeds to action A5.

[0073] By combining the dynamic object Ob1 obtained through this process with the background image, the images displayed on the front display panel 5, the right display panel 6, and the left display panel 7 are obtained.

[0074] According to the above information processing, for example, if a dynamic object is displayed on the right display panel 6 or the left display panel 7, but the right display panel 6 or the left display panel 7 is located outside the driver U's field of vision, the driver U can operate the front display panel 5 to bring the dynamic object Ob1 into their field of vision. Therefore, the sense of familiarity with the dynamic object Ob1 in the interior space SP of the vehicle 2 can be enhanced, and a more comfortable space can be provided for users such as the driver U.

[0075] 2.4. Behavior of the dynamic object Ob1 based on specified operations Next, the behavior of the dynamic object Ob1 based on the specified operation will be described. Figure 6 shows an example of the interior space SP of the vehicle 2 where the dynamic object Ob1 is displayed in the front display panel 5. Figure 7 shows an example of the behavior of the dynamic object Ob1 when a specified operation is performed on the right display panel 6 in the interior space SP shown in Figure 6. For the sake of explanation, the dynamic object Ob1 is not a point cloud, but is assumed to be constructed by assigning a fish-like appearance to some of the extracted target points.

[0076] As shown in Figure 6, the dynamic object Ob1 is displayed on the front display panel 5 as if floating in a virtual space within the composite image. In this case, the representative position of the target point cloud that forms the basis of the dynamic object Ob1 is located at least within the range of the front display panel 5.

[0077] If driver U touches the right display panel 6 with their finger, a designated point is specified within the virtual space assigned to the right display panel 6, as shown in Figure 7. This causes the target point in the target point group that forms the basis of the dynamic object Ob1 to move from the representative position located on the front display panel 5 to the designated point located on the right display panel 6, taking into account the amount of translational movement. As a result, the dynamic object Ob1a, which was located on the front display panel 5, moves toward the right display panel 6 and behaves like the dynamic object Ob1b, temporarily stopping near the designated point in the right display panel 6. In this way, by touching display panels 5 to 7, driver U can summon the autonomously behaving dynamic object Ob1, thus creating a sense of familiarity with the dynamic object Ob1.

[0078] 3. Specific examples of composite images Next, we will describe some specific examples of composite images displayed in the front display panel 5, the right display panel 6, and the left display panel 7 in this video display system 1.

[0079] 3.1. Example of display of a composite image when a fish-like appearance is assigned. Figure 8 shows an example of a composite image when a fish-like appearance is assigned. First, the composite image IM1 shown in Figure 8 is obtained by extracting some of the target points included in the target point cloud and assigning a fish-like appearance to those target points. The composite image IM1 changes in the order of (a)→(b)→(c)→(d)→(e) shown in Figure 8.

[0080] In Figure 8(a), the composite image IM1 is generated when the complexity parameter is below a baseline value (almost zero), for example, when vehicle 2 is stopped and there are no oncoming vehicles. In Figure 8(a), the processor 83 sets the color scheme of the fish-shaped dynamic object Ob1 to blend in with the background image, making the dynamic object Ob1 camouflage itself against the background.

[0081] Subsequently, when vehicle 2 begins to move and the complexity parameter exceeds the baseline value, the color scheme of the dynamic object Ob1 is changed to one that is distinguishable from the background image, as shown in Figure 8(b), making it easier for driver U to see the dynamic object Ob1.

[0082] Subsequently, a designation operation is performed on the left display panel 7 (for example, by a passenger seated in the front passenger seat 3b or the rear seat 3c), and as shown in Figure 8(c), a designated point P1 is specified, and the dynamic object Ob1, which resembles a school of fish, begins to move toward the designated point P1. At this time, the orientation of each fish-shaped object also changes according to the direction of movement. Note that the designated point P1 shown as a white circle in the figure is illustrated for the sake of explanation and does not actually need to be displayed.

[0083] Subsequently, when a designation operation is performed again on the right area of ​​the front display panel 5 (for example, by the driver U), the dynamic object Ob1 of the school of fish that has moved to the left display panel 7 moves collectively toward the designated point P1 in the front display panel 5, as shown in Figure 8(d), and remains stationary at the designated point P1.

[0084] Subsequently, as shown in Figure 8(e), the dynamic object Ob1 autonomously moves and deforms under the influence of the target force field, explosively spreading throughout the composite image IM1 while coming together.

[0085] 3.2. An example of a composite image in which trace processing with the background image is visible. Figure 9 shows an example of a composite image display where trace processing is visible. The composite image IM2 changes in the order of (a)→(b)→(c)→(d)→(e) shown in Figure 9. In generating the composite image IM2, the dynamic object Ob1 is displayed as a wireframe by sequentially connecting the target points that make up the target point cloud with white lines. In addition, as a background image, light blue spring-shaped objects Ob2 extending vertically are placed at intervals against a black background. The spring-shaped objects Ob2 are defined to be displaced (deformed) as the dynamic object Ob1 moves due to trace processing, and gradually return to their original shape. Hereafter, for the sake of explanation, objects Ob2 in the background image that are affected by the dynamic object Ob1 due to trace processing, such as the spring-shaped object Ob2, will be referred to as background objects Ob2. In this display example, the processor 83 changes the influence of the dynamic object Ob1 on the background objects Ob2 due to trace processing so that it increases as the complexity parameter increases.

[0086] In Figure 9(a), the composite image IM2 was generated when the complexity parameter was below a baseline value (almost zero), for example, when vehicle 2 is stationary and there are no oncoming vehicles. In Figure 9(a), the dynamic object Ob1 does not have any influence on the background object Ob2 and exhibits autonomous behavior while hidden behind the background object Ob2.

[0087] Subsequently, when vehicle 2 begins to move and the complexity parameter exceeds the baseline value, as shown in Figure 9(b), trace processing is performed such that the dynamic object Ob1 stretches and pushes the background object Ob2, distorting the background image and making the dynamic object Ob1 easier to see.

[0088] Subsequently, a designation operation is performed on the left display panel 7 (for example, by a passenger seated in the front passenger seat 3b or the rear seat 3c), and as shown in Figure 9(c), the designated point P1 is specified, and the dynamic object Ob1 begins to move toward the designated point P1. Note that the designated point P1 shown as a white circle in the figure is illustrated for illustrative purposes only and does not actually need to be displayed.

[0089] Subsequently, when a designation operation is performed again on the right area of ​​the front display panel 5 (for example, by driver U), the dynamic object Ob1, which had moved to the left display panel 7, moves toward the designated point P1 in the front display panel 5 and stops at the designated point P1, as shown in Figure 9(d).

[0090] Subsequently, as shown in Figure 9(e), the dynamic object Ob1 autonomously moves and deforms under the action of the target force field, causing it to explosively diffuse throughout the entire composite image IM2. At this time, the background object Ob2 is suddenly pushed aside as the dynamic object Ob1 diffuses.

[0091] 3.3. An example of a composite image where the dynamic object Ob1 and the background image change independently. Figure 10 shows an example of the generated composite image. The composite image IM3 changes in the order of (a)→(b)→(c)→(d)→(e) shown in Figure 10. The composite image IM3 is obtained by combining a linear object with target points connected by white lines as a dynamic object Ob1 and a fractal pattern that changes according to the complexity parameter as a background image. The dynamic object Ob1 is given an effect that makes it emit light at high brightness independently of the background image, according to the complexity parameter.

[0092] In Figure 9(a), the composite image IM2 was generated when the complexity parameter was below a baseline value (almost zero), for example, when vehicle 2 is stationary and there are no oncoming vehicles. In Figure 9(a), the dynamic object Ob1 exhibits autonomous behavior while simply hidden behind the background object Ob2.

[0093] Subsequently, as vehicle 2 begins to move and the complexity parameter exceeds the baseline value, the dynamic object Ob1 begins to glow bluish-white, as shown in Figure 9(b), making it easier to distinguish from the background image. Meanwhile, the background image continuously changes to have a more complex and finer fractal pattern.

[0094] Subsequently, a designation operation is performed on the left display panel 7 (for example, by a passenger seated in the front passenger seat 3b or the rear seat 3c), and as shown in Figure 10(c), the designated point P1 is specified, and the dynamic object Ob1 begins to move toward the designated point P1. Note that the white circular designated point P1 shown in the figure is illustrated for illustrative purposes only and does not actually need to be displayed. At this time, the background image in Figure 10 does not change in accordance with the movement of the dynamic object Ob1, as does the background object Ob2 of the composite image IM2 shown in Figure 9, but changes according to the complexity parameter independently of the behavior of the dynamic object Ob1.

[0095] Subsequently, when a designation operation is performed again on the central area of ​​the front display panel 5 (for example, by driver U), the dynamic object Ob1, which had moved to the left display panel 7, moves toward the designated point P1 in the front display panel 5 and stops at the designated point P1, as shown in Figure 10(d).

[0096] Subsequently, as shown in Figure 10(e), the dynamic object Ob1 autonomously moves and deforms so that it explosively diffuses throughout the entire composite image IM3 due to the action of the target force field.

[0097] [others] The above embodiments may be implemented as appropriate based on, for example, the following embodiments.

[0098] There may be multiple types of the above-mentioned specified operations. In this case, a specified point P1 with different properties may be set depending on the type of specified operation. For example, the processor 83 may change the behavior of the dynamic object Ob1 based on the specified point P1 depending on the value of the above-mentioned DC value (for example, depending on whether the finger is in contact, whether it is not in contact but is in close proximity, or whether it is neither in contact nor in close proximity). Specifically, as long as the DC value at which it is determined that the finger is in contact is maintained, the processor 83 may translate the target point group so that the representative position moves toward the specified point as described above, and when the user's contact state changes from a DC value at which it is determined that the finger is in contact to a DC value at which it is determined that the finger is in close proximity, the processor 83 may generate a repulsive force from the specified point P1 toward the dynamic object Ob1 and process the target point group to spread throughout the entire composite image.

[0099] The structure defining the internal space SP is not limited to passenger cars such as vehicle 2, but may also be a mobile body that moves on the ground, such as industrial vehicles or railway vehicles, a mobile body that moves in the air (i.e., a flying object), such as an aircraft or helicopter, or a mobile body that moves on or underwater, such as a ship or submarine. The structure defining the internal space SP is not limited to a mobile body, but may also be, for example, a building in which people can live. For example, the front display panel 5, the right display panel 6, and the left display panel 7 may each be located on the interior wall of a room in a building.

[0100] The video display device 8 may be on-premise or cloud-based. In the case of a cloud-based video display device 8, for example, the above-mentioned functions and processing may be provided in the form of SaaS (Software as a Service) or cloud computing.

[0101] In the above embodiment, the video display device 8 performed various storage and control functions, but instead of the video display device 8, multiple external devices may be used. That is, various information and programs may be stored in a distributed manner across multiple external devices using blockchain technology or the like.

[0102] The above-mentioned video display system 1, etc., may be provided in any of the following embodiments.

[0103] (1) A video display system for the interior of a space in which a user can stay, comprising a first display unit, a second display unit, and at least one control unit, wherein the first display unit and the second display unit are configured to display a single continuous image as a whole, wherein the virtual space defined by the continuous image is defined to include an autonomously movable dynamic object, the dynamic object is defined to behave autonomously as a set of multiple target points arranged around a certain representative position, the first display unit and the second display unit are arranged along an interior wall defining the space such that when the user is looking at one display unit from a reference position in which the user is staying, the other display unit is outside the user's field of view, and the control unit is configured to execute a program so that the following steps are performed: in the designation acquisition step, the system acquires a designation operation of the user to the first display unit and the second display unit, the designation operation is an operation to designate a point indicating the destination of the representative position in the virtual space, and in the movement step, the system moves the dynamic object continuously so that the representative position moves toward the designation point.

[0104] With this configuration, for example, if a dynamic object is displayed on the second display unit but the second display unit is located outside the user's field of view, the user can operate the first display unit, which is within their field of view, to bring the dynamic object into their field of view. Therefore, it is possible to enhance the user's sense of familiarity with the dynamic object in the space and provide a more comfortable space for them to stay in.

[0105] (2) A video display system as described in (1) above, wherein the first display unit and the second display unit are each part of a single display unit that displays the entire continuous video.

[0106] With this configuration, the movement of dynamic objects between the first and second display units can be displayed continuously, thus reducing the sense of incongruity caused by, for example, discontinuous movement of dynamic objects or temporary absence from display units. Therefore, it is possible to enhance the user's sense of familiarity with dynamic objects.

[0107] (3) In the video display system described in (1) or (2) above, the dynamic object is displayed in such a way that it exhibits autonomous behavior as the target points repeatedly diffuse and condense around a specific point defined based on the position of the target point.

[0108] (4) A video display system according to any one of (1) to (3) above, wherein in the movement step, while the specified operation is not performed, the specified point is randomly updated each time a predetermined update condition is met, thereby moving the dynamic object toward the updated specified point.

[0109] This configuration reduces the possibility of dynamic objects losing their sense of dynamism due to remaining stationary in specific locations. Therefore, it enhances the sense of life in dynamic objects and increases user engagement with them.

[0110] (5) A video display system according to any one of (1) to (4) above, wherein the space is the internal space of a mobile body on which the user can board, the mobile body is equipped with an imaging unit capable of imaging at least the surrounding area of ​​the mobile body, and the control unit is configured to execute the program so that the following steps are performed: in the image acquisition step, an image of an object outside the mobile body is acquired, which is imaged by the imaging unit, and the image of the object changes over time in accordance with the movement of the mobile body or changes in the external conditions, in the calculation step, a complexity parameter indicating the complexity of the time change of the object image is calculated based on the image of the object, and in the modification step, the display mode of the object point or the display mode of the background image of the object point is changed based on the complexity parameter.

[0111] With this configuration, the complexity of the movement of the moving object can be visually perceived as the appearance of the target object. For example, abrupt changes in the degree of change in the environment surrounding the moving object can be presented to the user as a sense of incongruity in the continuous video.

[0112] (6) A video display system according to any one of (1) to (5) above, further comprising a mobile body on which the user can board, wherein the space is the internal space of the mobile body, the mobile body is equipped with a seat on which the user can sit, the reference position is defined based on the position of the seat, the first display unit is positioned to face the front of the user seated in the seat, and the second display unit is positioned to face the side of the user seated in the seat.

[0113] This configuration allows for a lively atmosphere around the passenger's seat, thereby improving comfort during their stay inside the vehicle.

[0114] (7) The video display system described in (6) above, wherein the moving body is a vehicle, the passenger seat includes a driver's seat into which the user can board as a driver and a rear seat located behind the driver's seat, the vehicle has a rear door for boarding the rear seat, and at least a portion of the second display unit is arranged along the rear door.

[0115] This configuration can improve the enjoyment of passengers in the rear seats, such as children or friends, while they are inside the vehicle during travel. Of course, this is not always the case.

[0116] Finally, while various embodiments relating to this disclosure have been described, these are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be implemented in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of Symbols]

[0117] 1: Video display system 2: Vehicles 20: Communications bus 21: Vehicle body 22a: Front door 22b: Front door 22c: Rear door 23: Processor 3: Seats 3a: Driver's seat 3b:Passenger seat 3c: Rear seat 4: In-car camera 5: Front display panel 6: Right display panel 7: Left display panel 8: Video display device 80: Communications bus 81: Communications Department 82: Storage section 83: Processor 84: Processing display unit 85: Input section DS: Display IM0: In-vehicle image IM1: Composite image IM2: Composite image IM3: Composite image LS: Light source section Ob1: Dynamic object Ob1a: Dynamic object Ob2: Background object P1:Specified point R: Field of view SP: Internal space TS: Contact sensor U: Driver

Claims

1. A video display system for the interior of a space where users can stay, It comprises a first display unit, a second display unit, and at least one control unit. The first display unit and the second display unit are configured to display a single continuous image as a whole, wherein the virtual space defined by the continuous image is defined to include a dynamic object that can move autonomously, and the dynamic object is defined to behave autonomously as a set of multiple target points arranged around a certain representative position. The first and second display units are arranged along an inner wall defining the space such that when the user is looking at one display unit from a reference position where the user is located, the other display unit is outside the user's field of vision. The control unit is configured to execute a program so that the following steps are performed: In the designation acquisition step, the user's designation operation for the first display unit and the second display unit is acquired, and the designation operation is an operation to specify a designated point that indicates the destination of the representative position in the virtual space. A video display system that, in the movement step, continuously moves the dynamic object so that the representative position moves toward the designated point.

2. In the video display system according to claim 1, A video display system in which the first display unit and the second display unit are each part of a single display unit that displays the entire continuous video.

3. In the video display system according to claim 1, The aforementioned dynamic object is displayed in a video display system in which the target points repeatedly diffuse and condense around a specific point defined based on the position of the target point, thereby exhibiting autonomous behavior.

4. In the video display system according to claim 1, In the aforementioned movement step, the video display system moves the dynamic object toward the updated designated point by randomly updating the designated point whenever a predetermined update condition is met, while the specified operation is not being performed.

5. In the video display system according to claim 1, The aforementioned space is the internal space of a mobile vehicle that the user can board, The moving body includes an imaging unit capable of imaging at least the surrounding area of ​​the moving body, The control unit is further configured to execute the program so that the following steps are performed: In the image acquisition step, an image of the target outside the moving object, captured by the imaging unit, is acquired, and here, the target image changes over time in accordance with the movement of the moving object or changes in the external conditions. In the calculation step, a complexity parameter indicating the complexity of the time evolution of the target image is calculated based on the target image. A video display system that, in the modification step, changes the display mode of the target point or the display mode of the background image of the target point based on the complexity parameter.

6. In the video display system according to any one of claims 1 to 5, Furthermore, it includes a mobile vehicle that the user can board, The aforementioned space is the internal space of the moving body, The mobile vehicle is equipped with a passenger seat on which the user can sit, The aforementioned reference position is determined based on the position of the passenger seat, The first display unit is positioned to face the user seated in the passenger seat, The second display unit is a video display system positioned to face the side of the user seated in the passenger seat.

7. In the video display system described in claim 6, The aforementioned moving object is a vehicle, The aforementioned passenger seat includes a driver's seat in which the user can sit as the driver, and a rear seat located behind the driver's seat. The vehicle is equipped with a rear door for boarding the rear seats, At least a portion of the second display unit is a video display system arranged along the rear door.

Images