Video display system

Abstract

According to one aspect of the present invention, provided is a video display system for the interior of a space in which a user can stay, the video display system comprising a first display unit, a second display unit, and at least one control unit. The first display unit and the second display unit are configured to display one continuous video as a whole. A virtual space defined by the continuous video is defined to include an autonomously movable dynamic object. The dynamic object is defined to behave autonomously on the basis of a set of a plurality of target points arranged around a certain representative position. The first display unit and the second display unit are arranged along an inner wall defining the space, such that, when the user has his or her gaze directed toward one display unit from a certain reference position at which the user stays, the other display unit is out of the user's field of view. The control unit is configured to execute a program so that the following steps are performed. In a designation acquisition step, a user's designation operation with respect to the first display unit and the second display unit is acquired, the designation operation being an operation for designating a designated point indicating a destination of movement of the representative position in the virtual space. In a movement step, the dynamic object is continuously moved so that the representative position is directed to the designated point.

Description

Video display system

[0001] The present invention relates to a video display system.

[0002] Patent Document 1 discloses a technique for providing an image generation device or the like that can obtain an image that changes according to the surrounding environment of a moving object. The image generation device includes an information generation unit (parameter generation unit) that generates environment information (such as a complexity parameter) representing the degree of change in the surrounding environment of the moving object, and an image generation unit that controls image processing according to the environment information and generates an image that changes according to the environment information.

[0003] Japanese Unexamined Patent Application Publication No. 2019-92094

[0004] By the way, there is still room for improvement in the technology related to the interior decoration of a space where a user can stay, such as the interior space of a moving object.

[0005] According to one aspect of the present invention, there is provided a video display system in the interior decoration of a space where a user can stay, including a first display unit, a second display unit, and at least one control unit. The first display unit and the second display unit are configured to display one continuous video as a whole. The virtual space defined by the continuous video is defined to include a dynamically movable object. The dynamically movable object is defined to exhibit autonomous behavior by a set of a plurality of target points arranged around a certain representative position. The first display unit and the second display unit are arranged along the inner wall defining the space such that when the user is looking at one display unit from a certain reference position where the user stays, the other display unit is out of the user's field of view. The control unit is configured to execute a program so that the following steps are taken. In the designation acquisition step, a designation operation of the user with respect to the first display unit and the second display unit is acquired. The designation operation is an operation of designating a designated point indicating the destination of the representative position in the virtual space. In the movement step, a video display system is provided that continuously moves the dynamically movable object so that the representative position moves toward the designated point.

[0006] According to such a configuration, for example, it is possible to enhance the sense of closeness to the dynamically movable object in the space and provide a space where the user can stay more comfortably.

[0007] This is a configuration diagram representing the video display system 1. This is a block diagram showing the hardware configuration of the video display device 8. This is an activity diagram showing an example of the information processing flow performed in the video display system 1. This is an activity showing an example of the object movement processing flow in action A3. This is an activity showing an example of the background processing flow in action A4. This is a diagram showing an example of the internal space SP of the vehicle 2 in which the dynamic object Ob1 is displayed in the front display panel 5. This is a diagram showing an example of the behavior of the dynamic object Ob1 when a specified operation is performed on the right display panel 6 in the internal space SP shown in Figure 6. This is a diagram showing an example of the display of a composite image when a fish-like appearance is assigned. This is a diagram showing an example of the display of a composite image in which trace processing can be visually confirmed. This is a diagram showing an example of the display of a generated composite image.

[0008] Embodiments of the present invention will be described below with reference to the drawings. The various features shown in the embodiments below can be combined with each other.

[0009] Incidentally, the program for realizing the software appearing in one embodiment may be provided as a computer-readable non-transitor-readable medium, or it may be provided so that it can be downloaded from an external server, or it may be provided so that the program is launched on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0010] Furthermore, in various information processing according to one embodiment, an input and an output corresponding to the input can be realized. Here, as long as an output is obtained as a result of the input, the form of the information referenced in such information processing (hereinafter referred to as "reference information") is not limited. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression equation constructed by a statistical method), or a pre-trained model that has learned the correlation between input and output in advance, or a large-scale language model that can output a desired result by inputting a prompt.

[0011] Furthermore, in one embodiment, "part" may include, for example, hardware resources implemented by a circuit in a broad sense, and the information processing of software that can be specifically realized by these hardware resources. Also, in one embodiment, various types of information are handled, and this information can be represented, for example, by the physical values ​​of signal values ​​representing voltage and current, the high or low values ​​of signal values ​​as a set of binary bits composed of 0s or 1s, or by quantum superposition (so-called qubits), and communication and calculations can be performed on a circuit in a broad sense.

[0012] Furthermore, a circuit in a broad sense is a circuit realized by combining at least an appropriate combination of circuits, circuits, processors, and memory. The processor may be a general-purpose processor or a dedicated circuit. In other words, this includes application-specific integrated circuits (ASICs), programmable logic devices (for example, simple programmable logic devices (SPLDs), complex programmable logic devices (CPLDs), and field programmable gate arrays (FPGAs)), etc.

[0013] 1. Hardware Configuration This section describes the hardware configuration.

[0014] <Video Display System 1> Figure 1 is a configuration diagram representing the video display system 1. The video display system 1 is a system for displaying a specific video to a driver U, who is an example of a user, in the interior of a space where the driver U can stay. As an example, the video display system 1 includes a vehicle 2, which is an example of a mobile body that the driver U can board (ride in), and the space is the interior space SP of the vehicle 2 where the driver U can board.

[0015] Vehicle 2 comprises a body 21, two front doors 22a and 22b, two rear doors 22c and 22d, multiple seats 3, an onboard camera 4, a front display panel 5, a right display panel 6, a left display panel 7, and an image display device 8.

[0016] The body 21 is an example of an inner wall that defines the internal space SP of the vehicle 2. The body 21 is not limited to defining the internal space SP as a closed space; for example, if the vehicle 2 is a convertible, it may define it as an open space with an opening at the top.

[0017] The front doors 22a and 22b define entrances and exits for a user, such as the driver U, to enter the interior space SP and board the front of the vehicle 2.

[0018] The rear doors 22c and 22d are located behind the front doors 22a and 22b and define the entrances for boarding the rear seats 3c, which will be described later.

[0019] The seating area 3 may include a driver's seat 3a, a passenger seat 3b, and a rear seat 3c. The driver's seat 3a is located near the front door 22a and is configured so that a driver U can sit in it. While seated in the driver's seat 3a, the driver U faces forward and performs operations related to the driving of the vehicle 2 (for example, steering with the steering wheel, acceleration and deceleration with the pedals, etc.). The field of view R in Figure 1 conceptually shows the range that the driver U can see when facing forward. The passenger seat 3b is located near the front door 22b and next to the front door 22a (in this case, to the left). The rear seat 3c is located behind the driver's seat 3a and passenger seat 3b and is configured so that a passenger can board the vehicle 2 through the rear doors 22c and 22d.

[0020] The in-vehicle camera 4 is configured to generate an in-vehicle image by capturing images of at least a portion of the area surrounding the vehicle 2. The in-vehicle camera 4 in this embodiment is a so-called front camera, configured to capture images in front of the vehicle 2. The in-vehicle camera 4 may also be a so-called rear camera, configured to capture images behind the vehicle 2 when driving in reverse, or a combination of both.

[0021] In-vehicle images can change over time. These temporal changes in the in-vehicle image can be caused by the relative movement of objects within the imaging range of the in-vehicle camera 4 relative to the vehicle 2. For example, the temporal changes in the in-vehicle image tend to increase as the speed of the vehicle 2 increases. Furthermore, the temporal changes in the in-vehicle image tend to increase in proportion to the change in the direction of travel of the vehicle 2, such as due to sharp curves. Additionally, the temporal changes in the in-vehicle image tend to increase in the area corresponding to the wall, as the proximity of surrounding objects, such as a wall, to the vehicle 2 increases. Therefore, the temporal changes in the in-vehicle image tend to increase when the driver U is required to pay relatively high attention while operating the vehicle 2.

[0022] The front display panel 5, the right display panel 6, and the left display panel 7 are configured to display a single continuous image as a whole. The specific configuration of the front display panel 5, the right display panel 6, and the left display panel 7 is arbitrary as long as it can display an image, but in this embodiment, multiple displays DS are arranged side by side. Each of the displays DS includes a light source unit LS and a contact sensor TS.

[0023] The light source unit LS is a light source capable of emitting light to display an image, and is, for example, an array of LEDs arranged in a two-dimensional plane. The light source unit LS may be provided in a curved manner along the inner wall of the vehicle body 21.

[0024] The contact sensor TS is configured to detect contact between the driver U and the display DS by a user. In this embodiment, the contact sensor TS may be configured to detect not only contact between the user and the display DS, but also proximity (for example, when the display DS and the driver U's fingers are within a predetermined distance). The specific form of the contact sensor TS is arbitrary, but for example, the contact sensor TS can detect contact and proximity of the driver U to the display DS based on changes in capacitance between the transparent electrodes by providing transparent electrodes on both sides of a transparent plate (for example, an acrylic plate) and electrically connecting the transparent electrodes to a detection circuit (not shown) capable of detecting the capacitance between the transparent electrodes. In this embodiment, the contact sensor TS preferentially extracts and amplifies the frequency components induced in the human body (for example, 60 Hz and its harmonics) from the change in capacitance as an analog signal. Subsequently, the detection circuit converts the extracted and amplified analog signal into a digital signal, and the value of the digital signal is converted into an absolute value and used as the time-averaged DC value over a predetermined period. The DC value can be used as an indicator to determine whether the user is close to the display DS, in contact with it, or neither close nor in contact with it. Thus, the contact sensor TS in this embodiment is configured to perform detection using a so-called quasi-electrostatic field method, which amplifies the induced signal. In this embodiment, the contact sensors TS are arranged to correspond to each of the light source units LS and are configured to generate a signal that can detect which contact sensor TS the user has touched. The contact sensors TS may also be configured to detect the position of contact made by the user at one of the light source units LS. However, this is not limited to the above, and the contact sensors TS may, for example, generate a signal to detect the manner in which the user is touching the display DS using a capacitive method. Furthermore, the front display panel 5, etc., is not limited to being divided by a plurality of light source units LS, but may be configured to be divided and arranged around a single continuous light source unit LS.

[0025] Here, the positional relationship between the front display panel 5, the right display panel 6, and the left display panel 7 will be explained. The front display panel 5 is an example of the first display unit and is positioned to face the driver U seated in the driver's seat 3a. As an example, the front display panel 5 may be positioned to extend laterally in front of both the driver's seat 3a and the passenger seat 3b. The specific position of the front display panel 5 is arbitrary, but for example, the front display panel 5 is provided along the inner wall of the vehicle body 21 so as to cross below the instrument panel located at the front of the vehicle 2.

[0026] The right display panel 6 is an example of a second display unit and is positioned facing the side (right side) of the driver U seated in the driver's seat 3a. For example, the right display panel 6 is positioned to extend laterally along the area of ​​the inner wall of the vehicle body 21 located on the right side of the driver's seat 3a. For example, the right display panel 6 is positioned to cross the front door 22a. In this embodiment, the right display panel 6 is further positioned along the area of ​​the inner wall of the vehicle body 21, extending from the area on the right side of the driver's seat 3a to the area on the right side of the rear seat 3c. Also, for example, the left end of the right display panel 6 is connected to the right end of the front display panel 5. This allows the front display panel 5 and the right display panel 6 to function as an integrated display panel.

[0027] The left display panel 7 is an example of a second display unit and is positioned facing the side (left side) of the driver U seated in the driver's seat 3a. It is positioned to extend laterally along the area of ​​the interior wall of the vehicle body 21 located on the left side of the passenger seat 3b. For example, the left display panel 7 is positioned to cross the front door 22b. In this embodiment, the left display panel 7 is further positioned along the interior wall of the vehicle body 21, extending from the area on the left side of the passenger seat 3b to the area on the left side of the rear seat 3c. Also, for example, the right end of the left display panel 7 is connected to the left end of the front display panel 5. This allows the front display panel 5 and the right display panel 6 to function as an integrated display panel.

[0028] Thus, at least a portion of the right display panel 6 and the left display panel 7 may be positioned along the rear door 22c. With this configuration, the enjoyment of users riding in the rear seats 3c, such as children or friends, while staying inside the vehicle 2 during travel can be improved. Furthermore, each of the front display panel 5, the right display panel 6, and the left display panel 7 may be part of a single display panel that displays the entire continuous image. With this configuration, the movement of dynamic objects displayed in the continuous image between the front display panel 5, the right display panel 6, and the left display panel 7 can be displayed continuously, thus reducing the sense of incongruity caused by, for example, discontinuity in the movement of dynamic objects or temporary absence from any display unit. Therefore, the driver U can feel a greater sense of familiarity with the dynamic objects.

[0029] Thus, the front display panel 5, the right display panel 6, and the left display panel 7 are arranged along the inner wall of the vehicle body 21 that defines the interior space SP, such that when the driver U is looking at any one of the display panels (for example, the front display panel 5) from a certain reference position where the driver U is located, the other display panels (for example, the right display panel 6 or the left display panel 7) are outside the driver U's field of vision R. Here, it should be noted that "outside the driver U's field of vision R" is not limited to the entire display panel being outside the field of vision, but also includes the case where a part of the field of vision R is outside the field of vision. The reference position is a reference position that is predetermined when viewing at least one of the front display panel 5, the right display panel 6, and the left display panel 7. In this embodiment, the reference position is defined based on the position of the passenger seats, such as the driver's seat 3a, the passenger seat 3b, and the rear seat 3c. With this configuration, the area around the passenger seats can be made more lively for the user, thereby improving the comfort of staying inside the vehicle 2. For example, the reference position corresponds to the typical eye level of the driver U seated in the driver's seat 3a.

[0030] The video display device 8 is configured to control the content of the video displayed on the front display panel 5, the right display panel 6, and the left display panel 7 of the video display system 1. Figure 2 is a block diagram showing the hardware configuration of the video display device 8. The video display device 8 includes a communication unit 81, a storage unit 82, a processor 83, a processing display unit 84, and an input unit 85, and these components are electrically connected within the video display device 8 via a communication bus 20. Each component will be described further.

[0031] The communication unit 81 preferably uses wired communication methods such as USB, IEEE 1394, Thunderbolt®, and wired LAN network communication, but may also include wireless LAN network communication, mobile communication such as 3G / LTE / 5G, and Bluetooth® communication as needed. In other words, it is more preferable to implement it as a collection of these multiple communication methods. That is, the video display device 8 may communicate various information from the outside via the communication unit 81 and the network.

[0032] The storage unit 82 stores various types of information as defined above. This can be implemented, for example, as a storage device such as a solid-state drive (SSD) that stores various programs related to the video display device 8 executed by the processor 83, or as a memory such as a random access memory (RAM) that stores temporarily necessary information (arguments, arrays, etc.) related to program calculations. The storage unit 82 stores various programs and variables related to the video display device 8 executed by the processor 83.

[0033] The processor 83 performs processing and control of the overall operation related to the video display device 8. The processor 83 is, for example, a Central Processing Unit (CPU) (not shown). The processor 83 realizes various functions related to the video display device 8 by reading predetermined programs stored in the memory unit 82. That is, information processing by software stored in the memory unit 82 is concretely realized by the processor 83, which is an example of hardware, and can be executed as each functional unit included in the processor 83. These will be described in more detail in the next section. Note that the processor 83 is not limited to being a single unit, and may be implemented with multiple processors 83 for each function, or a combination thereof.

[0034] The processing and display unit 84 may be included in the housing of the video display device 8 or it may be an external unit. The processing and display unit 84 displays a graphical user interface (GUI) screen that can be operated by the user. This is preferably done by appropriately using different display devices such as a CRT display, liquid crystal display, organic EL display, and plasma display.

[0035] The input unit 85 is configured to accept input from the user. The input unit 85 may be included in the housing of the video display device 8 or it may be external. For example, the input unit 85 may be implemented as a touch panel integrated with the processing display unit 84. If it is a touch panel, the user can input tap operations, swipe operations, etc. Of course, instead of a touch panel, a switch button, mouse, QWERTY keyboard, voice recognition device, gesture detection device, gaze detection device, biosignal detection device, imaging device, etc. may be used. In other words, the input unit 85 accepts operation input made by the user. In response, the input unit 85 transmits a signal corresponding to the operation input to the processor 83 via the communication bus 80. The processor 83 can perform predetermined control and calculations as needed.

[0036] The processor 83 is configured as an acquisition unit to acquire information from various devices. The processor 83 is configured to acquire various information by reading various information stored in the storage area, which is at least a part of the memory unit 82, and writing the read information to the work area, which is at least a part of the memory unit 82. The storage area is, for example, the area of ​​the memory unit 82 that is implemented as a storage device such as an SSD. The work area is, for example, the area that is implemented as memory such as RAM. The acquisition by the processor 83 includes acquiring the output results of each functional unit included in the processor 83.

[0037] The processor 83 is configured as a display processing unit to display various types of information. This information can be presented to the user through a processing display unit 84 or the like. In such a case, for example, the processor 83 controls the display of visual information such as images including still images or moving images, icons, and messages. The processor 83 may generate only rendering information for displaying the visual information.

[0038] In this embodiment, the processor 83 is configured as a display processing unit to display a single continuous image on the front display panel 5, the right display panel 6, and the left display panel 7 as a whole. The content of the image and the method of displaying it will be described later.

[0039] 2. An Example of Information Processing This section describes the information processing performed in the video display system 1 described above. This information processing is for displaying a single continuous video as a whole on the front display panel 5, the right display panel 6, and the left display panel 7. The continuous video is configured to define a virtual space in which objects can be placed and moved. The virtual space defined by the continuous video is defined to include a dynamic object Ob1 (see Figures 6 to 10 described later) that can move autonomously. The specific form of the continuous video will be described in detail after the flow of this information processing is explained.

[0040] 2.1. Overview of the Information Processing Flow Figure 3 is an activity diagram showing an example of the overview of the information processing flow performed in the video display system 1. Note that this information processing may include any exceptions not shown. Exceptions include interrupting the information processing or omitting each process. The selections or inputs made in this information processing may be based on user operation or may be performed automatically without user operation.

[0041] [Action A1] As shown in Figure 3, first, in Action A1, the processor 83 acquires an in-vehicle image from the in-vehicle camera 4. The in-vehicle image may change over time in response to the movement of the vehicle 2 or changes in external conditions. The processor 83 acquires the latest image included in the in-vehicle image and the image immediately preceding the latest image in the in-vehicle image. The difference between these images may indicate a temporal change in the in-vehicle image.

[0042] Next, in action A2, the processor 83 calculates a complexity parameter based on the in-vehicle image acquired in action A1. The complexity parameter indicates the complexity of the time change of the in-vehicle image. For example, the processor 83 calculates the complexity parameter based on the difference between the latest image in the in-vehicle image and an image in the in-vehicle image from a predetermined period prior to a certain image (e.g., the current image). With this configuration, the difference between an image from a predetermined period prior and the current image can be visually grasped. When the temporal element is represented using frames, the predetermined period is specifically, for example, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 frames, and may be within the range of any two of the numbers exemplified here. In this embodiment, the processor 83 calculates the complexity parameter based on the difference between the latest image in the in-vehicle image and the image immediately preceding the latest image in the in-vehicle image (in other words, the image one frame prior). Specifically, the processor 83 identifies the number of pixels that differ between the latest image and the previous image, and calculates the complexity parameter from a relational expression relating the number of pixels to the complexity parameter. The complexity parameter in this embodiment is a scalar value. The relationship is defined such that the complexity parameter increases as the number of pixels increases. When the in-vehicle image does not change, the number of pixels is approximately 0, and as the changes in the in-vehicle image become more complex, the number of pixels increases. Therefore, nearly different numbers of pixels correlate with the complexity of the changes in the in-vehicle image. Note that the method of calculating the complexity parameter is not limited to this and is arbitrary; for example, the complexity parameter may be calculated using a pre-trained model that takes multiple images (e.g., two) as input and outputs the complexity parameters for those multiple images.

[0043] [Action A3] Next, in Action A3, the processor 83 executes an object movement process. The object movement process is a process to autonomously move the dynamic object Ob1 that is placed in the continuous video. As a result, the position of the dynamic object Ob1 in the continuous video is updated.

[0044] [Action A4] Next, in Action A4, the processor 83 executes background processing. The background processing is a process for generating or updating a background image that constitutes the background of the dynamic object Ob1 displayed in the continuous video.

[0045] [Action A5] Next, in Action A5, the processor 83 executes compositing processing. The compositing processing is a process for generating a composite image that visually represents a virtual space for displaying the dynamic object Ob1 whose position has been updated in Action A3 on the front display panel 5, the right display panel 6, and the left display panel 7 by compositing it with the latest background image generated or updated in Action A4.

[0046] [Action A6] Next, in Action A6, the processor 83 performs a process for displaying the composite image generated in Action A5 on the front display panel 5, the right display panel 6, and the left display panel 7. Here, the processor 83 allocates the areas of the virtual space to be displayed on each of the front display panel 5, the right display panel 6, and the left display panel 7, and cooperatively controls these display panels 5 to 7 so that one continuous video is displayed as a whole.

[0047] Thereafter, when continuing this information processing, the processor 83 re-executes the processing from Action A1, sequentially updates the position and background image of the dynamic object Ob1, and displays the latest composite image. On the other hand, when an operation to end this information processing is performed, the processor 83 stops the display of the continuous video and ends this information processing.

[0048] 2.2. Object Movement Processing Next, an example of object movement processing in Action A3 of the activity shown in FIG. 3 will be described. FIG. 4 is an activity showing an example of the flow of object movement processing in Action A3. The dynamic object Ob1 subject to object movement processing is defined to exhibit autonomous behavior by a set of a plurality of target points arranged around a certain representative position. Hereinafter, for convenience of explanation, the set of a plurality of target points constituting the dynamic object Ob1 is referred to as a target point group.

[0049] [Action A30] As shown in Figure 4, first, in action A30, the processor 83 obtains the position of the latest target point that constitutes the dynamic object Ob1. The position of the point cloud can be described, for example, as three-dimensional position coordinates in the virtual space. If the target point cloud does not exist in the virtual space, the processor 83 can appropriately determine the initial placement of the target point cloud and generate the target point cloud.

[0050] [Action A31] Next, in Action A31, the amount of movement of the target point cloud from the previous position to the latest position is calculated. This amount of movement is, for example, the amount of movement of each target point that makes up the target point cloud per unit time in the virtual space, and the processor 83 can calculate the velocity vector and acceleration vector of the target point based on this amount of movement.

[0051] [Action A32] Next, in action A32, the processor 83 sets a predetermined specific point in the virtual space. More specifically, the processor 83 sets a specific point in the virtual space based on the position coordinates of at least one target point. In this embodiment, the processor 83 sets a specific point by comparing the number of target points included in a plurality of sub-regions obtained by dividing the virtual space. More specifically, the processor 83 sets a specific point by comparing the number of target points included in the two-dimensional region of the image projected when the virtual space is displayed on the front display panel 5, etc. If the sub-regions are closed regions of equal size, it can also be said that the processor 83 sets a specific point based on the number density of target points in the two-dimensional region. More specifically, the processor 83 sets one of the target points as the specific point.

[0052] [Action A33] Next, in action A33, the processor 83 sets the target force field F. The target force field F is a force field that acts on target points in virtual space, causing acceleration at the target points. As a result, the position coordinates of each target point change. The change in position coordinate r due to the action of the target force field F can be calculated using known analytical mechanics relationships. Through the action of such a target force field, the dynamic object Ob1 is defined to behave autonomously as a set of multiple target points arranged around a certain representative position. The representative position indicates the core position of the dynamic object Ob1 and can be arbitrarily set, for example, the centroid position of the group of target points, the position of one of the target points, etc. As an example, the target force field F may include a first force field F1 and a second force field F2.

[0053] The first force field F1 is configured such that multiple target points move away from a designated specific point. Therefore, the first force field F1 is configured to act at least repulsively between the target points and the specific point. As a result, the first force field F1 functions to diffuse the target points away from the specific point. The direction of the first force field F1 is parallel to the direction r01 from the specific point toward the target points on which the first force field F1 acts. This direction r01 can be expressed in vector notation as r1 - r0, where r0 is the position coordinate r of the specific point and r1 is the position coordinate r1 of the target points.

[0054] In this embodiment, the magnitude of the first force field F1 acting on the target point is set according to the positional relationship between the specific point and the target point. For example, the magnitude of the first force field F1 acting on the target point decreases as the distance between the specific point and the target point increases. That is, as the distance between the specific point and the target point decreases, the specific point and the target point repel each other more strongly. In this embodiment, the first force field F1 is configured as a central force centered on the specific point. Note that if the target point has a finite size in virtual space, the above distance may be the distance between the centers of each point or the distance between the surfaces of each point.

[0055] The first force field F1 acting on the target point is configured to change over time in the virtual space. Specifically, the first force field F1 acting on the target point is configured to alternate between repulsive and attractive forces over time. This allows multiple target points to not only expand due to repulsive forces but also contract due to attractive forces. As a result, the representation of the actions of multiple target points becomes more diverse.

[0056] In this embodiment, the first force field F1 acting on the target point is configured to change periodically with respect to time. This reduces the amount of information required to set the first force field F1 acting on the target point, thereby reducing the processing load on the processor 23. The specific manner in which the first force field F1 changes over time is arbitrary, but for example, the waveform of the first force field F1 can be any, such as a square wave, triangular wave, sawtooth wave, or sine wave, with time t as a parameter. The period of the first force field F1 is arbitrary. In this embodiment, the first force field F1 increases so as time progresses in the virtual space that it switches almost continuously from an attractive force to a repulsive force on the target point. Subsequently, when the first force field F1 reaches a predetermined value, the sign of the first force field F1 is reversed. The waveform of such a first force field F1 is, for example, a sawtooth wave.

[0057] Next, using two target points, the first and second target points, we will explain how the second force field F2 acts on the first and second target points. For the sake of explanation, we will assume that the displacement of the first target point is negligibly small compared to the displacement dr of the second target point.

[0058] A second force field F2 can be configured to attract two object points to each other. In other words, the second force field F2 acts attractively between the two object points. The magnitude of the second force field F2 increases with increasing distance between the two object points. More specifically, the second force field F2 is configured to attract two object points to each other when they move away from each other. In this embodiment, the direction of the second force field F2 is parallel to the direction from one object point to the other. In other words, the second force field F2 functions as a reaction force that inhibits the movement of the two object points away from each other. In this embodiment, the change in distance between the first object point and the second object point is equal to the displacement dr of the second object point. Therefore, it can also be said that the magnitude of the second force field F2 increases with increasing displacement dr of the object points. The relationship between the second force field F2 and the displacement dr of the second object point is arbitrary, but can be expressed, for example, as F2 = k × dr using a coefficient k. As a result, the second force field F2 acts like a spring between the first and second target points, suppressing the dispersal of the first and second target points. The second force field F2 may include higher-order terms with respect to dr. In this embodiment, the second force field F2 acts on both the first and second target points in substantially antiparallel directions. When both the first and second target points move, the second force field F2 can be applied by setting the amount of movement dr of the second target point to the relative amount of movement between the first and second target points.

[0059] As an example, the second force field F2 may be defined so as not to act repulsively between the two object points. In other words, the second force field F2 may be configured to act only attractively between the two object points. For example, when the amount of movement dr of the second object point relative to the first object point is negative, the second force field F2 ≥ 0 (specifically, the second force field F2 = 0). This prevents the first and second object points from diffusing due to the reaction force of the second force field F2. Through the action of such a force field, the dynamic object Ob1 may be displayed as moving autonomously by the repeated diffusion and condensation of object points around a specific point defined based on the position of the object points. Note that the above configuration of the force field F is merely an example and is not limited to it.

[0060] The processor 83 may further change the variation mode of the force field F based on a complexity parameter. For example, the processor 83 may change the behavior of the dynamic object Ob1 so that it becomes faster as the complexity parameter increases. Faster behavior may include, for example, increasing the rate of change of the force field per unit time to increase the amount of movement of the target point per unit time (i.e., velocity), or making the change in the direction of movement more complex by shortening the period for reversing the force field.

[0061] [Action A34] Next, in action A34, the processor 83 calculates the next amount of movement of the target points based on the positions of the latest target point cloud acquired in action A30 and the target force field set in action A33. This amount of movement can be calculated, for example, from the position coordinates of the target points, the previous amount of movement corresponding to the velocity vector of the target points, the acceleration of each target point caused by the target force field, etc., according to the dynamic equations of motion of the target points moving in the virtual space.

[0062] [Action A35] Next, in action A35, the processor 83 acquires the detection results of the contact sensors TS (for example, the DC values ​​of each contact sensor TS). Each DC value is associated with each of the contact sensors TS. Each of the contact sensors TS is assigned a corresponding region of a continuous virtual space. Contact of a contact sensor TS by a user is an example of a user's designated operation, such as that of the driver U, to the front display panel 5, the right display panel 6, or the left display panel 7, and acquiring the detection results of the contact sensors TS is an example of acquiring such a designated operation.

[0063] [Action A36] Next, in action A36, the processor 83 sets a designated point according to the detection result obtained in action A35. Therefore, the above designation operation is an example of an operation to designate a designated point that indicates the destination of a representative position in the virtual space. For example, if the processor 83 obtains a DC value indicating that the user has made contact, it sets one of the points in the virtual space displayed on the display DS corresponding to the contact sensor TS as the designated point. On the other hand, while no designation operation is performed, the processor 83 moves the dynamic object Ob1 by randomly updating the designated point whenever a predetermined update condition is met. With this configuration, the possibility of the dynamic object Ob1 losing its sense of dynamism due to remaining stationary in a specific location can be reduced. Therefore, it is possible to create a sense of life for the dynamic object Ob1 and further enhance the driver U's sense of familiarity with the dynamic object Ob1. The update conditions are arbitrary, such as the passage of a certain period of time or the degree of diffusion or condensation of the target point cloud, as long as the representative position is set to be movable so that the dynamic object Ob1 exhibits autonomous behavior using the entire front display panel 5, right display panel 6, and left display panel 7.

[0064] [Action A37] Next, in Action A37, the processor 83 calculates the amount of translational movement of the target point cloud so that the representative position of the target point cloud moves closer to the specified point. The amount of translational movement is the amount of movement that uniformly translates the entire target point cloud within the virtual space displayed on the front display panel 5, the right display panel 6, and the left display panel 7, separate from the amount of movement based on the target force field described above. The movement to bring the representative position closer to the specified point is not limited to a uniform translational movement, but may also be performed by generating an additional force field.

[0065] [Action A38] Next, in action A38, the processor 83 updates the position of the target point cloud based on the amount of movement calculated in action A34 and the amount of translational movement calculated in action A37. For example, the processor 83 updates the position of the target point cloud by adding a combined amount of movement to the position of the latest target point obtained in action A30. In this embodiment, the processor 83 can continuously move the dynamic object Ob1 so that the representative position of the target point cloud moves toward the specified point by adding the above-mentioned amount of translational movement.

[0066] [Action A39] Next, in Action A39, the processor 83 determines the display mode of the dynamic object Ob1. For example, the processor 83 may display the target points as simple dots that are different from the background, or it may display the target points connected by lines. Alternatively, the processor 83 may extract the target points to be displayed as dynamic object Ob1 from among the target points included in the target point group, and determine the display mode of the dynamic object Ob1 by assigning shapes such as fish to the extracted target points. The processor 83 may also change the display mode of the target points based on the complexity parameter. With such a configuration, the complexity of the movement of the vehicle 2 can be visually perceived as the appearance of the target object, so for example, abrupt changes in the degree of change of the environment around the vehicle 2 can be presented to the driver U as a sense of incongruity in the continuous video. For example, the processor 83 may change the color scheme of the dynamic object Ob1 so that the dynamic object Ob1 stands out against the background image described later as the complexity parameter increases.

[0067] Subsequently, the processor 83 completes the object movement process and proceeds to action A4 shown in Figure 3.

[0068] 2.3. Background Processing Next, we will explain an example of the background processing flow in Action A4 of the activity shown in Figure 3. Figure 5 is an activity that shows an example of the background processing flow in Action A4.

[0069] [Action A40] First, in action A40, the processor 83 sets the basic state of the background image. Background processing may be defined to change the background image as a video by performing various image processing and image modulation on the basic state. The background image may be defined to include background objects. Background objects may be defined by a set of points, for example, similar to a target point cloud. Points may be described, for example, as particles floating in the background image.

[0070] [Action A41] Next, in Action A41, the processor 83 changes the display mode of the background image based on the complexity parameter. For example, as the complexity parameter increases, the processor 83 may modulate the background image to make the pattern finer or change the movement of particles in the background image to make it more intense. For example, the processor 83 may change the background image so that the value corresponding to the complexity parameter is the principal component of the frequency spectrum. In this case, the background image is a pseudo-pattern image obtained by forming a random pattern that has the principal frequency component. RGB values ​​are assigned to each pixel position of the background image to form the random pattern. The background image may also be a pattern image having periodicity corresponding to the principal frequency component. Furthermore, the background image is not limited to a color image to which RGB values ​​are assigned, but may also be a monochrome image or a binary image. In this way, the processor 83 can change the display mode of the background image of the target point based on the complexity parameter.

[0071] [Action A42] Next, in Action A42, the processor 83 may perform trace processing based on the behavior of the dynamic object Ob1. Trace processing is a process that represents the traces of the behavior of the dynamic object Ob1 (e.g., movement or deformation) through changes in the background image. For example, the processor 83 may perform trace processing by displacing patterns or objects in the background image that are located at the position where the dynamic object Ob1 collides with the dynamic object Ob1 so as to move them away from the position to which the dynamic object Ob1 moved. Alternatively, the processor 83 may perform trace processing that shows the trajectory of the dynamic object Ob1 for a certain period of time by leaving the displacement of patterns or objects in the background image based on the past movement history of the dynamic object Ob1.

[0072] [Action A43] Next, in action A43, the processor 83 generates or updates the background image to be displayed based on the result of the change in the display mode of the background image in action A41 and the result of the trace processing in action A42. After that, the processor 83 finishes the background processing and proceeds to action A5.

[0073] By combining the dynamic object Ob1 obtained through this process with the background image, images are obtained that can be displayed on the front display panel 5, the right display panel 6, and the left display panel 7.

[0074] According to the above information processing, for example, if a dynamic object is displayed on the right display panel 6 or the left display panel 7, but the right display panel 6 or the left display panel 7 is located outside the driver U's field of vision, the driver U can operate the front display panel 5 to bring the dynamic object Ob1 into their field of vision. Therefore, the sense of familiarity with the dynamic object Ob1 in the interior space SP of the vehicle 2 can be enhanced, and a more comfortable space can be provided for users such as the driver U.

[0075] 2.4. Behavior of Dynamic Object Ob1 Based on Specified Operations Next, the behavior of the dynamic object Ob1 based on specified operations will be described. Figure 6 is a diagram showing an example of the internal space SP of the vehicle 2 in which the dynamic object Ob1 is displayed in the front display panel 5. Figure 7 is a diagram showing an example of the behavior of the dynamic object Ob1 when a specified operation is performed on the right display panel 6 in the internal space SP shown in Figure 6. For the sake of explanation, the dynamic object Ob1 is not a point cloud, but is assumed to be constructed by assigning a fish-like appearance to some of the extracted target points.

[0076] As shown in Figure 6, the dynamic object Ob1 is displayed on the front display panel 5 as if floating in a virtual space within the composite image. In this case, the representative position of the target point cloud that forms the basis of the dynamic object Ob1 is located at least within the range of the front display panel 5.

[0077] If driver U touches the right display panel 6 with their finger, a designated point is specified within the virtual space assigned to the right display panel 6, as shown in Figure 7. This causes the target point of the target point group that forms the basis of the dynamic object Ob1 to move from the representative position located on the front display panel 5 to the designated point located on the right display panel 6, taking into account the amount of translational movement. As a result, the dynamic object Ob1a, which was located on the front display panel 5, moves toward the right display panel 6 and behaves as if it were temporarily stationary near the designated point in the right display panel 6, similar to the dynamic object Ob1b. In this way, by touching the display panels 5 to 7, driver U can summon the autonomously behaving dynamic object Ob1, thus creating a sense of familiarity with the dynamic object Ob1.

[0078] 3. Specific Examples of Composite Images Next, we will explain some specific examples of composite images that are displayed on the front display panel 5, the right display panel 6, and the left display panel 7 in this video display system 1.

[0079] 3.1. Example of display of composite image when a fish-like appearance is assigned Figure 8 shows an example of the display of a composite image when a fish-like appearance is assigned. First, the composite image IM1 shown in Figure 8 is obtained by extracting some of the target points included in the target point cloud and assigning a fish-like appearance to those target points. The composite image IM1 changes in the order of (a) → (b) → (c) → (d) → (e) shown in Figure 8.

[0080] In Figure 8(a), the composite image IM1 is generated when the complexity parameter is below a baseline value (almost zero), for example, when vehicle 2 is stopped and there are no oncoming vehicles. In Figure 8(a), the processor 83 sets the color scheme of the fish-shaped dynamic object Ob1 to blend in with the background image, making the dynamic object Ob1 camouflage itself against the background.

[0081] Subsequently, when vehicle 2 begins to move and the complexity parameter exceeds the baseline value, the color scheme of the dynamic object Ob1 is changed to one that is distinguishable from the background image, as shown in Figure 8(b), making it easier for driver U to see the dynamic object Ob1.

[0082] Subsequently, a designation operation is performed on the left display panel 7 (for example, by a passenger seated in the front passenger seat 3b or the rear seat 3c), and as shown in Figure 8(c), a designated point P1 is specified, and the dynamic object Ob1, which resembles a school of fish, begins to move toward the designated point P1. At this time, the orientation of each fish-shaped object also changes according to the direction of movement. Note that the designated point P1 shown as a white circle in the figure is illustrated for the sake of explanation and does not actually need to be displayed.

[0083] Subsequently, when a designation operation is performed again on the right area of ​​the front display panel 5 (for example, by the driver U), the dynamic object Ob1 of the school of fish that has moved to the left display panel 7 moves as a group toward the designated point P1 in the front display panel 5, as shown in Figure 8(d), and settles at the designated point P1.

[0084] Subsequently, as shown in Figure 8(e), the dynamic object Ob1 autonomously moves and deforms under the influence of the target force field, explosively diffusing throughout the composite image IM1 while coming together.

[0085] 3.2. An Example of a Composite Image in which Trace Processing with Background Image is Visible Figure 9 shows an example of a composite image in which trace processing is visible. The composite image IM2 changes in the order of (a) → (b) → (c) → (d) → (e) shown in Figure 9. In generating the composite image IM2, the dynamic object Ob1 is displayed as a wire by sequentially connecting the target points that make up the target point cloud with white lines. In addition, as the background image, light blue spring-shaped objects Ob2 extending vertically are placed at intervals against a black background. The spring-shaped objects Ob2 are defined to be displaced (deformed) as the dynamic object Ob1 moves due to trace processing, and gradually return to their original shape. Hereafter, for the sake of convenience of explanation, objects Ob2 in the background image that are affected by the dynamic object Ob1 due to trace processing, such as the spring-shaped object Ob2, will be referred to as background objects Ob2. In this example, the processor 83 changes the influence that the dynamic object Ob1 exerts on the background object Ob2 through trace processing, increasing it as the complexity parameter increases.

[0086] In Figure 9(a), the composite image IM2 is generated when the complexity parameter is below a baseline value (almost zero), for example, when vehicle 2 is stationary and there are no oncoming vehicles. In Figure 9(a), the dynamic object Ob1 has no influence over the background object Ob2 and exhibits autonomous behavior while hidden behind the background object Ob2.

[0087] Subsequently, when vehicle 2 begins to move and the complexity parameter exceeds the baseline value, as shown in Figure 9(b), trace processing is performed such that the dynamic object Ob1 stretches and pushes the background object Ob2, causing the background image to become distorted and making the dynamic object Ob1 easier to see.

[0088] Subsequently, a designation operation is performed on the left display panel 7 (for example, by a passenger seated in the front passenger seat 3b or the rear seat 3c), and as shown in Figure 9(c), the designated point P1 is specified, and the dynamic object Ob1 begins to move toward the designated point P1. Note that the designated point P1 shown as a white circle in the figure is illustrated for the sake of explanation and does not actually need to be displayed.

[0089] Subsequently, when a designation operation is performed again on the right area of ​​the front display panel 5 (for example, by the driver U), the dynamic object Ob1 that moved to the left display panel 7 moves toward the designated point P1 in the front display panel 5 and stops at the designated point P1, as shown in Figure 9(d).

[0090] Subsequently, as shown in Figure 9(e), the dynamic object Ob1 autonomously moves and deforms so that it explosively diffuses throughout the entire composite image IM2 due to the action of the target force field. At this time, the background object Ob2 is pushed aside all at once as the dynamic object Ob1 diffuses.

[0091] 3.3. An Example of a Composite Image in which the Dynamic Object Ob1 and the Background Image Change Independently Figure 10 shows an example of the display of the generated composite image. The composite image IM3 changes in the order of (a) → (b) → (c) → (d) → (e) shown in Figure 10. The composite image IM3 is obtained by combining a linear object with target points connected by white lines as the dynamic object Ob1 and a fractal pattern that changes according to the complexity parameter as the background image. The dynamic object Ob1 is given an effect that makes it emit light at high brightness independently of the background image, according to the complexity parameter.

[0092] In Figure 9(a), the composite image IM2 is generated when the complexity parameter is below a baseline value (almost zero), for example, when vehicle 2 is stationary and there are no oncoming vehicles. In Figure 9(a), the dynamic object Ob1 exhibits autonomous behavior while simply hidden behind the background object Ob2.

[0093] Subsequently, as vehicle 2 begins to move and the complexity parameter exceeds the baseline value, the dynamic object Ob1 begins to glow bluish-white, as shown in Figure 9(b), making it easier to distinguish from the background image. Meanwhile, the background image continuously changes to have a more complex and finer fractal pattern.

[0094] Subsequently, a designation operation is performed on the left display panel 7 (for example, by a passenger seated in the front passenger seat 3b or the rear seat 3c), and as shown in Figure 10(c), a designated point P1 is specified, and the dynamic object Ob1 begins to move toward the designated point P1. Note that the white circular designated point P1 shown in the figure is illustrated for illustrative purposes only and does not actually need to be displayed. At this time, the background image in Figure 10 does not change in accordance with the movement of the dynamic object Ob1, as does the background object Ob2 of the composite image IM2 shown in Figure 9, but changes according to the complexity parameter independently of the behavior of the dynamic object Ob1.

[0095] Subsequently, when a designation operation is performed again on the central area of ​​the front display panel 5 (for example, by the driver U), the dynamic object Ob1 that moved to the left display panel 7 moves toward the designated point P1 in the front display panel 5 and stops at the designated point P1, as shown in Figure 10(d).

[0096] Subsequently, as shown in Figure 10(e), the dynamic object Ob1 autonomously moves and deforms so that it explosively diffuses throughout the entire composite image IM3 due to the action of the target force field.

[0097] [Other] The above embodiments may be implemented as appropriate based on the following embodiments, for example.

[0098] There may be multiple types of the above-mentioned specified operation. In this case, a specified point P1 with different properties may be set depending on the type of specified operation. For example, the processor 83 may change the behavior of the dynamic object Ob1 based on the specified point P1 depending on the value of the above-mentioned DC value (for example, depending on whether the finger is in contact, whether it is not in contact but is in close proximity, or whether it is neither in contact nor in close proximity). Specifically, as long as the DC value at which it is determined that the finger is in contact is maintained, the processor 83 may translate the target point group so that the representative position moves toward the specified point as described above, and when the user's contact state changes from a DC value at which it is determined that the finger is in contact to a DC value at which it is determined that the finger is in close proximity, the processor 83 may generate a repulsive force from the specified point P1 toward the dynamic object Ob1 and process the target point group to spread throughout the entire composite image.

[0099] The structure defining the internal space SP is not limited to passenger cars such as vehicle 2, but may also be a mobile body that moves on the ground, such as industrial vehicles or railway vehicles, a mobile body that moves in the air, such as aircraft or helicopters (i.e., flying objects), or a mobile body that moves on or underwater, such as ships or submarines. The structure defining the internal space SP is not limited to a mobile body, but may also be, for example, a building in which people can live. For example, the front display panel 5, the right display panel 6, and the left display panel 7 may each be placed on the interior wall of a room in a building.

[0100] The video display device 8 may be on-premise or in a cloud-based configuration. In the case of a cloud-based video display device 8, for example, the above-mentioned functions and processing may be provided in the form of SaaS (Software as a Service) or cloud computing.

[0101] In the above embodiment, the video display device 8 performed various storage and control functions, but instead of the video display device 8, multiple external devices may be used. That is, various information and programs may be stored in a distributed manner across multiple external devices using blockchain technology or the like.

[0102] The above-mentioned video display system 1, etc., may be provided in any of the following embodiments.

[0103] (1) A video display system for the interior of a space in which a user can stay, comprising a first display unit, a second display unit, and at least one control unit, wherein the first display unit and the second display unit are configured to display a single continuous video as a whole, wherein the virtual space defined by the continuous video is defined to include autonomously movable dynamic objects, wherein the dynamic objects are defined to behave autonomously as a set of multiple target points arranged around a certain representative position, wherein the first display unit and the second display unit are arranged along an interior wall defining the space such that when the user is looking at one display unit from a reference position in which the user is staying, the other display unit is outside the user's field of view, and the control unit is configured to execute a program so that the following steps are performed: in the designation acquisition step, the system acquires a designation operation of the user to the first display unit and the second display unit, wherein the designation operation is an operation to designate a point that indicates the destination of the representative position in the virtual space, and in the movement step, the system continuously moves the dynamic object so that the representative position moves toward the designate point.

[0104] With this configuration, for example, if a dynamic object is displayed on the second display unit but the second display unit is located outside the user's field of view, the user can operate the first display unit, which is within their field of view, to bring the dynamic object into their field of view. Therefore, it is possible to enhance the user's sense of familiarity with the dynamic object in the space and provide a more comfortable space for them to stay in.

[0105] (2) A video display system as described in (1) above, wherein each of the first display unit and the second display unit is part of a single display unit that displays the entire continuous video.

[0106] With this configuration, the movement of dynamic objects between the first and second display units can be displayed continuously, thus reducing the sense of incongruity caused by, for example, discontinuous movement of dynamic objects or temporary absence from display units. Therefore, it is possible to enhance the user's sense of familiarity with dynamic objects.

[0107] (3) A video display system according to (1) or (2) above, wherein the dynamic object is displayed such that it exhibits autonomous behavior as the target points repeatedly diffuse and condense around a specific point defined based on the position of the target point.

[0108] (4) A video display system according to any one of (1) to (3) above, wherein in the movement step, while the specified operation is not performed, the specified point is randomly updated each time a predetermined update condition is met, thereby moving the dynamic object toward the updated specified point.

[0109] This configuration reduces the possibility of dynamic objects losing their sense of dynamism due to remaining stationary in specific locations. Therefore, it enhances the sense of life in dynamic objects and increases user engagement with them.

[0110] (5) A video display system according to any one of (1) to (4) above, wherein the space is the internal space of a mobile body on which the user can board, the mobile body is equipped with an imaging unit capable of imaging at least the surrounding area of ​​the mobile body, and the control unit is configured to execute the program so that the following steps are performed: in the image acquisition step, an image of an object outside the mobile body is acquired, which is imaged by the imaging unit, and the image of the object changes over time in accordance with the movement of the mobile body or changes in the external conditions, in the calculation step, a complexity parameter indicating the complexity of the time change of the object image is calculated based on the image of the object, and in the modification step, the display mode of the object point or the display mode of the background image of the object point is changed based on the complexity parameter.

[0111] With this configuration, the complexity of the movement of the moving object can be visually perceived as the appearance of the target object. For example, abrupt changes in the degree of change in the environment surrounding the moving object can be presented to the user as a sense of incongruity in the continuous video.

[0112] (6) A video display system according to any one of (1) to (5) above, further comprising a mobile body on which the user can ride, wherein the space is the internal space of the mobile body, the mobile body is equipped with a seat on which the user can sit, the reference position is defined based on the position of the seat, the first display unit is positioned to face the front of the user seated in the seat, and the second display unit is positioned to face the side of the user seated in the seat.

[0113] This configuration allows for a lively atmosphere around the passenger's seat, thereby improving comfort during their stay inside the vehicle.

[0114] (7) The video display system described in (6) above, wherein the moving body is a vehicle, the passenger seat includes a driver's seat into which the user can board as a driver and a rear seat located behind the driver's seat, the vehicle has a rear door for boarding the rear seat, and at least a portion of the second display unit is arranged along the rear door.

[0115] This configuration can improve the enjoyment of passengers in the rear seats, such as children or friends, while they are inside the vehicle during travel. Of course, this is not the only possible configuration.

[0116] Finally, while various embodiments relating to this disclosure have been described, these are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be implemented in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents.

[0117] 1: Video display system, 2: Vehicle, 20: Communication bus, 21: Body, 22a: Front door, 22b: Front door, 22c: Rear door, 23: Processor, 3: Seats, 3a: Driver's seat, 3b: Passenger seat, 3c: Rear seat, 4: Onboard camera, 5: Front display panel, 6: Right display panel, 7: Left display panel, 8: Video display device, 80: Communication bus, 81: Communication unit, 82: Memory unit, 83: Processor, 84: Processing display unit, 85: Input unit, DS: Display, IM0: Onboard image, IM1: Composite image, IM2: Composite image, IM3: Composite image, LS: Light source unit, Ob1: Dynamic object, Ob1a: Dynamic object, Ob2: Background object, P1: Designated point, R: Field of view, SP: Interior space, TS: Contact sensor, U: Driver

Claims

1. A video display system for the interior of a space in which a user can stay, comprising a first display unit, a second display unit, and at least one control unit, wherein the first display unit and the second display unit are configured to display a single continuous video as a whole, wherein the virtual space defined by the continuous video is defined to include autonomously movable dynamic objects, wherein the dynamic objects are defined to behave autonomously as a set of multiple target points arranged around a certain representative position, wherein the first display unit and the second display unit are arranged along an interior wall defining the space such that when the user is looking at one display unit from a reference position in which the user is staying, the other display unit is outside the user's field of view, and the control unit is configured to execute a program so that the following steps are performed: in the designation acquisition step, the designation operation of the first display unit and the second display unit is acquired, wherein the designation operation is an operation to designate a point indicating the destination of the representative position in the virtual space, and in the movement step, the dynamic object is continuously moved so that the representative position moves toward the designate point.

2. The video display system according to claim 1, wherein each of the first display unit and the second display unit is part of a single display unit that displays the entire continuous video.

3. A video display system according to claim 1 or claim 2, wherein the dynamic object is displayed such that it exhibits autonomous behavior as the target points repeatedly diffuse and condense around a specific point defined based on the position of the target point.

4. A video display system according to any one of claims 1 to 3, wherein in the movement step, while the specified operation is not performed, the specified point is randomly updated each time a predetermined update condition is met, thereby moving the dynamic object toward the updated specified point.

5. A video display system according to any one of claims 1 to 4, wherein the space is the internal space of a mobile body on which the user can ride, the mobile body includes an imaging unit capable of imaging at least the surrounding area of ​​the mobile body, and the control unit is configured to execute the program such that the following steps are performed: an image acquisition step, an image of an object outside the mobile body captured by the imaging unit, wherein the object image changes over time in accordance with the movement of the mobile body or changes in external conditions, a calculation step, a complexity parameter indicating the complexity of the time change of the object image based on the object image, and a modification step, a display mode of the object point or the display mode of the background image of the object point is changed based on the complexity parameter.

6. A video display system according to any one of claims 1 to 5, further comprising a mobile body on which the user can ride, wherein the space is the internal space of the mobile body, the mobile body is equipped with a seat on which the user can sit, the reference position is defined based on the position of the seat, the first display unit is positioned to face the front of the user seated in the seat, and the second display unit is positioned to face the side of the user seated in the seat.

7. The video display system according to claim 6, wherein the moving body is a vehicle, the passenger seat includes a driver's seat into which the user can board as a driver and a rear seat located behind the driver's seat, the vehicle has a rear door for boarding the rear seat, and at least a portion of the second display unit is arranged along the rear door.

Images