Mobile
By installing a virtual window display and a display controller on the mobile body, the performance images with changes in the window image are generated, and combined with multiple sensory stimulation, the problem of lack of realism in the mobile body performance in the park is solved, and the improvement in a small space is achieved Crew immersion and entertaining experience.
Patent Information
- Application Number
- CN202111503059.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-12-17
- Filing Date
- 2021-12-10
- Publication Date
- 2024-12-24
- Estimated Expiration
- 2041-12-10
AI Technical Summary
The prior art lacks realism in the performance of mobile bodies in the park, cannot fully provide immersion, and requires a broad dedicated space to maintain the world view. The displayed content images are not cooperative with external conditions, which cannot effectively enhance the immersion experience of the occupants.
Using a mobile body with a virtual window display and a display controller, the performance images that are partially changed from the car window image are displayed in the virtual window, and the characters or background elements can be transformed into characters or transparent to adapt to different theme areas, combined with Various sensory stimulations such as images, vibrations, sounds, tastes and moisture enhance the sense of reality.
The occupants’ immersion is enhanced without the need for dedicated space, providing a more realistic and entertaining window experience, enhancing the immersion of the world of the pre-appointed area, and further improving the quality of the experience through a variety of sensory stimulations.
Smart Images

Figure CN114642886B_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority from Japanese Patent Application No. 2020-208948 filed on December 17, 2020, which is hereby incorporated by reference in its entirety including the specification, claims, drawings, and abstract. Technical Field
[0003] In this specification, a moving object for transporting a user in a predetermined area is disclosed. Background Art
[0004] In a predetermined area with an unusual world view, such as an amusement park, theme park, or other park, users may use a moving object such as a vehicle to move to a desired destination. In one aspect, it is proposed that a specific performance be performed so that users can enjoy the performance even during the movement using such a moving object.
[0005] For example, Patent Document 1 discloses a technology for arranging artificial entertainment devices such as background objects, water curtains, dinosaur models, etc. along the moving route of a vehicle, so that the conditions outside the vehicle change as the vehicle moves. According to the above technology, users can enjoy the performance of the world view in the park while moving.
[0006] Prior art literature
[0007] Patent Literature
[0008] Patent Document 1: Japanese Patent Application Publication No. 2000-342858
[0009] Patent Document 2: International Publication No. 2017 / 208719 Summary of the invention
[0010] However, in order to maintain the world view of the park, the technology of Patent Document 1 requires that there are no unintended people or vehicles within the range visible from the vehicle. Therefore, in the case of the technology of Patent Document 1, it is necessary to prohibit people and vehicles from entering a relatively wide range around the moving route of the vehicle. In other words, in Patent Document 1, a dedicated and wide space is required for the performance.
[0011] In addition, Patent Document 2 discloses a technology for displaying content images superimposed on external scenery on a display unit provided on a mobile body. It is also considered to apply the technology of Patent Document 2 to a mobile body used in a park. That is, it is also considered to display content images suitable for the world view of the park on a display unit provided on the mobile body so that users can enjoy it. However, in Patent Document 2, the displayed content images are images that have nothing to do with external scenery, such as movies, and are not coordinated with the actual situation outside the car. Therefore, in the case of the content images provided in Patent Document 2, there is a lack of realism, and it is impossible to fully obtain a sense of immersion in the world of the park.
[0012] Therefore, this specification discloses a moving body that can further enhance the sense of immersion in the world view of a predetermined area without preparing a dedicated space for a performance.
[0013] The mobile body disclosed in the present specification is a mobile body for transporting users in a predetermined area, and is characterized in that it comprises: a first display for displaying an image on a virtual window which is a display range set on the inner surface of the mobile body; and a display controller for generating a performance image that partially changes the window image originally obtained when the virtual window is assumed to be a window, and displays it on the virtual window.
[0014] By making the above structure, even if a wide dedicated space is not provided around the moving body, it is possible to provide the passengers with entertaining car windows. In addition, the provided performance image is an image in which a part of the actual car window image is changed, so the sense of reality is excellent. As a result, it is possible to provide the passengers with an impression as if they actually came to the imaginary world with the predetermined area as the theme, and it is possible to further enhance the passengers' sense of immersion in the world of the predetermined area.
[0015] In this case, the display controller may transform a part or all of the body of a person included in the window image into a character in order to generate a dramatic image.
[0016] By transforming people who are actually in a predetermined area into characters in this way, a more realistic performance image can be provided.
[0017] Furthermore, the display controller may transform at least one of the plurality of characters included in the window image into a transparent one in order to generate a dramatic image.
[0018] By adopting the above structure, the passengers will not be disturbed by people outside the car and can enjoy the scenery of the predetermined area.
[0019] In this case, the display controller may determine the number of characters to be transformed into the transparent image so that the number of characters or roles included in the performance image becomes equal to or smaller than a predetermined reference number.
[0020] By making the above structure, the density of people and characters in the performance image can be reduced, and the scenery of the predetermined area can be appreciated.
[0021] In addition, the predetermined area may be divided into a plurality of zones having different themes, and the display controller changes the transformation content of the window image to match the theme of the zone where the moving body is located.
[0022] By making the above structure, passengers can get a variety of performances, which can make passengers enjoy it more.
[0023] In this case, the display controller may reduce the content elements included in the dramatic image when the moving object is located near a boundary of the zone, compared to when the moving object is located at the center of the zone.
[0024] By making the above structure, the passengers can be aware of the transition from one themed area to a different themed area.
[0025] Furthermore, the presenter may further include a performance device for generating at least one of vibration, sound, smell, moisture, and wind to sense the presence of the character in conjunction with the performance image.
[0026] By making the above structure, it is possible to perform performances that cannot be expressed only by images, and the sense of reality can be further improved.
[0027] Furthermore, when a driving event that is unpleasant to the passengers occurs, the display controller may generate and display the dramatic image so as to misunderstand that the driving event occurred due to the presence of the character.
[0028] With the above configuration, it is possible to change a driving event that is unpleasant to the occupants into an event that is pleasant to the occupants.
[0029] In addition, a second display may also be provided for displaying images on a virtual mirror which is a display range set inside the moving body, and the display controller generates a virtual mirror image in which a part or all of the body of a person included in the mirror image originally obtained when the virtual mirror is assumed to be a mirror is transformed into a character, and displays it on the virtual mirror.
[0030] By adopting the above-mentioned structure, the occupant can be given the impression that he or she has become a part of the world of the predetermined area, and the occupant's sense of immersion in the worldview of the predetermined area can be further enhanced.
[0031] According to the moving object disclosed in this specification, it is not necessary to prepare a dedicated space for performance, and the immersion in the world view of a predetermined area can be further improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 This is a video diagram showing the structure of a theme park using moving objects.
[0033] Figure 2 It is a block diagram showing the structure of a moving object.
[0034] Figure 3 This is a diagram showing an example of a car window image.
[0035] Figure 4 This is a diagram showing an example of a performance image.
[0036] Figure 5 It is shown Figure 4 An image diagram of the process of generating performance images.
[0037] Figure 6 This is a diagram showing another example of a performance image.
[0038] Figure 7 This is a diagram showing another example of a performance image.
[0039] Figure 8 It is shown Figure 7 An image diagram of the process of generating performance images.
[0040] Fig. 9 1 is a diagram showing an example of a method of selecting a person to be made transparent, and is a diagram showing an example of a car window image.
[0041] Fig.10 It shows that according to Fig. 9 An example of a dramatic image generated using a car window image.
[0042] Fig.11 This is a diagram showing an example of a dramatic image when sudden braking occurs.
[0043] Fig.12 This is a block diagram showing an example of the structure of a performance device.
[0044] Fig.13 is a diagram showing the structure of a virtual mirror function.
[0045] (Explanation of symbols)
[0046] 10: moving body; 12: vehicle controller; 14: display controller; 16: first camera; 18: first display; 19: virtual window; 20: performance device; 22: vehicle window image; 24: performance image; 30: person; 32: fixed object; 36: performance data; 38: reference data; 39: replacement image; 44: performance controller; 46: sprayer; 48: air jet; 50: speaker; 52: odor generator; 54: vibration generator; 60: second camera; 62: second display; 63: virtual mirror; 64: mirror image; 66: virtual mirror image; 100: theme park; 110: driving route. DETAILED DESCRIPTION
[0047] Hereinafter, the structure of the moving body 10 will be described with reference to the drawings. Figure 1 1 is a video diagram showing the structure of a theme park 100 as a predetermined area using a moving body 10. The moving body 10 is provided to transport predetermined users of the theme park 100. The theme park 100 is divided into several zones, and a theme is set for each zone. Hereinafter, a theme park 100 having a first zone A1 with a cat theme, a second zone A2 with an angel theme, and a third zone A3 with a robot theme will be described as an example.
[0048] In the theme park 100, a circular driving route 110 is provided that spans three zones A1 to A3. The moving body 10 travels along the driving route 110. In addition, a plurality of stops (not shown) are provided in the driving route 110. The moving body 10 stops at each stop in order to allow users to board and alight. Therefore, in this example, the moving body 10 functions as a shared bus that transports an unspecified number of users to the stop.
[0049] However, the operation mode of the mobile body 10 is not limited to the above, and may be appropriately changed. Therefore, the mobile body 10 may not have a prescribed driving route, but may freely select a driving route according to the user's instructions. In addition, the mobile body 10 may not be used by an unspecified majority of people, but may be used only by pre-assigned individuals or groups (such as families, etc.). In addition, the mobile body 10 in this example is a vehicle that can be driven manually or automatically. However, as long as the mobile body 10 can transport users, it is not limited to a vehicle, and may be other forms, such as a ship. In the case where the mobile body 10 is a ship, water is introduced into the driving route 110 in a manner that forms a canal.
[0050] The moving object 10 has an internal space that is closed to a certain extent. The moving object 10 provides a performance that can enhance the immersion of users in the internal space into the world of the park. Figure 2 is a block diagram showing the structure of the mobile body 10. Figure 2 In the figure, only the elements related to providing the performance are shown. The following describes each element.
[0051] The first display 18 displays a performance image on the inner surface of the vehicle, such as the side surface, the front surface, etc. The performance image is an image obtained by performing performance processing on the vehicle window image obtained when the display range of the first display 18 is assumed to be a window, and will be described in detail later. Therefore, the display range of the first display 18 functions as a virtual window 19 that projects the appearance of the outside of the moving body 10. The first display 18 may be one or more. The above-mentioned first display 18 may also have, for example, at least one of a liquid crystal display, an organic EL display, and a projector. In addition, the first display 18 may also have a transparent display that functions as a transparent window when no image is displayed.
[0052] The first camera 16 captures the outside of the moving body 10 and obtains a vehicle window image when the display range of the first display 18 is assumed to be a window. One vehicle window image may be obtained by a single first camera 16, or a plurality of images obtained by a plurality of first cameras 16 may be synthesized to obtain one vehicle window image. In either case, the number and arrangement of the first cameras 16 are set according to the position, posture, and size of the display range of the first display 18 (i.e., the virtual window 19).
[0053] The display controller 14 controls the display of the first display 18. Specifically, the display controller 14 generates a performance image that partially changes the window image and displays it on the first display 18. The display controller 14 is a computer that physically has a processor 14a and a memory 14b. The "computer" also includes a microcontroller that embeds a computer system into an integrated circuit. In addition, the processor 14a refers to a processor in a broad sense, including a general-purpose processor (such as CPU: Central Processing Unit, etc.), a dedicated processor (such as GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.). In addition, the action of the processor 14a described below is not only performed by one processor, but can also be performed by the cooperation of multiple processors existing in physically separated locations. Similarly, the memory 14b does not need to be physically one element, and can also be composed of multiple memories existing in physically separated locations. In addition, the memory 14b may include at least one of a semiconductor memory (such as RAM, ROM, solid state drive, etc.) and a magnetic disk (such as a hard disk drive, etc.). In addition, a computer may function as the display controller 14 and also function as the vehicle controller 12 or the performance controller 44 described later.
[0054] Various image processing programs are stored in the memory 14b of the display controller 14. The processor 14a performs calculations according to these image processing programs to generate a performance image. In addition, various data used when generating a performance image are also stored in the memory 14b of the display controller 14. The generation of the performance image 24 by such a display controller 14 will be described in detail later.
[0055] The mobile body 10 also has a vehicle controller 12 and a performance device 20. The vehicle controller 12 controls the travel of the mobile body 10. The vehicle controller 12 is also a computer having a processor and a memory, similar to the display controller 14. In the vehicle controller 12, the driving system of the mobile body 10 is controlled according to the instructions input from the operator and the detection results of various sensors. Here, the operator is a person who performs the travel operation of the mobile body 10, and can be either a driver riding the mobile body 10 or a person who performs the travel operation remotely at a management center set outside the mobile body 10. In addition, the sensor includes a sensor that detects the state of the driving system of the mobile body 10 (such as a vehicle speed sensor, etc.) and a sensor that detects the external environment of the mobile body 10 (such as an infrared sensor, a Lider, a position sensor, an optical sensor, etc.). The vehicle controller 12 drives the mobile body 10 autonomously according to the detection values of these various sensors in accordance with the instructions of the operator.
[0056] The control content of the vehicle controller 12 and the detection values in the sensor are output to the display controller 14 as needed. For example, as described later, the display controller 14 changes the content of the performance of the performance image according to the position of the mobile body 10. In order to make such performance content changeable, the vehicle controller 12 outputs the detection value in the position sensor (such as GPS, etc.) to the display controller 14 at any time. In addition, the display controller 14 also changes the content of the performance of the performance image according to the driving state of the mobile body 10, such as whether there is an emergency brake, etc. Therefore, the vehicle controller 12 outputs at least a part of the instruction content output to the drive system to the display controller 14 at any time.
[0057] The performance device 20 is a device that generates at least one of vibration, sound, smell, moisture, and wind to sense the presence of the character. The performance device 20 has a generating device that generates vibrations and a controller that controls the driving of these generating devices. The detailed structure will be described later.
[0058] Next, the performances provided by such a moving body 10 will be described. Figure 3 is a diagram showing an example of a vehicle window image 22. Figure 4 2 is a diagram showing an example of the dramatic image 24. As described above, in this example, the dramatic image 24 in which the window image 22 is partially changed is displayed in the display range of the first display 18 functioning as the virtual window 19.
[0059] The window image 22 is an image of the window obtained when the display range of the first display 18 is assumed to be a window. Figure 3 The figure includes fixed objects 32 such as buildings, roads, and trees, and characters 30 who are users of the theme park 100. The performance image 24 is as follows. Figure 4As shown, a part or all of the body of the person 30 included in the window image is transformed into an image of a predetermined character. Figure 4 In the example of FIG. 2 , the performance image 24 includes a character 30* whose body part is transformed into a cat character.
[0060] In this way, by displaying the image of the performance that follows the theme of the theme park 100 on the virtual window 19, the passengers of the moving body 10 can enjoy the travel time and can be more reliably immersed in the world view of the theme park 100. In addition, the performance image 24 is an image that changes a part of the window image 22. In other words, the performance image 24 is a realistic image including the window image 22. Therefore, the authenticity of the performance image 24 becomes higher, and the immersion in the world view of the theme park 100 can be further improved.
[0061] Figure 5 1 is an image diagram showing an example of the process of generating such a performance image 24. In order to generate the performance image 24, the display controller 14 pre-stores performance data 36. The performance data 36 is data of content that is appended or overlapped to the window image 22 for the purpose of performance. The above-mentioned performance data 36 includes, for example, three-dimensional shape information of various accessories (such as ears, clothing, etc.) of the characters that follow the theme of the theme park 100. Here, the characters processed by the performance data 36 can be either one type or multiple types. In the case where there are multiple types of characters, each character is stored in correspondence with its characteristics, such as gender, body shape, age, etc.
[0062] When generating the performance image 24, the display controller 14 first obtains the car window image 22. The car window image 22 may be the image itself captured by the first camera 16, but the image captured by the first camera 16 may be edited to generate the car window image 22. For example, depending on the configuration and the field of view of the first camera 16, there may be a case where the captured image and the car window image 22 are out of alignment. In this case, a plurality of captured images obtained by a plurality of first cameras 16 may be synthesized to generate the car window image 22.
[0063] If the window image 22 is obtained, the display controller 14 then extracts the person 30 from the window image 22. In extracting the person 30, known face detection or person detection techniques, such as Histograms of Oriented Gradients, etc., can be used. In addition, the person 30 detected once can also be tracked using techniques such as Tracking-by-Detection.
[0064] In either case, if the display controller 14 is able to extract the person 30, it then determines the posture and features of the person 30. The features of the person 30 include at least one of gender, body shape, and age. Such a posture and features of the person 30 can be determined based on the positional relationship of feature points (such as eyes, nose, jaw, etc.) contained in the extracted person image, the contour shape of the body, and the like. The display controller 14 selects a role suitable for the person 30 based on the determined features of the person 30. For example, when the person 30 is a female, a female role is selected. Next, the display controller 14 generates an image of the character that overlaps the image of the person 30 based on the posture of the person 30. For example, when the person 30 is in a sideways posture, based on the three-dimensional shape information of the character, images of the accessories that are seen when the character is also sideways are generated.
[0065] If the character image can be generated, the display controller 14 superimposes the character image on the front surface of the person 30 in the window image 22 to generate a dramatic image 24. The generated dramatic image 24 is displayed in the display range of the first display 18, that is, the virtual window 19.
[0066] In addition, the type of character to be applied may also change according to the zone in which the moving body 10 is located. Specifically, in the memory 14b of the display controller 14, information on multiple types of characters is recorded as performance data 36, but a zone corresponds to each character. For example, a first zone A1 with a cat theme corresponds to a character related to a cat, and a second zone A2 with an angel theme corresponds to a character related to an angel. When selecting a character to be applied to the person 30 included in the window image 22, the moving body 10 determines the zone in which the current moving body 10 is located. Then, from the characters corresponding to the zone, the character to be applied to the person 30 is selected. Therefore, for example, in a case where the moving body 10 is located in the first zone A1 with a cat theme, the person 30 is Figure 4 On the other hand, when the moving body 10 is located in the second zone A2 with an angel as the theme, the character 30 is transformed into a cat-related character. Figure 6 The figure is transformed into a character related to an angel. In this way, different performances are implemented according to the zone, so that the passengers can enjoy various performances and the entertainment is improved. In addition, the performance content is different according to the actual position of the moving body 10, so the passengers can clearly understand where they are currently.
[0067] In addition, in the previous description, only the character 30 is changed in the car window image 22, but it is also possible to change parts other than the character 30 in addition to or instead of the character 30. For example, it is also possible to overlap images corresponding to eyes and mouths on plants included in the car window image 22 to display the plants like intelligent characters. In addition, it is also possible to further add content that is not included in the car window image 22. For example, in order to generate a performance image, it is also possible to overlap the car window image 22 with an image of a huge cat, an image of an angel flying in the sky, etc. In this way, by adding new content elements to the car window image 22, a more entertaining performance image can be generated.
[0068] In addition, instead of transforming the person 30 into a character, the person 30 may be made transparent. Figure 3 In the case of the window image 22 in which the person 30 is reflected, an image obtained by performing image processing so that the person 30 does not exist may be generated as the dramatic image 24 . Figure 7 It is shown from Figure 3 FIG. 2 is an example of a dramatic image 24 generated from the car window image 22. In this way, by removing the person 30 from the car window image 22, the user can view the scenery of the theme park 100 without being blocked by other people.
[0069] Figure 8 The image diagram shows an example of the flow of generating such a performance image 24. Figure 7 The performance image 24 shown has reference data 38 stored in advance. The reference data 38 is data related to an image displayed instead of the image of the person 30. The reference data 38 may be three-dimensional image data of a large number of fixed objects 32 existing in the theme park 100, or may be a car window image taken during the closing hours of the theme park 100, that is, a car window image without a person reflected.
[0070] When generating a staged image 24 that makes the person 30 transparent, the display controller 14 obtains the window image 22 and extracts the person 30 from the window image 22. Next, the display controller 14 generates an image that is displayed instead of the person 30 based on the reference data 38. Specifically, the display controller 14 determines the relative positional relationship between various fixed objects 32 and the moving body 10 based on the current position of the moving body 10. Next, based on the determined relative positional relationship, the image of the fixed object 32 existing behind the person 30 (hereinafter referred to as the "replacement image 39") is extracted from the reference data 38. Then, the display controller 14 synthesizes the replacement image 39 with the window image 22 in such a way that the person 30 in the window image 22 is replaced by the extracted replacement image 39, and generates the staged image 24. During the synthesis, the display controller 14 corrects the color and edge of the replacement image 39 based on the window image 22. That is, the color tone of the fixed object 32 and the like differ depending on the actual weather, time, and season. In addition, the shape and color of organisms such as plants change over time. Therefore, the shape and color of the fixture 32 represented by the reference data 38 may be different from the shape and color of the current fixture 32. Therefore, the display controller 14 estimates the shape and color of the current fixture 32 based on the window image 22, corrects the replacement image in a manner close to the estimated shape and color, and synthesizes it into the window image 22.
[0071] Such a transparentization of the person 30 may be performed for all the persons 30 reflected in the vehicle window image 22, or may be performed for only a part of the persons 30. Figure 7 , Figure 8 Transparency and reference of the illustrated character 30 Figure 4 , Figure 5 The characterization of the person 30 described above can also be performed simultaneously for one window image 22. For example, when 10 people 30 are reflected in the window image 22, an image obtained by making 5 of them transparent and converting the remaining 5 people into characters can be generated as the performance image 24. By making the above structure, the number of characters reflected in the performance image 24 can be reduced, and the user can fully enjoy both the characters and the scenery of the theme park 100.
[0072] The display controller 14 may also have a predetermined benchmark for determining the characters 30 to be made transparent. For example, the display controller 14 may determine the number of characters 30 to be made transparent in such a way that the number of characters 30 (including characters 30 transformed into roles) included in one frame of the performance image 24 is below a predetermined benchmark number. For example, when 30 characters 30 are included in one frame of the car window image 22 relative to a benchmark number of 10, the display controller 14 makes the 20 characters 30 reflected in the frame transparent. The characters 30 to be made transparent may be selected randomly or in such a way that the distribution of the characters 30 becomes more even. In addition, the display controller 14 may divide the frame into a plurality of blocks and select the characters 30 to be made transparent in such a way that the faces of the characters 30 reflected in each block are below a predetermined block upper limit. Refer to Fig. 9 , Fig.10 , explain it.
[0073] Fig. 9 , Fig.10 This is a diagram showing an example of a method of selecting a person 30 to be made transparent. Fig. 9 is an example of a car window image 22. Fig.10 This is an example of a staged image 24 generated from a car window image 22. Each frame constituting the car window image 22 is divided into a plurality of blocks. In the example shown in the figure, each frame of the car window image 22 is divided into 12 blocks of 4×3. In the following, the rows of the blocks are represented by numbers, and the columns of the blocks are represented by letters. Each block is displayed using a combination of the letter of the column and the number of the row. For example, in Fig. 9 In the figure, the lower left block is called "a1 block" and the upper right block is called "d3 block". Fig.10 The same is true in Chinese.
[0074] In addition, the numbers enclosed in squares recorded in each block represent the upper limit of the number of characters 30 set in the block, that is, the block upper limit. In addition, the numbers enclosed in circles recorded in the same block represent the number of characters 30 actually projected in the block. Fig. 9 In the example, as the block upper limit value, the blocks in the first column (i.e., block a1, block b1, block c1, and block d1) are set to "0 people", the blocks in the second column are set to "1 person", and the blocks in the third column are set to "2 people".
[0075] The display controller 14 determines the number of characters 30 to be included in each block. Here, the number of characters 30 is determined by the “face” of the characters 30. For example, Fig. 9 In the example, the number of people 30 (more precisely, faces of people 30) in block a3 is "2", and the number of people 30 in block a2 is "1". In addition, there is a case where the face of a person 30 is reflected across multiple blocks. For example, Fig. 9The face 80a in FIG. 8 spans the b1 block and the b2 block. Based on the position of the face 80a, etc., it can be determined as which block the face 80a is counted as. For example, the area of the face 80a in the b1 block and the area of the face 80a in the b2 block can be compared, and the face 80a in the block with the larger area can be counted. Fig. 9 In the example of , the face 80a is counted as the face of the b2 block. In this case, the number of the persons 30 in the b1 block is "0", and the number of the persons 30 in the b2 block is "2".
[0076] If the number of characters 30 in each block can be counted, then the display controller 14 compares the block upper limit value (in Fig. 9 The numbers enclosed in squares) and the number of characters 30 counted (in Fig. 9 Then, when the number of characters 30 exceeds the block upper limit, the characters 30 to be made transparent are determined so as to be below the block upper limit. Fig. 9 In the block c2, the block upper limit value is "1", and the number of faces is "3". Therefore, in this case, two characters 30 need to be selected as the characters 30 to be made transparent. When selecting the characters 30 to be made transparent from a plurality of characters 30, the position and area of the face of the character 30 in the block may also be considered. For example, the characters 30 having a smaller face area in the block may be made transparent in sequence. In addition, as another method, the characters 30 having a face position in the block that is farther away from a specified reference position (such as the center position of the block, etc.) may be made transparent in sequence. Fig. 9 In the example of FIG. 1 , the blocks are made transparent in order from the character 30 whose face area is smaller in the block.
[0077] By making the selected character 30 transparent, Fig.10 The performance image 24 shown. Fig.10 It can be seen that by selecting the person 30 to be made transparent so that the face of the person 30 reflected in each block is below the block upper limit, the person 30 is appropriately dispersed in the dramatic image 24. As a result, a more natural and realistic dramatic image 24 is obtained.
[0078] However, such a performance image 24 includes characters 30 and fixed objects 32 such as buildings. Hereinafter, the elements constituting such a performance image 24 are referred to as content elements. The number of such content elements may also be changed according to the position of the moving body 10. For example, as described above, the theme park 100 is divided into a plurality of zones A1 to A3. The number of content elements may be increased near the center of the zones A1 to A3, and the number of content elements may be reduced near the boundaries of the zones A1 to A3. For example, the number of content elements may be increased when the moving body 10 is located at a certain position. Figure 1 In the case of position P2 in the example, compared with the case where the moving body 10 is located at Figure 1 In the case of position P1 in the image 24, the content elements included in the performance image 24 are reduced. As a method of reducing the content elements, the number of content elements included in the performance image 24 may be gradually reduced as the moving body 10 approaches the boundary of the zone. In another embodiment, the brightness of the performance image 24 may be gradually reduced as the moving body 10 approaches the boundary of the zone, and the performance image 24 may be made black near the boundary of the zone. By making the above structure, the passengers can be aware of the transition from a zone of one theme to a zone of a different theme.
[0079] In the previous description, the performance image 24 is generated regardless of the driving state of the moving body 10, but the content of the performance image 24 may be changed in conjunction with the driving state of the moving body 10. Specifically, the moving body 10 is required to drive stably, but for some reason, driving events that are unpleasant to the passengers sometimes occur. For example, the moving body 10 sometimes brakes suddenly for the purpose of avoiding danger. Such sudden braking suddenly applies a large inertial force to the passengers, which becomes an unpleasant driving event for the passengers. In the above case, a performance image 24 may be generated that mistakenly believes that the sudden braking is caused by the presence of the character. For example, in the case of sudden braking, it may also be possible to Fig.11 As shown, a performance image 24 including an image of a giant cat character 31 blocking the movement of the moving body 10 is displayed on a virtual window 19 located on the front surface of the moving body 10. In addition, the moving body 10 may temporarily stop due to the influence of a person crossing in front of the moving body 10 or a signal. Such a temporary stop causes the travel time to be prolonged for the passengers, and becomes an unpleasant travel event for the passengers. In the above case, for example, a performance image 24 such as a giant cat character sleeping in front of the moving body 10 may be displayed on the virtual window 19 located on the front surface of the moving body 10, so that the moving body 10 may be mistakenly believed to have stopped due to the cat.
[0080] In this way, when an unpleasant driving event occurs for the passengers, by displaying the performance image 24 that makes the passengers mistakenly believe that the driving event occurred due to the presence of the character, the unpleasant driving event can be turned into an event that the passengers enjoy. As a result, the passengers can enjoy the movement in the theme park more. In particular, such unpleasant driving events do not occur frequently, so it can be said that the performance image 24 linked to the unpleasant driving event is a rare image. By watching the above rare image, the passengers' satisfaction is further improved.
[0081] In order to generate such a performance image 24, the display controller 14 stores the corresponding event image in advance for each driving event that is unpleasant to the passengers. In addition, as described above, the display controller 14 receives at least a part of the instruction content output by the vehicle controller 12 to the drive system from the vehicle controller 12. Then, the display controller 14 monitors whether a driving event that is unpleasant to the passengers occurs based on the instruction content received from the vehicle controller 12. As a result of the monitoring, when a driving event that is unpleasant to the passengers occurs, the event image corresponding to the event, such as the image of a huge cat blocking the moving body 10, is synthesized into the performance image 24 in which the character 30 is characterized or transparent, and displayed on the first display 18.
[0082] Furthermore, the mobile body 10 of this example has a performance device 20 for performing a performance that allows the user to sense the presence of a character through at least one of hearing, smell, and touch, either in conjunction with the performance image 24 or independently of the performance image 24 . Fig.12 2 is a block diagram showing an example of the structure of the performance device 20. The performance device 20 includes a sprayer 46, an air jet 48, a speaker 50, a scent generator 52, a vibration generator 54, and a performance controller 44 for controlling the driving of these.
[0083] The sprayer 46 generates mist or even moisture in the mobile body 10, and includes, for example, a pump that compresses water and a nozzle that sprays the compressed water. In addition, the air ejector 48 sprays air into the mobile body 10 to generate wind, and includes, for example, a compressor that compresses air. The speaker 50 outputs sound. The odor generator 52 has one or more odor sources, and outputs air that has passed through the odor source into the mobile body 10. The vibration generator 54 vibrates the entire mobile body 10 or the seat where the occupant sits, and includes actuators such as motors, hydraulic cylinders, and air cylinders.
[0084] The performance controller 44 is a computer having a processor and a memory similarly to the display controller 14. The performance controller 44 drives the sprayer 46 etc. according to the instruction from the display controller 14 to perform a performance in which the presence of the character is sensed by at least one of hearing, smell and touch.
[0085] For example, in order to give the passengers an impression that a small animal character is running quickly through the passengers' feet, the air jet 48 may be used to generate wind blowing in the horizontal direction near the passengers' feet. In addition, as another method, in order to give the passengers an impression that a character jumps onto the roof of the moving body 10, the vibration generator 54 may be used to greatly shake the entire moving body 10, and the speaker 50 may be used to generate a sound as if the character jumps onto the roof of the moving body 10. In addition, as another method, in order to give the passengers an impression that a character with a unique smell (such as a flower fairy character that emits a flower fragrance) is nearby, the smell generator 52 may be used to generate the smell. In addition, as another method, in order to give the passengers an impression that a character in a high humidity environment (such as a frog character) is nearby, the sprayer may be used to generate mist.
[0086] By providing the above-mentioned performance device 20, it is possible to perform a performance that cannot be expressed only by images, and the sense of reality can be further improved. And as a result, the user's sense of immersion in the world view of the park can be further improved.
[0087] In addition, the mobile body 10 of this example can also be Fig.13 As shown, there is also a second camera 60 and a second display 62. The second camera 60 and the second display 62 are provided to provide a virtual mirror function for the passengers.
[0088] The second display 62 is provided inside the mobile body 10, and its display area functions as a virtual mirror 63. A mirror-like decoration is applied to the display area of the second display 62, that is, the virtual mirror 63, and, for example, its periphery is surrounded by a wooden frame. The second display 62 may include, for example, at least one of a liquid crystal display, an organic EL display, and a projector.
[0089] The second camera 60 captures a portion facing the virtual mirror 63, and obtains a mirror image 64 obtained by assuming that the display range of the second display 62 is a mirror. One mirror image 64 may be obtained by mirror-reversing an image obtained by a single second camera 60. In another embodiment, a plurality of images obtained by a plurality of second cameras 60 may be synthesized to obtain one mirror image 64. In either case, the number and arrangement of the second cameras 60 are set according to the position, posture, and size of the virtual mirror 63.
[0090] When the mirror image 64 is obtained by the second camera 60, the display controller 14 extracts the person from the mirror image 64, generates a virtual mirror image 66 in which a part or all of the body of the person 30 is transformed into the character, and displays it on the second display 62. The type of the transformed character can be automatically determined by the display controller 14 side, or can be freely selected by each passenger.
[0091] In either case, by providing the virtual mirror image 66 to the passenger in front of the virtual mirror 63, the passenger can have the impression that he or she has transformed into a character and become a member of the world of the park. This can further enhance the passenger's sense of immersion in the world of the park.
[0092] In addition, the structure described above is an example, and other structures can be appropriately changed as long as the display range (virtual window 19) of the first display 18 set at least on the inner surface of the mobile body 10 displays a performance image that partially changes the window image. For example, in the previous description, the mobile body 10 that moves only in the park is used as an example, but as long as the user of the predetermined area is transported, the mobile body 10 can also move outside the predetermined area. For example, the mobile body 10 can also be a facility located outside the park, such as a shuttle bus that transports users between a parking lot, an accommodation facility and the park. In this case, the amount of performance applied to the window image 22 can also be increased or decreased according to the distance between the mobile body 10 and the park. For example, as the mobile body 10 approaches the park, the number of characters 30 transformed into roles can also be gradually increased. By making the above structure, the occupants can more surely feel that they are gradually approaching the park, which can increase their anticipation for the park.
Claims
1. A mobile body for transporting users in a predetermined area, characterized in that: The mobile body has: A first display that displays an image in a virtual window that is a display range provided on an inner surface of the moving body; and a display controller that generates a dramatic image by partially changing a window image obtained by photographing the outside of the moving body with a camera while assuming that the virtual window is a window, and displays the image on the virtual window; The predetermined area is divided into a plurality of zones having different themes. In order to generate a performance image, the display controller transforms some of the multiple characters included in the window image into transparent characters, and displays only the window image where the characters are not reflected at the positions of the characters transformed into transparent characters. In order to generate a performance image, the display controller transforms a part or the whole of the body of all characters except the part of the characters among the multiple characters included in the window image into characters corresponding to the theme of the area where the moving body is currently located, according to the area where the moving body is currently located. When a driving event such as sudden braking or temporary stopping occurs, the display controller generates and displays the dramatic image that mistakenly believes that the driving event occurred due to the appearance of a character in front of the moving body.
2. The mobile body according to claim 1, characterized in that: The display controller determines the number of characters to be transformed into the transparent image so that the number of characters or roles included in the performance image becomes equal to or less than a predetermined reference number.
3. The mobile body according to claim 1 or 2, characterized in that: The display controller changes the transformation content of the vehicle window image to match the theme of the area where the moving object is located.
4. The mobile body according to claim 1 or 2, characterized in that: The display controller reduces content elements included in the dramatic image when the moving object is located near a boundary of the zone, compared to when the moving object is located at the center of the zone.
5. The mobile body according to claim 1 or 2, characterized in that: The device further comprises a performance device for generating at least one of vibration, sound, smell, moisture and wind to sense the presence of the character in conjunction with the performance image.
6. The moving object according to claim 1 or 2, characterized in that: further comprising a second display for displaying an image on a virtual mirror as a display range provided inside the moving body, The display controller generates a virtual mirror image in which a part or all of a person's body included in a mirror image originally obtained when the virtual mirror is assumed to be a mirror is transformed into a character, and displays the virtual mirror image on the virtual mirror.
Citation Information
Patent Citations
Intertainment facility of drive-through type
JP2000342858A
Display control device, display control method, display device, and moving body device
WO2017208719A1
Emotive advisory system
CN102030008A
Interaction implementation method and system based on singing scene, and medium
CN111698543A
Can realize interactive display device of image
CN205901943U
