Information processing device, system, information processing method, and program
The information processing apparatus addresses energy inefficiencies by generating and transmitting map images in optimized modes, reducing power consumption while maintaining real-time navigation display.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- PIONEER IP
- Filing Date
- 2025-08-04
- Publication Date
- 2026-07-02
AI Technical Summary
Existing information processing systems do not consider energy consumption, particularly in generating and transmitting map images, leading to inefficient power usage.
An information processing apparatus that generates images in different modes, reducing the number of colors, pixels, or generating images at longer intervals, and transmits image data in packets at longer intervals to conserve energy.
Reduces power consumption by optimizing image generation and transmission, ensuring real-time navigation display without excessive energy usage.
Smart Images

Figure JP2025027477_02072026_PF_FP_ABST
Abstract
Description
Information Processing Apparatus, System, Information Processing Method, and Program
[0008] ,
[0007] , ,
[0006] , ,
[0005] ,
[0001] The present invention relates to an information processing apparatus, a system, an information processing method, and a program.
[0002] In information processing, there is an increasing need to reduce energy consumption.
[0003] Patent Document 1 discloses an information terminal that transmits a map image via Bluetooth (registered trademark) in response to a request from a mobile terminal.
[0004] Japanese Unexamined Patent Application Publication No. 2010 - 239181
[0005] However, Patent Document 1 does not consider at all the energy required for map image generation.
[0006] As an example of the problem to be solved by the present invention, in an information processing apparatus that generates an image, it is possible to reduce power consumption as needed.
[0007] The invention according to claim 1 includes an image generation unit that generates an image according to different rules in a first mode and a second mode, and a mode switching unit that switches between the first mode and the second mode. The image generation unit performs at least one of the following in the second mode: generating the image with a smaller number of colors than in the first mode, generating the image with fewer pixels than in the first mode, and generating a plurality of images at longer intervals than in the first mode.
[0008] The invention described in claim 9 is an information processing device according to claim 1, further comprising a transmission unit for transmitting image data for displaying images generated by the image generation unit, wherein the image generation unit generates the plurality of images at longer intervals than in the first mode in the second mode, and the transmission unit divides the image data into a plurality of packets and transmits them, wherein the packets are transmitted at longer intervals than in the first mode in the second mode, and a terminal that receives the image data transmitted from the transmission unit and displays the image on a display.
[0009] The invention described in claim 10 is an information processing method performed by one or more computers, comprising: an image generation step of generating an image according to different rules in a first mode and a second mode; and a mode switching step of switching between the first mode and the second mode, wherein the image generation step includes at least one of the following: generating the image in the second mode with fewer colors than in the first mode; generating the image in the second mode with fewer pixels than in the first mode; and generating a plurality of images in the second mode at longer intervals than in the first mode.
[0010] The invention described in claim 11 is a program that causes a computer to execute each of the steps included in the information processing method described in claim 10.
[0011] This is a diagram illustrating the functional configuration of an information processing device according to an embodiment. This is a diagram illustrating the configuration of a system according to an embodiment. This is a diagram illustrating the functional configuration of a terminal. This is a diagram illustrating a computer for realizing an information processing device. This is a flowchart illustrating the processing flow executed by the information processing device and terminal according to an embodiment. This is a diagram illustrating the operating environment of the system according to Embodiment 1. This is a diagram illustrating the functional configuration of an information processing device according to Embodiment 2. This is a diagram illustrating the processing flow executed by the information processing device and terminal according to Embodiment 2. This is a diagram for explaining a method for generating a second image having a data size smaller than the data size of the image data of the first image. This is a diagram illustrating the functional configuration of an information processing device according to Embodiment 3. This is a diagram illustrating image generation in the image generation unit and display on the display according to Embodiment 3. This is a diagram illustrating the processing flow executed by the information processing device and terminal according to Embodiment 3. This is a diagram illustrating the functional configuration of an information processing device according to Embodiment 4. This is a diagram illustrating the processing flow executed by the information processing device and terminal according to Embodiment 4. This is a diagram illustrating the functional configuration of a terminal according to Embodiment 4. This is a diagram illustrating images generated using each of multiple rules. This is a diagram illustrating the functional configuration of an information processing device according to Embodiment 5. This figure illustrates the processing flow performed by the information processing device and terminal according to Example 5. This figure illustrates the functional configuration of the information processing device according to Example 6. This figure illustrates the processing flow performed by the information processing device according to Example 6. This figure illustrates information indicating a color palette held in the color storage unit. This figure shows a modified example of the information indicating a color palette held in the color storage unit. This figure illustrates the functional configuration of the information processing device according to Example 7. This figure illustrates the processing flow performed by the image data generation unit according to Example 7. This figure illustrates the processing flow performed by the transmission unit according to Example 7. This figure is for explaining the processing content of the terminal according to Example 8. This figure illustrates the processing flow performed by the terminal according to Example 8. This figure illustrates the functional configuration of the information processing device according to Example 9. This figure illustrates the processing flow performed by the information processing device and terminal according to Example 9. This figure is for explaining the information processing method according to Example 9. This figure illustrates the functional configuration of the information processing device according to a modified example of Example 9.
[0012] Embodiments of the present invention will be described below with reference to the drawings. In all drawings, similar components are denoted by the same reference numerals, and their descriptions are omitted as appropriate.
[0013] (Embodiment) Figure 1 is a diagram illustrating the functional configuration of an information processing device 10 according to an embodiment. The information processing device 10 according to this embodiment comprises an image generation unit 130, a conversion unit 150, and a transmission unit 170. The image generation unit 130 generates an image. The conversion unit 150 converts the image generated by the image generation unit 130 into image data for transmission to a display. The transmission unit 170 transmits the image data.
[0014] Figure 2 is a diagram illustrating the configuration of a system 50 according to this embodiment. The system 50 according to this embodiment includes an information processing device 10 and a terminal 20. The terminal 20 receives image data transmitted from the transmission unit 170 of the information processing device 10 and displays it on a display. The information processing device 10 and the terminal 20 are connected to each other so as to be able to communicate with each other.
[0015] Figure 3 illustrates the functional configuration of terminal 20. Terminal 20 comprises an image acquisition unit 210, a display control unit 230, and a display unit 270. The image acquisition unit 210 acquires image data by receiving image data transmitted from the information processing device 10. The display control unit 230 uses the image data acquired by the image acquisition unit 210 to display an image on the display unit 270 (display).
[0016] The hardware configuration of the information processing device 10 is described below. Each functional component of the information processing device 10 (image generation unit 130, conversion unit 150, and transmission unit 170) is realized through a combination of hardware and software.
[0017] Figure 4 illustrates a computer 1000 for implementing the information processing device 10. The computer 1000 is any computer. For example, the computer 1000 may be an SoC (System on Chip), a Personal Computer (PC), a server machine, a tablet terminal, or a smartphone. The computer 1000 may be a dedicated computer designed to implement the information processing device 10, or it may be a general-purpose computer. Furthermore, the information processing device 10 may be implemented by a single computer 1000, or by a combination of multiple computers 1000.
[0018] Computer 1000 includes a bus 1020, a processor 1040, a memory 1060, a storage device 1080, an input / output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path for the processor 1040, memory 1060, storage device 1080, input / output interface 1100, and network interface 1120 to send and receive data to and from each other. However, the method of connecting the processor 1040 and the other components is not limited to bus connection. The processor 1040 is a variety of processor such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an FPGA (Field-Programmable Gate Array). The memory 1060 is a main memory device implemented using RAM (Random Access Memory), etc. The storage device 1080 is an auxiliary storage device implemented using a hard disk, SSD (Solid State Drive), memory card, or ROM (Read Only Memory), etc.
[0019] The input / output interface 1100 is an interface for connecting the computer 1000 with input / output devices. For example, input devices such as keyboards and output devices such as displays are connected to the input / output interface 1100. A touch panel that serves as both an input and output device may also be connected to the input / output interface 1100. The method by which the input / output interface 1100 connects to input and output devices may be wireless or wired. One example of a method by which the input / output interface 1100 connects to input and output devices is short-range wireless communication such as Bluetooth Low Energy.
[0020] The network interface 1120 is an interface for connecting the computer 1000 to a network. Examples of such communication networks include LANs (Local Area Networks) and WANs (Wide Area Networks). The network interface 1120 may connect to the network via a wireless connection or a wired connection.
[0021] The storage device 1080 stores program modules that realize each functional component of the information processing device 10. The processor 1040 reads these program modules into the memory 1060 and executes them to realize the functions corresponding to each program module.
[0022] The hardware configuration of terminal 20 is described below. Each functional component of terminal 20 (image acquisition unit 210 and display control unit 230) is realized by a combination of hardware and software. The hardware configuration of the computer that realizes terminal 20 according to this embodiment is shown, for example, in Figure 4, similar to the information processing device 10 according to this embodiment. However, the storage device 1080 of the computer 1000 that realizes terminal 20 according to this embodiment stores program modules that realize the functions of terminal 20 according to this embodiment.
[0023] A display unit 270 is connected to the input / output interface 1100 of the computer 1000, which is used to realize the terminal 20. The information processing device 10 and the terminal 20 can communicate with each other via their respective input / output interfaces 1100.
[0024] Figure 5 is a flowchart illustrating the processing flow performed by the information processing device 10 and terminal 20 according to this embodiment. In Figure 5, dashed lines indicate data transmission and reception. The same applies to Figures 8, 12, 14, 18, and 29. The image generation unit 130 of the information processing device 10 generates an image (step S10). The conversion unit 150 of the information processing device 10 converts the image generated by the image generation unit 130 into image data (step S20). The transmission unit 170 of the information processing device 10 transmits the image data obtained by the conversion unit 150 (step S30). The image acquisition unit 210 of the terminal 20 acquires the image data transmitted from the transmission unit 170 of the information processing device 10 by receiving it (step S40). Then, the display control unit 230 of the terminal 20 displays the image on the display unit 270 using the image data (step S50).
[0025] (Example 1) The information processing device 10, terminal 20, and system 50 according to Example 1 each have the configuration of the information processing device 10, terminal 20, and system 50 according to the embodiment.
[0026] Figure 6 illustrates the usage environment of the system 50 according to this embodiment. The system 50 according to this embodiment can function as a navigation device. In this embodiment, the information processing device 10 is, for example, a mobile terminal such as a smartphone. The information processing device 10 is connected to the server 30 via a communication network 32. The information processing device 10 performs navigation functions by communicating wirelessly with the server 30.
[0027] The user of system 50 is riding in a mobile vehicle while holding the information processing device 10. The mobile vehicle is, for example, a car, bicycle, motorcycle, or other vehicle. A terminal 20 is provided on the mobile vehicle. The display unit 270 of the terminal 20 is positioned in a location easily visible to the driver of the mobile vehicle. For example, the display unit 270 of the terminal 20 may be a display that shows a meter indicating the status of the mobile vehicle together with a map for navigation. Alternatively, the display unit 270 may be a display provided separately from the meter.
[0028] The information processing device 10 and the terminal 20 are capable of wireless communication with each other. That is, the transmitting unit 170 of the information processing device 10 transmits image data to the terminal 20 wirelessly. This allows the user to handle the information processing device 10 freely, for example, by leaving it in their bag even while navigating. The transmitting unit 170 can transmit image data via short-range wireless communication. Short-range wireless communication is preferably Bluetooth from the viewpoint of ease of connection, and among these, Bluetooth Low Energy (BLE) is preferred from the viewpoint of reducing power consumption.
[0029] The information processing device 10 can determine its current location using GPS (Global Positioning System) or the like. The information processing device 10 transmits location information indicating its determined current location and information indicating its destination to the server 30. The server 30 obtains the location information and destination information from the information processing device 10 and determines the route from the current location to the destination. The server 30 transmits route information indicating the determined route and map information of the area including the current location to the information processing device 10. The information processing device 10 obtains the route information and map information from the server 30 and uses this information to generate an image to be displayed on the terminal 20. The information processing device 10 then transmits image data to the terminal 20 for displaying the generated image. The terminal 20 uses the received image data to display the image on the display unit 270.
[0030] However, the information processing device 10 may be capable of performing navigation without communicating with the server 30. That is, the information processing device 10 may hold map information and perform route identification within the information processing device 10.
[0031] The image generated by the image generation unit 130 of the information processing device 10 includes a map of the region containing the current location of the information processing device 10. The map in the image has a marker indicating the current location superimposed on it. The map in the image may also show the route that a moving object should take to its destination.
[0032] The images displayed on the terminal 20 require real-time performance. That is, based on the current position of the information processing device 10, which changes as the moving object moves, the image generation unit 130 of the information processing device 10 sequentially generates images at predetermined intervals. Then, in order for the terminal 20 to correctly reflect its current position, it is preferable to display the images generated by the image generation unit 130 with the shortest possible delay. The frequency at which the image generation unit 130 generates images and the frequency at which the terminal 20 updates images can each be, for example, 3 fps to 5 fps under standard conditions. Standard conditions refer to a state in which ideal communication quality is achieved between the information processing device 10 and the terminal 20.
[0033] The processing flow executed by the information processing device 10 and terminal 20 according to this embodiment is illustrated in Figure 5, as in the embodiment. The functional configuration of the information processing device 10 according to this embodiment is illustrated in Figure 1, as in the embodiment. The functional configuration of the terminal 20 according to this embodiment is illustrated in Figure 3, as in the embodiment. The processing executed by each functional component of the information processing device 10 and terminal 20 in this embodiment will be described in detail below.
[0034] The image generation unit 130 generates an image. Specifically, the image generation unit 130 can draw a map in the image generation process as follows: The image generation unit 130 draws roads on the map using map information obtained from the server 30. At this time, the image generation unit 130 can use route information obtained from the server 30 to draw roads that overlap the route in a different color from other roads. Then, the image generation unit 130 overlays various characters and marks using the map information. The characters are, for example, one or more of the names of facilities on the map and the speed limit at the current location. The marks are, for example, one or more of the marks indicating facilities on the map, marks indicating destinations, marks indicating the current location, and map symbols.
[0035] The image generation unit 130 may further overlay one or more of the following on the map: the distance from the current location to the destination, the estimated time required from the current location to the destination, the estimated time of arrival, and a message for guiding the moving object to the destination. This information may be further acquired by the information processing device 10 from the server 30, or it may be generated by the information processing device 10 based on the map information and the current location.
[0036] The conversion unit 150 acquires image information representing the image generated by the image generation unit 130. The image contains multiple pixels. In the image, each of the multiple pixels is associated with information indicating its color. That is, the image information is information (for example, a table) that associates the coordinates of each of the multiple pixels with the color that should be displayed for that pixel.
[0037] The conversion unit 150 converts image information into image data. Preferably, the data size of the image data is smaller than the data size of the image information. In other words, it is preferable for the conversion unit 150 to generate image data by performing a compression process on the image information. It can also be said that the conversion unit 150 converts an image into image data by compressing the image. For example, the conversion unit 150 can convert image information into image data using existing technologies such as PNG (Portable Network Graphics), GIF (Graphics Interchange Format), and TIFF (Tagged Image File Format) as the compression process.
[0038] The method by which the transmitting unit 170 transmits image data using BLE will be explained in detail below.
[0039] In BLE, data packets are transmitted at a specific connection interval. This connection interval is variable depending on the settings, for example, between 7.5 milliseconds and 4 seconds. A shorter connection interval increases the transmission speed and power consumption. The maximum data size in a single packet is variable within a predetermined range depending on the settings. This maximum value is, for example, 517 bytes or less.
[0040] The transmitting unit 170 acquires the image data generated by the conversion unit 150. Then, the transmitting unit 170 divides the image data into multiple packets and transmits them. In other words, the transmitting unit 170 transmits one image data in multiple packets. In this way, the image data can be transmitted even if the data size of the image data exceeds the data size that can be contained in a single packet.
[0041] The number of packets for a single image data is not particularly limited. The number of packets can be set appropriately based on considerations such as ensuring real-time performance, ensuring sufficient image data size, and reducing power consumption.
[0042] The transmission unit 170 may be configured to transmit a plurality of packets corresponding to one piece of image data within a predetermined time. The predetermined time, for example, corresponds to the standard frame image update interval on the display and can also be said to be one frame time.
[0043] Each packet includes, in addition to the data for constituting the image data, necessary commands. The transmission unit 170 may include in the packet information indicating which packet in the image data it is. Further, the transmission unit 170 may include in the last packet to be transmitted among the plurality of packets for one piece of image data information indicating that it is the final packet.
[0044] The image acquisition unit 210 of the terminal 20 receives the image data transmitted from the transmission unit 170. Specifically, the image acquisition unit 210 receives a plurality of packets for one piece of image data. The data of one received packet is hereinafter referred to as "partially received data". Then, data for constituting the image data is extracted from the plurality of partially received data. And by combining the extracted data, one piece of image data can be restored.
[0045] The display control unit 230 causes the display unit 270 to display the image data restored by the image acquisition unit 210. The display control unit 230 may cause the display unit 270 to display only the image based on the acquired image data, or may further combine information indicating the state (such as speed) of the moving body and cause the display unit 270 to display it. The display control unit 230 can obtain, for example, the measurement results obtained by sensors or the like provided on the moving body as information indicating the state of the moving body.
[0046] As described above, in this embodiment, the image generation unit 130 of the information processing apparatus 10 sequentially executes image generation at a predetermined cycle based on the current position of the information processing apparatus 10 that changes as the moving body moves. That is, the image generation unit 130 repeatedly generates images. Then, the generated images are converted into image data and transmitted. Also, in the terminal 20, an image is displayed using the received image data. That is, the flow of FIG. 5 is repeated. The driver of the moving body can recognize the current position of the moving body at that time and the route to be traveled, etc., by checking the image displayed on the terminal 20.
[0047] According to this embodiment, the user can check the navigation content on the display unit 270 of the terminal 20 without checking the information processing apparatus 10.
[0048] (Embodiment 2) FIG. 7 is a diagram illustrating the functional configuration of the information processing apparatus 10 according to Embodiment 2. The information processing apparatus 10 according to this embodiment includes at least an image generation unit 130, an image determination unit 160, and a transmission unit 170. The image generation unit 130 generates an image. The image determination unit 160 determines whether the image generated by the image generation unit 130 satisfies a predetermined condition. The transmission unit 170 transmits, as image data for causing the image determined by the image determination unit 160 to be displayed on the display, the image that satisfies the predetermined condition. When the first image generated by the image generation unit 130 does not satisfy the predetermined condition, the image generation unit 130 generates a second image. Here, the data size of the image data of the second image is smaller than the data size of the image data of the first image.
[0049] Figure 8 is a diagram illustrating the processing flow performed by the information processing device 10 and terminal 20 according to Embodiment 2. The information processing method according to this embodiment is performed by one or more computers. The information processing method according to this embodiment includes at least an image generation step S10, an image determination step S21, and a transmission step S30. In the image generation step S10, one or more computers generate an image. In the image determination step S21, one or more computers determine whether the image generated in the image generation step S10 satisfies predetermined conditions. In the transmission step S30, if the predetermined conditions are met, one or more computers transmit image data for displaying the image determined in the image determination step S21 on a display. If the generated first image does not satisfy the predetermined conditions, in the image generation step S10, one or more computers generate a second image. Here, the data size of the image data of the second image is smaller than the data size of the image data of the first image.
[0050] For example, when attempting to transmit an image containing a map of the area including the current location of the information processing device 10 to a terminal 20 via a BLE with a slow data transfer speed, if there are many roads, characters, and various markers included in the map corresponding to the current location, the image data size will become large, and it may not be possible to complete the transmission of the image data within one frame time. In this embodiment, by making the data size of the image data of the second image newly generated by the image generation unit 130 smaller than the data size of the image data of the first image generated before it, it is possible to prevent the data size of the image data to be transmitted from becoming too large. In other words, an appropriate image can be generated according to the conditions related to image transmission.
[0051] The information processing method according to this embodiment can be executed by the information processing device 10 according to this embodiment. The information processing device 10 according to this embodiment is the same as the information processing device 10 according to the embodiment and at least one of embodiment 1, except for the points described below. The terminal 20 according to this embodiment is the same as the terminal 20 according to the embodiment and at least one of embodiment 1, except for the points described below. The system 50 according to this embodiment is the same as the system 50 according to the embodiment and at least one of embodiment 1, except for the points described below.
[0052] As shown in Figure 7, the information processing device 10 according to this embodiment may further include a conversion unit 150 that converts the image generated by the image generation unit 130 to generate image data.
[0053] Furthermore, the predetermined condition may be that the data size of the image data generated from the image generated by the image generation unit 130 is smaller than a predetermined data size. By doing so, the data size of the image data can be optimized in relation to the image data transmission conditions and the target specifications of the system 50. The predetermined data size can be determined based on at least one of the target value of the image update frequency (i.e., frame rate) to be displayed on the display unit 270 and the connection interval in BLE.
[0054] Referring to Figure 8, the processing flow executed by the information processing device 10 according to this embodiment will be described in detail. The image generation unit 130 according to this embodiment can generate an image in the same manner as described in Embodiment 1 (step S10). The conversion unit 150 can convert the image into image data in the same manner as described in Embodiment 1 (step S20).
[0055] In one example, the image determination unit 160 determines whether an image satisfies a predetermined condition by comparing the data size of the image data generated by the conversion unit 150 with a predetermined data size. Specifically, if the data size of the image data is smaller than the predetermined data size, it is determined that the image satisfies the predetermined condition. If it is determined that the image satisfies the predetermined condition (Yes in step S21), the transmission unit 170 transmits the image data of that image. The method by which the transmission unit 170 transmits the image data is as described in Embodiment 1.
[0056] Terminal 20 receives the transmitted image data (step S40) and displays the image on the display unit 270 (step S50), similar to the first embodiment.
[0057] On the other hand, if the data size of the image data is not smaller than a predetermined data size, it is determined that the image does not meet the predetermined conditions. If it is determined that the image does not meet the predetermined conditions (No. in step S21), the image generation unit 130 changes the rules for image generation (step S22) and generates the image again (step S10). That is, if the first image does not meet the predetermined conditions, the image generation unit 130 generates a second image using rules different from the rules used to generate the first image. By doing so, the image generation unit 130 generates a second image having a data size smaller than the data size of the image data of the first image.
[0058] Through this process, in this embodiment, the image generation unit 130 repeats image generation until the image generated by the image generation unit 130 satisfies predetermined conditions. The first image and the second image are images that show the same situation in navigation. That is, the first image and the second image are images based on the same current position. The image generation unit 130 repeats the generation of images based on the same current position until the generated images satisfy predetermined conditions. In this way, appropriate image data of images that satisfy predetermined conditions can be obtained.
[0059] Figure 9 illustrates a method for generating a second image having a smaller data size than the data size of the first image's image data. Below, we will describe three examples of methods for generating a second image having a smaller data size than the data size of the first image's image data, i.e., data size reduction methods. Note that when the image generation unit 130 generates an image based on the same current position three or more times, one of the data size reduction methods from the first to third examples may be repeatedly applied. Alternatively, two or more data size reduction methods from the first to third examples may be applied in sequence. For example, the first example method may be applied in the first regeneration, and if the predetermined conditions are not met and further regeneration is performed, the second example method may be applied. Furthermore, in a single regeneration, two or more data size reduction methods from the first to third examples may be combined and applied.
[0060] <First example of data reduction method> In the first example of the data deletion method, the image generation unit 130 generates an image including a map of the area including the current location of the information processing device 10, as described in Example 1. In this case, if the first image generated by the image generation unit 130 does not satisfy predetermined conditions, the image generation unit 130 can generate a second image such that the number of links in the map included in the second image is smaller than the number of links in the map included in the first image.
[0061] Map information includes information indicating multiple nodes and information indicating multiple links. Nodes on a map indicate either dead ends, intersections, or points where road attributes change. Road attributes refer to the type of road, such as national roads, prefectural roads, or expressways. Links on a map indicate connections between two nodes. In other words, each link corresponds to an individual road section, and the number of links can be said to be the number of roads. Reducing the number of links in a map included in an image reduces the number of roads in the image, making the image simpler and reducing the data size of the image data.
[0062] The map information includes information indicating the width of the roads. When the image generation unit 130 generates an image, the roads are drawn in order of thickness. Here, when generating the second image, a limit value is set for the thickness of the roads to be drawn, and the image generation unit 130 draws only roads that are thicker than or equal to the limit value. Alternatively, the limit value when generating the second image is set to be larger than the limit value when generating the first image. By doing so, the number of links in the map in the second image can be made smaller than the number of links in the map in the first image. In Figure 9, the number of links in the central image is less than the number of links in the upper image.
[0063] Furthermore, it is preferable that the image generation unit 130 determines which links to delete based on the current position of the information processing device 10. In other words, it is preferable that the image generation unit 130 does not delete the paths that the moving object will take, i.e., paths that overlap with the route to the destination, and paths that intersect with that path, but instead draw them on the map. By doing so, the ease of route recognition can be maintained.
[0064] <Second example of data reduction method> In the second example of the data deletion method, the image generation unit 130 generates a second image such that the number of pixels in the second image is smaller than the number of pixels in the first image if the first image generated by the image generation unit 130 does not meet predetermined conditions.
[0065] In Figure 9, the number of pixels in the lower image is less than the number of pixels in the central image. Even with the same drawing content, a lower number of pixels results in a smaller data size for the image data. The display control unit 230 of the terminal 20 may enlarge the acquired image to fill the predetermined display area of the display unit 270, regardless of the number of pixels in the image acquired from the information processing device 10. In this case, since the display size of the display unit 270 does not change, images with fewer pixels will appear coarser when displayed on the display unit 270.
[0066] <Third example of data reduction method> In the third example of data deletion method, the image generation unit 130 generates a second image such that the number of colors used in the second image is less than the number of colors used in the first image, if the first image generated by the image generation unit 130 does not meet predetermined conditions. By reducing the number of colors, the data size of the image data can be reduced. For example, by predetermining the priority order of colors to be used in an image, the number of colors can be reduced by replacing the color with the lowest priority among the colors used in the first image with a color with a higher priority.
[0067] The above describes an example in which the image determination unit 160 determines whether an image satisfies predetermined conditions using image data. However, the image determination unit 160 may also determine whether an image satisfies predetermined conditions before it is converted into image data. In this case, it is not necessary to perform conversion to image data each time an image is generated. That is, only images that are determined to satisfy predetermined conditions need to be converted into image data. The image determination unit 160 may perform step S21 after step S10 and before step S20. An example in which the image determination unit 160 determines whether an image satisfies predetermined conditions before it is converted into image data will be described below.
[0068] As described in Example 1, the image generation unit 130 can generate an image that includes a map. The predetermined condition may be that the number of links in the map included in the image generated by the image generation unit 130 is less than a predetermined number.
[0069] As another example, the image determination unit 160 can perform a determination by calculating the complexity of the image generated by the image generation unit 130 and comparing that complexity with a predetermined complexity. That is, the predetermined condition may be that the complexity of the image generated by the image generation unit 130 is less than the predetermined complexity. As described in Embodiment 1, the image generation unit 130 can generate an image containing a map and multiple characters. The image determination unit 160 can then calculate the complexity of the image using the number of links and characters in the map contained in the image. The more links in the map, the greater the complexity of the image. Also, the more characters in the map, the greater the complexity of the image. Specifically, the complexity can be obtained, for example, as a weighted sum of the number of links and the number of characters.
[0070] Even if the image determination unit 160 determines whether or not predetermined conditions are met for an image before it is converted into image data, the above-described example can be applied similarly as a data reduction method.
[0071] The hardware configuration of the computer implementing the information processing device 10 according to this embodiment is shown, for example, in Figure 4, similar to the information processing device 10 according to the embodiment. However, the storage device 1080 of the computer 1000 implementing the information processing device 10 according to this embodiment further stores a program module that implements the functions of the image determination unit 160 according to this embodiment.
[0072] As described above, according to this embodiment, the image generation unit 130 generates a second image if the first image generated by the image generation unit 130 does not meet predetermined conditions. Here, the data size of the image data of the second image is smaller than the data size of the image data of the first image. Therefore, even when transmitting an image via a communication with a slow data transfer speed, such as BLE, an appropriate image can be generated according to the conditions related to image transmission.
[0073] (Example 3) Figure 10 is a diagram illustrating the functional configuration of the information processing device 10 according to Example 3. The information processing device 10 according to this example is the same as the information processing device 10 according to at least one of Embodiment, Example 1, and Example 2, except for the points described below. The terminal 20 according to this example is the same as the terminal 20 according to at least one of Embodiment, Example 1, and Example 2, except for the points described below. The system 50 according to this embodiment is the same as the system 50 according to at least one of Embodiment, Example 1, and Example 2, except for the points described below.
[0074] The information processing device 10 according to this embodiment further comprises a display information acquisition unit 110. The display information acquisition unit 110 acquires information indicating the type of display (hereinafter also referred to as "display information") from a terminal 20 that receives image data and displays the image on the display. The image generation unit 130 generates an image using the information indicating the type of display.
[0075] Display information, for example, indicates the shape of the area on the display where an image is displayed. The shape of the area on the display where an image is displayed will also be referred to as the "display shape" below. The display shape is not particularly limited and may be circular, elliptical, or egg-shaped, or it may be a polygon such as a square, pentagon, or hexagon. Examples of squares include squares and rectangles. Furthermore, the display shape may be a rounded polygon with rounded corners.
[0076] Figure 11 illustrates the image generation in the image generation unit 130 and the display on the display according to this embodiment. In the example shown in this figure, the display shape of the display is circular.
[0077] The image generation unit 130 can identify the effective display area 91 according to the type of display and generate an image 90 in which the area outside the effective display area 91 is a single color.
[0078] Specifically, the image generation unit 130 can identify an effective display area 91 with a shape corresponding to the type of display. That is, if the display information indicates a display shape, the image generation unit 130 matches that display shape with the shape of the effective display area 91.
[0079] In the example in Figure 11, the shape of image 90 is a rectangle, and the effective display area 91 is circular. When the effective display area 91 is placed within the effective display area 91, an external area 92 is created outside the effective display area 91 of image 90. In the example in Figure 11, the image generation unit 130 fills this external area 92 with a single color, black. That is, the image generation unit 130 sets the color of the external area 92 to a single color. Then, the image generation unit 130 draws a map within the effective display area 91, in the same manner as described in Example 1, etc.
[0080] When the display control unit 230 of the terminal 20 acquires image data showing such an image, it displays the portion of the image 90 within the effective display area 91 on the display. On the other hand, the portion within the external area 92 is not displayed on the display.
[0081] By filling the external region 92 with a single color, the compression ratio in the conversion unit 150 can be improved compared to the case where a map is further drawn in the external region 92, and the data size of the image data based on the image 90 can be reduced. Consequently, the transmission load due to the image data can be reduced. The image generation unit 130 may divide the external region 92 into multiple regions and fill each region with a single color. The image generation unit 130 may also make the colors of the multiple regions different from each other. However, from the viewpoint of improving the compression ratio, it is preferable to have fewer regions and fewer colors used in the external region 92. For example, the number of regions is preferably 4 or less, and more preferably 2 or less. The number of colors used in the external region 92 is preferably 4 or less, and more preferably 1 color.
[0082] As another example, the information indicating the display type may also indicate the display size. In that case, the image generation unit 130 generates an image with a number of pixels corresponding to the display size. This avoids generating an excessively large number of pixels, i.e., an excessively high-resolution image. Consequently, it avoids unnecessarily increasing the processing load and power consumption of image generation.
[0083] Figure 12 illustrates the flow of processing performed by the information processing device 10 and terminal 20 according to this embodiment. Once communication is established between the information processing device 10 and terminal 20, terminal 20 transmits display information about its display unit 270 to the information processing device 10 (step S01). The display information acquisition unit 110 of the information processing device 10 acquires the display information by receiving it from terminal 20 (step S02). Note that steps S01 and S02 do not need to be performed every time an image is generated. They only need to be performed once after communication is established between the information processing device 10 and terminal 20 and before the first image is generated.
[0084] The image generation unit 130 of the information processing device 10 generates an image using the information shown on the display (step S10) as described above. The conversion unit 150 converts the image into image data (step S20). The transmission unit 170 transmits the image data to the terminal 20 (step S30). The processing performed by the conversion unit 150 and the transmission unit 170 is the same as the processing in at least one of the embodiments, example 1 and example 2.
[0085] The image acquisition unit 210 of the terminal 20 receives image data transmitted from the information processing device 10 (step S40). As described above, the display control unit 230 uses the image data to display the image on the display unit 270 (step S50).
[0086] In the example described above, the image generation unit 130 can set the external area 92 to a predetermined color. Alternatively, the image generation unit 130 may identify a single color corresponding to the state of the information processing device 10 and use it to generate the image. By doing so, the state of the information processing device 10 can be communicated to the terminal 20.
[0087] For example, a table associating the state of the information processing device 10 with a color is pre-stored in a storage unit accessible from the image generation unit 130. This storage unit can be implemented, for example, using a storage device 1080 in a computer 1000 that implements the information processing device 10. Examples of the states of the information processing device 10 include normal, low battery level, notification generated, and communication failure with the server 30.
[0088] In step S10, the image generation unit 130 acquires information indicating the state of the information processing device 10 from the operating system of the information processing device 10. Then, in a table that associates the state of the information processing device 10 with a color, it identifies the color corresponding to the acquired state of the information processing device 10 as the color to be used for image generation. The image generation unit 130 then generates an image in which the external region 92 is painted with the identified color. The terminal 20 maintains a table that associates colors with the processes to be executed. This table is, for example, stored in the storage device 1080 of the computer 1000 that implements the terminal 20. The terminal 20, having acquired image data of the image, can use this table to identify the process to be executed based on the color of the external region 92 in the image. The processes to be executed are, for example, outputting messages such as "Battery level is low," "There is a notification on your smartphone," or "There is a problem with internet communication," depending on the state of the information processing device 10.
[0089] As mentioned above, the external area 92 may be divided into multiple areas, and each area may be filled with a color indicating the status of the information processing device 10. In that case, for example, one area's color may indicate the battery level, and another area's color may indicate whether or not a notification has been sent, allowing multiple pieces of information indicating the status of the information processing device 10 to be sent to the terminal 20.
[0090] The hardware configuration of the computer implementing the information processing device 10 according to this embodiment is shown, for example, in Figure 4, similar to the information processing device 10 according to the embodiment. However, the storage device 1080 of the computer 1000 implementing the information processing device 10 according to this embodiment further stores a program module that implements the functions of the display information acquisition unit 110 according to this embodiment.
[0091] As described above, according to this embodiment, the image generation unit 130 generates an image using display information. Therefore, it is possible to generate an appropriate image file according to the conditions of the terminal 20 to which the image is sent. As a result, even when transmitting an image via a communication with a slow data transfer speed, such as BLE, the size of the image data to be transmitted can be appropriately reduced.
[0092] (Example 4) Figure 13 is a diagram illustrating the functional configuration of the information processing device 10 according to Example 4. The information processing device 10 according to this example is the same as the information processing device 10 according to Embodiment and at least one of Examples 1 to 3, except for the points described below. The terminal 20 according to this example is the same as the terminal 20 according to Embodiment and at least one of Examples 1 to 3, except for the points described below. The system 50 according to this embodiment is the same as the system 50 according to Embodiment and at least one of Examples 1 to 3, except for the points described below.
[0093] The information processing device 10 according to this embodiment comprises an image generation unit 130, a transmission unit 170, a reception result acquisition unit 100, and a communication determination unit 101. The image generation unit 130 generates an image according to rules for image generation. The transmission unit 170 transmits image data for displaying the image generated by the image generation unit 130 via wireless communication. The reception result acquisition unit 100 acquires result information indicating the reception result of the image data from a terminal 20 that receives the image data. The communication determination unit 101 uses the reception result to determine whether the communication quality of the wireless communication falls below a predetermined quality standard. If the communication determination unit 101 determines that the communication quality of the wireless communication falls below a predetermined quality standard, the image generation unit 130 changes the rules used for image generation.
[0094] Figure 14 is a diagram illustrating the flow of processing performed by the information processing device 10 and terminal 20 according to this embodiment. The information processing method according to this embodiment is performed by one or more computers. The information processing method according to this embodiment includes at least an image generation step S10, a transmission step S30, a reception result acquisition step S46, and a communication determination step S03. In the image generation step S10, one or more computers generate an image according to rules for image generation. In the transmission step S30, one or more computers transmit image data for displaying the image generated in the image generation step S10 via wireless communication. In the reception result acquisition step S46, one or more computers acquire result information indicating the reception result of the image data from the terminal that receives the image data. In the communication determination step S03, one or more computers use the reception result to determine whether the communication quality of the wireless communication is below a predetermined quality standard. If the communication determination step determines that the communication quality of the wireless communication is below a predetermined quality standard, one or more computers change the rules used for image generation in the image generation step S10.
[0095] The information processing method according to this embodiment can be executed by the information processing device 10 according to this embodiment.
[0096] The flow in Figure 14 is executed for each image. That is, multiple images are generated and transmitted by repeatedly executing the flow in Figure 14. In the flow for a given image, the result information used for the determination in steps S03 and S05 is the result information for images generated and transmitted before that image. That is, in the flow for a given image, the result information used for the determination in steps S03 and S05 is the result information received in step S46 of the flow preceding that flow.
[0097] Figure 15 is a diagram illustrating the functional configuration of the terminal 20 according to this embodiment. The terminal 20 according to this embodiment further comprises a reception determination unit 250. The reception determination unit 250 determines the reception result of the image data and transmits result information. The reception result is, for example, whether or not the reception was successful. It can also be said that the reception determination unit 250 determines as a reception result whether the received image data is corrupted or missing. Existing error detection techniques such as checksums can be used to determine the reception result. The reception determination unit 250 may determine the reception result for each image data, or it may determine the reception result for each packet, i.e., for each partially received data.
[0098] When determining the reception result for each image data, the reception determination unit 250 performs the determination on the image data restored using multiple partially received data. This reduces the number of determinations and thus the processing load compared to determining the result for each packet.
[0099] When determining the reception result for each packet, the reception determination unit 250 performs a determination on each individual packet. If partial reception data is successfully obtained for all of the multiple packets that make up a single image data, the reception determination unit 250 determines that the reception of that image data was successful. On the other hand, if partial reception data is not successfully obtained for one or more of the multiple packets that make up a single image data, the reception determination unit 250 determines that the reception of that image data was unsuccessful.
[0100] The reception determination unit 250 generates information indicating the determination result as result information and transmits it to the information processing device 10. Preferably, the reception determination unit 250 transmits the result information for each image data.
[0101] As described in Example 1, the transmission unit 170 includes information indicating that the last packet to be transmitted among multiple packets for a single image data is the final packet. The reception determination unit 250 can determine whether or not the reception of the image data has been completed. That is, if the partially received data contains information indicating that it is the final packet, the reception determination unit 250 determines that the reception of one image data has been completed. On the other hand, if the partially received data does not contain information indicating that it is the final packet, the reception determination unit 250 determines that the reception of the image data has not been completed.
[0102] If the reception determination unit 250 determines that the reception of image data is complete, it may transmit information indicating that the reception of image data is complete, along with the result information, to the information processing device 10. In this case, upon receiving this information, the information processing device 10 may become ready to transmit the next image data. That is, the transmission unit 170 may use the information processing device 10 receiving information indicating that the reception of image data is complete as a trigger to transmit the first packet for the next image data transmission.
[0103] The information processing device 10's reception result acquisition unit 100 acquires the result information generated by the terminal 20's reception determination unit 250. The communication determination unit 101 uses the result information to determine whether the communication quality of the wireless communication between the information processing device 10 and the terminal 20 is below a predetermined quality standard. For example, the communication determination unit 101 may determine that the communication quality is below a predetermined quality standard if the reception of the image data transmitted immediately before was unsuccessful. The communication determination unit 101 may also determine that the communication quality is not below a predetermined quality standard if the reception of the image data transmitted immediately before was successful.
[0104] As another example, the communication determination unit 101 may determine the communication quality of wireless communication between the information processing device 10 and the terminal 20 using the reception results for the most recent multiple image data transmissions. This allows for determination based on the current average communication quality. For example, the communication determination unit 101 may determine the percentage of successful image data receptions out of a predetermined number of image data transmissions most recent as a communication quality index. The communication determination unit 101 then compares the determined communication quality index with a predetermined reference index to determine whether the communication quality falls below a predetermined quality standard. That is, if the determined communication quality index is below the reference index, the communication determination unit 101 determines that the communication quality falls below the predetermined quality standard. If the determined communication quality index is not below the reference index, the communication determination unit 101 determines that the communication quality does not fall below the predetermined quality standard.
[0105] Furthermore, after the information processing device 10 is started up, until sufficient result information for determination is obtained, the communication determination unit 101 may determine that the communication quality of the wireless communication is not below a predetermined quality standard.
[0106] In the example shown in Figure 13, the information processing device 10 further includes a rule storage unit 132. Rule information indicating multiple rules for the image generation unit 130 to generate an image is pre-stored in the rule storage unit 132, which is accessible from the image generation unit 130. The rule information is, for example, a table that associates each of the multiple rule identification IDs with the conditions that should be used for image generation in that rule. Multiple rules are identified from each other by their rule identification IDs. Each rule has multiple items set as conditions that should be used for image generation. For example, it is preferable that each rule specifies one or more of the following: the number of pixels in the image to be generated, the upper limit of the number of colors to be used, and the lower limit of the thickness of the roads to be drawn on the map. It is even more preferable that each rule specifies all of the following: the number of pixels in the image to be generated, the upper limit of the number of colors to be used, and the lower limit of the thickness of the roads to be drawn on the map. The rule storage unit 132 can be implemented by the storage device 1080 of the computer 1000 that implements the information processing device 10. However, the rule storage unit 132 may be provided outside the information processing device 10. The image generation unit 130 can read and use the rules to be used from the rule storage unit 132.
[0107] Figure 16 illustrates images generated using multiple rules. These rules include a standard rule. The initial setting for the rules used by the image generation unit 130 is the standard rule. When images based on the same current location are generated using multiple rules, the image generated using the standard rule has the largest data size among the resulting images.
[0108] If the communication determination unit 101 determines that the communication quality of the wireless communication falls below a predetermined quality standard, the image generation unit 130 changes the rules used for image generation so that the data size of the image data of the generated image is reduced.
[0109] As described in Example 1, the transmission unit 170 divides one image data corresponding to one image generated by the image generation unit 130 into multiple packets and transmits these multiple packets within a predetermined time. Here, if the communication determination unit 101 determines that the communication quality of the wireless communication is below a predetermined quality standard, it is preferable that the image generation unit 130 changes the rules used for image generation so as to reduce the number of packets when transmitting one image data corresponding to one image. By reducing the number of packets corresponding to one image data, the probability of failing to receive the image data can be reduced.
[0110] The following describes three examples of how to change the rules.
[0111] <First example of rule change method> In the first example of rule change method, if the communication determination unit 101 determines that the communication quality of wireless communication is below a predetermined quality standard, the image generation unit 130 changes the rules used for image generation so that the number of pixels in the generated image decreases. By reducing the number of pixels, the data size of the image data can be reduced. Images with fewer pixels will appear coarser when displayed on the display unit 270.
[0112] <Second Example of Rule Change Method> In the second example of the rule change method, if the communication determination unit 101 determines that the communication quality of wireless communication is below a predetermined quality standard, the image generation unit 130 changes the rules used for image generation so that the number of colors included in the generated image is reduced. By reducing the number of colors, the data size of the image data can be reduced. The same method as described in Example 2 can be used to reduce the number of colors.
[0113] <Third Example of Rule Modification Method> In the third example of the rule modification method, as described in Example 1, the image generation unit 130 generates an image that includes a map of the area including the current location of the information processing device 10. When the communication determination unit 101 determines that the communication quality of the wireless communication is below a predetermined quality standard, the image generation unit 130 changes the rules used for image generation so that the number of links in the map included in the generated image is reduced. The links are as described in Example 2. Furthermore, the same method as described in Example 2 can be used to determine which links to include in the image.
[0114] The first three examples of rule changes have been explained above. Note that in each example, multiple rules with different degrees of data size reduction may exist. For example, for the first example, multiple rules with different pixel counts may exist. For the second example, multiple rules with different color counts may exist. For the third example, multiple rules with different lower limits on road width may exist.
[0115] Furthermore, as rule changes in steps S04 and S06 described later, one of the first to third examples may be applied, or two or more may be applied in combination.
[0116] Another example of a rule is that there may be a rule that transmits the same image data multiple times. For example, if the rule is modified to reduce the data size as described above, and the number of packets for one image data is reduced, it may become possible to transmit that image data multiple times within a predetermined time. Specifically, if the communication determination unit 101 determines that the communication quality of the wireless communication is below a predetermined quality standard, the transmission unit 170 may transmit multiple packets corresponding to one image data multiple times within a predetermined time. On the other hand, if the communication determination unit 101 determines that the communication quality of the wireless communication is not below a predetermined quality standard, the transmission unit 170 transmits multiple packets corresponding to one image data once within a predetermined time. In the rule information, each rule identification ID may also be associated with the number of times the image data is transmitted within a predetermined time.
[0117] Referring to Figure 14, the processing flow executed by the information processing device 10 and terminal 20 according to this embodiment will be described. Figure 14 shows the processing for a single image.
[0118] In step S03, the communication determination unit 101, as described above, uses result information for one or more image data transmitted immediately before to determine whether the communication quality of the wireless communication falls below a predetermined quality standard. If the communication quality of the wireless communication falls below the predetermined quality standard (Yes in step S03), the image generation unit 130 changes the rules used for image generation so that the data size of the image data obtained with the changed rules is smaller than the data size of the image data obtained with the currently set rules (step S04). Then, it generates an image using the changed rules (step S10).
[0119] On the other hand, if the communication quality of the wireless communication does not fall below a predetermined quality standard (No. in step S03), the communication determination unit 101 further determines whether or not predetermined conditions regarding communication quality are met (step S05). The predetermined conditions regarding communication quality are, for example, that all of the most recent predetermined number of image data transmissions have been successful. Here, the predetermined number can be, for example, the number of times that the image update frequency of the terminal 20 in the standard state described above can be achieved. The predetermined conditions regarding communication quality can be said to be conditions that indicate that there are no problems with the communication quality.
[0120] If predetermined conditions regarding communication quality are met (Yes in step S05), the image generation unit 130 changes the rules used for image generation so that the data size of the image data obtained with the changed rules is larger than the data size of the image data obtained with the currently set rules (step S06). Then, it generates an image using the changed rules (step S10). When there are no problems with communication quality, the system can be gradually returned to standard image generation processing by changing the rules to increase the data size. Note that in step S06, if the rules before the change are already standard rules, the image generation unit 130 does not need to change the rules.
[0121] If the predetermined conditions regarding communication quality are not met (No. in step S05), the image generation unit 130 generates an image without changing the rules (step S10).
[0122] Step S05 may be omitted. In that case, step S06 may be executed if the communication quality of the wireless communication does not fall below a predetermined quality standard (No. in step S03).
[0123] When the image generation unit 130 generates an image, the conversion unit 150 converts the image into image data (step S20). The transmission unit 170 transmits the image data to the terminal 20 (step S30).
[0124] Terminal 20 receives image data transmitted from the information processing device 10 (step S40). Then, it transmits result information regarding the reception of the image data (step S45). In addition, the reception determination unit 250 of terminal 20 displays an image on the display unit 270 using the received image data (step S50).
[0125] The information processing device 10's reception result acquisition unit 100 receives result information transmitted from the terminal 20 (step S46). This result information is used by the communication determination unit 101 for determination to generate the next image.
[0126] Let's further explain an example of rule changes. In rule information, priorities may be predetermined for multiple rules. These priorities can be determined based on the degree of impact on the user and the degree of data size reduction. For example, in rule information, a priority may be further associated with each rule identification ID. Then, rule changes may be made according to the priority. In this way, rule changes can be made in stages according to the communication quality.
[0127] For example, in the example in Figure 16, in step S04, the image generation unit 130 changes the rules in order of priority. Specifically, when changing from the standard rule, it changes to the second rule, which has the next highest priority after the standard rule. When changing from the second rule, it changes to the third rule, which has the next highest priority after the second rule. When changing from the third rule, it changes to the fourth rule, which has the next highest priority after the third rule.
[0128] Furthermore, for example, in step S06, the image generation unit 130 changes the rules in order of increasing priority. Specifically, when changing from the fourth rule, it changes to the third rule, which has the next lowest priority after the fourth rule. When changing from the third rule, it changes to the second rule, which has the next lowest priority after the third rule. When changing from the second rule, it changes to the standard rule, which has the next lowest priority after the second rule.
[0129] The hardware configuration of the computer implementing the information processing device 10 according to this embodiment is shown, for example, in Figure 4, similar to the information processing device 10 according to the embodiment. However, the storage device 1080 of the computer 1000 implementing the information processing device 10 according to this embodiment further stores program modules that implement the functions of the reception result acquisition unit 100 and the communication determination unit 101 according to this embodiment.
[0130] The hardware configuration of the computer that implements the terminal 20 according to this embodiment is shown, for example, in Figure 4, similar to the terminal 20 according to the embodiment. However, the storage device 1080 of the computer 1000 that implements the terminal 20 according to this embodiment further stores a program module that implements the functions of the reception determination unit 250 according to this embodiment.
[0131] As described above, according to this embodiment, if the communication determination unit 101 determines that the communication quality of wireless communication falls below a predetermined quality standard, the image generation unit 130 changes the rules used for image generation. Therefore, even when communication quality deteriorates, it is possible to reduce the success rate of image transmission, and consequently, to reduce the frequency of display updates on the terminal 20. For this reason, even if the communication quality deteriorates further due to radio interference or the like when transmitting images via a communication with a slow data transfer speed such as BLE, it is possible to suppress the decrease in the frequency of display updates on the terminal 20.
[0132] (Example 5) Figure 17 is a diagram illustrating the functional configuration of the information processing device 10 according to Example 5. The information processing device 10 according to this example is the same as the information processing device 10 according to Embodiment and at least one of Examples 1 to 4, except for the points described below. The terminal 20 according to this example is the same as the terminal 20 according to Embodiment and at least one of Examples 1 to 4. The system 50 according to this embodiment is the same as the system 50 according to Embodiment and at least one of Examples 1 to 4, except for the points described below.
[0133] The information processing device 10 according to this embodiment includes an image generation unit 130 and a mode switching unit 120. The image generation unit 130 generates images according to different rules in the first mode and the second mode. The mode switching unit 120 switches between the first mode and the second mode. In the second mode, the image generation unit 130 generates an image with fewer colors than in the first mode, generates an image with fewer pixels than in the first mode, and generates multiple images at longer intervals than in the first mode.
[0134] Figure 18 is a diagram illustrating the flow of processing performed by the information processing device 10 and terminal 20 according to this embodiment. The information processing method according to this embodiment is performed by one or more computers. The information processing method according to this embodiment includes an image generation step S10 and a mode switching step S12. In the mode switching step S12, one or more computers switch between a first mode and a second mode. In the image generation step S10, one or more computers generate images according to different rules in the first mode and the second mode. In the image generation step S10, one or more computers perform at least one of the following: generate an image with fewer colors in the second mode than in the first mode; generate an image with fewer pixels in the second mode than in the first mode; or generate multiple images at longer intervals in the second mode than in the first mode.
[0135] The information processing method according to this embodiment can be executed by the information processing device 10 according to this embodiment.
[0136] In the example shown in Figure 17, the information processing device 10 includes a power control unit 125 and a battery 126. The power control unit 125 controls the power supply of the information processing device 10. When no external power supply is connected to the information processing device 10, the power control unit 125 discharges the battery 126, and the information processing device 10 is operated by the power charged in the battery 126. Also, when an external power supply is connected to the information processing device 10, the power control unit 125 charges the battery 126 with power from the external power supply. When an external power supply is connected to the information processing device 10, the power control unit 125 may operate the information processing device 10 with power from that external power supply. The external power supply may be a commercial power supply provided via an outlet, or it may be a battery such as a portable battery provided outside the information processing device 10.
[0137] The second mode can be described as a so-called power-saving mode. In contrast, the first mode can be described as a normal mode. In the information processing device 10, the more frequently the image generation unit 130 generates images, and the more frequently the conversion unit 150 converts those images into image data, the greater the power consumption. Alternatively, the larger the data size of the image data converted by the conversion unit 150, and the larger the size of the image data transmitted by the transmission unit 170 within a predetermined time, the greater the power consumption. In other words, reducing the processing load in image generation, conversion, and transmission leads to reduced power consumption. In this embodiment, the image generation unit 130 can reduce the processing load in image generation, conversion, and transmission by generating images with a small number of colors, generating images with a small number of pixels, and generating multiple images at long intervals in the second mode.
[0138] The mode switching unit 120 determines whether to set the information processing device 10 to the first mode or the second mode based on the state of the information processing device 10. An example of how the mode switching unit 120 determines which mode to set is described below.
[0139] The mode switching unit 120 switches between the first mode and the second mode based, for example, on the remaining battery level of the battery 126 provided in the information processing device 10. By doing so, the battery depletion of the information processing device 10 can be delayed. The mode switching unit 120 can obtain information indicating the remaining battery level from the power control unit 125. If the remaining battery level is below a predetermined level, the mode switching unit 120 determines that the information processing device 10 should be set to the second mode. On the other hand, if the remaining battery level is not below a predetermined level, the mode switching unit 120 determines that the information processing device 10 should be set to the first mode.
[0140] Furthermore, the mode switching unit 120 may switch between the first mode and the second mode based on the power supply status to the information processing device 10. The mode switching unit 120 can obtain information from the power control unit 125 indicating whether or not power is being supplied to the information processing device 10. The state in which power is being supplied to the information processing device 10 means that an external power supply is connected to the information processing device 10 and power is being supplied to the information processing device 10 from the external power supply. If there is no power supply to the information processing device 10, the mode switching unit 120 determines that the information processing device 10 should be set to the second mode. On the other hand, if there is power supply to the information processing device 10, the mode switching unit 120 determines that the information processing device 10 should be set to the first mode. By doing so, the decrease in battery level when there is no power supply can be suppressed.
[0141] The mode switching unit 120 may switch between the first mode and the second mode based on an operation on the information processing device 10. That is, the user of the information processing device 10 may be able to switch between the first mode and the second mode by performing a mode setting operation. This allows the system 50 to be used according to the user's wishes. The mode switching unit 120 can acquire information indicating the user's operation from an input device such as a touch panel connected to the computer 1000 that implements the information processing device 10. If the setting based on the operation is for the second mode, the mode switching unit 120 determines that the information processing device 10 should be set to the second mode. On the other hand, if the setting based on the operation is for the first mode, the mode switching unit 120 determines that the information processing device 10 should be set to the first mode.
[0142] As described in Example 1, the image may include a map. When the terminal 20 displays a map for navigation, it is preferable that a more detailed map be displayed on the terminal 20 when the moving object is located near an intersection or destination. Therefore, at such times, it is preferable to set the information processing device 10 to the first mode to avoid reducing the image quality or frame rate. To this end, the mode switching unit 120 may switch between the first mode and the second mode using the location information of the information processing device 10. Doing so can improve convenience at important points in navigation.
[0143] Specifically, the mode switching unit 120 acquires location information indicating the current location of the information processing device 10, which has been identified by GPS (Global Positioning System) or the like. The mode switching unit 120 also acquires route information and map information transmitted from the server 30. The mode switching unit 120 uses the location information, route information, and map information to determine, for example, whether the current location is within a cautionary range. Examples of cautionary ranges include areas within a predetermined distance from the destination, areas within a predetermined distance from intersections on the route, areas within a predetermined distance from road junctions on the route, and areas within a predetermined distance from road junctions on the route. If the current location is within at least one of the cautionary ranges, the mode switching unit 120 determines that the information processing device 10 should be set to the first mode. If the current location is not within any of the cautionary ranges, the mode switching unit 120 determines that the information processing device 10 should be set to the second mode.
[0144] The above describes several examples of determination methods for identifying the mode to be set, but the mode switching unit 120 may also identify the mode to be set by combining the above examples. That is, if the status of the information processing device 10 falls under at least one of the reasons for identifying that the information processing device 10 should be set to the second mode as described above, the mode switching unit 120 may identify that the information processing device 10 should be set to the second mode. If the status of the information processing device 10 does not fall under any of the reasons for identifying that the information processing device 10 should be set to the second mode as described above, the mode switching unit 120 may identify that the information processing device 10 should be set to the first mode. Alternatively, the mode switching unit 120 may determine the priority order of multiple determinations for identifying the mode to be set in advance and identify the mode to be set by making determinations according to that priority order.
[0145] The image generation unit 130 generates images according to rules corresponding to the set mode. The rules to be used by the image generation unit 130 in the first mode and the rules to be used in the second mode are predetermined. Each rule specifies at least one of the following: the number of colors to be used in the image, the number of pixels in the image, and the interval for image generation.
[0146] When the image generation unit 130 generates an image with fewer colors in the second mode than in the first mode, the image generation unit 130 generates an image with the number of colors specified in the rules. An example of a method for reducing the number of colors is as described in Embodiment 2. When the image generation unit 130 generates an image with fewer pixels in the second mode than in the first mode, the image generation unit 130 generates an image with the number of pixels specified in the rules. When the image generation unit 130 generates multiple images at longer intervals in the second mode than in the first mode, it generates images at intervals specified in the rules. Specifically, the image generation unit 130 generates the next image when the interval specified in the rules has elapsed since the previous image generation.
[0147] In the example shown in Figure 17, the information processing device 10 includes a transmission unit 170 that transmits image data for displaying the image generated by the image generation unit 130. As described in Embodiment 1, the transmission unit 170 can divide the image data into multiple packets and transmit them. If the image generation unit 130 generates multiple images at longer intervals in the second mode than in the first mode, the transmission unit 170 may transmit packets at longer intervals in the second mode than in the first mode. In this case, the frame rate of image display on the terminal 20 will be lower in the second mode than in the first mode.
[0148] Referring to Figure 18, the processing flow executed by the information processing device 10 and terminal 20 according to this embodiment will be described. Prior to image generation, the mode switching unit 120 determines whether a mode switch is necessary (step S11). To make this determination, the mode switching unit 120 identifies whether the information processing device 10 should be set to the first mode or the second mode. If the identified mode is different from the mode currently set, it determines that a mode switch is necessary (Yes in step S11), and the mode switching unit 120 switches the mode (step S12). If the identified mode matches the mode currently set, it determines that a mode switch is unnecessary (No in step S11), and the mode switching unit 120 does not switch the mode. In other words, the mode currently set is maintained.
[0149] In step S10, the image generation unit 130 generates an image according to the rules corresponding to the mode set at that time. Steps S20 to S50 are as described in Example 1, etc.
[0150] The hardware configuration of the computer implementing the information processing device 10 according to this embodiment is shown, for example, in Figure 4, similar to the information processing device 10 according to the embodiment. However, the storage device 1080 of the computer 1000 implementing the information processing device 10 according to this embodiment further stores program modules that implement the functions of the mode switching unit 120 and the power control unit 125 according to this embodiment.
[0151] As described above, according to this embodiment, the image generation unit 130 generates an image with fewer colors in the second mode than in the first mode, generates an image with fewer pixels in the second mode than in the first mode, and generates multiple images at longer intervals in the second mode than in the first mode. Therefore, the information processing device 10 that generates images can achieve a reduction in power consumption as needed.
[0152] (Example 6) Figure 19 is a diagram illustrating the functional configuration of the information processing device 10 according to Example 6. The information processing device 10 according to this example is the same as the information processing device 10 according to Embodiment and at least one of Examples 1 to 5, except for the points described below. The terminal 20 according to this example is the same as the terminal 20 according to Embodiment and at least one of Examples 1 to 5. The system 50 according to this embodiment is the same as the system 50 according to Embodiment and at least one of Examples 1 to 5, except for the points described below.
[0153] The information processing device 10 according to this embodiment comprises at least a modification unit 140 and a conversion unit 150. The modification unit 140 modifies the color combination to include a special color when a special color is used in the image. A special color is a color that is not included in a preset color combination. When the color combination is changed, the conversion unit 150 generates image data by converting the image using the modified color combination.
[0154] Figure 20 is a diagram illustrating the flow of processing performed by the information processing device 10 according to this embodiment. Steps S201 to S209 shown in Figure 20 are processes that are performed in place of step S20 described above in the embodiment, etc.
[0155] The information processing method according to this embodiment is executed by one or more computers. The information processing method according to this embodiment includes a modification step S208 and a conversion step S209. In the modification step S208, one or more computers change the color combination to include a special color if a special color is used in the image. A special color is a color that is not included in a pre-set color combination. If the color combination is changed, in the conversion step S209, one or more computers generate image data by converting the image using the changed combination.
[0156] The information processing method according to this embodiment can be executed by the information processing device 10 according to this embodiment.
[0157] In the following, a combination of colors will also be referred to as a "color palette." The maximum number of colors that can be included in a color palette is predetermined. Image data represents an image consisting of the colors included in the color palette. By limiting the number of colors included in an image, for example, the compression ratio when compressing image information and converting it into image data can be increased. From the viewpoint of reducing the data size of the image data, the maximum number of colors that can be included in a color palette is preferably 256 colors or less. On the other hand, from the viewpoint of enriching the image displayed on the terminal 20, the maximum number of colors that can be included in a color palette is preferably 8 colors or more.
[0158] In the example shown in Figure 19, the information processing device 10 further includes a color storage unit 131. The color storage unit 131 is implemented, for example, by a storage device 1080 of a computer 1000 that implements the information processing device 10. However, the color storage unit 131 may be located outside the information processing device 10. The color storage unit 131 stores a basic color palette. The basic color palette is a color palette prepared in advance as the color palette in the initial state.
[0159] Figure 21 illustrates information indicating a color palette, which is stored in the color memory unit 131. The information indicating the color palette is a table that associates an index with a color. The number of indices is the maximum number of colors that can be included in this color palette. In the example in Figure 21, a six-color color palette is shown, but the number of colors in the color palette is not limited to this. In the example in Figure 21, each color is represented by a combination of numerical values indicating the intensity of each RGB (red, green, blue) component. Furthermore, each index is associated with a priority level; that is, each color is associated with a priority level.
[0160] In the image data converted by the conversion unit 150, each color in the image is represented using an index. The image data includes correspondence information indicating the color to which each of the multiple indices corresponds. By using indices, the conversion unit 150 can reduce the data size of the image data.
[0161] When generating an image in the image generation unit 130, if only colors included in the basic color palette can be used, the conversion unit 150 can convert the image into image data using the basic color palette as is. However, for example, maps may display symbols indicating stores. In such cases, the colors to be used are specified, and changing the colors may not be permitted. As a result, the image generation unit 130 must use colors not included in the basic color palette, i.e., special colors, in the image. That is, when the image includes a map, the special colors may be the colors used in the symbols displayed on the map. Note that a single image may contain multiple special colors.
[0162] This embodiment provides a technique for converting an image containing special colors into image data.
[0163] In this embodiment, the image generation unit 130 accesses the color storage unit 131 to obtain information indicating a basic color palette. The image generation unit 130 draws on the image, at least roads, marks indicating the current location, marks and characters indicating navigation instructions, lines indicating a route, the distance from the current location to the destination, the estimated time required from the current location to the destination, the estimated time of arrival, and messages to guide the moving object to the destination, using colors included in the basic color palette. These are drawing objects that have a degree of freedom in terms of color.
[0164] The image generation unit 130 may use colors not included in the basic color palette only when the image includes symbols or other elements whose color cannot be changed.
[0165] Furthermore, the image generation unit 130 generates special color information for each generated image, indicating whether or not a special color is used in that image. If the image uses a color not included in the basic color palette, the image generation unit 130 generates special color information indicating that a special color is used. If the image does not use a color not included in the basic color palette, the image generation unit 130 generates special color information indicating that no special color is used. If a special color is used in the image, the image generation unit 130 further includes information indicating what the special color is (for example, a combination of RGB intensities) in the special color information.
[0166] Referring to Figure 20, the processing flow in the modification unit 140 and the conversion unit 150 will be explained.
[0167] The modification unit 140 acquires image information and special color information related to that image information from the image generation unit 130 (step S201). The modification unit 140 uses the acquired special color information to determine whether or not special colors are used in the image (step S202).
[0168] However, the modification unit 140 may not acquire special color information and instead determine whether or not special colors are used in the image based on the image information and the basic color palette. In this case, the image generation unit 130 does not need to generate special color information. Specifically, the modification unit 140 identifies all the colors used in the image and determines whether each identified color is included in the basic color palette. If at least one of the identified colors is not included in the basic color palette, the modification unit 140 determines that special colors are used in the image. The modification unit 140 also identifies any of the identified colors that are not included in the basic color palette as special colors. On the other hand, if all of the identified colors are included in the basic color palette, the modification unit 140 determines that no special colors are used in the image.
[0169] If no special colors are used in the image (No. in step S202), the conversion unit 150 converts the image information into image data using the basic color palette as is (step S209). Specifically, it replaces the color information associated with each pixel in the image with the index associated with that color in the color palette. Then, it compresses the image information.
[0170] If special colors are used in the image (Yes in step S202), the modification unit 140 further determines whether there are any colors in the basic color palette that are not used in the image (step S203).
[0171] If there are colors that are not used in the image (Yes in step S203), the modification unit 140 identifies those unused colors as the colors to be changed (step S204). The colors to be changed are the colors in the color palette that should be replaced with special colors. The modification unit 140 obtains the modified color palette by replacing the identified colors to be changed with special colors in the basic color palette (step S208). That is, in the color palette, the special colors are now associated with the indices that were previously associated with the colors to be changed. Then, the conversion unit 150 converts the image information into image data using the modified color palette (step S209). The conversion unit 150 includes information indicating the modified color palette in the image data.
[0172] On the other hand, if there are no colors not used in the image (No. in step S203), the modification unit 140 identifies the color to be changed based on the priority assigned to the index in the basic color palette (step S205). Specifically, it identifies the color assigned to the index with the highest priority in the basic color palette, i.e., the color with the highest priority, as the color to be changed. If multiple special colors are used in the image, the multiple colors to be changed can be identified in order from the highest priority. The modification unit 140 identifies the same number of colors to be changed as the number of special colors used in the image.
[0173] Following step S205, the modification unit 140 further identifies an alternative color to replace the color to be changed in the image (step S206). The alternative color can be the color closest to the color to be changed from among the colors included in the modified color palette. This suppresses changes in the appearance of the image. The modified color palette is obtained by replacing the color to be changed in the basic color palette with a special color.
[0174] The color distance (color difference) can be calculated using existing methods. The modification unit 140 calculates the distance between the color to be changed and each of the colors included in the modified color palette, and identifies the color with the closest distance as the alternative color. If there are multiple colors to be changed, an alternative color is identified for each color to be changed.
[0175] In step S207, the modification unit 140 replaces the color to be changed in the image with an alternative color. That is, it identifies the pixel associated with the color to be changed in the image information and changes the color associated with that pixel to the alternative color. By doing so, the modified image information is obtained.
[0176] Following step S207, the modification unit 140 obtains a modified color palette by replacing the specified target color in the basic color palette with a special color (step S208). The conversion unit 150 converts the modified image information into image data using the modified color palette (step S209). The conversion unit 150 includes information indicating the modified color palette in the image data.
[0177] The image data generated by the conversion unit 150 is transmitted to the terminal 20 by the transmission unit 170, similar to the example in Embodiment 1. Then, the image data is used to display an image on the display unit 270 at the terminal 20.
[0178] As described above, the modification unit 140 identifies colors from the color palette that are not used in the image as colors to be modified, and modifies the color palette by replacing those colors with special colors. In this way, special colors can be included in the color palette without affecting the colors of the image.
[0179] Furthermore, the modification unit 140 identifies the colors to be changed from among the colors included in the color palette based on a predetermined priority order, and modifies the color palette by replacing the colors to be changed with special colors. In this way, even if there are no colors in the basic color palette that are not used in the image, special colors can be included in the color palette.
[0180] The modification unit 140 may identify the colors to be changed based on a predetermined priority, regardless of whether or not there are colors not used in the image. That is, if special colors are used in the image (Yes in step S202), step S205 may be executed without performing the determination in step S203.
[0181] The conversion unit replaces the color of the pixels associated with the color to be changed in the image with an alternative color included in the modified color palette, and then converts it to image data. Therefore, it is possible to prevent the loss of parts where the color to be changed was used.
[0182] Figure 22 shows a modified example of the color palette information held in the color memory unit 131. In the example in Figure 22, a six-color color palette is shown, but the number of colors in the color palette is not limited to this. In the example in Figure 22, the information indicating the color palette includes surplus indices, which are indices to which no colors are associated. The surplus indices are provided to associate special colors. By providing surplus indices, a modified color palette can be generated by adding special colors to the color palette. Adding special colors to the color palette means associating the special colors with the surplus indices.
[0183] In particular, if the number of special colors is less than or equal to the number of surplus indices, all colors included in the basic color palette can be included in the modified color palette without replacement. In other words, there is no need to replace colors in images. If the number of special colors exceeds the number of surplus indices, the colors to be changed should be identified based on priority, as in the example above. Surplus indices may or may not be associated with priority, just like other indices.
[0184] Furthermore, according to the modified unit 140 and the conversion unit 150 of this embodiment, it is possible to convert any image, not limited to images generated by the image generation unit 130, into image data with a smaller data size.
[0185] The hardware configuration of the computer implementing the information processing device 10 according to this embodiment is shown, for example, in Figure 4, similar to the information processing device 10 according to the embodiment. However, the storage device 1080 of the computer 1000 implementing the information processing device 10 according to this embodiment further stores a program module that implements the function of the modification unit 140 according to this embodiment.
[0186] As described above, according to this embodiment, the modification unit 140 changes the color combination to include the special color when the special color is used in the image. Therefore, even when the number of usable colors is limited, it is possible to generate image data of an image using a specific color.
[0187] (Example 7) Figure 23 is a diagram illustrating the functional configuration of the information processing device 10 according to Example 7. The information processing device 10 according to this example is the same as the information processing device 10 according to the embodiment and at least one of Examples 1 to 6, except for the points described below. The terminal 20 according to this example is the same as the terminal 20 according to the embodiment and at least one of Examples 1 to 6. The system 50 according to this embodiment is the same as the system 50 according to the embodiment and at least one of Examples 1 to 6, except for the points described below.
[0188] The information processing device 10 according to this embodiment includes an image data generation unit 155 and a transmission unit 170. The image data generation unit 155 generates image data. The transmission unit 170 transmits the image data generated by the image data generation unit 155. If the number of untransmitted image data has not reached a predetermined number N, the transmission unit 170 transmits the image data in the order in which it was generated by the image data generation unit 155. If the number of untransmitted image data has reached a predetermined number N, the transmission unit 170 transmits at least the image data generated most recently by the image data generation unit 155, without transmitting the image data generated most recently.
[0189] Figure 24 is a diagram illustrating the processing flow performed by the image data generation unit 155 according to this embodiment. Figure 25 is a diagram illustrating the processing flow performed by the transmission unit 170 according to this embodiment. The information processing method according to this embodiment is performed by one or more computers. The information processing method according to this embodiment includes an image data generation step S100 and a transmission step S30. In the image data generation step S100, one or more computers generate image data. In the transmission step S30, one or more computers transmit the image data generated in the image data generation step S100. In the transmission step S30, if the number of untransmitted image data has not reached a predetermined number N, one or more computers transmit the image data in the order in which it was generated in the image data generation step S100. In the transmission step S30, if the number of untransmitted image data has reached a predetermined number N, one or more computers transmit at least the image data generated last in the image data generation step S100 without transmitting the image data generated first in the image data generation step S100.
[0190] The information processing method according to this embodiment can be executed by the information processing device 10 according to this embodiment.
[0191] In the example shown in Figure 23, the image data generation unit 155 comprises an image generation unit 130 and a conversion unit 150. The image generation unit 130 in this embodiment is the same as the image generation unit 130 in the embodiment and at least one of the embodiments 1 to 6. The conversion unit 150 in this embodiment is the same as the conversion unit 150 in the embodiment and at least one of the embodiments 1 to 6.
[0192] In the example shown in Figure 23, the information processing device 10 further comprises a storage unit 171 and a storage management unit 172. The storage unit 171 temporarily holds the image data generated by the image data generation unit 155. That is, the storage unit 171 functions as a buffer. The storage unit 171 can be implemented using the storage device 1080 or memory 1060 of the computer 1000 that implements the information processing device 10. However, it may also be provided outside the storage unit 171. The storage management unit 172 manages the image data held in the storage unit 171.
[0193] In this embodiment, the transmission unit 170 transmits image data held in the storage unit 171. The storage management unit 172 deletes the image data transmitted from the transmission unit 170 from the storage unit 171. As a result of deleting the transmitted image data, the storage unit 171 remains with untransmitted image data. Furthermore, as will be described in detail later, the storage management unit 172 deletes at least one image data held in the storage unit 171 when the number of image data held in the storage unit 171 exceeds a predetermined number N.
[0194] The image data generation unit 155 generates image data at predetermined intervals, for example, regardless of the transmission timing of the transmission unit 170. Under normal conditions, the image data generation interval by the image data generation unit 155 and the image data transmission interval by the transmission unit 170 are approximately the same. On the other hand, delays may occur in the transmission process of the transmission unit 170, such as when the data size of the data to be transmitted is large or when there is a processing delay in the information processing device 10. If the storage unit 171 holds all untransmitted image data, multiple untransmitted image data will accumulate in the storage unit 171.
[0195] As explained in Example 1, if the image data is data for displaying an image that reflects the current location of the information processing device 10, then real-time display of the image on the terminal 20 is required. Therefore, even if multiple untransmitted image data accumulates in the storage unit 171, the highest priority for transmission and display is given to the latest image data, that is, the image data generated most recently by the image data generation unit 155. On the other hand, there is no high need to transmit image data generated before the latest image data.
[0196] According to this embodiment, if the number of untransmitted image data reaches a predetermined number N, the transmitting unit 170 will not transmit at least the image data generated most recently by the image data generation unit 155 (i.e., the oldest image data) among the untransmitted image data. On the other hand, the transmitting unit 170 will transmit the image data generated most recently by the image data generation unit 155 (i.e., the latest image data). In other words, if the number of untransmitted image data reaches a predetermined number N, the transmitting unit 170 will skip transmitting at least the oldest image data and transmit the latest image data at that time. By doing so, even if a delay occurs in transmission, it is less likely to cause a decrease in the real-time performance of data transmission and reception. Consequently, it is less likely to cause a decrease in the real-time performance of image display on the terminal 20.
[0197] The image data generation unit 155 generates image data, stores that image data in the storage unit 171, and then generates the next image data. In this way, the image data generation unit 155 sequentially generates multiple image data. The transmission unit 170 reads the image data stored in the storage unit 171 and transmits it to the terminal 20. The memory management unit 172 deletes the image data from the storage unit 171 each time the transmission unit 170 reads it from the storage unit 171.
[0198] Referring to Figure 24, the processing flow executed by the image data generation unit 155 according to this embodiment will be described. In the example in Figure 24, the image data generation step S100 includes at least steps S10 and S20 described above in Embodiment 1, etc. The image data generation unit 155 repeatedly executes the flow shown in Figure 24 at a predetermined cycle. In this way, image data based on the current position of the information processing device 10 at each point in time is generated.
[0199] In step S10, the image generation unit 130 of the image data generation unit 155 generates an image in the same manner as the image generation unit 130 according to the embodiment and at least one of Examples 1 to 6. The conversion unit 150 of the image data generation unit 155 converts the image into image data in the same manner as the conversion unit 150 according to the embodiment and at least one of Examples 1 to 6 (step S20). In doing so, the image data generation unit 155 generates image data. The image data generation unit 155 stores the generated image data in the storage unit 171 (step S25).
[0200] Referring to Figure 25, the processing flow executed by the transmission unit 170 in this embodiment will be described. The transmission unit 170 repeatedly executes the flow shown in Figure 25. In doing so, multiple image data generated by the image data generation unit 155 are transmitted sequentially.
[0201] The transmitting unit 170 determines whether or not a predetermined number N or more untransmitted image data is stored in the storage unit 171 (step S26). If the storage unit 171 does not have a predetermined number N or more untransmitted image data (No. in step S26), the transmitting unit 170 reads the next image data from the storage unit 171 (step S27). That is, the transmitting unit 170 reads the image data generated immediately after the image data transmitted just before.
[0202] If the storage unit 171 holds a predetermined number of N or more untransmitted image data (Yes in step S26), the transmission unit 170 reads the latest image data from the storage unit 171 without reading the next image data (step S28). That is, the transmission unit 170 reads and transmits the image data that was generated most recently by the image data generation unit 155 from among the untransmitted image data held in the storage unit 171, without transmitting the image data that was generated most recently by the image data generation unit 155.
[0203] When step S27 or step S28 is performed, the transmission unit 170 then transmits the read image data (step S30).
[0204] Furthermore, the memory management unit 172 may monitor the number of image data stored in the storage unit 171, and if the storage unit 171 has more than a predetermined number N of image data stored, it may delete N-1 image data stored in the storage unit 171. This reduces the amount of data stored in the storage unit 171. Specifically, the memory management unit 172 deletes N-1 image data from the storage unit 171, starting with the earliest generated data. This leaves only the most recent image data in the storage unit 171. From the viewpoint of suppressing the size of the data stored in the storage unit 171, the predetermined number N is preferably 3 or less, and more preferably 2.
[0205] If the predetermined number N is 3 or more, the number of image data that the storage management unit 172 deletes from the storage unit 171 when the storage unit 171 holds an amount of N or more image data does not have to be N-1. The number of image data that the storage management unit 172 deletes when the storage unit 171 holds an amount of N or more image data may be N-2 or 1. As a result, the storage unit 171 will hold multiple untransmitted image data. Even in this case, it is preferable for the transmission unit 170 to transmit the image data that was generated most recently among the untransmitted image data held in the storage unit 171.
[0206] The hardware configuration of the computer implementing the information processing device 10 according to this embodiment is shown, for example, in Figure 4, similar to the information processing device 10 according to the embodiment. However, the storage device 1080 of the computer 1000 implementing the information processing device 10 according to this embodiment further stores program modules that realize the functions of the memory management unit 172 according to this embodiment.
[0207] As described above, according to this embodiment, when the number of untransmitted image data reaches a predetermined number N, the transmitting unit 170 will transmit the image data generated most recently by the image data generation unit 155, without transmitting the image data generated most recently by the image data generation unit 155. Therefore, even if a communication delay occurs, it is less likely to cause a decrease in the real-time performance of data transmission and reception.
[0208] (Example 8) The information processing device 10 according to this embodiment is the same as the information processing device 10 according to the embodiment and at least one of Examples 1 to 7. The terminal 20 according to this embodiment is the same as the terminal 20 according to the embodiment and at least one of Examples 1 to 7, except for the points described below. The system 50 according to this embodiment is the same as the system 50 according to the embodiment and at least one of Examples 1 to 7, except for the points described below.
[0209] The functional configuration of the terminal 20 according to this embodiment is illustrated in Figure 15, similar to that of the terminal 20 according to Embodiment 4. The terminal 20 according to this embodiment includes a display control unit 230 and a reception determination unit 250. The display control unit 230 displays an image on the display using image data. The reception determination unit 250 determines whether the received image data is normal or not. If the reception determination unit 250 determines that the received image data is normal, the display control unit 230 updates the display content on the display using that image data. If the reception determination unit 250 determines that the received image data is not normal, the display control unit 230 does not update the display content on the display.
[0210] Poor communication quality between the information processing device 10 and the terminal 20 may result in missing or corrupted image data being received by the terminal 20. If such abnormal image data is forced to be displayed on the display unit 270, or if nothing is displayed during the period when the image data should have been displayed, the content displayed on the display unit 270 will be difficult for the user to recognize. In contrast, according to this embodiment, if the reception determination unit 250 determines that the received image data is abnormal, the display control unit 230 does not update the display content of the display. That is, it maintains the display content up to that point. By doing so, even if there is a problem with the communication quality, it is possible to suppress the difficulty in recognizing the content displayed on the display unit 270.
[0211] Figure 26 is a diagram illustrating the processing content of terminal 20 according to this embodiment. Terminal 20 is assumed to receive image data of multiple images sequentially, one at a time, within one frame. In the example in Figure 26, the received image data for images 2, 3, and 5 is assumed to be normal. On the other hand, the received image data for image 4 is assumed to be abnormal. In this case, image 2 is displayed for one frame, followed by image 3, but after image 3 is displayed for one frame, image 4 is not displayed. Instead, the display of image 3 continues. Then, when the image data for image 5 is received, image 5 is displayed using that image data. That is, image 3 is displayed for two frames, followed by image 5.
[0212] Figure 27 illustrates the flow of processing performed by the terminal 20 according to this embodiment. The image acquisition unit 210 receives image data (step S40). The reception determination unit 250 then determines whether the received image data is normal or not (step S41). The reception determination unit 250 can determine whether the image data is normal or not in the same manner as described in Embodiment 4. If the received image data is normal (Yes in step S41), the display control unit 230 displays the image data received in step S40 on the display unit 270 (step S50). That is, the display content of the display unit 270 is updated with the received image data.
[0213] On the other hand, if the received image data is not normal (No. in step S41), the display control unit 230 terminates processing of the image data without displaying the image data received in step S40 on the display unit 270. In other words, it does not update the display content of the display unit 270 with the received image data, but continues the display content up to that point.
[0214] Through the process described above, the display on the display unit 270 is updated each time image data is successfully received.
[0215] The hardware configuration of the computer that implements the terminal 20 according to this embodiment is shown, for example, in Figure 4, similar to the terminal 20 according to the embodiment. However, the storage device 1080 of the computer 1000 that implements the terminal 20 according to this embodiment further stores a program module that implements the functions of the reception determination unit 250 according to this embodiment.
[0216] As described above, according to this embodiment, if the reception determination unit 250 determines that the received image data is not normal, the display control unit 230 does not update the display content of the display. Therefore, even if there is a problem with the communication quality, it is possible to suppress the difficulty in recognizing the display content of the display unit 270.
[0217] (Example 9) Figure 28 is a diagram illustrating the functional configuration of the information processing device 10 according to Example 9. The information processing device 10 according to this example is the same as the information processing device 10 according to Embodiment and at least one of Examples 1 to 8, except for the points described below. The terminal 20 according to this example is the same as the terminal 20 according to Embodiment and at least one of Examples 1 to 8, except for the points described below. The system 50 according to this embodiment is the same as the system 50 according to Embodiment and at least one of Examples 1 to 8, except for the points described below.
[0218] The information processing device 10 according to this embodiment includes a transmission unit 170, a reception result acquisition unit 100, and a communication determination unit 101. The transmission unit 170 transmits image data wirelessly. The reception result acquisition unit 100 acquires result information indicating the reception result of the image data from a terminal 20 that receives the image data. The communication determination unit 101 uses the reception result to determine whether the communication quality of the wireless communication falls below a predetermined quality standard. The transmission unit 170 changes the number of times it transmits the same image data within a predetermined time according to the determination result of the communication determination unit 101.
[0219] Figure 29 is a diagram illustrating the flow of processing performed by the information processing device 10 and terminal 20 according to this embodiment. The information processing method according to this embodiment is performed by one or more computers. The information processing method according to this embodiment includes a transmission step S30, a reception result acquisition step S46, and a communication determination step S03. In the transmission step S30, one or more computers transmit image data wirelessly. In the reception result acquisition step S46, one or more computers acquire result information indicating the reception result of the image data from the terminal 20 that receives the image data. In the communication determination step S03, one or more computers use the reception result to determine whether the communication quality of the wireless communication is below a predetermined quality standard. In the transmission step S30, one or more computers change the number of times they transmit the same image data within a predetermined time, according to the determination result in the communication determination step S03.
[0220] The information processing method according to this embodiment can be executed by the information processing device 10 according to this embodiment. The predetermined time corresponds to, for example, the standard frame image update interval on a display, and can also be said to be one frame time.
[0221] The flow in Figure 29 is executed for each image. That is, multiple images are generated and transmitted by repeatedly executing the flow in Figure 29. In the flow for a given image, the result information used for the determination in steps S03 and S05 is the result information for images generated and transmitted before that image. That is, in the flow for a given image, the result information used for the determination in steps S03 and S05 is the result information received in step S46 of the flow preceding that flow.
[0222] The functional configuration of the terminal 20 according to this embodiment is illustrated by Figure 15, similar to that of Embodiment 4. The terminal 20 according to this embodiment includes a reception determination unit 250. The reception determination unit 250 according to this embodiment is the same as the reception determination unit 250 according to Embodiment 4.
[0223] The reception result acquisition unit 100 and the communication determination unit 101 in this embodiment are the same as the reception result acquisition unit 100 and the communication determination unit 101 in Embodiment 4, respectively. Also, the image generation unit 130 in this embodiment is the same as the image generation unit 130 in Embodiment and at least one of Embodiments 1 to 8. The conversion unit 150 in this embodiment is the same as the conversion unit 150 in Embodiment and at least one of Embodiments 1 to 8.
[0224] The transmitting unit 170 in this embodiment holds a numerical value S that indicates the number of times the same image data is to be transmitted. Based on the numerical value S at the timing of transmitting the image data, the transmitting unit 170 transmits the image data S times. The initial value of the numerical value S can be, for example, 1.
[0225] The transmitting unit 170 changes the number of times it transmits the same image data within a predetermined time period according to the determination result of the communication determination unit 101. For example, if the communication determination unit 101 determines that the communication quality of the wireless communication is below a predetermined quality standard, the transmitting unit 170 transmits the same image data more times than if the communication determination unit 101 determined that it is not below the predetermined quality standard. As another example, the transmitting unit 170 may change the number of times it transmits the same image data within a predetermined time period in multiple stages according to the determination result of the communication determination unit 101. In that case, the transmitting unit 170 transmits the same image data more times as the communication quality decreases.
[0226] As described in Example 1, the transmitting unit 170 divides one image data into multiple packets and transmits them wirelessly. Here, if the communication determination unit 101 determines that the wireless communication quality is below a predetermined quality standard, the transmitting unit 170 transmits the multiple packets corresponding to one image data more times within a predetermined time than if the communication determination unit 101 determines that it is not below the predetermined quality standard.
[0227] Figure 30 is a diagram illustrating the information processing method according to this embodiment. Figure 30 shows an example in which the transmission unit 170 transmits the same image data twice within one frame time. By transmitting the same image data multiple times within one frame time, if the image data is received successfully at least once out of the multiple transmissions, the display control unit 230 can use that image data to display the image on the display unit 270. In the example in Figure 30, the image data for image 3 was not received successfully the first time, but was received successfully the second time. Then, on the terminal 20, image 3 is displayed using the image data received the second time. The image data for images 2 and 4 were received successfully the first time, and each image is displayed using the image data received the first time. Note that if the image data for a single image is received successfully the first time, the image may be displayed on the display regardless of whether the reception of the second image data has been completed or not. That is, the display control unit 230 may display the image on the display unit 270 using the image data obtained in the first reception before the reception of the second image data is completed.
[0228] Referring to Figure 29, the processing flow executed by the information processing device 10 and terminal 20 according to this embodiment will be described. Figure 29 shows the processing for a single image.
[0229] In step S03, the communication determination unit 101, as described above, uses result information for one or more image data transmitted immediately before to determine whether the communication quality of the wireless communication falls below a predetermined quality standard. If the communication quality of the wireless communication falls below the predetermined quality standard (Yes in step S03), the transmission unit 170 increases the number of transmissions (step S07). That is, the transmission unit 170 increases the numerical value S. The transmission unit 170 can increase the number of transmissions within one frame time by a predetermined number. For example, the transmission unit 170 increases the number of transmissions by 1.
[0230] On the other hand, if the communication quality of the wireless communication does not fall below a predetermined quality standard (No. in step S03), the communication determination unit 101 further determines whether or not predetermined conditions regarding communication quality are met (step S05). The predetermined conditions regarding communication quality are, for example, that all of the most recent predetermined number of image data transmissions have been successful. Here, the predetermined number can be, for example, the number of times that the image update frequency of the terminal 20 in the standard state described above can be achieved. The predetermined conditions regarding communication quality can be said to be conditions that indicate that there are no problems with the communication quality.
[0231] If predetermined conditions regarding communication quality are met (Yes in step S05), the transmitting unit 170 reduces the number of transmissions (step S08). That is, the transmitting unit 170 reduces the numerical value S. The transmitting unit 170 can reduce the number of transmissions within one frame time by a predetermined number. For example, the transmitting unit 170 reduces the number of transmissions by 1.
[0232] If the predetermined conditions regarding communication quality are not met (No. in step S05), the transmitting unit 170 does not change the number of transmissions.
[0233] Step S05 may be omitted. In that case, step S08 may be executed if the communication quality of the wireless communication does not fall below a predetermined quality standard (No. in step S03).
[0234] If the predetermined conditions regarding communication quality are not met (No. in step S05), if step S07 is performed, or if step S08 is performed, then the image generation unit 130 generates an image (step S10). Then, the conversion unit 150 converts the image into image data (step S20).
[0235] The transmitting unit 170 transmits the image data to the terminal 20 a number of times indicated by the numerical value S within one frame time (step S30).
[0236] Terminal 20 receives image data transmitted from the information processing device 10 (step S40). That is, terminal 20 receives image data as many times as transmitted from the transmission unit 170 within one frame time. Then, the reception determination unit 250 transmits result information each time image data is received (step S45).
[0237] Terminal 20 displays an image on its display using the first received data that was successfully received from among multiple received data for the same image data (step S50). The reception result acquisition unit 100 of the information processing device 10 receives the result information transmitted from terminal 20 (step S46). This result information is used by the communication determination unit 101 to determine whether to transmit the image data of the next image.
[0238] The determination regarding the number of transmissions may be performed before the transmission unit 170 transmits the image data, or it may be performed after the image data is generated. In other words, steps S03, S05, S07, and S08 may be performed after step S20.
[0239] Furthermore, the terminal 20 may, after displaying an image on the display using the first received data that was successfully received from among multiple received data for the same image data, continue to display the image currently displayed on the display until new image data different from the same image data is successfully received. In other words, as in Example 8, image data for which no successfully received data has been obtained does not need to be displayed on the display.
[0240] Figure 31 illustrates the functional configuration of an information processing device 10 according to a modified example of this embodiment. The information processing device 10 may further include a transmission interval setting unit 173. The transmission interval setting unit 173 sets the interval at which the transmission unit 170 transmits packets. When the communication determination unit 101 determines that the communication quality of the wireless communication is below a predetermined quality standard, the transmission interval setting unit 173 may shorten the interval at which the transmission unit 170 transmits packets compared to when the communication determination unit 101 determines that the quality is not below the predetermined quality standard. By doing so, the time required to transmit image data once can be reduced when the number of transmissions is increased. The interval at which the transmission unit 170 transmits packets corresponds to the connection interval described in Example 1 in BLE. Note that when the connection interval is set to be shorter, the power consumption of the information processing device 10 will be higher than when the connection interval is set to be longer. In other words, the information processing device 10 according to this modified example suppresses a decrease in the success rate of image transmission by temporarily sacrificing power consumption when the communication quality of the wireless communication deteriorates.
[0241] The hardware configuration of the computer implementing the information processing device 10 according to this embodiment is shown, for example, in Figure 4, similar to the information processing device 10 according to the embodiment. However, the storage device 1080 of the computer 1000 implementing the information processing device 10 according to this embodiment further stores program modules that implement the functions of the reception result acquisition unit 100 and the communication determination unit 101 according to this embodiment. Also, in the example in Figure 31, the storage device 1080 of the computer 1000 implementing the information processing device 10 further stores program modules that implement the function of the transmission interval setting unit 173 according to this embodiment.
[0242] The hardware configuration of the computer that implements the terminal 20 according to this embodiment is shown, for example, in Figure 4, similar to the terminal 20 according to the embodiment. However, the storage device 1080 of the computer 1000 that implements the terminal 20 according to this embodiment further stores a program module that implements the functions of the reception determination unit 250 according to this embodiment.
[0243] As described above, according to this embodiment, the transmission unit 170 changes the number of times it transmits the same image data within a predetermined time according to the determination result of the communication determination unit 101. Therefore, even when the communication quality deteriorates, it is less likely that the success rate of image transmission will decrease. Consequently, it is less likely that the update frequency of the display will decrease.
[0244] Although embodiments and several examples have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.
[0245] Furthermore, while the flowcharts used in the above description show multiple steps (processes) in sequence, the execution order of the steps performed in each embodiment is not limited to that order. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content. Also, the above embodiments and multiple embodiments can be combined to the extent that their content does not conflict.
[0246] The following are examples of reference forms. 1. An information processing device comprising: an image generation unit that generates images according to different rules in a first mode and a second mode; and a mode switching unit that switches between the first mode and the second mode, wherein the image generation unit performs at least one of the following: generating an image with fewer colors than in the first mode in the second mode; generating an image with fewer pixels than in the first mode in the second mode; and generating multiple images at longer intervals than in the first mode in the second mode. 2. An information processing device according to 1, wherein the mode switching unit switches between the first mode and the second mode based on the remaining battery level of a battery provided in the information processing device. 3. An information processing device according to 1 or 2, wherein the mode switching unit switches between the first mode and the second mode based on the power supply status to the information processing device. 4. 1 to 3. 1. An information processing device according to any one of the above, wherein the mode switching unit switches between the first mode and the second mode based on an operation on the information processing device. 5. An information processing device according to any one of the above, wherein the image includes a map, and the mode switching unit switches between the first mode and the second mode using the location information of the information processing device. 6. An information processing device according to any one of the above, further comprising a transmission unit for transmitting image data for displaying an image generated by the image generation unit, wherein the image generation unit generates the plurality of images at longer intervals than in the first mode in the second mode, and the transmission unit divides the image data into a plurality of packets and transmits them, and transmits the packets at longer intervals than in the first mode in the second mode. 7. An information processing device according to the above, wherein the transmission unit transmits the image data by short-range wireless communication. 8. An information processing device according to the above, wherein the short-range wireless communication is Bluetooth Low Energy.9. A system comprising an information processing device described in any one of 6 to 8, and a terminal that receives the image data transmitted from the transmission unit and displays the image on a display. 10. An information processing method performed by one or more computers, comprising: an image generation step of generating an image according to different rules in a first mode and a second mode; and a mode switching step of switching between the first mode and the second mode, wherein the image generation step performs at least one of the following: generating the image with fewer colors than in the first mode in the second mode; generating the image with fewer pixels than in the first mode in the second mode; and generating a plurality of images at longer intervals than in the first mode in the second mode. 11. A program that causes a computer to perform each step included in the information processing method described in 10.
[0247] This application claims priority based on Japanese Patent Application No. 2024-229437, filed on 25 December 2024, and incorporates all of its disclosures herein.
[0248] 10 Information Processing Device 20 Terminal 30 Server 32 Communication Network 50 System 100 Reception Result Acquisition Unit 101 Communication Judgment Unit 110 Display Information Acquisition Unit 120 Mode Switching Unit 125 Power Control Unit 126 Battery 130 Image Generation Unit 131 Color Storage Unit 132 Rule Storage Unit 140 Modification Unit 150 Conversion Unit 155 Image Data Generation Unit 160 Image Judgment Unit 170 Transmission Unit 171 Storage Unit 172 Storage Management Unit 173 Transmission Interval Setting Unit 210 Image Acquisition Unit 230 Display Control Unit 250 Reception Judgment Unit 270 Display Unit 1000 Computer 1020 Bus 1040 Processor 1060 Memory 1080 Storage Device 1100 Input / Output Interface 1120 Network Interface
Claims
1. An information processing device comprising: an image generation unit that generates images according to different rules in a first mode and a second mode; and a mode switching unit that switches between the first mode and the second mode, wherein the image generation unit performs at least one of the following: generating the image with fewer colors than in the first mode in the second mode; generating the image with fewer pixels than in the first mode in the second mode; and generating multiple images at longer intervals than in the first mode in the second mode.
2. An information processing device according to claim 1, wherein the mode switching unit switches between the first mode and the second mode based on the remaining battery level of a battery provided in the information processing device.
3. An information processing apparatus according to claim 1 or 2, wherein the mode switching unit switches between the first mode and the second mode based on the power supply status to the information processing apparatus.
4. An information processing apparatus according to any one of claims 1 to 3, wherein the mode switching unit switches between the first mode and the second mode based on an operation on the information processing apparatus.
5. An information processing device according to any one of claims 1 to 4, wherein the image includes a map, and the mode switching unit switches between the first mode and the second mode using the location information of the information processing device.
6. An information processing apparatus according to any one of claims 1 to 5, further comprising a transmitting unit for transmitting image data for displaying an image generated by the image generation unit, wherein the image generation unit generates the plurality of images at longer intervals than in the first mode in the second mode, and the transmitting unit divides the image data into a plurality of packets and transmits them, and transmits the packets at longer intervals than in the first mode in the second mode.
7. An information processing apparatus according to claim 6, wherein the transmitting unit transmits the image data by short-range wireless communication.
8. An information processing device according to claim 7, wherein the short-range wireless communication is Bluetooth Low Energy.
9. A system comprising an information processing device according to any one of claims 6 to 8, and a terminal that receives the image data transmitted from the transmission unit and displays the image on a display.
10. An information processing method performed by one or more computers, comprising: an image generation step of generating an image according to different rules in a first mode and a second mode; and a mode switching step of switching between the first mode and the second mode, wherein the image generation step includes at least one of the following: generating the image in the second mode with fewer colors than in the first mode; generating the image in the second mode with fewer pixels than in the first mode; and generating a plurality of images in the second mode at longer intervals than in the first mode.
11. A program that causes a computer to execute each step included in the information processing method described in claim 10.