Information processing device, information processing method, and in-vehicle device

The information processing device addresses the challenge of maintaining smooth animation during high-processing-content movements by replacing predetermined content with fixed images, reducing processor load and enhancing user experience.

JP2026020890APending Publication Date: 2026-02-10TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024122509
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2026-02-10

AI Technical Summary

Technical Problem

Existing display technologies struggle to maintain smooth animation during screen operations, leading to increased processor load and potential malfunctions when displaying content that requires high processing power, such as maps or videos, which can cause the image to lag or fail to follow user inputs.

Method used

An information processing device that detects user inputs moving a display area within a screen, identifies the content, and replaces predetermined content with a fixed image during movement to reduce processor load, ensuring smooth animation by displaying a static image in areas that would otherwise cause high processing demands.

Benefits of technology

Prevents images from lagging behind user operations by reducing processor load and maintaining smooth animation, thereby improving user experience by ensuring consistent display performance even during high-processing-content movements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026020890000001_ABST
    Figure 2026020890000001_ABST
Patent Text Reader

Abstract

To prevent an image displayed on a screen from failing to follow a user's operation.SOLUTION: The electronic apparatus includes a controller configured to detect an input for moving a display area, which is an area where an image corresponding to content is displayed, within a screen, specify the content corresponding to the image displayed in the display area within the screen in response to the detection of the input, and replace the image corresponding to the predetermined content when the display area is moved within the screen with a predetermined fixed image in response to the specified content being the predetermined content.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and an in-vehicle device. [Background technology]

[0002] It is known that when a user performs a flick operation on a display area where a touch panel is arranged, the CPU switches the display content by scrolling in the direction of the flick operation. It is also known that for frames with a display priority lower than a priority threshold set according to the CPU load, the currently displayed frame continues to be displayed without switching to the next frame (see, for example, Patent Document 1). This reduces the CPU load. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-134596 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present disclosure is to prevent an image displayed on a screen from becoming unable to follow a user's operation. [Means for solving the problem]

[0005] One aspect of the present disclosure is Detecting an input that moves a display area, which is an area where an image corresponding to the content is displayed, within a screen; In response to detecting the input, identifying the content corresponding to the image displayed in the display area within the screen; In response to the identified content being a predetermined content, replacing the image corresponding to the predetermined content when the display area is being moved within the screen with a predetermined fixed image; The information processing device includes a control unit configured to execute the above.

[0006] One aspect of the present disclosure is The computer Detecting an input that moves a display area, which is an area where an image corresponding to the content is displayed, within a screen; In response to detecting the input, identifying the content corresponding to the image displayed in the display area within the screen; In response to the identified content being a predetermined content, replacing the image corresponding to the predetermined content when the display area is being moved within the screen with a predetermined fixed image; This is an information processing method for performing the above.

[0007] One aspect of the present disclosure is Detecting an input that moves a display area, which is an area where an image corresponding to the content is displayed, within a screen; In response to detecting the input, identifying the content corresponding to the image displayed in the display area within the screen; In response to the identified content being a predetermined content, replacing the image corresponding to the predetermined content when the display area is being moved within the screen with a predetermined fixed image; The in-vehicle device includes a control unit configured to execute the above.

[0008] One aspect of the present disclosure is receiving a signal from a sensor that detects a user touching the screen; determining whether the signal from the sensor is a signal for moving a display area, which is an area where an image corresponding to a content is displayed, within the screen, according to information stored in a storage unit; In response to determining that the signal is for moving the display area within the screen, specifying the content corresponding to the image displayed in the display area within the screen according to information stored in the storage unit; determining whether the identified content is a predetermined content according to information stored in the storage unit; In response to determining that the content is the predetermined content, replacing the image corresponding to the predetermined content to be displayed in the display area corresponding to each frame when the display area is moved within the screen with a predetermined fixed image that is the same in each frame and is stored in the storage unit; When the display area is moved within the screen in response to the detected signal from the sensor, a signal for automatically displaying the predetermined fixed image in the display area corresponding to the predetermined content is output for each frame in real time; The information processing device includes a control unit configured to execute the above.

[0009] Another aspect of the present disclosure is a program executed by the information processing device described above, or a storage medium that non-temporarily stores the program. [Effects of the Invention]

[0010] According to the present disclosure, it is possible to prevent an image displayed on a screen from becoming unable to follow user operations. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram showing a schematic configuration of a vehicle according to a first embodiment. [Figure 2] FIG. 2 is a diagram showing an example of a home screen displayed on a display. [Figure 3] FIG. 3 shows an example of a home screen displayed on a display during page scrolling of the home screen shown in FIG. 2 to the left. [Figure 4]FIG. 10 is a diagram showing a home screen on which an image including the text "Scrolling" is displayed in the display area of ​​a scrolling map widget. [Figure 5] FIG. 10 is a diagram illustrating a home screen in which the image displayed in the map widget at the start of scrolling is displayed in the display area of ​​the map widget during scrolling. [Figure 6] FIG. 2 is a diagram illustrating a functional configuration of an in-vehicle device. [Figure 7] 10 is a flowchart of processing in the in-car device when page scrolling is performed on the home screen according to the first embodiment. [Figure 8] FIG. 10 is a diagram illustrating an example of a home screen on which a second map widget is displayed in addition to a map widget. [Figure 9] FIG. 9 shows an example of a home screen displayed on a display while the home screen shown in FIG. 8 is being page scrolled to the left. [Figure 10] 10 is a flowchart of a process in the in-car device when page scrolling is performed on the home screen according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] A known example of animation display on a display device is one in which a user flicks a display area on a touch panel, scrolling the display content in the direction of the flick. However, if a specific item is displayed and the display content continues scrolling, rendering performance may be degraded. For example, conventional methods reduce the processor's processing load by thinning out frames, but this can make the animation appear rough. Furthermore, if the processing load for each frame is high, the animation may not be displayed at all. Furthermore, even if it is possible to control the page switching via a flick operation, it is not practical to process the frame thinning control in real time when the page scrolls in response to a swipe while touching. Furthermore, if the processing load on the processor increases due to the animation display, this may adversely affect other information processing operations besides the animation display.

[0013] In response to this, a control unit included in an information processing device according to one aspect of the present disclosure detects an input to move a display area, which is an area displaying an image corresponding to a content, within the screen. The content includes, for example, displaying a map including the current location, playing a video, displaying a weather forecast, playing music, answering a phone call, displaying vehicle information, or displaying a clock. These may be widgets. When displaying a map including the current location, for example, images indicating a map, a route, and the current location are displayed in the display area. When playing a video, for example, a video is displayed in the display area. This video includes, for example, television footage, video provided from a storage medium, video provided from the Internet, etc. When displaying a weather forecast, for example, text or an image corresponding to the weather is displayed in the display area. When playing music, for example, an image corresponding to the music, a song title, and a time bar are displayed in the display area. When displaying a clock, for example, the current time and date are displayed in the display area. In this way, an image corresponding to the content is displayed in the display area. Each content is assigned a display area of ​​a size corresponding to the respective content. Multiple display areas corresponding to multiple content may be arranged on the screen. That is, images corresponding to multiple contents may be displayed on one screen. The display area of ​​each content may be moved within the screen. This movement may include, for example, page scrolling, zooming in, and zooming out. This movement may also include, for example, changing the layout within the same screen without page scrolling. In the case of page scrolling, this may include moving the display area from inside the screen to outside the screen, or moving the display area from outside the screen to inside the screen. An input that moves the display area within the screen is, for example, an operation such as a flick, swipe, or pinch by the user. For example, when the user touches the screen and makes a finger movement associated with this operation, the control unit detects the operation input by the user. For example, when the user touches the screen and makes a finger movement associated with a flick operation or a swipe operation, the control unit detects the input that moves the display area within the screen. Note that the user's touching the screen means that the user touches a touch panel. Furthermore, the user's finger movement may be detected by a camera or the like instead of a touch panel.

[0014] In addition, the control unit, in response to detecting the input, identifies the content corresponding to the image displayed in the display area within the screen. When multiple display areas corresponding to multiple contents are arranged within the screen, the control unit identifies the content corresponding to each display area. In addition, when moving a display area within the screen, the control unit may further identify the content corresponding to a display area that is currently located outside the screen and is predicted to move into the screen.

[0015] Furthermore, when the specified content is a predetermined content, the control unit displays the image corresponding to the predetermined content when the display area is moved within the screen. The control unit replaces the image displayed in the moving display area with a predetermined fixed image. The predetermined content is content that may not be displayed correctly when animated while the corresponding display area is moving. For example, the predetermined content may be content that cannot display all frames when animated while the corresponding display area is moving. The predetermined content may be determined, for example, according to the performance of the processor or memory. When an image corresponding to such predetermined content is displayed on the screen, displaying an animation while the display area is moving may cause a malfunction in the animation display. In such a case, the control unit replaces the image displayed in the moving display area with a predetermined fixed image. A fixed image is an image that does not change during movement, i.e., a single still image. The control unit displays the same fixed image in the moving display area. That is, the control unit displays the same image in the display area corresponding to the predetermined content in all frames during movement. For example, in the case of content that plays a video, the image displayed in the display area changes over time before the display area is moved. On the other hand, the image displayed in the display area does not change over time while the display area is moving. Such a fixed image can reduce the processing load on the processor even when the display area is moved within the screen, which can prevent problems with animation display while the display area is moving. This improves UX (User Experience). When the movement of the display area is completed, the predetermined fixed image is switched to an image corresponding to the content. In other words, the image can change over time.

[0016] The control unit may acquire, as the predetermined fixed image, an image corresponding to the predetermined content at the start of scrolling of the display area. For example, the control unit may generate, as the fixed image, an image captured from an image displayed in the display area at the start of scrolling.

[0017] The control unit may also acquire, as the predetermined fixed image, an image including text indicating that the display area is moving. For example, the control unit may acquire an image including text indicating that the display area is scrolling. This image may be stored in advance in a storage unit.

[0018] The control unit may use a single-color image as the predetermined fixed image. The control unit may acquire a single-color image, such as black or white. This image may be stored in advance in a storage unit.

[0019] The image corresponding to the predetermined content may include an image that changes over time. The predetermined content may include content that provides at least one of a map including the current location and video playback. Images that change over time include, for example, an image of a map including the current location, television footage, or video. These images may place a high processing load on the processor while the display area is moving. Therefore, by limiting the animation display while the display area of ​​these contents is moving, problems with the animation display can be prevented. This can improve UX.

[0020] The information processing device may further include a storage unit that stores the predetermined static image corresponding to the predetermined content. The predetermined static image corresponding to the predetermined content may be stored in the storage unit in advance. In this case, the static image may be, for example, a single-color image or an image including text indicating that the display area is moving. Furthermore, the control unit may store, in the storage unit, an image captured according to the content at the time when the display area starts to move.

[0021] The control unit may also determine whether the identified content is a content other than the predetermined content. Depending on whether the content is a predetermined content, the image corresponding to the content may be displayed when the display area is being moved within the screen. For content other than predetermined content, even if the image changes over time while the display area is being moved, there is little chance that a malfunction will occur in the animation display. In the case of such content, the UX can be improved by displaying an image in the display area that changes over time even while the display area is being moved.

[0022] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The configurations of the following embodiments are examples, and the present disclosure is not limited to the configurations of the embodiments. Furthermore, the following embodiments can be combined as much as possible.

[0023] First Embodiment FIG. 1 is a diagram showing a schematic configuration of a vehicle 1 according to this embodiment. The vehicle 1 is owned by a user who is the driver. The vehicle 1 is equipped with an in-vehicle device 10. The in-vehicle device 10 may be a multimedia device or a navigation device. The in-vehicle device 10 may also be a device that is detachable from the vehicle 1. The in-vehicle device 10 has a processor 11, a main memory unit 12, an auxiliary memory unit 13, an input unit 14, a display 15, a communication unit 16, and a position information sensor 17. These are interconnected by a bus.

[0024] The processor 11 is a CPU (Central Processing Unit), a DSP (Digital Signal Processor), etc. The processor 11 controls the in-vehicle device 10 and performs various information processing operations. The main memory unit 12 is a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The auxiliary memory unit 13 is an EPROM (Erasable Programmable ROM), a hard disk, etc. Hard disk drives (HDDs), removable media, etc. The memory unit 13 stores an operating system (OS), various programs, various tables, etc. The processor 11 loads the programs stored in the auxiliary memory unit 13 into a working area of ​​the main memory unit 12 and executes them, and each component unit, etc. is controlled through the execution of these programs. This allows the in-vehicle device 10 to realize functions that meet a predetermined purpose. The main memory unit 12 and the auxiliary memory unit 13 are examples of memory units. Furthermore, the main memory unit 12 and the auxiliary memory unit 13 are computer-readable recording media. The in-vehicle device 10 may be a single computer or may be a combination of multiple computers. Furthermore, information stored in the auxiliary memory unit 13 may be stored in the main memory unit 12. Furthermore, information stored in the main memory unit 12 may be stored in the auxiliary memory unit 13.

[0025] The series of processes executed by the in-vehicle device 10 can be executed by hardware, but can also be executed by software.

[0026] The input unit 14 is a means for accepting an input operation performed by the user, and is, for example, a touch panel. The touch panel may be, for example, a pressure-sensitive type that detects the pressure with which the user presses the panel, or a capacitance type that detects a change in capacitance when the user presses the panel. As another example, the input unit 14 may be a button that can operate the display 15. The display 15 is a means for presenting information to the user, and is, for example, an LCD (Liquid Crystal Display) or an EL (Electroluminescence) panel. The input unit 14 and the display 15 may be integrated into a single touch screen. In the following description, when a user touches a screen, it means that the user touches a touch panel.

[0027] The communication unit 16 is a communication means for connecting the in-vehicle device 10 to the network N1. In this embodiment, the in-vehicle device 10 can communicate with other devices via the network using mobile communication services such as 3G, LTE, 5G, and 6G.

[0028] The position information sensor 17 acquires position information (for example, latitude and longitude) of the vehicle 1. The position information sensor 17 is, for example, a GPS (Global Positioning System) receiving unit, a wireless communication unit, etc. be.

[0029] Next, the functions of the in-vehicle device 10 will be described. The in-vehicle device 10 provides content to the user by displaying a screen corresponding to the content on the display 15. FIG. 2 is a diagram showing an example of a home screen 20 displayed on the display 15. The home screen 20 shown in FIG. 2 displays a main menu 21, status icons 22, a main area 23, and a page display 24. The main menu 21 is configured to include a plurality of icons. These icons are used to switch the content displayed in the main area 23. The status icons 22 are used to display icons corresponding to the status of each device.

[0030] In the example shown in FIG. 2, widgets corresponding to content are arranged in the main area 23. Widgets are shortcut functions that aggregate specific functions to make them easier for users to access. In the example shown in FIG. 2, a map widget 231 and a music widget 232 are displayed as widgets. When a content widget is displayed in the main area 23 and the user taps the widget, the content corresponding to the tapped widget is displayed in the main area 23. The size of the area in which the widget is displayed (hereinafter also referred to as the display area) varies depending on the content.

[0031] The map widget 231 displays the vehicle's position 231B on a map 231A. The vehicle's position 231B indicates the current location detected by the position information sensor 17. The vehicle's position 231B moves on the map 231A in real time as the vehicle 1 moves. The map 231A displayed in the map widget 231 moves in real time so that the vehicle's position 231B is located within the display range of the map widget 231. The map widget 231 may also display a searched route.

[0032] The music widget 232 displays an image 232A corresponding to the song being played, a time bar 232B indicating the playback position of the song being played, icons 232C for selecting play, stop, previous song, or next song, and an icon 232D for controlling connection with the user's terminal. The display area of ​​the music widget 232 is horizontally shorter than the display area of ​​the map widget 231.

[0033] At the bottom of the home screen 20, a page display 24 is arranged, which indicates the page currently being displayed. The page display 24 shows the total number of pages and the current page. The page currently being displayed on the screen is indicated by an oval, and the remaining pages are indicated by circles. In the example shown in FIG. 2, this indicates that there are three pages in total, and that the first page on the left is currently being displayed. The two pages not displayed on the home screen 20 are also allocated display areas for other widgets. The size of this display area may be set in advance for each widget. The user can select the widget to be displayed on the home screen 20 from options provided to the user. The user can also specify the order in which the widgets are arranged.

[0034] The home screen 20 is configured to allow page scrolling by the user, for example, by a swipe operation. By page scrolling, it becomes possible to display widgets that were not displayed on the home screen 20. In addition to the map widget 231 and the music widget 232, widgets include, for example, a video widget, a weather forecast widget, a phone widget, a vehicle information widget, and a clock widget. A video widget is a widget that displays television images and videos. Television images are The information may be acquired by a television antenna provided in the vehicle 1. The video may be acquired, for example, from a website that distributes videos via the communication unit 16. The weather forecast widget is a widget that displays a weather forecast, the current weather, the current temperature, etc. Information regarding the weather forecast may be acquired, for example, from a website that distributes weather forecasts via the communication unit 16. The phone widget is a widget that displays information about answering a phone call and the call destination. The vehicle information widget is a widget that displays the status of the vehicle detected by a sensor in the vehicle. The clock widget is a widget that displays the current time and date. The current time and date may be acquired via the communication unit 16 or via the location information sensor 17.

[0035] FIG. 3 is a diagram showing an example of the home screen 20 displayed on the display 15 while the home screen shown in FIG. 2 is being scrolled leftward. When the home screen 20 shown in FIG. 2 is scrolled leftward, the clock widget 233, which is located at the left edge of the next page, appears from the right edge of the home screen 20. The clock widget 233 displays the current time 233A and the date 233B. When the home screen 20 includes a map widget 231 during scrolling, the in-vehicle device 10 according to the present embodiment displays a single-color (e.g., black or white) image in the display area of ​​the map widget 231, rather than displaying the map 231A and the vehicle's position 231B in real time. That is, the in-vehicle device 10 replaces an image that changes in real time with a fixed image and displays it. In addition to the map widget 231, widgets (e.g., video widgets) that may cause animation display problems if displayed in real time during page scrolling due to the increased processing load on the processor 11 are replaced with fixed images during page scrolling.

[0036] Here, if the map widget 231 displays the map 231A and the vehicle position 231B in real time while displaying an animation during scrolling, the processing load on the processor 11 will be high. That is, since the map 231A and the vehicle position 231B may change over time, it is conceivable that the images will be different for each frame when the animation is displayed. If the processor 11 generates such an image for each frame, the processing load on the processor 11 may be high. This may cause problems with the animation display or may cause problems when the processor 11 performs other processing. By not displaying a real-time image during scrolling of such a widget, which increases the processing load on the processor 11, the processing load on the processor 11 can be reduced.

[0037] On the other hand, the music widget 232 and the clock widget 233 only change a limited number of parts over time. For example, in the music widget 232, the time bar 232B may change, but the processing load on the processor 11 corresponding to this change is relatively low. Such widgets impose a relatively low processing load on the processor 11 even when displayed in real time during scrolling. Widgets with a relatively low processing load like this are displayed in real time even during scrolling.

[0038] In the example shown in FIG. 3, a single-color fixed image 231C is displayed, but the image to be replaced is not limited to this. FIG. 4 is a diagram showing a home screen 20 in which an image including the text "Scrolling" is displayed in the display area of ​​the map widget 231 being scrolled. By replacing the image with an image including text in this way, it is possible to inform the user that no malfunction has occurred. FIG. 5 is a diagram showing a home screen 20 in which an image 231E that was displayed in the map widget 231 at the start of scrolling is displayed in the display area of ​​the map widget 231 being scrolled. In other words, the captured image at the start of scrolling is used as a fixed image. By displaying an animation of an image that does not change in real time during scrolling, the processing load on the processor 11 is reduced. It is possible to reduce the number of times the image 231E displayed in the map widget 231 at the start of scrolling may be replaced by a still image of a map that is not related to the vehicle position.

[0039] FIG. 6 is a diagram illustrating an example of the functional configuration of the in-vehicle device 10. The in-vehicle device 10 includes a control unit 100 and a storage unit 110 as functional components. The control unit 100 is a functional component provided, for example, by the processor 11 executing various programs stored in the auxiliary storage unit 13. The control unit 100 includes an input determination unit 101, a content identification unit 102, an image replacement unit 103, and an output unit 104. The processor 11 of the in-vehicle device 10 executes the processes of the input determination unit 101, the content identification unit 102, the image replacement unit 103, and the output unit 104 in accordance with a computer program stored in the main storage unit 12. However, all or part of these processes may be executed by a hardware circuit.

[0040] Storage unit 110 is a means for storing information, and is composed of main storage unit 12 and auxiliary storage unit 13. Storage unit 110 includes static image information DB 111 and map information DB 112. Static image information DB 111 and map information DB 112 are constructed by a database management system (DBMS) program executed by processor 11 managing data stored in auxiliary storage unit 13. Static image information DB 111 and map information DB 112 are, for example, relational databases.

[0041] Any of the functional components of the in-vehicle device 10 or part of the processing thereof may be executed by another computer connected to the network.

[0042] The input determination unit 101 receives a signal from the input unit 14 and determines a user's input operation via the input unit 14. When a user touches a touch panel serving as the input unit 14 and performs a finger movement associated with a tap, flick, swipe, or pinch, the input determination unit 101 determines that a tap, flick, swipe, or pinch operation has been performed. The input determination unit 101 may also be capable of determining input operations such as a double tap, a long tap, and a multi-tap in addition to a tap, a flick, a swipe, or a pinch. The relationship between the user's finger movement and the user's input operation is stored in the storage unit 110. The input determination unit 101 may also calculate the number of pages to scroll depending on, for example, the direction and speed of a swipe operation. This calculation formula may be stored in the storage unit 110.

[0043] The content identification unit 102 identifies content displayed on the home screen 20. If a widget is arranged on the home screen 20, the content corresponding to the widget may be identified. Note that, hereinafter, identifying a widget includes identifying content, and identifying content includes identifying a widget. The "content displayed on the home screen 20" identified by the content identification unit 102 is content (widget) of which at least a part of the display area is displayed on the home screen 20 from the time when the content starts to move due to a user operation to the time when the movement is completed. In other words, even if content was not displayed on the home screen 20 when scrolling of the home screen 20 started, the content may be identified by the content identification unit 102 as long as it appears on the home screen 20 due to scrolling. The content identification unit 102 calculates the page at the start of scrolling and the page at the end of scrolling according to a user's input operation (e.g., the position of a finger touching the home screen 20 and the change in the position over time), and identifies content included on all pages from the page at the start of scrolling to the page at the end of scrolling.

[0044] The image replacement unit 103 changes the content displayed on the home screen 20 during scrolling to a predetermined In the case of content, a fixed image to be displayed in the display area of ​​the predetermined content is acquired. The predetermined content is set in advance depending on the processing power of the processor 11 and the storage power of the main memory unit 12 or the auxiliary memory unit 13. The fixed image may be a single-color image as shown in FIG. 3, an image including text such as "Scrolling" as shown in FIG. 4, or a captured image at the start of scrolling as shown in FIG. 5. Note that if the predetermined content is not displayed on the home screen 20 at the start of scrolling but is displayed on the home screen 20 during scrolling, an image that would be displayed on the home screen 20 at the start of scrolling may be generated as the fixed image.

[0045] The output unit 104 displays an image corresponding to each content on the home screen 20 in a display area corresponding to the content. The output unit 104 generates an image corresponding to each content for each frame, generates a signal for displaying the home screen 20 for each frame, and transmits the signal to the display 15. Furthermore, when the input determination unit 101 determines that the user has, for example, tapped on the display area of ​​a content, the output unit 104 may output an operation screen corresponding to the content. The operation screen corresponding to the content is stored in the storage unit 110. When the user is not operating the screen, the output unit 104 generates a real-time image corresponding to the content and displays it on the display 15. For example, in the case of the map widget 231, the output unit 104 acquires the current location obtained by the position information sensor 17 and displays the vehicle position 231B on a map 231A obtained from the map information DB 112.

[0046] Furthermore, the output unit 104 performs animation display so that the display area of ​​each content moves in the scroll direction during page scrolling. The output unit 104 generates and outputs an image of each frame. In this embodiment, animation display is performed by continuously switching frames (i.e., still images) to be displayed on the display 15 at predetermined display switching timings. First, the output unit 104 generates, by calculation, information about the next frame (hereinafter also referred to as next frame information), which is the frame to be displayed after the currently displayed frame, at each display timing. The animation displayed by a swipe operation differs depending on the display content at the time of the swipe operation and the speed or velocity of the finger at the time of the swipe operation. Therefore, at each display switching timing, the output unit 104 generates various information about the next frame, such as which display area should be displayed next and where. The information about the next frame includes information about the position (which may be coordinates) of each display area. The output unit 104 performs animation display by switching to the next frame at each display switching timing. At this time, the output unit 104 displays a pre-acquired static image in the display area corresponding to the predetermined content, and displays a real-time image in the display area corresponding to the content other than the predetermined content.

[0047] Static image information DB 111 stores information about static images corresponding to predetermined content. Static images are still images such as a single-color image, an image including text indicating that scrolling is in progress, and a captured image of a widget at the start of scrolling. These static images may be stored in static image information DB 111 by image replacement unit 103.

[0048] The map information DB 112 stores map information including map data and POIs (Points of Interest) such as characters and photos that indicate the characteristics of each point on the map data. The information DB 112 may be provided from another system connected to the network, for example, a GIS (Geographic Information System). The map data may include, for example, roads (links), The data includes link data relating to the route, node data relating to node points, intersection data relating to each intersection, search data for searching for routes, facility data relating to facilities, and search data for searching for locations.

[0049] Next, a description will be given of the processing in the in-car device 10 when page scrolling is performed on the home screen 20. Fig. 7 is a flowchart of the processing in the in-car device 10 when page scrolling is performed on the home screen 20 according to this embodiment. The processing shown in Fig. 7 is repeatedly executed at predetermined time intervals in the in-car device 10.

[0050] In step S101, the input determination unit 101 determines whether or not there has been an input from the user to the input unit 14. For example, when the input determination unit 101 detects that the user has touched the screen through a signal from the input unit 14, the input determination unit 101 determines that there has been an input from the user. Note that in the present embodiment, a touch panel is given as an example of the input unit 14, but the input unit 14 is not limited to this, and may be, for example, a button arranged on a steering wheel. Then, for example, it may be determined that there has been an input from the user when the user presses a button arranged on the steering wheel. If the input determination unit 101 makes a positive determination in step S101, the process proceeds to step S102, and if a negative determination is made, this routine ends.

[0051] In step S102, the input determination unit 101 determines whether the input from the user is a scroll operation (which may be a swipe operation). The input determination unit 101 determines whether, for example, the movement of the user's finger while touching the screen corresponds to a scroll operation. The storage unit 110 stores information corresponding to the scroll operation, such as the position on the screen where the user is touching the screen, the direction in which the finger moves on the screen, and the speed or acceleration of the finger moving on the screen. The input determination unit 101 determines whether the input from the user corresponds to a scroll operation based on the input from the user to the input unit 14 and the information stored in the storage unit 110. As another example, the input determination unit 101 may determine that the input from the user corresponds to scrolling when the user presses a button on a steering wheel that corresponds to scrolling. If the input determination unit 101 makes a positive determination in step S102, the process proceeds to step S103; if the input determination unit 101 makes a negative determination, the process proceeds to step S112. In step S112, the control unit 100 executes a process corresponding to an operation other than the scroll operation.

[0052] In step S103, the input determination unit 101 calculates a scroll amount corresponding to the user's screen operation. The scroll amount is the number of pages moved by the scroll operation. The scroll amount increases according to, for example, the speed or acceleration of the user's finger when the user performs the scroll operation. The input determination unit 101 calculates the speed or acceleration at which the user's finger moves on the touch panel. The relationship between the finger speed or acceleration and the scroll amount may be stored in the storage unit 110. As another example, the input determination unit 101 may calculate the scroll amount so that the scroll amount when the user presses a button corresponding to scrolling, which is located on the steering wheel, once is one page.

[0053] In step S104, the content identification unit 102 identifies the content to be displayed on the display 15. For example, the output unit 104 stores in the storage unit 110 which content is displayed on which page. This relationship may be stored in the storage unit 110 as the display order of the content. The content identification unit 102 may identify the content displayed on the display 15 based on the page displayed on the display 15. For example, the content identification unit 102 reads the page currently displayed on the display 15 from the storage unit 110, and identifies the content displayed on that page based on the display order of the content stored in the storage unit 110. Note that the method of identifying the content displayed on the display 15 is not limited to this.

[0054] In addition, the content specifying unit 102 specifies the content that will be newly displayed on the display 15 by scrolling. Based on the relationship between the crawl amount and the display order of widgets stored in the storage unit 110, the content identification unit 102 identifies all of the content that will be newly displayed on the display 15 during scrolling. Note that when multiple pieces of content are displayed on the display 15 and when multiple pieces of content are newly displayed on the display 15, the content identification unit 102 identifies all of the content that is displayed on the display 15 and all of the content that will be newly displayed on the display 15.

[0055] In step S105, image replacement unit 103 determines whether or not predetermined content is included in the content identified by content identification unit 102 in step S104. The predetermined content is content registered in static image information DB 111. Image replacement unit 103 compares the content identified by content identification unit 102 with the content registered in static image information DB 111 to determine whether or not the content identified by content identification unit 102 in step S104 is the predetermined content. If image replacement unit 103 makes a positive determination in step S105, the process proceeds to step S106, and if it makes a negative determination, the process proceeds to step S108.

[0056] In step S106, image replacement unit 103 acquires from static image information DB 111 a static image corresponding to the predetermined content determined in step S105. If there are multiple corresponding predetermined contents, image replacement unit 103 acquires a static image for each predetermined content. Image replacement unit 103 identifies a record corresponding to the predetermined content from static image information DB 111 and reads information about the static image of that record. If there are multiple predetermined contents, image replacement unit 103 reads information about the static image corresponding to each of the specified contents from static image information DB 111. In this case, static image information DB 111 may store, for example, a single-color still image or a still image including text indicating that scrolling is in progress.

[0057] As another example, image replacement unit 103 may generate a static image and store it in static image information DB 111 before reading a static image from static image information DB 111. The static image generated at this time may be a captured image of predetermined content that was displayed on display 15 at the start of scrolling. Furthermore, a static image corresponding to content that was not displayed on display 15 at the start of scrolling may be a captured image of the predetermined content that would be displayed if it were displayed on display 15 at the start of scrolling. In this case, image replacement unit 103 generates an image that would be displayed on display 15 at the start of scrolling, and stores it in static image information DB 111.

[0058] As another example, the image replacement unit 103 may acquire a captured image of the predetermined content that was displayed on the display 15 at the start of scrolling as a fixed image of the predetermined content that was displayed on the display 15 at the start of scrolling, and may acquire a single-color still image or a still image including text indicating that scrolling is in progress as a fixed image of the predetermined content that was not displayed on the display 15 at the start of scrolling. As yet another example, the image replacement unit 103 may acquire a captured image of the predetermined content that was displayed on the display 15 at the start of scrolling as a fixed image of the predetermined content that will be displayed on the display 15 at the end of scrolling, and may acquire a single-color still image or a still image including text indicating that scrolling is in progress as a fixed image of the predetermined content that is not displayed on the display 15 at the end of scrolling.

[0059] Then, in step S107, the image replacement unit 103 displays a fixed image corresponding to the predetermined content determined in step S105 on the display 15 during scrolling. The image replacement unit 103 transfers the replaced image to the output unit 104.

[0060] In step S108, the output unit 104 generates a next frame, which is the frame to be displayed next. The output unit 104 calculates the content to be displayed in the main area 23 at the timing of displaying the next frame and the position at which the content will be displayed, based on the display order of the content, the scrolling speed or acceleration, and the time from the current time to the time at which the next frame will be displayed. That is, the output unit 104 calculates which content will be displayed at which position in the main area 23. If the content to be displayed in the main area 23 includes a predetermined content, the output unit 104 generates the next frame so that the fixed image replaced in step S107 is displayed in the display area corresponding to the predetermined content. For content other than the predetermined content, the output unit 104 generates an image corresponding to the display time of the next frame (a real-time image) and displays that image in the corresponding display area, thereby generating the next frame. The output unit 104 also generates images corresponding to areas other than the main area 23, thereby generating the next frame. The images of the next frame corresponding to areas other than the main area 23 are real-time images.

[0061] After generating the next frame in step S108, output unit 104 outputs the next frame to display 15 in step S109. As a result, the next frame is displayed on display 15. That is, output unit 104 automatically outputs, in real time, a signal for each frame that causes a predetermined fixed image to be displayed in a display area corresponding to predetermined content. In this way, output unit 104 displays the fixed image on display 15 so that the fixed image moves in accordance with the movement of the display area of ​​the predetermined content due to scrolling. Furthermore, for content other than the predetermined content, output unit 104 displays the real-time image on display 15 so that the real-time image moves in accordance with the scrolling. By output unit 104 gradually moving the display area corresponding to each content frame by frame in the direction of scrolling, continuous animation display is possible.

[0062] In step S110, the output unit 104 determines whether scrolling has ended. The output unit 104 may determine whether scrolling has ended by determining whether the amount of scrolling from the start of scrolling to the current time has reached the amount of scrolling determined by the input determination unit 101 in step S102. Note that the output unit 104 may also determine whether scrolling has ended by using other known methods. If the output unit 104 makes a positive determination in step S110, the process proceeds to step S111, and if the output unit 104 makes a negative determination, the process returns to step S108. As a result, a fixed image is displayed in the display area corresponding to the predetermined content on the display 15 until scrolling ends.

[0063] In step S111, the output unit 104 returns the image corresponding to the predetermined content determined in step S105 to a normal image. That is, the output unit 104 switches the image corresponding to the predetermined content from a fixed image to a real-time image and displays it on the display 15. Thereafter, the output unit 104 ends this routine.

[0064] As described above, according to this embodiment, for content that may cause problems if an animation is displayed during scrolling, the content is replaced with a fixed image during scrolling, thereby preventing the occurrence of such problems. This prevents the image displayed on the screen from being unable to follow the user's operations.

[0065] Second Embodiment In the first embodiment, when a display area of ​​a predetermined content exists within the home screen 20 and a scroll operation is performed, the image displayed in the display area is changed to a fixed image. However, depending on the processing power of the processor 11, it may be possible to scroll only one predetermined content. Furthermore, it may be difficult to scroll two predetermined contents while displaying them in real time. For example, when a wide-area map and an enlarged map are displayed side by side, the processing power of the processor 11 may not be sufficient to scroll both maps while displaying them in real time.

[0066] Therefore, in the second embodiment, when two or more predetermined contents are displayed on the display 15, if the user performs a scroll operation, a fixed image is displayed in the display area of ​​the predetermined content. FIG. 8 is a diagram showing an example of a home screen 20 in which a second map widget 234 is displayed on the display 15 in addition to a map widget 231. The map widget 231 is the same as in the first embodiment. The second map widget 234 is a widget whose horizontal width is half that of the map widget 231 and displays a vehicle position 234B on a map 234A. The scales of the map widget 231 and the second map widget 234 can be changed independently. The vehicle position 234B displayed in the second map widget 234 indicates the current location detected by the position information sensor 17. The vehicle position 234B moves on the map 234A in real time as the vehicle 1 moves. Furthermore, the map 234A displayed in the second map widget 234 moves in real time so that the vehicle position 234B is located within the display range of the second map widget 234. The second map widget 234 may display the searched route.

[0067] FIG. 9 is a diagram showing an example of the home screen 20 displayed on the display 15 while the home screen shown in FIG. 8 is being page-scrolled to the left. When the home screen 20 shown in FIG. 8 is page-scrolled to the left, the clock widget 233 located at the left edge of the next page appears from the right edge of the home screen 20. The clock widget 233 is the same as in the first embodiment. Here, when the home screen 20 being scrolled includes the map widget 231 and the second map widget 234, the in-car device 10 according to this embodiment displays images of a single color (e.g., black or white) in the display areas of the map widget 231 and the second map widget 234. That is, the in-car device 10 replaces an image that changes in real time with a fixed image and displays it.

[0068] 9, a single-color static image 231C is displayed corresponding to the map widget 231, and a static image 234C is displayed corresponding to the second map widget 234, but the static images are not limited to these. As with the map widget 231 shown in FIG. 4, an image including the text "Scrolling" may be displayed in the display area of ​​each of the map widget 231 and the second map widget 234 while the map widget 231 and the second map widget 234 are being scrolled. As with the map widget 231 shown in FIG. 5, a captured image displayed in the map widget 231 and the second map widget 234 at the start of scrolling may be displayed in the display area of ​​each of the map widget 231 and the second map widget 234 while the map widget 231 and the second map widget 234 are being scrolled. Furthermore, instead of the image displayed in the map widget 231 and the second map widget 234 at the start of scrolling, a still image of a map unrelated to the vehicle position may be displayed.

[0069] As another example, a fixed image may be displayed only in the display area corresponding to one of the two predetermined contents being scrolled. That is, a real-time image may be displayed in the display area corresponding to the other predetermined content. Furthermore, if one predetermined content moves out of the main area 23 and becomes invisible during scrolling, a real-time image may be displayed in the display area of ​​the other predetermined content displayed in the main area 23. Furthermore, as another example, a fixed image may continue to be displayed in the display area of ​​the other predetermined content until scrolling is completed.

[0070] 10 is a flowchart of the processing in the in-car device 10 when page scrolling is performed on the home screen 20 according to this embodiment. The processing shown in FIG. 10 is repeatedly executed at predetermined time intervals in the in-car device 10. Among the processing in the flowchart shown in FIG. 10, steps in which the same processing as in the flowchart shown in FIG. 7 is executed are assigned the same reference numerals, and description thereof will be omitted.

[0071] In the flowchart shown in FIG. 10, when the processing of step S104 is completed, the process proceeds to step S201. In step S201, the image replacement unit 103 determines whether or not there are two or more display areas for the predetermined content in the main area 23. In this case, it is sufficient that at least a portion of the display area for the predetermined content is located in the main area 23. The image replacement unit 103 calculates the content to be displayed in the main area 23 at the timing of displaying the next frame and the position at which the content will be displayed, based on the display order of the content, the scrolling speed or acceleration, and the time from the current time to the time at which the next frame will be displayed. In other words, the image replacement unit 103 calculates which content should be displayed at which position in the main area 23. Furthermore, the image replacement unit 103 determines whether or not there are two or more display areas for the predetermined content in the main area 23. If the image replacement unit 103 makes a positive determination in step S201, the process proceeds to step S202; if a negative determination is made, the process proceeds to step S204.

[0072] In step S202, image replacement unit 103 obtains static images corresponding to the predetermined content determined in step S201 from static image information DB 111. At this time, image replacement unit 103 reads information about static images corresponding to each of two or more predetermined contents. In this case, static image information DB 111 stores, for example, still images of a single color or still images including text indicating that scrolling is in progress.

[0073] As another example, image replacement unit 103 may generate a static image and store it in static image information DB 111 before reading a static image from static image information DB 111. The static image generated at this time may be a captured image of an image that was displayed on display 15 at the start of scrolling. Furthermore, a static image corresponding to content that was not displayed on display 15 at the start of scrolling may be a captured image of specific content that would be displayed if it were displayed on display 15 at the start of scrolling. In this case, image replacement unit 103 generates an image that would be displayed on display 15 at the start of scrolling, and stores it in static image information DB 111.

[0074] Then, in step S203, the image replacement unit 103 replaces the static images corresponding to the respective predetermined contents determined in step S201 as images to be displayed on the display 15 during scrolling. The image replacement unit 103 passes the replaced images to the output unit 104.

[0075] On the other hand, in step S204, the image replacement unit 103 sets the image to be displayed on the display 15 during scrolling as a real-time image. That is, when there is one or less predetermined content displayed in the main area 23, the image replacement unit 103 sets it so that all content is displayed as a real-time image even during scrolling.

[0076] In step S205, the output unit 104 generates the next frame. Based on the display order of the content, the speed or acceleration of the scroll, and the time from the current time until the next frame is displayed, the output unit 104 calculates the content to be displayed in the main area 23 at the timing of displaying the next frame and the position at which the content will be displayed. If the content displayed in main area 23 includes two or more predetermined contents, the next frame is generated so that the fixed image replaced in step S203 is displayed in the display area corresponding to the predetermined contents. If there is one or less predetermined contents displayed in main area 23, output unit 104 generates a real-time image corresponding to the display time of the next frame and displays that image in the corresponding display area, generating the next frame. Output unit 104 also generates images corresponding to areas other than main area 23, thereby generating the next frame.

[0077] After generating the next frame in step S205, output unit 104 outputs the next frame to display 15 in step S109. As a result, the next frame is displayed on display 15. In this way, when two or more predetermined contents are displayed in main area 23 during scrolling, output unit 104 displays a fixed image on display 15 so that the fixed image moves in accordance with the movement of the display area of ​​the predetermined content due to scrolling. Furthermore, when there is one or less predetermined contents displayed in main area 23, output unit 104 displays a real-time image on display 15 so that the real-time image moves in accordance with the scrolling.

[0078] In step S110, the output unit 104 determines whether or not scrolling has ended. If the output unit 104 makes an affirmative decision in step S110, the process proceeds to step S111, and if the output unit 104 makes a negative decision, the process returns to step S201.

[0079] As described above, according to this embodiment, for content that may cause problems if an animation is displayed during scrolling, the content is replaced with a fixed image during scrolling, thereby preventing the occurrence of such problems. This prevents the image displayed on the screen from being unable to follow the user's operations.

[0080] <Other embodiments> The above-described embodiment is merely an example, and the present disclosure may be modified as appropriate within the scope of the present disclosure. The processes and means described in the present disclosure may be freely combined and implemented as long as no technical contradiction occurs.

[0081] Furthermore, a process described as being performed by one device may be shared and executed by multiple devices. Alternatively, a process described as being performed by different devices may be executed by a single device. In a computer system, the hardware configuration that realizes each function can be flexibly changed.

[0082] The above embodiment describes a case where a user scrolls by a swipe operation. However, this is not limited to this. For example, even when a user zooms out by a pinch-in operation or zooms in by a pinch-out operation, if a display area corresponding to a predetermined content is included, the control unit 100 may replace the image with a fixed image and zoom in or out. In this case, the control unit 100 may zoom in or out while displaying a real-time image for content other than the predetermined content. Also, for example, even when a user changes the display order of the predetermined content or the position of the display area of ​​the predetermined content by a drag operation, the control unit 100 may replace the image with a fixed image and change the display order or position. In this case, the control unit 100 may change the display order or position of content other than the predetermined content while displaying a real-time image.

[0083] In the above embodiment, an example has been described in which the in-vehicle device 10 functions as an information processing device. However, the present invention is not limited to this. For example, a user's mobile terminal may function as an information processing device. Alternatively, an external server may function as the information processing device.

[0084] The present disclosure can also be realized by providing a computer program implementing the functions described in the above embodiments to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer via a non-transitory computer-readable storage medium connectable to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk, such as a magnetic disk (e.g., a floppy disk, a hard disk drive (HDD), etc.), an optical disk (e.g., a CD-ROM, a DVD disk, a Blu-ray disk), a read-only memory (ROM), a random-access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, an optical card, or any type of medium suitable for storing electronic instructions. [Explanation of symbols]

[0085] 1 vehicle 10 Onboard equipment 11 processors 12 Main memory 13 Auxiliary storage 14 Input section 15 Display 16 Communications Department 17 Location information sensor 100 control section 101 Input determination unit 102 Content Identification Unit 103 Image Replacement Section 104 Output section 110 Storage section

Claims

1. Detecting an input that moves a display area, which is an area where an image corresponding to the content is displayed, within a screen; In response to detecting the input, identifying the content corresponding to the image displayed in the display area within the screen; In response to the identified content being a predetermined content, replacing the image corresponding to the predetermined content when the display area is being moved within the screen with a predetermined fixed image; An information processing device comprising a control unit configured to execute the above.

2. the control unit acquires, as the predetermined fixed image, an image corresponding to the predetermined content at a time when movement of the display area starts. The information processing device according to claim 1 .

3. the control unit acquires, as the predetermined fixed image, an image including text indicating that the display area is moving. The information processing device according to claim 1 .

4. the control unit acquires a single-color image as the predetermined fixed image. The information processing device according to claim 1 .

5. the image according to the predetermined content includes an image that changes over time; The information processing device according to claim 1 .

6. the predetermined content includes content that provides at least one of a map including a current location and video playback; The information processing device according to claim 1 .

7. further comprising a storage unit that stores the predetermined static image corresponding to the predetermined content; The information processing device according to claim 1 .

8. and when the identified content is content other than the predetermined content, the control unit displays the image corresponding to the content while moving the display area within the screen. The information processing device according to claim 1 .

9. The computer Detecting an input that moves a display area, which is an area where an image corresponding to the content is displayed, within a screen; In response to detecting the input, identifying the content corresponding to the image displayed in the display area within the screen; In response to the identified content being a predetermined content, replacing the image corresponding to the predetermined content when the display area is being moved within the screen with a predetermined fixed image; An information processing method that performs the above.

10. the computer acquires, as the predetermined fixed image, an image corresponding to the predetermined content at a time when movement of the display area starts; The information processing method according to claim 9.

11. the computer acquires, as the predetermined fixed image, an image including text indicating that the display area is moving; The information processing method according to claim 9.

12. the computer acquires a single-color image as the predetermined fixed image; The information processing method according to claim 9.

13. the image according to the predetermined content includes an image that changes over time; The information processing method according to claim 9.

14. the predetermined content includes content that provides at least one of a map including a current location and video playback; The information processing method according to claim 9.

15. the computer stores the predetermined static image corresponding to the predetermined content in a storage unit; The information processing method according to claim 9.

16. and when the identified content is content other than the predetermined content, the computer displays the image corresponding to the content while moving the display area within the screen. The information processing method according to claim 9.

17. Detecting an input that moves a display area, which is an area where an image corresponding to the content is displayed, within a screen; In response to detecting the input, identifying the content corresponding to the image displayed in the display area within the screen; In response to the identified content being a predetermined content, replacing the image corresponding to the predetermined content when the display area is being moved within the screen with a predetermined fixed image; An in-vehicle device comprising a control unit configured to execute the above.

18. receiving a signal from a sensor that detects a user touching the screen; determining whether the signal from the sensor is a signal for moving a display area, which is an area where an image corresponding to a content is displayed, within the screen, according to information stored in a storage unit; In response to determining that the signal is for moving the display area within the screen, specifying the content corresponding to the image displayed in the display area within the screen according to information stored in the storage unit; determining whether the identified content is a predetermined content according to information stored in the storage unit; In response to determining that the content is the predetermined content, replacing the image corresponding to the predetermined content to be displayed in the display area corresponding to each frame when the display area is moved within the screen with a predetermined fixed image that is the same in each frame and is stored in the storage unit; When the display area is moved within the screen in response to the detected signal from the sensor, a signal for automatically displaying the predetermined fixed image in the display area corresponding to the predetermined content is output for each frame in real time; An information processing device comprising a control unit configured to execute the above.

Citation Information

Patent Citations

  • Information processing device, frame image changeover method, and program

    JP2013134596A