electronic machines

Abstract

This technology provides tactile information that matches the photographer's intentions. [Solution] The electronic device of the present invention is characterized by having an acquisition means for acquiring operation information representing user operations on an imaging device, and a generation means for generating tactile information corresponding to an image captured by the imaging device based on the operation information.

Description

Technical Field

[0001] The present invention relates to electronic devices, and particularly to a technique for generating tactile information corresponding to a captured image.

Background Art

[0002] There has been proposed a tactile presentation device (haptic device) that presents a pseudo tactile sensation to a user by vibrating a vibration device with a predetermined drive waveform or controlling the temperature of the device surface. By presenting a pseudo tactile sensation corresponding to the scene of content (games or other video content) using the tactile presentation device provided on the controller or display device during game play or viewing of other video content, the sense of presence of the content can be enhanced. Patent Document 1 discloses a technique for analyzing a video captured from a moving body such as an automobile to obtain information related to the vibration of the moving body, and vibrating a vibration device provided on a chair on which the user sits according to the information.

[0003] If tactile information (information related to touch) is associated with a captured image at the time of shooting (recording of the captured image), and a touch corresponding to the tactile information is presented to the viewer at the time of playback (display of the captured image), the intention of the photographer can be conveyed to the viewer. By using the technique disclosed in Patent Document 1, it is possible to analyze a captured image and obtain information related to the shake of the imaging device as tactile information corresponding to the captured image.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, vibrations in the imaging device can occur against the photographer's intentions, and even after analyzing the captured images, it is not guaranteed that the tactile information will match the photographer's intentions.

[0006] The present invention aims to provide a technology that can obtain tactile information that matches the photographer's intentions. [Means for solving the problem]

[0007] A first aspect of the present invention is an electronic device characterized by having an acquisition means for acquiring operation information representing user operations on an imaging device, and a generation means for generating tactile information corresponding to an image captured by the imaging device based on the operation information.

[0008] A second aspect of the present invention is a control method for electronic equipment, characterized by comprising the steps of: acquiring operation information representing user operations on an imaging device; and generating tactile information corresponding to an image captured by the imaging device based on the operation information.

[0009] A third aspect of the present invention is a program for causing a computer to function as one of the means of the electronic device described above. A fourth aspect of the present invention is a computer-readable storage medium that stores a program for causing a computer to function as one of the means of the electronic device described above. [Effects of the Invention]

[0010] According to the present invention, tactile information that matches the photographer's intentions can be obtained. [Brief explanation of the drawing]

[0011] [Figure 1] This diagram shows the configuration of the viewing system according to Example 1. [Figure 2] This is a block diagram showing the configuration of the imaging device according to Example 1. [Figure 3] This is a block diagram showing the configuration of the image and tactile information processing unit according to Example 1. [Figure 4] This figure shows the developed image and tactile information related to Example 1. [Figure 5] This is a flowchart showing the operation of the imaging device according to Example 1. [Figure 6] This is a block diagram showing the configuration of the image and tactile information processing unit according to Example 2. [Figure 7] This is a flowchart showing the operation of the imaging device according to Example 2. [Modes for carrying out the invention]

[0012] <Example 1> Embodiment 1 of the present invention will now be described. In Embodiment 1, operation information representing user operation on the imaging device is acquired, tactile information is generated based on the captured image during shooting (when recording the captured image), the tactile information is adjusted based on the operation information, and the captured image and the adjusted tactile information are recorded in relation to each other.

[0013] Figure 1 shows the configuration of the viewing system 101 according to Embodiment 1. The viewing system 101 includes an imaging device 102, a display device 103, a haptic presentation device 105, and a playback device 106.

[0014] The imaging device 102 is a digital camera or the like, and generates and records captured images (images of the subject) and tactile information. The captured images and tactile information recorded by the imaging device 102 are output to the playback device 106 via a recording medium or network.

[0015] The playback device 106 plays back various images and other data. In Embodiment 1, the playback device 106 outputs the captured image recorded by the imaging device 102 to the display device 103 and outputs the tactile information recorded by the imaging device 102 to the tactile presentation device 105.

[0016] The display device 103 is a display that displays various images. In the first embodiment, the display device 103 displays the captured image output from the playback device 106.

[0017] The tactile presentation device 105 presents a pseudo tactile sensation based on tactile information to the user 104 who holds the tactile presentation device 105 in the hand. The user 104 is a viewer of the image (video content) displayed by the display device 103.

[0018] The method of presenting the tactile sensation is not particularly limited. For example, the tactile presentation device 105 presents a pseudo force sensation by vibrating a vibration mechanism such as a linear resonance actuator (LRA) or a piezoelectric actuator with a specific vibration waveform. The tactile presentation device 105 may allow the user 104 to experience a specific temperature by means of a Peltier element or a heater.

[0019] Note that the tactile presentation device 105 is not limited to a device that is held in the hand. When the display device 103 is a head-mounted display (HMD), the tactile presentation device 105 may be provided on the display device 103. The tactile presentation device 105 may be a device that is worn on the neck, wrist, ankle, waist, or the like and used.

[0020] FIG. 2 is a block diagram showing the configuration of the imaging device 102.

[0021] The optical system 201 is composed of a lens group including a zoom lens and a focus lens, and forms an image of the subject (the optical image of the subject) on the imaging surface of the imaging unit 202. The optical system 201 is provided with an operation member for changing the zoom position and the focus position of the optical system 201.

[0022] The imaging unit 202 is an image sensor such as a CCD or CMOS sensor. The imaging unit 202 performs photoelectric conversion of the subject image formed on the imaging surface of the imaging unit 202 by the optical system 201, performs A / D conversion of the analog image signal obtained by the photoelectric conversion, and outputs digital image data (RAW image data) obtained by the A / D conversion. The RAW image data output from the imaging unit 202 is temporarily stored in the RAM 208.

[0023] The image and tactile information processing unit 203 performs processing such as developing RAW image data stored in RAM 208 and generating tactile information.

[0024] The recording unit 204 is a memory card or the like that can be attached to and removed from the imaging device 102. The recording unit 204 stores image data (image data after development processing) and tactile information generated by the image / tactile information processing unit 203.

[0025] The display unit 205 is a display device such as a liquid crystal display or an organic EL display, and displays images stored in the RAM 208, images stored in the recording unit 204, and a GUI for receiving instructions from the user. The user of the imaging device 102 is, for example, the photographer.

[0026] The control unit 206 is, for example, a CPU, which reads a program from the ROM 207, loads it into the RAM 208, and executes it. In this way, the control unit 206 controls the operation of each part of the imaging device 102.

[0027] ROM207 is an electrically erasable and recordable non-volatile memory that stores programs executed by the control unit 206 and parameters necessary for the operation of each part of the imaging device 102.

[0028] RAM208 is a rewritable volatile memory used for temporary storage of programs executed by the control unit 206 and data generated by various parts of the imaging device 102.

[0029] The communications unit 209 communicates with external devices via the network.

[0030] The control unit 210 includes a touch panel and control buttons, and receives instructions from the photographer. The photographer can use the control unit 210 to instruct the image processing (development processing) settings performed by the image / tactile information processing unit 203 to be changed. For example, the photographer can instruct the white balance to be changed so that the color of the developed image changes. The photographer can also instruct the contrast and edge enhancement levels to be changed so that the contrast and sharpness of the developed image change. By changing the color, gradation characteristics, sharpness characteristics, etc., of the developed image in this way, the photographer can obtain a developed image with the desired visual effect.

[0031] The control unit 210 also includes a shutter button. The photographer can instruct the camera to begin the preparation process for taking a picture (recording the captured image) by half-pressing the shutter button, or to begin taking a picture (recording the captured image) by fully pressing the shutter button.

[0032] GPS211 is a GPS sensor that receives GPS signals from GPS satellites and acquires positional information of the imaging device 102.

[0033] The electronic compass 212 is a magnetic sensor that detects the Earth's magnetic field and acquires attitude information of the imaging device 102.

[0034] The distance measuring unit 213 measures the distance from the imaging device 102 to the subject. For example, the distance measuring unit 213 calculates the distance from the imaging device 102 to the subject based on the phase difference detected by the phase difference detection unit and the position information of the photographic lens. The method for determining the subject to be measured (distance measurement) and the method of measurement are not particularly limited, and various existing methods may be used.

[0035] The gyro sensor 214 is an angular velocity sensor that detects angular velocity, and it detects vibrations and changes in the attitude of the imaging device 102. By using the gyro sensor 214, it is possible to detect camera shake and camera work operations such as panning and tilting.

[0036] Figure 3 is a block diagram showing the configuration of the image / tactile information processing unit 203.

[0037] The development processing unit 301 generates developed image data (developed image data) by performing development processing on the RAW image data stored in RAM 208, including white balance adjustment, color interpolation, gamma processing, and NR (noise reduction) processing.

[0038] The object detection unit 302 detects objects from the developed image (developed image data) and outputs the detection result to the tactile information generation unit 303. For example, as an object detection result, information indicating the type of object detected is output.

[0039] The tactile information generation unit 303 generates tactile information corresponding to each object detected by the object detection unit 302. For example, multiple tactile pieces of information corresponding to multiple types of objects are stored in the ROM 207, and the tactile information generation unit 303 reads the tactile information corresponding to the type of object detected by the object detection unit 302 from the ROM 207.

[0040] Tactile information is information used in the tactile presentation device 105 to present a simulated tactile sensation to the user 104 (viewer). Various types of information related to touch can be used as tactile information. For example, the tactile information represents at least one of the vibrations performed by the vibration device provided on the tactile presentation device 105 and the temperature presented by the temperature presentation device provided on the tactile presentation device 105. The information representing vibration may be waveform data representing the vibration waveform, or it may be feature data representing the period (frequency) or amplitude (intensity) of the vibration. In Example 1, the tactile information represents vibration, and the tactile information generated by the tactile information generation unit 303 represents vibration with a standard amplitude (intensity).

[0041] While we have described an example of generating tactile information using a developed image, it is also possible to generate tactile information that matches the waveform of the audio (for example, waveform data representing a vibration waveform that matches the waveform of the audio) using a developed image and the corresponding audio (audio data).

[0042] The operation information acquisition unit 304 acquires operation information representing user operations on the imaging device 102. In Embodiment 1, the operation information represents user operations that change the characteristics of image processing performed on the imaging device 102 (development processing performed on the development processing unit 301). For example, parameters that determine (control) the characteristics of the development processing are stored in the ROM 207, and the control unit 206 changes the parameters stored in the ROM 207 in response to user operations on the operation unit 210. The operation information acquisition unit 304 acquires user operations on the operation unit 210 as operation information. - Retrieve the modified parameters based on the operation.

[0043] The tactile information adjustment unit 305 adjusts the tactile information generated by the tactile information generation unit 303 based on the operation information acquired by the operation information acquisition unit 304.

[0044] Figures 4(A) to 4(D) illustrate an example of a method for adjusting tactile information (characteristics of tactile information) based on operation information.

[0045] Figure 4(A) shows the developed image 400, and Figure 4(B) shows the developed image 410. The imaging range of developed image 400 and developed image 410 are the same, and developed images 400 and 410 each include fireworks 401, a building 402, and a fountain 403 as objects detected by the object detection unit 302. In this case, the tactile information generation unit 303 generates tactile information corresponding to the fireworks 401 and tactile information corresponding to the fountain 403. As tactile information corresponding to the fireworks 401, information is generated that represents vibrations (vibration of a vibration device) that reproduce the sound and impact a person feels at the moment the fireworks 401 explode in the sky. As tactile information corresponding to the fountain 403, information is generated that represents vibrations (vibration of a vibration device) that reproduce the sound and impact a person feels when the water of the fountain 403 hits the water surface. The tactile information generation unit 303 does not generate tactile information for certain types of objects. For example, for objects that do not move and do not emit sound, such as building 402, tactile information is not generated (it is not pre-prepared in ROM207).

[0046] The developed image 400 in Figure 4(A) is an image obtained when the photographer increased the contrast and sharpness beyond the standard settings in order to add a hard impression as an image effect. Therefore, the tactile information adjustment unit 305 adjusts the tactile information of the fireworks 401 generated by the tactile information generation unit 303 so that the amplitude (intensity) of the vibration is larger (intensified) than the standard. Similarly, the tactile information adjustment unit 305 adjusts the tactile information of the fountain 403 generated by the tactile information generation unit 303 so that the amplitude (intensity) of the vibration is larger (intensified) than the standard.

[0047] The developed image 400 in Figure 4(B) is an image obtained when the photographer performed user operations to reduce the contrast and sharpness from the standard in order to add a soft impression as an image effect. For this reason, the tactile information adjustment unit 305 adjusts the tactile information of the fireworks 401 generated by the tactile information generation unit 303 so as to reduce (weaken) the amplitude (intensity) of the vibration from the standard. Similarly, the tactile information adjustment unit 305 adjusts the tactile information of the fountain 403 generated by the tactile information generation unit 303 so as to reduce (weaken) the amplitude (intensity) of the vibration from the standard.

[0048] Figure 4(C) shows the adjusted tactile information corresponding to the developed image 400, and Figure 4(D) shows the adjusted tactile information corresponding to the developed image 410. In Figures 4(C) and 4(D), the adjusted vibration waveform corresponding to the fireworks 401 is shown in the upper panel, and the adjusted vibration waveform corresponding to the fountain 403 is shown in the lower panel. In Figures 4(C) and 4(D), the vertical axis of the graph represents amplitude (displacement), and the horizontal axis of the graph represents time. As described above, the vibration amplitude is large in Figure 4(C) and small in Figure 4(D). This makes it possible to obtain tactile information that gives an impression that matches the impression given by the developed image (the image effect intended by the photographer).

[0049] Figure 5 is a flowchart showing the operation of the imaging device 102.

[0050] In step S501, the control unit 206 acquires a RAW image (RAW image data) using the imaging unit 202.

[0051] In step S502, the control unit 206 uses the operation information acquisition unit 304 to operate the operation unit 21 For a value of 0, operation information representing the user operation performed by the photographer is obtained. For example, user operations performed by the photographer on the control unit 210 are obtained.

[0052] In step S503, the control unit 206 uses the development processing unit 301 to perform development processing on the RAW image acquired in step S501. In the development processing, for example, parameters corresponding to the operation information acquired in step S502 are used.

[0053] In step S504, the control unit 206 uses the object detection unit 302 to detect objects from the developed image (developed image data) generated in step S503.

[0054] In step S505, the control unit 206 uses the tactile information generation unit 303 to generate tactile information corresponding to the object detected in step S504.

[0055] In step S506, the control unit 206 uses the tactile information adjustment unit 305 to adjust the tactile information generated in step S505 based on the operation information acquired in step S502.

[0056] In step S507, the control unit 206 stores (records) the developed image generated in step S503 and the adjusted operation information from step S506 in the recording unit 204, associating them with each other.

[0057] The operation shown in Figure 5 may be performed during still image capture or during video recording. When performed during video recording, the generation and adjustment of haptic information may be performed only once for the entire video or multiple times. For example, the generation and adjustment of haptic information may be performed for each frame of the video, for each scene of the video, or at predetermined intervals (two or more predetermined frames). By doing so, more suitable haptic presentation can be achieved. For example, haptic feedback can be presented at a timing that matches the movement of the object.

[0058] Furthermore, while we have described an example of generating and adjusting tactile information, it is also possible to generate tactile information based on operation information without performing any adjustments to it.

[0059] The developed image and tactile information recorded by the imaging device 102 are output to the playback device 106 via a recording medium or network. The playback device 106 reads the developed image and outputs it to the display device 103, and reads the tactile information and outputs it to the tactile presentation device 105, in response to instructions from the user 104 (viewer). The display device 103 displays the developed image output from the playback device 106, and the tactile presentation device 105 presents the user 104 with a simulated tactile sensation based on the tactile information output from the playback device 106. As a result, when the user 104 checks the developed image on the display device 103, they can experience a simulated tactile sensation corresponding to the developed image from the tactile presentation device 105.

[0060] As described above, according to Embodiment 1, operation information representing user operation on the imaging device 102 is acquired, tactile information corresponding to the captured image is generated based on the captured image obtained by the imaging device 102, and the tactile information is adjusted based on the operation information. For example, the intensity of vibration represented by the tactile information is changed according to the contrast and sharpness intensity specified by the photographer. In this way, tactile information that matches the photographer's intentions can be obtained. For example, tactile information that gives an impression that matches the impression given by the captured image (the image effect intended by the photographer) can be obtained, and the image effect intended by the photographer can be conveyed to the viewer more clearly (emphasized).

[0061] Furthermore, while the photographer's intentions may not be fully understood or may be misinterpreted from the captured image alone, user operations are usually performed intentionally by the user. Therefore, the photographer's intentions can be more accurately understood from the operation information. For this reason, in Example 1, suitable tactile information can be generated more reliably compared to a configuration that generates tactile information based solely on the captured image.

[0062] While examples of user operations that change the contrast and sharpness of captured images have been described, user operations are not limited to these. For example, if a user increases the image stabilization level of the imaging device beyond the standard level, the vibrations represented by tactile information may be reduced beyond the standard level. Conversely, if a user decreases the image stabilization level beyond the standard level, the vibrations represented by tactile information may be increased beyond the standard level.

[0063] Furthermore, temperature information may be generated as tactile information, and the temperature represented by the tactile information may be changed in response to user operations that change the white balance. For example, if a user operation is performed to make the color tone of the captured image closer to red (warm colors) than the standard, the temperature represented by the tactile information may be made higher than the standard. If a user operation is performed to make the color tone of the captured image closer to blue (cool colors) than the standard, the temperature represented by the tactile information may be made lower than the standard.

[0064] Furthermore, while examples of detecting tangible objects such as fireworks and fountains have been described, intangible objects such as wind may also be detected as targets for generating tactile information. For example, the swaying of trees included in the captured image may be detected, and wind may be detected based on that swaying. Then, tactile information representing vibrations that reproduce the sensation a person experiences due to the wind may be generated.

[0065] The location and size of the area that presents tactile sensations may be changeable, and the tactile information may represent at least one of the location and size of the area that presents tactile sensations. For example, tactile information may be generated so that tactile sensations are presented only in the central or peripheral parts of the area that can present tactile sensations. If the user performs an action to increase the contrast or sharpness beyond the standard, tactile information may be generated so that tactile sensations are presented in areas that are easily perceived by humans, such as the central part or a wide area of ​​the tactile presentation device.

[0066] Furthermore, while we have described an example of determining the amplitude (intensity) of vibrations represented by tactile information based on user input, the frequency of vibrations represented by tactile information may also be determined based on user input. Either the amplitude or frequency of vibrations may be determined based on user input, or both may be determined. When user operations are performed to increase contrast or sharpness beyond the standard, tactile information representing vibrations at frequencies easily perceived by the user may be generated.

[0067] Furthermore, the system may choose whether or not to generate (record) tactile information based on the operation information. If the operation information represents a specific user operation (for example, when a user operation is performed to enable image stabilization of the imaging device), tactile information does not need to be generated.

[0068] <Example 2> Embodiment 2 of the present invention will now be described. Note that the same configurations and processes as in Embodiment 1 will not be described below, and only configurations and processes different from those in Embodiment 1 will be described.

[0069] In Example 1, tactile information was generated based on the captured image and adjusted based on the operation information. In Example 2, tactile information is generated (and adjusted) based on the operation information.

[0070] Figure 6 is a block diagram showing the configuration of the image / tactile information processing unit 203 according to Example 2. In Example 2, since no process is performed to generate tactile information based on the captured image, the image / tactile information processing unit 203 does not have an object detection unit 302. Also, unlike Example 1, the operation information acquired by the operation information acquisition unit 304 is input to the tactile information generation unit 303 (and the tactile information adjustment unit 305).

[0071] Figure 7 is a flowchart showing the operation of the imaging device 102 according to Example 2.

[0072] In step S701, similar to step S501, the control unit 206 uses the imaging unit 202 to acquire a RAW image (RAW image data).

[0073] In step S702, similar to step S502, the control unit 206 uses the operation information acquisition unit 304 to acquire operation information representing user operations performed by the photographer. For example, user operations may include panning the imaging device 102 horizontally or tilting the imaging device 102 vertically, and operation information is acquired indicating the direction and speed of the user operation performed. Panning and tilting operations can be detected using a gyro sensor 214 or the like.

[0074] In step S703, similar to step S503, the control unit 206 uses the development processing unit 301 to perform development processing on the RAW image acquired in step S701. Note that the recording unit 204 may store the RAW image instead of the developed image as the captured image. In that case, the development processing in step S703 may be omitted, and the image / tactile information processing unit 203 does not need to have the development processing unit 301.

[0075] In step S704, the control unit 206 uses the haptic information generation unit 303 to generate haptic information based on the operation information acquired in step S702. For example, multiple haptic information corresponding to multiple types of user operations is stored in the ROM 207, and the haptic information generation unit 303 reads the haptic information corresponding to the type of user operation represented by the operation information acquired in step S702 from the ROM 207. If a pan operation or tilt operation is performed as a user operation, for example, haptic information is acquired that gives the viewer the illusion of movement in the direction of the user operation performed.

[0076] In step S705, similar to step S506, the control unit 206 uses the tactile information adjustment unit 305 to adjust the tactile information generated in step S704 based on the operation information acquired in step S702. For example, if a pan or tilt operation is performed as a user operation, the tactile information is adjusted so that the faster the speed of the user operation, the stronger the vibration. The tactile information may also be adjusted so that the faster the speed of the user operation, the more the viewer perceives faster movement.

[0077] In step S706, similar to step S507, the control unit 206 associates the developed image generated in step S703 with the adjusted operation information from step S705 and stores (records) them in the recording unit 204.

[0078] As described above, according to Embodiment 1, operation information representing user operations on the imaging device 102 is acquired, and tactile information corresponding to the captured image obtained by the imaging device 102 is generated based on the operation information. For example, when the photographer performs pan or tilt operations as user operations, tactile information is obtained that gives the viewer the illusion of movement in the direction and speed of the user operations. In this way, tactile information that matches the photographer's intentions can be obtained. For example, tactile information that gives an impression that matches the impression given by the captured image (the image effect intended by the photographer) can be obtained, and the image effect intended by the photographer can be conveyed to the viewer more clearly (emphasized).

[0079] While the example described involves generating tactile information at the time of shooting (when recording captured images), the timing of tactile information generation is not limited to this. For example, captured images and operation information may be recorded in association with each other, and tactile information may be generated when editing the captured images. Editing of captured images may be performed on an electronic device separate from the imaging device (e.g., a personal computer), and tactile information may be generated on an electronic device separate from the imaging device. The imaging device may be a real-world imaging device or a virtual imaging device used in a virtual space (VR space).

[0080] Furthermore, user operations performed by the photographer are not limited to operations that change at least one of the position and orientation of the imaging device, such as panning or tilting. For example, the photographer may perform user operations that change the image angle of view, such as zooming to change the zoom position of the photographic lens. The photographer may also perform user operations that change the focus state, such as focusing to change the focus position of the photographic lens.

[0081] When zooming is performed, haptic information may be generated that gives the viewer the illusion of movement in the same direction as the zoom position change. For example, when the zoom position moves from wide-angle to telephoto, haptic information may be generated that gives the viewer the illusion of movement from foreground to background.

[0082] Similarly, when a focus operation is performed, tactile information may be generated that gives the viewer the illusion of movement in the same direction as the change in focus position. For example, if the focus position moves from foreground to background, tactile information may be generated that gives the viewer the illusion of movement from foreground to background. Also, if the subject in focus changes due to the movement of the focus position, tactile information may be generated that gives the viewer the illusion of movement in the same direction as the change in the position of the subject in focus. For example, if the focus changes from a subject located on the right side of the captured image to a subject located on the left side of the captured image, tactile information may be generated that gives the viewer the illusion of movement from right to left.

[0083] Furthermore, GPS211 may be used to acquire movement information of the imaging device as operational information. Then, tactile information may be generated that gives the viewer the illusion of movement in the same direction as the imaging device's movement. If vibration of the imaging device is detected by the gyro sensor214, tactile information representing vibrations corresponding to those vibrations may be generated.

[0084] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). Multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0085] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0086] Furthermore, although embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments. This invention also includes various forms that do not depart from the spirit of the invention. Furthermore, the embodiments described above are merely examples of one embodiment of the present invention, and it is possible to combine these embodiments as appropriate.

[0087] <Other examples> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0088] This embodiment includes the following configurations, methods, programs, and media. (Composition 1) An acquisition means for acquiring operation information representing user operations on an imaging device, Based on the aforementioned operation information, a generation means generates tactile information corresponding to the captured image obtained by the imaging device. An electronic device characterized by having the following features. (Configuration 2) The generation means generates tactile information based on the captured image and adjusts the tactile information based on the operation information. The electronic device according to configuration 1, characterized by the features described above. (Composition 3) The aforementioned operation information represents an operation that changes the characteristics of the image processing performed by the imaging device. The electronic device according to configuration 1 or 2, characterized by the above. (Composition 4) The aforementioned operation information represents at least one of the following: a user operation to change the position and orientation of the imaging device; a user operation to change the imaging angle of view; and a user operation to change the focus state. An electronic device according to any one of configurations 1 to 3, characterized by the features described herein. (Composition 5) The aforementioned tactile information represents at least one of vibration and temperature. An electronic device according to any one of configurations 1 to 4, characterized by the above. (Composition 6) The aforementioned tactile information represents vibration, The generating means determines at least one of the vibration intensity and frequency based on the operation information. An electronic device according to any one of configurations 1 to 5, characterized by the above. (Composition 7) The generation means does not generate the tactile information if the operation information represents a specific user operation. An electronic device according to any one of configurations 1 to 6, characterized by the features described above. (Composition 8) The aforementioned tactile information represents at least one of the location and size of the region that presents touch. An electronic device according to any one of configurations 1 to 7, characterized by the above. (Composition 9) Generation means for generating tactile information corresponding to the captured image obtained by the imaging device. It has, The generation means generates different tactile information for an image of a subject obtained by performing a first user operation on the imaging device and for an image of the subject obtained by performing a second user operation on the imaging device that is different from the first user operation. An electronic device characterized by the following features. (Composition 10) A step of acquiring operation information representing user operations on the imaging device, Based on the aforementioned operation information, the step of generating tactile information corresponding to the captured image obtained by the imaging device, and A method for controlling electronic equipment, characterized by having the following features. (program) A program for causing a computer to function as one of the electronic devices described in configurations 1 to 9. (medium) A computer-readable storage medium that stores a program for causing the computer to function as one of the electronic devices described in configurations 1 to 9. [Explanation of symbols]

[0089] 102: Imaging device 303: Tactile information generation unit 304: Operation information acquisition unit 305: Tactile information adjustment unit

Claims

1. An acquisition means for acquiring operation information representing user operations on an imaging device, Based on the aforementioned operation information, a generation means generates tactile information corresponding to the captured image obtained by the imaging device. An electronic device characterized by having the following features.

2. The generation means generates tactile information based on the captured image and adjusts the tactile information based on the operation information. The electronic device according to feature 1.

3. The aforementioned operation information represents an operation that changes the characteristics of the image processing performed by the imaging device. The electronic device according to feature 1.

4. The aforementioned operation information represents at least one of the following: a user operation to change the position and orientation of the imaging device; a user operation to change the imaging angle of view; and a user operation to change the focus state. The electronic device according to feature 1.

5. The aforementioned tactile information represents at least one of vibration and temperature. The electronic device according to feature 1.

6. The aforementioned tactile information represents vibration, The generating means determines at least one of the vibration intensity and frequency based on the operation information. The electronic device according to feature 1.

7. The generation means does not generate the tactile information if the operation information represents a specific user operation. The electronic device according to feature 1.

8. The aforementioned tactile information represents at least one of the location and size of the region that presents touch. The electronic device according to feature 1.

9. Generation means for generating tactile information corresponding to the captured image obtained by the imaging device. It has, The generation means generates different tactile information for an image of a subject obtained by performing a first user operation on the imaging device and for an image of the subject obtained by performing a second user operation on the imaging device that is different from the first user operation. An electronic device characterized by the following features.

10. A step of acquiring operation information representing user operations on the imaging device, Based on the aforementioned operation information, the step of generating tactile information corresponding to the captured image obtained by the imaging device, and A method for controlling electronic equipment, characterized by having the following features.

11. A program for causing a computer to function as one of the means of an electronic device according to any one of claims 1 to 9.

12. The computer functions as one of the means of the electronic device described in any one of claims 1 to 9. A computer-readable storage medium containing a program for storing data.

Images