An indoor bicycle that matches real road images and speed positions

Abstract

The present invention relates to an indoor bicycle that matches real road images and speed positions. The indoor bicycle is characterized by comprising: an indoor bicycle comprising a bicycle body with a saddle, a rotating body, pedals, and a speed sensing module; a processing control unit that generates and provides road images and avatar images linked to a user's pedaling speed; and a display screen that displays a fused image of the avatar and the road images received by the processing control unit. The processing control unit includes a video storage unit that stores images of a driving scene captured at multiple frames per unit time; a user avatar generation unit that can pre-generate and store user avatar shapes for user selection and generate user avatar images; and an image fusion playback unit that matches the user's driving speed with the speed of the driving image and plays the driving image, so that the user avatar images are fused and played together.

Description

Technical Field

[0001] The present invention relates to an indoor bicycle that matches real road images and speed positions. Background Art

[0002] Korean Patent KR 10-2108687 (applied on October 18, 2019) discloses a fitness bicycle system that provides pedaling speed linked content. In the fitness bicycle system that provides pedaling speed linked content, it is characterized in that when the content corresponds to an image of an actual place captured by an actual camera or a virtual image of the same form as the actual place, and is an image of a form in which the surrounding area moves backward with the road as the center in the actual place, the fitness bicycle system includes: a pedaling speed sensor, which senses the pedaling speed of the fitness bicycle; and an electronic device, which is connected to the pedaling speed sensor, receives a sensor value corresponding to the pedaling speed and links the content with the sensor value in real time; wherein the electronic device includes a display screen, displays the content through the display screen, and displays the content based on the sensor value received during the display of the content. Obtaining driving status information and changing the content in the display in real time based on the obtained driving status information; wherein the driving status information includes: i-1) the current position in the total driving length of the content, i-2) the driving speed, i-3) the driving distance corresponding to the accumulated distance from the start, i-4) the driving distance, driving time and the consumed calories calculated taking into account the weighted value; the pedaling speed sensor includes: a magnet, the magnet is attached to the pedal crankshaft of the fitness bicycle; a magnetic sensor, the magnetic sensor is attached to the periphery of the pedal crankshaft in a manner adjacent to the magnet; and a circuit board, the circuit board is connected to the magnetic sensor, receives the sensor value sensed by the magnetic sensor, and is connected to the electronic device and installed on the handlebar of the fitness bicycle; wherein the sensor value is sensed once every rotation of the pedal, corresponding to the value transmitted through serial communication.

[0003] In the past, indoor home training virtual bicycles that reflected the speed and direction of indoor bicycles on the display screen generated a stand-in on the virtual image and virtual road, but had the problem of low realism and failed to attract users' interest. Summary of the Invention

[0004] Technical issues

[0005] The present invention aims to provide an indoor bicycle that matches real road images and speed and position. By reflecting the speed and direction of the indoor bicycle on the display screen to generate a user avatar and image, and using the actual real road images, the realism and exercise effect can be enhanced, and the user can exercise while enjoying the pre-captured images.

[0006] The problem with conventional technology is that the playback speed is determined by assuming that the captured image is shot while driving at a constant speed, which reduces the sense of reality in speed-varying areas (such as slow-stop shooting at a crosswalk or speeding shooting on a downhill slope).

[0007] The present invention aims to provide an indoor bicycle that matches real road images and speed positions. Using image recognition technology, the changing speed of the captured image is calculated in real time and reflected in the playback speed. This enhances the user's sense of actual riding, even when the real road image is captured while stopping at a crosswalk or speeding downhill.

[0008] The present invention aims to provide an indoor bicycle that matches real road images and speed positions. The image analysis unit uses road markings to calculate the vanishing point, and based on this, naturally realizes the direction change of the user's stand-in, thereby enhancing the user's actual riding experience.

[0009] Technical Solution

[0010] <Linked playback of real-speed road images>

[0011] The indoor bicycle that matches real road images and speed positions of the present invention is characterized by comprising:

[0012] An indoor bicycle comprising a bicycle body having a saddle, a rotating body, pedals for rotating the rotating body, and a speed sensing module for sensing the rotational speed of the pedals; a processing control unit for generating and providing a real road image and a user avatar image linked to a user's pedaling speed; and a display screen for displaying a fused image including the avatar image received by the processing control unit and the real road image.

[0013] The processing and control unit includes: a video storage unit that stores images of a driving scene captured in multiple frames per unit time at predetermined time intervals; a user avatar generation unit that uploads an avatar selected by the user from a user avatar storage unit that has pre-generated and stored user avatar shapes, and generates a user avatar image; and an image fusion playback unit that matches the user's indoor bicycle driving speed with the driving speed of the driving image and plays the driving image, so that the user avatar images are fused and played together.

[0014] <Opponent Stand Generator>

[0015] Preferably, the indoor cycling machine that matches the real road image and speed and position of the present invention further includes an opponent avatar generating unit that receives the opponent bicycle's speed and position information from the opponent information providing unit and displays the opponent avatar in the real road video in comparison with the user's avatar.

[0016] <Recognizes real-time driving speed and reflects it in captured images for realistic playback>

[0017] The indoor bicycle that matches the real road image and speed position of the present invention further includes an image analysis unit that has the function of identifying the road, vehicles, and stationary objects in the real road shot image.

[0018] The image analysis unit includes a real-time driving speed recognition unit, which calculates the driving speed of the captured driving image in real time and transmits it to the image fusion and playback unit, wherein the real-time driving speed recognition unit recognizes a specific object classified as stationary within the pixel image of the frame, and uses the position difference, size difference or number of pixels of the specific object between the pixel image of the past frame captured at the second time t2 and the pixel image of the current frame captured at the first time t1 to calculate the moving distance of the specific object during the predetermined time t1-t2, thereby estimating the real-time driving speed of the driving image.

[0019] By using the difference in position, size, or number of pixels of the specific object between the two frames in the past frame pixel image I2 captured at the second time t2 and the current frame pixel image I1 captured at the first time t1, the distance moved by the specific object during the predetermined time t1-t2 is calculated, thereby estimating the real-time driving speed of the driving image.

[0020] The image fusion playback unit plays the real road image according to the following formula:

[0021] Playback speed = V_Bicycle / V_Image Real-time.

[0022] <Calculate Vanishing Point: User Avatar Orientation Transformation>

[0023] Preferably, the image analysis unit includes a real-time vanishing point calculation unit that detects the left side line, right side line, or center line of the road, predicts the vanishing point of the current frame in real time, and stores the predicted vanishing point in the memory. The user avatar generation unit receives the vanishing point information from the real-time vanishing point calculation unit and executes the direction change of the user avatar based on the predicted vanishing point information.

[0024] Preferably, the image analysis unit includes a real-time vanishing point calculation unit that detects the left line, right line, or center line of the road and predicts the vanishing point of the current frame in real time.

[0025] The image analysis unit determines that the photographing camera is rotated right when the vanishing point calculated by the real-time vanishing point calculation unit moves to the left side of the pixel image, and determines that the photographing image is rotated left when the vanishing point calculated by the real-time vanishing point calculation unit moves to the right side of the pixel image.

[0026] The user avatar generation unit converts the direction of the avatar to the rotation direction of the shooting camera determined by the image analysis unit.

[0027] <Opponent Stand Size Adjustment - Distance>

[0028] Preferably, the opponent avatar generating unit expresses the current size of the opponent avatar using perspective according to the opponent position information received from the opponent information providing unit, and

[0029] h2 (current size of the opponent's stand) = h1 (size of the opponent's stand at the baseline) × y2 / y1

[0030] h2=h1×y2 / y1

[0031] Among them, y2: the pixel distance between the vanishing point and the opponent's stand-in,

[0032] y1: The distance in pixels between the vanishing point and the baseline.

[0033] <Target location logo: graphic, circular logo>

[0034] Preferably, the processing control unit further includes an identification generating unit, which displays a target location identification indicating the direction of travel in the form of a graphic identification or a circular identification at a location on the driving route that the user's avatar image is expected to arrive at after a predetermined time based on the vanishing point provided by the real-time vanishing point calculating unit.

[0035] The preferred display screen displays the user's exercise distance, speed, calories burned, and competitors on the screen.

[0036] Effects of the Invention

[0037] According to the present invention, an indoor bicycle that matches the speed and position of a real road image is provided. By reflecting the speed and direction of the indoor bicycle being ridden by the athlete on a display screen and generating an avatar and image of the user, and using the actual filmed real road image, not only can the sense of reality be enhanced and the exercise effect be improved, but the athlete can also exercise while enjoying the pre-filmed image.

[0038] Furthermore, the present invention provides an indoor bicycle that matches real road images and speed positions. Using image recognition technology, the bicycle calculates the changing speed of the captured image in real time and reflects this in the playback speed. This enhances the user's sense of actual riding, even when the real road image is captured while stopping at a crosswalk or speeding downhill.

[0039] In addition, according to the present invention, an indoor bicycle is provided that matches real road images and speed positions. The image analysis unit calculates the vanishing point using road markings and, based on this, naturally realizes the direction change of the user's avatar, thereby enhancing the user's actual riding experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only one embodiment of the present invention. Those skilled in the art can also derive other implementation drawings based on the provided drawings without inventive effort.

[0041] Figure 1 : The overall structure diagram of the indoor bicycle matching the real road image and speed position of the present invention;

[0042] Figure 2 : The present invention matches the real road image and speed position of the indoor bicycle usage status diagram (display screen);

[0043] Figure 3 : Schematic diagram of the vanishing point of an indoor bicycle matching the real road image and speed position of the present invention;

[0044] Figure 4 : Schematic diagram of distance calculation for an indoor bicycle matching real road images and speed positions of the present invention. DETAILED DESCRIPTION

[0045] The present invention will be further described below with reference to the accompanying drawings and examples:

[0046] The following describes embodiments of the present invention in detail. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended only to explain the present invention and are not to be construed as limiting the present invention.

[0047] In the description of the present invention, it should be noted that, unless otherwise specified or limited, the terms "mounted," "connected," and "connected" should be understood broadly. For example, they may refer to fixed connections, detachable connections, or integral connections; they may refer to direct connections or indirect connections through an intermediary. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on the specific circumstances.

[0048] In the description of the present invention, it should be understood that the terms "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0049] The following reference Figures 1 to 4 , the indoor bicycle that matches real road images and speed positions of the present invention is described in detail.

[0050] <Speed ​​and real road image playback>

[0051] The indoor bicycle that matches real road images and speed positions of the present invention is characterized by comprising:

[0052] An indoor bicycle 10 includes a bicycle body having a saddle, a rotating body, pedals for rotating the rotating body, and a speed sensing module S for sensing the rotational speed of the pedals; a processing and control unit 100 for generating and providing a real road image and a user avatar image linked to the user's pedaling speed; and a display screen 200 for displaying a fused image of the avatar and the real road image received by the processing and control unit 200.

[0053] The processing and control unit 100 includes a video storage unit 110 that stores a plurality of frames of a riding scene (real-shot images) captured at predetermined time intervals t1 per unit time; a user avatar generation unit 120 that uploads an avatar selected by the user from a user avatar storage unit that has pre-generated and stored user avatar shapes and generates a user avatar image; and an image fusion playback unit 130 that matches the user's indoor bicycle riding speed with the riding speed of the riding image and plays the riding image, so that the user avatar images are fused and played together.

[0054] <Opponent Stand Generator>

[0055] Preferably, the indoor cycling machine that matches the real road image and speed and position of the present invention further includes an opponent avatar generating unit 140. The opponent avatar generating unit 140 receives the speed and position information of the opponent bicycle from the opponent information providing unit 141, and displays the opponent avatar in the real road video in a manner of comparison with the user avatar.

[0056] <Recognizes real-time driving speed and reflects it in captured images for realistic playback>

[0057] The indoor bicycle that matches the real road image and speed position of the present invention further includes an image analysis unit 150 , which has the function of identifying the road, vehicles, and stationary objects in the real road image.

[0058] The image analysis unit 150 includes a real-time driving speed recognition unit 151, which calculates the driving speed of the captured driving image in real time (V_image real-time) and transmits it to the image fusion playback unit 130, wherein the real-time driving speed recognition unit 151 recognizes a specific object classified as stationary in the pixel image of the frame, and uses the position difference of the specific object, the size difference of the object, or the difference in the number of pixels of the object between the two frames to calculate the moving distance of the specific object during the predetermined time t1-t2, thereby estimating the real-time driving speed of the driving image.

[0059] The image fusion playback unit 130 plays the real road image according to the following formula:

[0060] Playback speed = V_Bicycle / V_Image Real-time.

[0061] Figure 3 The vanishing point calculation process shown may apply 1) image segmentation (eg, K-means segmation, image binarization), 2) line detection, and 3) vanishing point prediction steps.

[0062] In one embodiment of the present invention, in distance calculation, if Figure 4 As shown, a method using vanishing points can be applied.

[0063] L=a0(W1 / W2)=a0(y1 / y2)

[0064] a0: The distance constant between the camera capturing the image and the baseline, typically set 2-3 meters in front. W1 is the baseline width, for example, the width of a road within the image. W2 represents the width of the observation point. y1 is the distance from the vanishing point to the baseline, and y2 is the distance from the vanishing point to the observation line.

[0065] At this time, V_image_realtime=L / (t1-t2).

[0066] Alternatively, the motion characteristics of a stationary object can be observed by using a previously known constant speed value (e.g., 5 m / s) of a captured image to extract a0: a distance constant, which can be used for real-time speed calculation of non-constant speed driving.

[0067] Another method for calculating movement distance is the pixel image grid method. By mapping a fixed (square) or transformed grid within the pixel image, the object's movement distance between frames can be calculated by moving the object's position on the grid between the previous and current frames. The movement distances for each grid can be used to calculate the relationship between global coordinates and image coordinates using either trial values ​​(fixed grid) or homogeneous transformations (transformed grid).

[0068] <Vanishing Point Calculation: User Avatar Orientation Transformation and Vanishing Point Calculation Process>

[0069] Preferably, the image analysis unit 150 includes a real-time vanishing point calculation unit 155. The real-time vanishing point calculation unit 155 detects the left side line, right side line, or center line of the road, predicts the vanishing point of the current frame in real time, and stores the predicted vanishing point in memory. The user avatar generation unit 120 receives the vanishing point information from the real-time vanishing point calculation unit 155 and executes the direction change of the user avatar based on the predicted vanishing point information.

[0070] Preferably, the image analysis unit 150 includes a real-time vanishing point calculation unit 155, which detects the left line, right line, or center line of the road and predicts the vanishing point of the current frame in real time.

[0071] The image analysis unit 150 determines that the photographing camera is rotated right when the vanishing point calculated by the real-time vanishing point calculation unit 155 moves to the left side of the pixel image, and determines that the photographing image is rotated left when the vanishing point calculated by the real-time vanishing point calculation unit 155 moves to the right side of the pixel image.

[0072] The user avatar generation unit 120 converts the avatar's direction to the rotation direction of the shooting camera determined by the image analysis unit 150 .

[0073] Figure 3 The vanishing point calculation process shown may apply 1) image segmentation (eg, K-means segmation, image binarization), 2) line detection, and 3) vanishing point prediction steps.

[0074] <Opponent Stand Size Adjustment - Distance>

[0075] like Figure 4 As shown, the opponent avatar generation unit 140 preferably expresses the current size of the opponent avatar using perspective based on the opponent position information received from the opponent information providing unit 141 .

[0076] h2 (current size of the opponent's stand) = h1 (size of the opponent's stand at the baseline) × y2 / y1

[0077] Where y2: the pixel distance between the vanishing point and the opponent's stand-in,

[0078] y1: The distance in pixels between the vanishing point and the baseline.

[0079] <Target location logo: graphic, circular logo>

[0080] Preferably, the processing control unit 100 further includes an identification generating unit 160, which displays a target location identification indicating the direction of travel in the form of a graphic identification or a circular identification at a location on the driving route that the user's avatar image is expected to arrive at after a predetermined time based on the vanishing point provided by the real-time vanishing point calculating unit 155.

[0081] Preferably, the display screen 200 displays the user's exercise distance, speed, calories burned, and competitors on the screen.

[0082] The present invention has been described above by way of examples, but the present invention is not limited to the above specific embodiments. Any changes or modifications based on the present invention fall within the scope of protection claimed by the present invention.

Claims

1. An indoor bicycle that matches real road images and speed positions, characterized in that: include: An indoor bicycle (10) comprises a bicycle body having a saddle, a rotating body, pedals for rotating the rotating body, and a speed sensing module (S) for sensing the rotation speed of the pedals; The processing control unit (100) includes: A video storage unit (110) stores a video of a driving scene captured in multiple frames per unit time at a predetermined time interval, wherein the predetermined time interval is t1; A user avatar generating unit (120) which uploads an avatar selected by the user from a user avatar storage unit which has pre-generated and stored user avatar shapes, and generates a user avatar image; Image Analysis Department (150), including: A real-time driving speed recognition unit (151) calculates the image real-time speed V_image real-time by comparing the position, size or pixel difference of a stationary object between two frames; A real-time vanishing point calculation unit (155) detects the left side line, the right side line or the center line of the road, predicts the vanishing point in real time, and stores the vanishing point information in a memory; The image fusion playback unit (130) adjusts the image playback speed in real time according to the formula playback speed = V_bicycle / V_image, and dynamically adjusts the direction of the user's avatar based on the vanishing point information so that the perspective relationship between the avatar image and the real road image is consistent; The display screen (200) displays the fused image and the avatar.

2. The indoor bicycle that matches real road images and speed positions according to claim 1, characterized in that: The system also includes an opponent avatar generating unit (140), which receives the running speed and position information of the opponent's bicycle from the opponent information providing unit (141), and displays the opponent's avatar in the real road video in a manner of comparison with the user's avatar.

3. The indoor bicycle that matches real road images and speed positions according to claim 1, characterized in that: The system further comprises an image analysis unit (150), which has the function of identifying roads, vehicles and stationary objects in the real road shooting image. The image analysis unit (150) includes a real-time driving speed recognition unit (151), which calculates the driving speed of the captured driving image in real time as V_image real-time and transmits it to the image fusion playback unit (130). The real-time driving speed recognition unit (151) recognizes a specific object classified as stationary within a pixel image of a frame. Calculating a distance traveled by the specific object during a predetermined time period t1-t2 using a difference in position, size, or number of pixels of the specific object between a pixel image of a past frame captured at a second time and a pixel image of a current frame captured at a first time, thereby estimating a real-time driving speed of the driving image; The image fusion playback unit (130) plays the real road image according to the following formula: Playback speed = V_bicycle / V_image real time.

4. The indoor bicycle that matches real road images and speed positions according to claim 1, characterized in that: The image analysis unit (150) includes a real-time vanishing point calculation unit (155), which detects the left line, right line or center line of the road, predicts the vanishing point of the current frame in real time and stores it in a memory. The user avatar generation unit (120) receives vanishing point information from the real-time vanishing point calculation unit (155), and executes direction conversion of the user avatar based on the vanishing point information.

5. The indoor bicycle that matches real road images and speed positions according to claim 1, characterized in that: The image analysis unit (150) includes a real-time vanishing point calculation unit (155), which detects the left line, right line or center line of the road and predicts the vanishing point of the current frame in real time; The image analysis unit (150) determines that the photographing camera is rotated right when the vanishing point calculated by the real-time vanishing point calculation unit (155) moves to the left side of the pixel image, and determines that the photographing image is rotated left when the vanishing point calculated by the real-time vanishing point calculation unit (155) moves to the right side of the pixel image. The user avatar generation unit (120) performs a direction conversion of the avatar toward the rotation direction of the shooting camera determined by the image analysis unit (150).

6. The indoor bicycle that matches real road images and speed positions according to claim 2, characterized in that: The opponent avatar generation unit (140) displays the current size of the opponent avatar using perspective according to the opponent position information received from the opponent information providing unit (141), and h2 = h1 × y2 / y1 Among them, y2 is the pixel distance from the vanishing point to the opponent's stand-in, y1 is the pixel distance from the vanishing point to the baseline, h1 is the size of the opponent's stand-in on the baseline, and h2 is the current size of the opponent's stand-in.

7. The indoor bicycle that matches real road images and speed positions according to claim 4, characterized in that: The processing control unit (100) further includes an identification generating unit (160), The marker generating unit (160) displays a target location marker indicating the direction of travel in the form of a graphic marker or a circular marker at a location on the driving route that the user's avatar image is expected to arrive at after a predetermined time based on the vanishing point provided by the real-time vanishing point calculating unit (155).

8. The indoor bicycle that matches real road images and speed positions according to claim 1, characterized in that: The display screen (200) displays the user's exercise distance, speed, calories burned, and competitors on the screen.

Images