GB2619273A - System for providing visual feeds of operations of a machine - Google Patents

System for providing visual feeds of operations of a machine Download PDF

Info

Publication number
GB2619273A
GB2619273A GB2207579.0A GB202207579A GB2619273A GB 2619273 A GB2619273 A GB 2619273A GB 202207579 A GB202207579 A GB 202207579A GB 2619273 A GB2619273 A GB 2619273A
Authority
GB
United Kingdom
Prior art keywords
machine
image capturing
capturing device
visual
actuator
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
GB2207579.0A
Other versions
GB202207579D0 (en
Inventor
J Sturos Timothy
R K Brockman Elizabeth
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Caterpillar Paving Products Inc
Original Assignee
Caterpillar Paving Products Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Caterpillar Paving Products Inc filed Critical Caterpillar Paving Products Inc
Priority to GB2207579.0A priority Critical patent/GB2619273A/en
Publication of GB202207579D0 publication Critical patent/GB202207579D0/en
Publication of GB2619273A publication Critical patent/GB2619273A/en
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/28Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with an adjustable field of view
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F3/00Dredgers; Soil-shifting machines
    • E02F3/04Dredgers; Soil-shifting machines mechanically-driven
    • E02F3/18Dredgers; Soil-shifting machines mechanically-driven with digging wheels turning round an axis, e.g. bucket-type wheels
    • E02F3/22Component parts
    • E02F3/26Safety or control devices
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26Indicating devices
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26Indicating devices
    • E02F9/261Surveying the work-site to be treated
    • E02F9/262Surveying the work-site to be treated with follow-up actions to control the work tool, e.g. controller
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26Indicating devices
    • E02F9/264Sensors and their calibration for indicating the position of the work tool
    • E02F9/265Sensors and their calibration for indicating the position of the work tool with follow-up actions (e.g. control signals sent to actuate the work tool)
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/40Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components
    • B60R2300/406Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components using wireless transmission
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F3/00Dredgers; Soil-shifting machines
    • E02F3/04Dredgers; Soil-shifting machines mechanically-driven
    • E02F3/18Dredgers; Soil-shifting machines mechanically-driven with digging wheels turning round an axis, e.g. bucket-type wheels
    • E02F3/20Dredgers; Soil-shifting machines mechanically-driven with digging wheels turning round an axis, e.g. bucket-type wheels with tools that only loosen the material, i.e. mill-type wheels

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mining & Mineral Resources (AREA)
  • Civil Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Structural Engineering (AREA)
  • Mechanical Engineering (AREA)
  • Signal Processing (AREA)
  • Operation Control Of Excavators (AREA)

Abstract

A system (200 figure 2), for providing a visual feed of an operation of a machine 100, includes at least one image capturing device 204, at least one actuator 208 operatively coupled to the image capturing device, a display system 212, and a controller (216). The display system is configured to display one or more visual indicators (248) associated with one or more views of the machine. The controller is configured to receive an input corresponding to a selection of at least one visual indicator of the one or more visual indicators; move the actuator in response to the input to position the image capturing device to a predetermined pose for capturing at least one corresponding view of the one or more views of the machine; and display at least one visual feed of the at least one corresponding view of the machine through the display system. The machine may be a construction machine for performing multiple operations such as milling a road surface. The image capturing device may comprise a camera located on the machine or on an unmanned aerial vehicle (figure 40).

Description

SYSTEM FOR PROVIDING VISUAL FEEDS OF OPERATIONS OF A
MACHINE
Technical Field
[0001] The present disclosure relates generally to systems for monitoring operations of a machine. More particularly, the present disclosure relates to a system for providing at least one visual feed of at least one operation of the machine to an operator of the machine.
Background
[0002] Machines, such as construction machines, perform multiple operations (or tasks) during a work cycle. For instance, during a milling cycle, a milling machine may be required to start or halt at a particular position (or orientation) relative to one or more work site references, such as a painted marking line, an edge of a previous cut, an edge of manhole cover, a transition from asphalt to concrete, etc. These operations may require precise control of the machine and/or of one or more implements associated with the machine.
[0003] Viewing or monitoring an operation of the machine is crucial for safe and efficient control of the machine, or its implements, or the work site references. An operator, stationed at an operator cabin of the machine, may generally control the machine and/or the implements based on signals and/or commands provided by site personnel present in the surroundings of the machine. [0004] Japanese Patent Publication 2018017028 discloses a camera device for a construction machine. The camera device is mounted to a ceiling of the construction machine by a tilting shaft and a support arm. The camera device captures an image of the periphery of an attachment of the construction machine and transmits moving image data to a monitor present at an operation cabin of the construction machine.
Summary of the Invention
[0005] In one aspect, the present disclosure is directed to a system for providing a visual feed of an operation of a machine. The system includes at least one image capturing device, at least one actuator operatively coupled to the at least one image capturing device, a display system, and a controller. The display system is configured to display one or more visual indicators. Each visual indicator of the one or more visual indicators is associated with one or more views of the machine. The controller is configured to receive an input corresponding to a selection of at least one visual indicator of the one or more visual indicators. Further, the controller is configured to move the at least one actuator in response to the input to position the at least one image capturing device to a predetermined pose for capturing at least one corresponding view of the one or more views of the machine. Furthermore, the controller is configured to display at least one visual feed of the at least one corresponding view of the machine through the display system.
Brief Description of Drawings
[0006] FIG. 1 illustrates an exemplary machine, in accordance with an embodiment of the present disclosure; [0007] FIG. 2 illustrates a schematic view of a system for providing a visual feed of an operation of the machine, in accordance with an embodiment of the present disclosure; [0008] FIG. 3 depicts a flowchart illustrating a method for providing the visual feed of the operation of the machine, in accordance with an embodiment of the present disclosure; and [0009] FIG. 4 illustrates a top vi ew of the machine and a system for providing a visual feed of an operation of the machine, in accordance with another embodiment of the present disclosure.
Detailed Description
[0010] Reference will now be made in detail to embodiments of the disclosure, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
[0011] Referring to FIG. 1, an exemplary machine 100 is shown. The machine 100 may include a roadway/pavement profiler, a roadway planer, or a milling machine 100'. As an example, the milling machine 100' includes a cold planer 104. The machine 100 may be used to perform a milling operation to modify a ground surface 108 of a roadway 112. For example, the milling operation may mean or include scarifying, removing, mixing, and/or reclaiming material, from the ground surface 108 for the laying of a new surface. Although references to the milling machine 100' are used, aspects of the present disclosure may also be applicable to other machines, e.g., to mobile machines, such as excavators, loaders, graders, off highway trucks, and the like, and references to the milling machine 100' in the present disclosure is to be viewed as purely exemplary.
[0012] The machine 100 may define a forward end 116 and a rearward end 120 opposite to the forward end 116. The forward end 116 and the rearward end 120 may be defined in relation to an exemplary direction of travel (indicated by an arrow:A 1 of the machine 100, with said direction of travel being defined from the rearward end 120 towards the forward end 116. Also, the machine 100 may include two lateral sides, i.e., a first lateral side 124 (or right side) and a second lateral side 128 (or left side) opposite to the first lateral side 124. The first lateral side 124 and the second lateral side 128 may be located transversely relative to the exemplary direction of travel:A' of the machine 100. Further, the machine 100 may include a frame 132, a set of traction devices 136 each including an associated leg, a propulsion system 140, a trilling assembly 144, a conveyor 148, and an operator cabin 152.
[0013] The traction devices 136 may support and propel the frame 132 (or the machine 100) over an expanse of the roadway 112. Exemplarily, the machine may include four traction devices 136 (one at each corner of the frame 132 of the machine 100), although a lesser or greater number of traction devices 136 may be contemplated. The propulsion system 140 may include a power compartment 156 and a power source (not shown), such as an internal combustion engine, provided within the power compartment 156. The power source may be configured to power operations of various systems on the machine 100, typically by combusting fuel.
[0014] The milling assembly 144 may be supported by the frame 132 and may be configured to facilitate the milling operation. The milling assembly 144 may include a mixing chamber 160 and a rotor 164 disposed within the mixing chamber 160. The rotor 164 may include cutting elements 166 arranged around its periphery to engage, grind, and/or pulverize the ground surface 108 to form a milled ground surface 168, as the machine 100 moves over the ground surface 108 (e.g., along the direction, A). Milled materials resulting from the milling operation may be transferred to the conveyor 148, which may in turn convey the milled materials into a dump body of a transport vehicle (e.g., a dump truck) (not shown) that may move ahead of the machine 100.
[0015] The operator cabin 152 may be supported over the frame 132. The operator cabin 152 may facilitate stationing of one or more operators therein, to monitor the operations of the machine 100, and/or the milling assembly 144. Also, the operator cabin 152 may house various components and controls of the machine 100, access to one or more of which may help the operators to control the machine'S movement and/or operation. For example, the operator cabin 152 may include an input device 172 that may be used and/or actuated for facilitating control of the machine 100 or the milling assembly 144 (e.g., moving the mixing chamber 160 and the rotor 164 relative to the ground surface 108) of the machine 100. The input device 172 may include, but not limited to, one or more of touch displays, joysticks, switches, and the like.
[0016] With continued reference to FIG. 1, the machine 100 may include one or more outer panels 176 which may be disposed at the first lateral side 124 of the machine 100. The outer panels 176 may be formed of a material, such as aluminized steel, sheet metal, and corrosion resistant steel. The outer panels 176 may be coupled to the frame 132 of the machine 100, e.g., via mechanical fasteners (i.e., bolts, screws, rivets, etc.), welding, brazing, or any other joining process known in the art.
[0017] During a milling cycle, the machine 100 (or the cold planer 104) may perform multiple operations (or tasks). Such an operation (or a task) may include adjusting or aligning the machine 100 and/or the milling assembly 144 (the mixing chamber 160 and the rotor 164) with respect to one or more work site references 180. In an example, the one or more work site references 180 correspond to an approaching edge 184 of a previous cut (as shown in FIG. 1). In another example, the one or more work site references 180 may include, but are not limited to, an edge of an approaching manhole cover, an edge of a departing manhole cover, and painted marking lines or side edges of the ground surface 108.
[0018] To precisely control the machine 100 and/or the milling assembly 144 during the operation, the operator (stationed within the operator cabin 152) may desire to view the active operation region of the machine 100 (or the milling assembly 144). To provide a visual feed of the operation of the machine 100 to the operator, in one or more aspects of the present disclosure, a system 200 is disclosed. The system 200 includes at least one image capturing device 204, at least one actuator 208, a display system 212, and a controller 216 (please see FIG. 2).
[0019] The image capturing device 204 may include a camera 204'. The camera 204' may be configured to capture and record visual feeds (or image data), for example, still images, video streams, time lapse sequences, etc., associated with one or more views of the machine 100 and its surroundings. Also, the camera 204' may be configured to generate one or more signals corresponding to the captured visual feeds.
[0020] The camera 204' may be a monochrome digital camera, a high-resolution digital camera, or any suitable digital camera. Further, the camera 204' may include a still camera, a camcorder, a video camera, a Closed-Circuit Television (CCTV) camera, and the like, without any limitations. T he camera 204' may also include optical flow chips that facilitate acquisition of images. In some examples, the camera 204' may embody a Complimentary Metal-Oxide Semiconductor (CM OS) camera.
[0021] The actuator 208 may be operatively coupled to the image capturing device 204 (or the camera 204'). The actuator 208 may facilitate positioning of the image capturing device 204 (or the camera 204') relative to the machine 100. In the present embodiment, the actuator 208 may include a telescopic actuator 208' (as shown in FIG. 1). The telescopic actuator 208' may be hydraulically or pneumatically actuated for positioning the image capturing device 204 (or the camera 204') relative to the machine 100.
[0022] The telescopic actuator 208' may include a first arm 220 and a second arm 224. The first arm 220 may be an outer hollow tube of the telescopic actuator 208'. The first arm 220 may include a first end portion 228 and a second end portion 232 opposite to the first end portion 228. The second arm 224 may be an inner tube of the telescopic actuator 208'. The second arm 224 may include a third end portion (not shown) disposed within the first arm 220 and a fourth end portion 236 opposite to the third end portion. The second arm 224 may be configured to move or slide with respect to the first arm 220, for example, between a first position and a second position. In the first position (e.g., an extended position, as shown in FIG. 1), the second arm 224 may extend out from the first arm 220 to move the image capturing device 204 away from the first lateral side 124 of the machine 100. In a second position (e.g., a retracted position), the second arm 224 may retract inside the first arm 220 to move the image capturing device 204 towards the first lateral side 124 of the machine 100. [0023] The telescopic actuator 208' may be movably coupled at one end to the machine 100 and at the other end to the at least one image capturing device 204 (or the camera 204'). For example, the first end portion 228 of the first arm 220 (of the telescopic actuator 208') is movably coupled to the one or more outer panels 176 of the machine 100 via a first joint 240, and the fourth end portion 236 of the second arm 224 (of the telescopic actuator 208') is movably coupled to the image capturing device 204 (or the camera 204) via a second joint 244. The first joint 240 and the second joint 244 may allow the telescopic actuator 208' and the image capturing device 204 (or the camera 204) to move (e.g., rotate or pivot) in at least one plane relative to the machine 100.
[0024] Although the actuator 208 is contemplated as the telescopic actuator 208' having the first arm 220 and the second arm 224, it may be appreciated that, in other embodiments, the actuator 208 may include any other type of mechanical gimbal or arm of different shapes and configurations.
[0025] With reference to FIG. 2, the display system 212 may include a display 246. The display 246 may be a Light Emitting Diode (L E D) display, a Liquid Crystal Display (LCD), a Cathode Ray Tube (CRT) display, a touchscreen display, or any other type of display system known in the art. The display system 212 (or the display 246) may be communicably coupled to the input device 172 of the machine 100 for receiving one or more gestures (e.g., selections) from the operator. In the present embodiment, the display system 212 is a touchscreen display system 212' having the input device 172 embedded therein for receiving touch gestures from the operator.
[0026] The display system 212 may be disposed within the operator cabin 152, as shown in FIG. 1, and may be viewable and operable by the operator stationed at the operator cabin 152 of the machine 100. For example, the display system 212 is mounted to a dashboard 188 of the machine 100 within reach of the operator. In other embodiments, the display system 212 may be positioned at a remote location outside the machine 100, and may be viewable and operable by an operator situated at the remote location.
[0027] Further, the display system 212 is configured to display one or more visual indicators 248. The visual indicators 248 may include, but are not limited to, icons, still images, numeric symbols, alphanumeric symbols, alphabetical symbols, and the likes. In the present embodiment, the display system 212 displays six visual indicators 248 first visual indicator 252, second visual indicator 254, third visual indicator 256, fourth visual indicator 258, fifth visual indicator 260, and sixth visual indicator 262. It may be contemplated that the display system 212 may display higher or lesser number of visual indicators 248. [0028] Each visual indicator 248 may indicate at least one operation (or task) of the machine 100. For example, the first visual indicator 252 may indicate a creep to scratch task (e.g., slow controlled lowering of the rotor 164 to just touch the ground surface 108 to be mi I led); the second visual indicator 254 may indicate an approaching obstacle jump task (e.g., a height the rotor is raised to clear the approaching obstacle); the third visual indicator 256 may indicate a lateral side alignment task (e.g., aligning the second lateral side 128 of the machine 100 with respect to a painted line:P1-on the ground surface 108 of the roadway 112) (as shown in FIG. 4); the fourth visual indicator 258 may indicate a departing obstacle edge alignment task (e.g., aligning the rotor of the machine 100 with respect to an edge of a departing manhole cover); the fifth visual indicator 260 may indicate a dump truck alignment task (e.g., aligning the conveyor 148 relative to a dump truck travelling ahead of the machine 100); and the sixth visual indicator 262 may indicate rotor alignment task (e.g., aligning the rotor 164 with the approaching edge 184 of the previous cut).
[0029] Each visual indicator 248 is associated with the one or more views of the machine 100. Each view of the machine 100 may correspond to a point of view relative to the machine 100 captured by the image capturing device 204 (or the camera 2040. In an example, the first visual indicator 252 (indicating the creep to scratch task) may be associated with a first view of the machine 100 that covers at least a portion of the milling assembly 144 and a portion of the ground surface 108 beneath the milling assembly 144.
[0030] In another example, the second visual indicator 254 (indicating the front obstacle jump task) may be associated with a second view of the machine 100 that covers at least a portion of the milling assembly 144 and the obstacle approaching towards the machine 100. In yet another example, the third visual indicator 256 (indicating the lateral side alignment task) may be associated with a third view:V3-(please see FIG. 4) of the machine 100 that covers at least a portion of the second lateral side 128 of the machine 100 and the painted line:P1-on the ground surface 108 of the roadway 112.
[0031] In yet another example, the fourth visual indicator 258 (indicating the departing obstacle edge alignment task) may be associated with a fourth view:V4-(please see FIG. 4) of the machine 100 that covers at least a portion of the rearward end 120 of the machine 100 and the departing obstacle. In yet another example, the fifth visual indicator 260 (indicating the dump truck alignment task) may be associated with a fifth view of the machine 100 that covers at least an end portion (not shown) of conveyor 148 and a dump body of the dump truck travelling ahead of the machine 100. In yet another example, the sixth visual indicator 262 (indicating the rotor alignment task) is associated with a sixth view:V 6-(as shown in FIG. 1) of the machine 100 that covers at least a portion of the milling assembly 144 and the approaching edge 184 of the previous cut [0032] The controller 216 may be communicably coupled (e.g., wirelessly) to the input device 172. The controller 216 detects an actuation (e.g., an activation) of the input device 172 and receives an input corresponding to a selection of the at least one visual indicator 248 from the input device 172.
[0033] Further, the controller 216 may be communicably coupled to the at least one image capturing device 204 (or the camera 204'), the at least one actuator 208, and the display system 212. In response to the input received from the input device 172, the controller 216 may be configured to determine a corresponding predetermined pose at which the at least one image capturing device 204 is to be positioned relative to the machine 100. For example, the controller 216 may utilize a look-up table pre-stored in a memory 266 of the controller 216 to determine the predetermined pose corresponding to the visual indicator 248 selected by the operator.
[0034] Subsequently, the controller 216 is configured to move the at least one actuator 208 to position the at least one image capturing device 204 to the corresponding predetermined pose. For example, the controller 216 may move (e.g., extend, retract, rotate, pivot, etc.) the first arm 220 and the second arm 224 of the telescopic actuator 208' i n a manner to position the image capturing device 204 (or the camera 204) to the corresponding predetermined pose. Once the image capturing device 204 is positioned at the predetermined pose, the controller 216 is configured to display at least one visual feed of the at least one corresponding view of the machine 100 through the display system 212.
[0035] Additionally, in some embodiments, the controller 216 may be configured to move the at least one actuator 208 to a default position relative to the machine 100. At the default position, the at least one actuator 208 may facilitate the at least one image capturing device 204 (or the camera 204) to attain a stowed pose (shown in dashed lines, in FIG. 1) at which the at least one image capturing device 204 may be stowed on the machine 100.
[0036] In some embodiments, the controller 216 may be configured to receive one or more touch inputs corresponding to a selection of the one or more work site references 180, displayed in the visual feed of an operation of the machine 100 and relative to which the machine 100 is to be aligned. Upon receipt of the touch inputs, the controller 216 may be configured to monitor alignment status of the machine 100 relative to the selected work site references 180 and provide desired feedback to the operator of the machine 100. The desired feedback may include, but need not be limited to, a visual alert an audio alert an audio-visual alert, and a tactile alert.
[0037] Further, in some embodiments, the controller 216 may be configured to automatically identify the one or more work site references 180 present in the visual feed of the operation of the machine 100 displayed to the operator though the display system 212. Based on the identification of the work site reference 180, the controller 216 may be configured to monitor alignment status of the machine 100 relative to the work site reference 180 and provide desired feedback to the operator of the machine 100.
[0038] The controller 216 may include a processor 270 to process the inputs received from the input device 172 and the at least one image capturing device 204 associated with the system 200. Examples of the processor 270 may include, but are not limited to, an X 86 processor, a Reduced Instruction Set Computing (RISC) processor, an Application Specific Integrated Circuit (ASIC) processor, a Complex Instruction Set Computing (CISC) processor, an Advanced RISC Machine (A R M) processor, or any other processor.
[0039] Further, the controller 216 may include a transceiver 274. According to various embodiments of the present disclosure, the transceiver 274 may enable the controller 216 to communicate (e.g., wirelessly) with the input device 172, the at least one image capturing device 204, the at least one actuator 208, and the display system 212, over one or more of wireless radio links, infrared communication links, short wavelength Ultra-high frequency radio waves, short-range high frequency waves, or the like. Example transceivers 274 may include, but are not limited to, wireless personal area network (W PA N) radios compliant with various IEEE 802.15 ( B I uetootho) standards, wireless local area network (W LAN) radios compliant with any of the various IEEE 802.11 (WiFiO) standards, wireless wide area network (WWA N) radios for cellular phone communication, wireless metropolitan area network (W M A N) radios compliant with various IEEE 802.15 (Wi MAX it) standards, and wired local area network (L A N) Ethernet transceivers for network data communication.
[0040] Controller 216 also includes the memory 266. Examples of the memory 266 may include a hard disk drive (HDD), and a secure digital (SD) card. Further, the memory 266 may include non-volatile/volatile memory units such as a random-access memory (RAM) / a read only memory (ROM), which may include associated input and output buses. The memory 266 may be configured to store various other instruction sets for various other functions of the system 200, along with the set of instruction, discussed above.
[0041] Referring to FIG. 4, a system 400 is shown. The system 400 is similar to the system 200 but differs from the system 200 in that the at least one image capturing device 204 and the at least one actuator 208 are omitted. Rather, the system 400 includes at least one image capturing device 404 and at least one actuator 408. The functioning and configuration of the at least one image capturing device 404 may be similar to the at least one image capturing device 204, and hence, discussion related to the at least one image capturing device 404 is omitted for the sake of brevity.
[0042] The at least one image capturing device 404 and the at least one actuator 408 may be mounted on at least one unmanned aerial vehicle 410 (hereafter referred to as 'UAV J. For example, an image capturing device 404' and an actuator 408' may be mounted on a first UAV 410' and an image capturing device 404" and an actuator 408" may be mounted on a second UAV 410". The at least one actuator 408 may correspond to one or more electric motors (not shown). In an example, as shown in FIG. 4, the first UAV 410' and the second UAV 410" are configured to move relative to the machine 100 to position their corresponding image capturing devices 404', 404", for capturing the third view:V 3' andthe fourth view:V 4-, respectively, of the machine 100.
[0043] On receipt of an input corresponding to the selection of the third visual indicator 256 and the fourth visual indicator 258 from the input device 172, the controller 216 may determine (e.g., via look-up table pre-stored in the memory 266 of the controller 216) that the image capturing device 404' of the first UAV 410' is required to be positioned at a corresponding third pose relative to the machine 100 for capturing the view:V 3-of the machine 100, and the image capturing device 404" of the second UAV 410" is required to be positioned at a corresponding fourth pose relative to the machine 100 for capturing the view:V4-of the machine 100. Accordingly, the controller 216 may move (e.g., actuate or control) the actuator 408' of the first UAV 410' in a manner to position the image capturing device 404' of the first UAV 410' to the third pose relative to the machine 100. Also, the controller 216 may move (e.g., actuate or control) the actuator 408" of the second UAV 410" in a manner to position the image capturing device 404" of the second UAV 410" to the fourth pose relative to the machine 100. Subsequently, the controller 216 may receive corresponding visual feeds from the image capturing device 404' of the first UAV 410' and the image capturing device 404" of the second UAV 410", respectively, and display the visual feeds to the operator through the display system 212.
Industrial Applicability
[0044] Referring to FIG. 3, an exemplary method for providing a visual feed of an operation of a machine, such as the machine 100, is discussed. The method is discussed by way of a flowchart 300 that illustrates exemplary stages (i.e., from 304 to 312) associated with the method. The method is also discussed in conjunction with FIGS. 1, 2, and 4.
[0045] During a work cycle (e.g., a milling cycle), the operator, stationed at the operator cabin 152 of the machine 100, may desire to start a new cut from the approaching edge 184 of the previous cut. For that, the operator may be required to precisely align the rotor 164 with respect to the approaching edge 184 of the previous cut. Accordingly, the operator may desire to view at least a portion of the milling assembly 144 and the approaching edge 184 of the previous cut. In this regard, the operator may select the sixth visual indicator 262 indicating the rotor alignment task (out of the six visual indicators 248 displayed on the display system 212), via the input device 172. Accordingly, the controller 216 may receive said input corresponding to the selection of the sixth visual indicator 262 (STAGE 304).
[0046] On receipt of said input, the controller 216 may determine (e.g., by utilizing the look-up table pre-stored in the memory 266 of the controller 216) that the image capturing device 204 (or the image capturing device 404) is required to be positioned at a corresponding sixth pose relative to the machine 100 for capturing the sixth view:V 6-of the machine 100. Accordingly, the controller 216 may move (e.g., actuate, or activate) the actuator 208 (or the actuator 408) in a manner to position the image capturing device 204 (or the image capturing device 404) to the sixth pose (STAGE 308).
[0047] Once the image capturing device 204 (or the image capturing device 404) is positioned at the sixth pose, the controller 216 may receive a visual feed corresponding to the sixth view:V 6-of the machine 100 from the image capturing device 204 (or the image capturing device 404). Further, the controller 216 may display the visual feed corresponding to the sixth view:V 6-to the operator through the display system 212 (STAGE 312).
[0048] With the application of the system 200, or 400, the operator, stationed at the operator cabin 152 of the machine 100, may be able to closely view and monitor those portions associated with the machine 100 that are otherwise unavailable from within the operator cabin 152. The system 200, or 400, provides visual feeds (i.e., live video stream) associated with at least one operation of the machine 100, in response to a minimal input, for example, a single input action, from the operator. Also, the system 200, or 400, may be easily retrofitted on existing machines, without modifying hardware associated with such machines. Accordingly, the disclosed system 200, or 400, provides a safe, efficient, and cost-effective solution for precisely controlling the machine 100 and/or the mi!ling assembly 144.
[0049] It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed system, method, and machine of the present disclosure without departing from the scope of the disclosure. Other embodiments will be apparent to those skilled in the art from consideration of the specification and practice of the system, method, and machine, disclosed herein. It is intended that the specification and examples be considered as exemplary only, with a true scope of the disclosure being indicated by the following claims and their equivalents.

Claims (1)

  1. Claims What is claimed is: 1. A system for providing a visual feed of an operation of a machine, the system comprising: at least one image capturing device; at least one actuator operatively coupled to the at least one image capturing device; a display system configured to display one or more visual indicators, each visual indicator of the one or more visual indicators being associated with one or more views of the machine; and a controller configured to: receive an input corresponding to a selection of at least one visual indicator of the one or more visual indicators; move the at least one actuator in response to the input to position the at least one image capturing device to a predetermined pose for capturing at least one corresponding view of the one or more views of the machine; and displaying at least one visual feed of the at least one corresponding view of the machine through the display system.
GB2207579.0A 2022-05-24 2022-05-24 System for providing visual feeds of operations of a machine Pending GB2619273A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB2207579.0A GB2619273A (en) 2022-05-24 2022-05-24 System for providing visual feeds of operations of a machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB2207579.0A GB2619273A (en) 2022-05-24 2022-05-24 System for providing visual feeds of operations of a machine

Publications (2)

Publication Number Publication Date
GB202207579D0 GB202207579D0 (en) 2022-07-06
GB2619273A true GB2619273A (en) 2023-12-06

Family

ID=82220458

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2207579.0A Pending GB2619273A (en) 2022-05-24 2022-05-24 System for providing visual feeds of operations of a machine

Country Status (1)

Country Link
GB (1) GB2619273A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016076233A1 (en) * 2014-11-11 2016-05-19 ヤンマー株式会社 Work vehicle
WO2017164781A1 (en) * 2016-03-23 2017-09-28 Cargotec Patenter Ab Load handling assembly
EP3964910A1 (en) * 2020-08-11 2022-03-09 Kobelco Construction Machinery Co., Ltd. Work support apparatus for work machine

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016076233A1 (en) * 2014-11-11 2016-05-19 ヤンマー株式会社 Work vehicle
WO2017164781A1 (en) * 2016-03-23 2017-09-28 Cargotec Patenter Ab Load handling assembly
EP3964910A1 (en) * 2020-08-11 2022-03-09 Kobelco Construction Machinery Co., Ltd. Work support apparatus for work machine

Also Published As

Publication number Publication date
GB202207579D0 (en) 2022-07-06

Similar Documents

Publication Publication Date Title
US10519631B2 (en) Work tool vision system
US9776566B2 (en) Environment monitoring device for operating machinery
US10907326B2 (en) Vision system for monitoring a work tool of a work vehicle
US10228232B2 (en) Operator assistance system
US20170175363A1 (en) Method for providing images of a work tool for a machine
KR20170039615A (en) Periphery monitoring device for crawler-type working machine
GB2619273A (en) System for providing visual feeds of operations of a machine
US20210363732A1 (en) System and method for selectively displaying image data in a working machine
JP5261832B2 (en) Rear view display system for transport vehicles
WO2023164348A1 (en) Work machine safety zone control
US20230060815A1 (en) Loading Machine with Visual Reference System
KR102019780B1 (en) Working machine
JP5778796B2 (en) Rear view display system for transport vehicles
JP2628008B2 (en) Visual recognition of operating state of work machine
JP2022085617A (en) Periphery monitoring system and display device
JP2021080041A (en) Working vehicle
WO2022064969A1 (en) Automatic loading system
JP5462352B2 (en) Rear view display system for transport vehicles
JP2013131949A (en) Radio wave relay vehicle for remote operation
US20230266754A1 (en) Work area overlay on operator display
US20230116011A1 (en) Secondary control system and method for mounting with service orientation
JP2963959B2 (en) Relay antenna device
JPH0787541B2 (en) Image information transmission device
JP3508878B2 (en) Work vehicle remote control method
JPH07288753A (en) Attitude holding device for video transmission device in remote control system