CN110139082A - By video processnig algorithms to the identification device of equipment working condition - Google Patents
By video processnig algorithms to the identification device of equipment working condition Download PDFInfo
- Publication number
- CN110139082A CN110139082A CN201910520945.9A CN201910520945A CN110139082A CN 110139082 A CN110139082 A CN 110139082A CN 201910520945 A CN201910520945 A CN 201910520945A CN 110139082 A CN110139082 A CN 110139082A
- Authority
- CN
- China
- Prior art keywords
- camera
- data
- module
- data processing
- working condition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000006835 compression Effects 0.000 claims description 3
- 238000007906 compression Methods 0.000 claims description 3
- 238000010276 construction Methods 0.000 abstract description 29
- 239000007787 solid Substances 0.000 abstract description 3
- 238000009434 installation Methods 0.000 abstract description 2
- 238000000034 method Methods 0.000 description 3
- 239000004575 stone Substances 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/147—Details of sensors, e.g. sensor lenses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Vascular Medicine (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
The present invention provides a kind of identification device by video processnig algorithms to equipment working condition, including camera data acquisition module and coupled data processing system module, the camera data acquisition module, it is mounted at engineering machinery vehicle driver's front windshield, including camera sensor, camera lens, dsp processor, bus, camera lens collection site data, the camera sensor using cmos sensor is provided in camera lens, field data is converted to electric image signal by camera sensor, then pass through bus transfer to dsp processor, carry out data processing.The present invention provides solid plan for intelligence construction, meanwhile, it can identify operating condition scene, avoid breakage in installation critical facility；Owner can also remotely check construction operating condition, it is ensured that the equipment construction operating condition of oneself is normal.
Description
Technical field
The present invention relates to a kind of camera systems, more particularly, to a kind of knowledge by video processnig algorithms to equipment working condition
Other device.
Background technique
Currently, the capital construction industry in China flourishes, State-level has been put into greatly in capital construction, high-speed rail, heavy construction field
The manpower, material resources and financial resources of amount, almost all of construction scene require to use mechanical equipment, the management of these engineering mechanical devices
Also all in the low level management stage, the construction of engineering equipment requires the participation of people, some construction scene danger closes, ring for operation
Border is very severe, can generate grave danger to the safety of people itself, at present by video algorithm processing technique, intellectual analysis construction is existing
Field operating condition, provides solid foundation for the unmanned intelligent driving of engineering equipment, meanwhile, owner (possesses engineering mechanical device
Personal or unit) scene and actual agreements that also the different equipment for worrying oneself are worked difference (because engineering mechanical device is dry
Charge living, and related with construction scene) or work progress in, prevent damage other equipment or object, this technology side
Case just can solve the above problem.
Summary of the invention
The present invention provides a kind of by video processnig algorithms to the identification device of equipment working condition, is mainly acquired with camera
Data flow judges engineering mechanical device construction operating condition then by intellectual analysis.It solves in engineering mechanical device work progress
For the intelligent recognition for operating condition of constructing, it is described that its technical solution is as follows:
It is a kind of by video processnig algorithms to the identification device of equipment working condition, including camera data acquisition module and and its
The data processing system module being connected, the camera data acquisition module are mounted on engineering machinery vehicle driver's front windshield
At glass, including camera sensor, camera lens, dsp processor, bus, camera lens collection site data are provided in camera lens and adopt
With the camera sensor of cmos sensor, field data is converted to electric image signal by camera sensor, then leads to
Bus transfer is crossed to dsp processor, carries out data processing.
Camera data acquisition module is connected by the data line of MIPI interface with data processing system module.
Dsp processor is used to carry out the compression processing of image, by RAW data boil down to YUV, while to be encoded to H.265
Transmission, is connect using MIPI interface with data processing system module.
Data processing system module includes that primary processor is executed with the 4G module connect, gyroscope, mechanism is connected with
Module.
Mechanism execution module is connected with executive device, and the executive device is the various mechanical behaviour on engineering machinery vehicle
Make device.
The present invention provides solid plan for intelligence construction, meanwhile, it can identify operating condition scene, avoid breakage in installation
Critical facility；Owner can also remotely check construction operating condition, it is ensured that the equipment construction operating condition of oneself is normal.
Detailed description of the invention
Fig. 1 is the structural schematic diagram by video processnig algorithms to the identification device of equipment working condition.
Specific embodiment
As shown in Figure 1, the present invention includes camera data acquisition module and data processing system modules.Camera data are adopted
Collection module is connected by the data line of MIPI interface with data processing system module.
The camera data acquisition module is mounted at engineering machinery vehicle driver's front windshield, serves as driver's " eye
Eyeball ".Camera data acquisition module is mainly responsible for collection site situation picture, is transmitted to data processing system, for analyzing operating condition.
Data processing system module, the mainly live video of processing camera system acquisition back, by artificial intelligence
Study, identifies field working conditions；Data processing system will carry out construction scene calibration before recognition, carry out a large amount of construction field
Scape study.
Camera data acquisition module:
Camera data acquisition module mainly include camera sensor (camera sensor), camera lens, dsp processor,
Bus, camera lens collection site data are provided with the camera sensor using cmos sensor in camera lens, and field data passes through
Camera sensor is converted to electric image signal, then by bus transfer to dsp processor, carries out data processing.
Dsp processor carries out the compression processing of image, by RAW data boil down to YUV, while to be encoded to and H.265 pass
It is defeated, it is connect using MIPI interface with data processing system module.
Data processing system module:
Data processing system module includes that primary processor is executed with the 4G module connect, gyroscope, mechanism is connected with
Module.
The data that master processor processes camera data acquisition module is sent, are calculated, then send instructions to machine
Structure execution module, mechanism execution module execute the movement of response according to instruction control executive device, and 4G module is responsible for and backstage is handed over
Mutual data, gyroscope are responsible for the attitude data of gathering project motor vehicles and machines.
Mechanism execution module includes the circuit controling switch of the various mechanical manipulators on engineering machinery vehicle.
Mechanism execution module is connected with executive device, and the executive device is the various mechanical behaviour on engineering machinery vehicle
Make device, mechanical manipulator is the mechanical part that Engineering Task is carried out on engineering truck, such as the excavator in engineering truck, packet
Turntable, the digging arm included；Or the crane in engineering truck comprising swing mechanism, cantilever crane.
These mechanical manipulators pass through circuit control, there is signaling switch on circuit, and operation passes through the place of primary processor
Reason, realization are turned on or off, can be operated, otherwise in operation invalid state.
Scene, the calibration of algorithm need to carry out data processing module a large amount of the Processing Algorithm that the present invention applies for identification
Scene learn calibration, in order to which data processing module can be carried out the identification of various scenes.
The identification of scene: data processing system module needs to identify scene, and differentiates current construction operating condition scene,
Such as the earthwork, the cubic meter of stone, the construction scene such as stone.And need to judge what operation engineering mechanical device executes.Such as the advance of engineering truck,
(dress is dug), rotation etc. in construction.
Specific step is as follows for the work of data processing system module:
1, photographing module captures construction site picture；
2, the artificial intelligence module of photographing module identifies the scene in picture, carries out intellectual analysis to scenic picture, a. sentences
Disconnected construction scene type, the earthwork, the cubic meter of stone；B. in identification construction scenic picture, if someone, if there is non-breakable thing,
If so, stop working at once, and notify Construction control personnel；
If 3, recognizing construction scene construction type, owner is notified, to do the processing responded；If identifying construction
Someone or there is non-breakable thing in range, then stop constructing, notifies Construction control personnel.
Notice includes warning, and indicator light, short massage notice etc. can be used for the scene Recognition of intelligent driving.
In the present invention, processor scheme performance is powerful, and recognizer uses *** Open Framework, more mature；Camera shooting
Head acquisition image is apparent, accurately can identify construction scene by color.
Claims (5)
1. it is a kind of by video processnig algorithms to the identification device of equipment working condition, it is characterised in that: including camera data acquire
Module and coupled data processing system module, the camera data acquisition module are mounted on engineering machinery vehicle
At driver's front windshield, including camera sensor, camera lens, dsp processor, bus, camera lens collection site data, camera lens
In be provided with camera sensor using cmos sensor, field data is converted to image telecommunications by camera sensor
Number, then by bus transfer to dsp processor, carry out data processing.
2. it is according to claim 1 by video processnig algorithms to the identification device of equipment working condition, it is characterised in that: camera shooting
Head data acquisition module is connected by the data line of MIPI interface with data processing system module.
3. it is according to claim 1 by video processnig algorithms to the identification device of equipment working condition, it is characterised in that: DSP
Processor is used to carry out the compression processing of image, by RAW data boil down to YUV, while to be encoded to and H.265 transmit, and uses
MIPI interface is connect with data processing system module.
4. it is according to claim 1 by video processnig algorithms to the identification device of equipment working condition, it is characterised in that: data
Processing system modules include primary processor and are connected with the 4G module connect, gyroscope, mechanism execution module.
5. it is according to claim 4 by video processnig algorithms to the identification device of equipment working condition, it is characterised in that: mechanism
Execution module is connected with executive device, and the executive device is the various mechanical manipulators on engineering machinery vehicle.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910520945.9A CN110139082A (en) | 2019-06-17 | 2019-06-17 | By video processnig algorithms to the identification device of equipment working condition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910520945.9A CN110139082A (en) | 2019-06-17 | 2019-06-17 | By video processnig algorithms to the identification device of equipment working condition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110139082A true CN110139082A (en) | 2019-08-16 |
Family
ID=67577535
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910520945.9A Pending CN110139082A (en) | 2019-06-17 | 2019-06-17 | By video processnig algorithms to the identification device of equipment working condition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110139082A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110830782A (en) * | 2019-11-20 | 2020-02-21 | 南通嘉骏信息科技有限公司 | FPGA (field programmable Gate array) -based method for realizing conversion from RAW (RAW edge to edge) to YUV (YUV) of MIPI (million Instructions Per interface) CSI (channel State information-2) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040178945A1 (en) * | 2001-06-23 | 2004-09-16 | Buchanan Alastair James | Object location system for a road vehicle |
| CN102145688A (en) * | 2010-02-08 | 2011-08-10 | 鸿富锦精密工业（深圳）有限公司 | Vehicle anti-collision monitoring system and method |
| CN202856898U (en) * | 2012-08-02 | 2013-04-03 | 李建华 | 3G remote video all-in-one machine |
| WO2014146809A1 (en) * | 2013-03-22 | 2014-09-25 | Mts Maschinentechnik Schrode Ag | Mobile construction site surveying device, and device for providing information, particularly for generating handling instructions, for a construction machine operator |
| CN104469314A (en) * | 2014-12-12 | 2015-03-25 | 国家电网公司 | Video monitoring system and method of electric power construction field |
| CN105989682A (en) * | 2015-02-05 | 2016-10-05 | 国家电网公司 | Safety early warning and monitoring system and monitoring method for construction machinery under power transmission line |
| CN106454250A (en) * | 2016-11-02 | 2017-02-22 | 北京弘恒科技有限公司 | Intelligent recognition and early warning processing information platform |
| CN108978769A (en) * | 2018-07-03 | 2018-12-11 | 柳州柳工挖掘机有限公司 | Excavator operating mode's switch clocking method and system and excavator |
| CN109445363A (en) * | 2018-12-21 | 2019-03-08 | 杭州睿兴栋宇建筑科技有限公司 | A kind of construction site dynamic security monitoring system based on Outlier Detection Algorithm |
| CN109542105A (en) * | 2018-12-28 | 2019-03-29 | 北京龙马智行科技有限公司 | A kind of subgrade and pavement Intelligent unattended rcc system |
| CN209949292U (en) * | 2019-06-17 | 2020-01-14 | 北京信达众联科技有限公司 | Device for identifying equipment working condition through video processing algorithm |
-
2019
- 2019-06-17 CN CN201910520945.9A patent/CN110139082A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040178945A1 (en) * | 2001-06-23 | 2004-09-16 | Buchanan Alastair James | Object location system for a road vehicle |
| CN102145688A (en) * | 2010-02-08 | 2011-08-10 | 鸿富锦精密工业（深圳）有限公司 | Vehicle anti-collision monitoring system and method |
| CN202856898U (en) * | 2012-08-02 | 2013-04-03 | 李建华 | 3G remote video all-in-one machine |
| WO2014146809A1 (en) * | 2013-03-22 | 2014-09-25 | Mts Maschinentechnik Schrode Ag | Mobile construction site surveying device, and device for providing information, particularly for generating handling instructions, for a construction machine operator |
| CN104469314A (en) * | 2014-12-12 | 2015-03-25 | 国家电网公司 | Video monitoring system and method of electric power construction field |
| CN105989682A (en) * | 2015-02-05 | 2016-10-05 | 国家电网公司 | Safety early warning and monitoring system and monitoring method for construction machinery under power transmission line |
| CN106454250A (en) * | 2016-11-02 | 2017-02-22 | 北京弘恒科技有限公司 | Intelligent recognition and early warning processing information platform |
| CN108978769A (en) * | 2018-07-03 | 2018-12-11 | 柳州柳工挖掘机有限公司 | Excavator operating mode's switch clocking method and system and excavator |
| CN109445363A (en) * | 2018-12-21 | 2019-03-08 | 杭州睿兴栋宇建筑科技有限公司 | A kind of construction site dynamic security monitoring system based on Outlier Detection Algorithm |
| CN109542105A (en) * | 2018-12-28 | 2019-03-29 | 北京龙马智行科技有限公司 | A kind of subgrade and pavement Intelligent unattended rcc system |
| CN209949292U (en) * | 2019-06-17 | 2020-01-14 | 北京信达众联科技有限公司 | Device for identifying equipment working condition through video processing algorithm |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110830782A (en) * | 2019-11-20 | 2020-02-21 | 南通嘉骏信息科技有限公司 | FPGA (field programmable Gate array) -based method for realizing conversion from RAW (RAW edge to edge) to YUV (YUV) of MIPI (million Instructions Per interface) CSI (channel State information-2) |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN206023052U (en) | A kind of HV Transmission Line Routing Inspection robot | |
| CN108590664B (en) | Multi-functional unattended intelligent tunnel digging change system based on trinocular vision identification technology | |
| CN103395694A (en) | Integral monitoring system for tower crane | |
| CN109291035A (en) | Small-sized inspection robot and small-sized inspection robot system | |
| CN103235562A (en) | Patrol-robot-based comprehensive parameter detection system and method for substations | |
| CN107765854A (en) | A kind of polling transmission line method based on augmented reality | |
| CN106251567A (en) | A kind of Intellective Fire Alarm System | |
| CN111824963A (en) | Intelligent tower crane wireless remote control system with pose perception technology and control method | |
| CN111186771A (en) | Remote tower crane intelligent control system | |
| CN110139082A (en) | By video processnig algorithms to the identification device of equipment working condition | |
| CN112052785A (en) | Intelligent monitoring system of inspection robot | |
| CN209949292U (en) | Device for identifying equipment working condition through video processing algorithm | |
| CN113858194A (en) | A other robot that stands for job site auxiliary management | |
| CN206075460U (en) | The transmission line of electricity external force destruction monitoring and warning system merged based on double light on-axis images | |
| CN210061146U (en) | Transformer substation robot hanging and dismounting ground wire control system | |
| CN108098763A (en) | A kind of intelligent robot | |
| CN111731979A (en) | Automatic staircase takes advantage of personnel identification system that tumbles based on computer vision | |
| CN207645648U (en) | Intelligent crane control system | |
| CN108975165B (en) | Tower crane monitoring system and method and tower crane | |
| CN108009502A (en) | Unattended Intelligent unattended machine management system | |
| CN110255381A (en) | A kind of tower crane assistant driving system based on technology of Internet of things | |
| CN115690687A (en) | Safe wearing standard detection system based on deep learning technology | |
| CN208560504U (en) | Compression vehicle automatic control system | |
| CN109856662B (en) | Radioactive source detection moving robot | |
| CN105923545A (en) | Pedal-controlled dead zone display assisting device for hoisting machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220111 Address after: 300350 Haitang space-s-308-09, Zone D, Haitang Zhongchuang street, xianshuigu Town, Jinnan District, Tianjin Applicant after: Yunzhi Technology (Tianjin) Co.,Ltd. Address before: Room 402, south of the fourth floor, building 16, Zhixin village, Haidian District, Beijing 100083 Applicant before: BEIJING XINDA ZHONGLIAN TECHNOLOGY Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190816 |