CN116828288A - Composite intelligent inspection robot capable of being applied to multiple scenes and related system - Google Patents

Composite intelligent inspection robot capable of being applied to multiple scenes and related system Download PDF

Info

Publication number
CN116828288A
CN116828288A CN202311082504.8A CN202311082504A CN116828288A CN 116828288 A CN116828288 A CN 116828288A CN 202311082504 A CN202311082504 A CN 202311082504A CN 116828288 A CN116828288 A CN 116828288A
Authority
CN
China
Prior art keywords
inspection
scene feature
patrol
scene
components
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202311082504.8A
Other languages
Chinese (zh)
Other versions
CN116828288B (en
Inventor
张家业
彭远庆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou United Faith Intelligent Equipment Co ltd
Original Assignee
Guangzhou United Faith Intelligent Equipment Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou United Faith Intelligent Equipment Co ltd filed Critical Guangzhou United Faith Intelligent Equipment Co ltd
Priority to CN202311818865.4A priority Critical patent/CN117733881A/en
Priority to CN202311709419.XA priority patent/CN117687655A/en
Priority to CN202311082504.8A priority patent/CN116828288B/en
Publication of CN116828288A publication Critical patent/CN116828288A/en
Application granted granted Critical
Publication of CN116828288B publication Critical patent/CN116828288B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/617Upgrading or updating of programs or applications for camera control
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/20Checking timed patrols, e.g. of watchman
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Analysis (AREA)
  • Manipulator (AREA)

Abstract

The application provides a compound intelligent inspection robot capable of being applied to multiple scenes and a related system, wherein the intelligent factory inspection system comprises a background server and a plurality of compound intelligent inspection robots, a first compound intelligent inspection robot in the plurality of compound intelligent inspection robots is used for carrying out first scanning on a first inspection range in an intelligent factory by using an embedded industrial camera to obtain a first scanning video, and carrying out scene feature searching in the first scanning video by using an embedded scene feature searching firmware to obtain a first scene feature set, and sending a first expansion inspection assembly issuing request carrying the first scene feature set to the background server; and receiving a first expansion inspection component issuing response fed back by the background server, wherein the first expansion inspection component issuing response carries X1 expansion inspection components. The inspection robot provided by the application can flexibly adapt to the inspection requirements of multiple application scenes.

Description

Composite intelligent inspection robot capable of being applied to multiple scenes and related system
Technical Field
The application relates to the technical field of intelligent manufacturing, in particular to a compound intelligent inspection robot capable of being applied in multiple scenes and a related system.
Background
In the push to new industrialization, intelligent factories are increasingly deployed. The intelligent factory aims to break the process barriers, and the quality information acquisition, quality design, quality monitoring, online quality judgment, process quality tracing, quality analysis improvement and the like of the production process of the product are realized through big data, so that the online monitoring and early warning of important process parameters affecting the quality of the product can be realized. The basis of these works is to collect and digitize the production quality data scattered in each production line and each system.
The inspection robot is increasingly applied to intelligent factories, however, the current inspection robot only aims at the inspection requirement of a single application scene to carry out factory setting when the factory setting is carried out, so that the inspection robot cannot flexibly adapt to the inspection requirement of multiple application scenes.
Disclosure of Invention
The embodiment of the application provides a composite intelligent inspection robot and a related system, which are beneficial to greatly enhancing the scene adaptability of the inspection robot, and one inspection robot can flexibly adapt to the inspection requirements of a plurality of application scenes according to the needs.
The first aspect of the embodiment of the application provides a compound intelligent patrol robot capable of being applied to multiple scenes, which is applied to an intelligent factory patrol system, wherein the intelligent factory patrol system comprises a background server and a compound intelligent patrol robot cluster, the compound intelligent patrol robot cluster comprises a plurality of compound intelligent patrol robots, and each compound intelligent patrol robot in the compound intelligent patrol robot cluster is in communication connection with the background server; a patrol component base library is preset in each compound intelligent patrol robot in the compound intelligent patrol robot cluster, the patrol component base library comprises N basic patrol components (wherein, the patrol component base libraries preset in each compound intelligent patrol robot in the compound intelligent patrol robot cluster can be identical, the inspection component basic library preset in each composite intelligent inspection robot in the composite intelligent inspection robot cluster comprises N identical basic inspection components, an inspection component expansion library is stored in the background server, and M expansion inspection components are included in the inspection component expansion library; m and N are positive integers; the composite intelligent inspection robot cluster comprises a first composite intelligent inspection robot (the first composite intelligent inspection robot can be any composite intelligent inspection robot in the composite intelligent inspection robot cluster, for example).
The first compound intelligent inspection robot is used for using an industrial camera built in the first compound intelligent inspection robot to perform first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, performing scene feature searching on the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, and sending a first expansion inspection assembly issuing request carrying the first scene feature set to the background server; receiving a first expansion inspection component issuing response fed back by the background server and used for responding to the first expansion inspection component issuing request, wherein the first expansion inspection component issuing response carries X1 expansion inspection components, the X1 expansion inspection components are subsets of the M expansion inspection components, X1 is a positive integer, any one of the X1 expansion inspection components is associated with at least 1 scene feature in the first scene feature set, and any one of the first scene feature set is associated with at least 1 expansion inspection component in the X1 expansion inspection components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot.
The first compound intelligent patrol robot activates the X1 expansion patrol components and the N basic patrol components, and the X1 expansion patrol components and the N basic patrol components are activated to patrol a first patrol range in the intelligent factory.
In some possible embodiments, Y1 standard scene feature templates are built in the scene feature searching firmware, and the first composite intelligent inspection robot is specifically configured to, through the built-in scene feature searching firmware, perform scene feature searching in the first scan video by using each standard scene feature template of the Y1 standard scene feature templates, and combine the searched scene features to obtain a first scene feature set, where each scene feature in the first scene feature set is matched with at least one standard scene feature template of the Y1 standard scene feature templates.
In some possible embodiments, the first compound intelligent patrol robot is further configured to receive a scene feature search firmware upgrade instruction sent by the background server, where the scene feature search firmware upgrade instruction carries a version number of a latest version of scene feature search firmware, compare a version number of a scene feature search firmware built in the first compound intelligent patrol robot with a version number carried in the scene feature search firmware upgrade instruction, and if it is determined by comparing that the version of the scene feature search firmware built in the first compound intelligent patrol robot is not the latest version, feed back a response of the scene feature search firmware upgrade instruction to the background server, where the response of the scene feature search firmware upgrade instruction carries an upgrade packet download identifier, receive a scene feature search firmware upgrade packet sent by the background server, upgrade the scene feature search firmware built in the first compound intelligent patrol robot to the latest version of scene feature search firmware by using the scene feature search firmware upgrade packet, where Y2 features are built in the latest version of scene feature search firmware, where the scene feature search firmware is identical to the scene feature standard of the scene feature standard 2, and the scene feature standard of the latest version 2 template is identical.
In some possible embodiments, the first compound intelligent inspection robot is further configured to, when it is detected that the upgrade of the built-in scene feature searching firmware is completed, perform a second scan on a first inspection range in the intelligent factory to obtain a second scan video by using an industrial camera built in the first compound intelligent inspection robot, perform a scene feature search on the second scan video by using the built-in upgraded scene feature searching firmware to obtain a second scene feature set, compare the second scene feature set with the first scene feature set, and if at least one scene feature in the second scene feature set does not belong to the first scene feature set, send a second expansion inspection component issuing request carrying a second scene feature subset to the background server, where the second scene feature subset is a subset of the second scene feature set, and any one scene feature in the second scene feature subset does not belong to the first scene feature set; receiving a second extended patrol component issuing response fed back by the background server and used for responding to the second extended patrol component issuing request, wherein the second extended patrol component issuing response carries X2 extended patrol components, the X2 extended patrol components are subsets of the M extended patrol components, X2 is a positive integer, and any one of the X2 extended patrol components is associated with at least 1 scene feature in the second scene feature subset; any one of the second subset of scene features is associated with at least 1 of the X2 extended patrol components.
The first compound intelligent patrol robot activates the X2 expansion patrol components, and the X1 expansion patrol components, the X2 expansion patrol components and the N basic patrol components which are activated are used for patrol the first patrol range in the intelligent factory.
In some possible embodiments, the first compound intelligent patrol robot is further configured to, when it is detected that the upgrade of the built-in scene feature search firmware is completed, perform a second scan on a first patrol range in the intelligent factory to obtain a second scan video by using an industrial camera built in the first compound intelligent patrol robot, perform a scene feature search on the second scan video by using the built-in scene feature search firmware that has been upgraded to obtain a second scene feature set, and send a second extended patrol component issue request carrying the second scene feature set to the background server; receiving a second extended inspection component issuing response which is fed back by the background server and is used for responding to the second extended inspection component issuing request, wherein the second extended inspection component issuing response carries X3 extended inspection components, the X3 extended inspection components are subsets of the M extended inspection components, X3 is a positive integer, and any one of the X3 extended inspection components is associated with at least 1 scene feature in the second scene feature set; any one of the second set of scene features is associated with at least 1 of the X3 extended patrol components.
The first compound intelligent inspection robot deactivates the X1 expansion inspection components, activates the X3 expansion inspection components, and the activated X3 expansion inspection components and the N basic inspection components are used for inspecting a first inspection range in the intelligent factory.
It is to be appreciated that an inspection component (extended inspection component or base inspection component) that is in an inactive ("inactive" may also be referred to as "deactivated") may be considered to be in a dormant state or an off state, and that an extended inspection component that is in an inactive will not perform an inspection function.
In some possible embodiments, at least 1 Scene feature associated with each extended patrol component in the extended library of patrol components is recorded, wherein when the extended patrol component com1 has recorded therein Scene feature Scene-f1 associated with it, the Scene feature Scene-f1 is a proprietary Scene feature of Scene1, and the extended patrol component com1 is capable of being used for patrol of the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f2 associated with the extended patrol component com1, wherein the Scene characteristics Scene-f1 and Scene characteristics Scene-f2 are the exclusive Scene characteristics of the Scene1, and the extended patrol component com1 can be used for carrying out patrol on the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f3 associated with the extended patrol component, the Scene characteristics Scene-f1 are the exclusive Scene characteristics of the Scene1, the Scene characteristics Scene-f3 are the exclusive Scene characteristics of the Scene3, and the extended patrol component com1 can be used for carrying out patrol on the Scene1 and the Scene 3.
The second aspect of the embodiment of the application provides an intelligent factory inspection system, which can comprise a background server and a composite intelligent inspection robot cluster, wherein the composite intelligent inspection robot cluster comprises a plurality of composite intelligent inspection robots, and each composite intelligent inspection robot in the composite intelligent inspection robot cluster is in communication connection with the background server; a patrol component base library is preset in each compound intelligent patrol robot in the compound intelligent patrol robot cluster, the patrol component base library comprises N basic patrol components (the patrol component base libraries preset in each compound intelligent patrol robot in the compound intelligent patrol robot cluster can be identical, the inspection component basic library preset in each composite intelligent inspection robot in the composite intelligent inspection robot cluster comprises N identical basic inspection components, an inspection component expansion library is stored in the background server, and M expansion inspection components are included in the inspection component expansion library; wherein M and N are positive integers; the composite intelligent patrol robot cluster comprises a first composite intelligent patrol robot (the first composite intelligent patrol robot can be any one of the composite intelligent patrol robots).
The first compound intelligent inspection robot is used for using an industrial camera built in the first compound intelligent inspection robot to perform first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, performing scene feature searching on the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, and sending a first expansion inspection assembly issuing request carrying the first scene feature set to the background server.
The background server is used for receiving a first expansion inspection component issuing request from the first composite intelligent inspection robot, searching X1 expansion inspection components associated with scene features in a first scene feature set in the inspection component expansion library, and sending a first expansion inspection component issuing response for responding to the first expansion inspection component issuing request to the first composite intelligent inspection robot.
The first composite intelligent inspection robot is further used for receiving a first expansion inspection component issuing response fed back by the background server and used for responding to the first expansion inspection component issuing request, the first expansion inspection component issuing response carries X1 expansion inspection components, the X1 expansion inspection components are subsets of the M expansion inspection components, X1 is a positive integer, any one expansion inspection component in the X1 expansion inspection components is associated with at least 1 scene feature in a first scene feature set, and any one scene feature in the first scene feature set is associated with at least 1 expansion inspection component in the X1 expansion inspection components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot.
The first compound intelligent inspection robot is further used for activating the X1 expansion inspection components and the N basic inspection components, and the X1 expansion inspection components and the N basic inspection components are used for inspecting a first inspection range in the intelligent factory.
In some possible embodiments, Y1 standard scene feature templates are built in the scene feature searching firmware, and the first composite intelligent inspection robot is specifically configured to, through the built-in scene feature searching firmware, perform scene feature searching in the first scan video by using each standard scene feature template of the Y1 standard scene feature templates, and combine the searched scene features to obtain a first scene feature set, where each scene feature in the first scene feature set is matched with at least one standard scene feature template of the Y1 standard scene feature templates.
In some possible implementations, the background server is further configured to send a scene feature search firmware upgrade instruction to the first compound intelligent patrol robot.
The first compound intelligent patrol robot is further configured to receive a scene feature search firmware upgrade instruction sent by the background server, where the scene feature search firmware upgrade instruction carries a version number of a scene feature search firmware of a latest version, compare the version number of the scene feature search firmware built in the first compound intelligent patrol robot with the version number carried in the scene feature search firmware upgrade instruction, and if the version of the scene feature search firmware built in the first compound intelligent patrol robot is determined to be not the latest version by comparison, feed back a scene feature search firmware upgrade instruction response to the background server, where the scene feature search firmware upgrade instruction response carries an upgrade packet download identifier, receive a scene feature search firmware upgrade packet sent by the background server, upgrade the scene feature search firmware built in the first compound intelligent patrol robot to the scene feature search firmware of the latest version by using the scene feature search firmware upgrade packet, where Y2 scene feature templates are built in the scene feature search firmware of the latest version, and the scene feature templates of the latest version are identical in the scene feature search firmware, where the Y2 scene feature templates are identical in standard and Y standard templates.
In some possible embodiments, the first compound intelligent inspection robot is further configured to, when it is detected that the upgrade of the built-in scene feature searching firmware is completed, perform a second scan on a first inspection range in the intelligent factory to obtain a second scan video by using an industrial camera built in the first compound intelligent inspection robot, perform a scene feature search on the second scan video by using the built-in upgraded scene feature searching firmware to obtain a second scene feature set, compare the second scene feature set with the first scene feature set, and if at least one scene feature in the second scene feature set does not belong to the first scene feature set, send a second expansion inspection component issuing request carrying a second scene feature subset to the background server, where the second scene feature subset is a subset of the second scene feature set, and any one scene feature in the second scene feature subset does not belong to the first scene feature set; receiving a second extended patrol component issuing response fed back by the background server and used for responding to the second extended patrol component issuing request, wherein the second extended patrol component issuing response carries X2 extended patrol components, the X2 extended patrol components are subsets of the M extended patrol components, X2 is a positive integer, and any one of the X2 extended patrol components is associated with at least 1 scene feature in the second scene feature subset; any one of the second subset of scene features is associated with at least 1 of the X2 extended patrol components.
The first compound intelligent patrol robot activates the X2 expansion patrol components, and the X1 expansion patrol components, the X2 expansion patrol components and the N basic patrol components which are activated are used for patrol the first patrol range in the intelligent factory.
In some possible embodiments, the first compound intelligent patrol robot is further configured to, when it is detected that the upgrade of the built-in scene feature search firmware is completed, perform a second scan on a first patrol range in the intelligent factory to obtain a second scan video by using an industrial camera built in the first compound intelligent patrol robot, perform a scene feature search on the second scan video by using the built-in scene feature search firmware that has been upgraded to obtain a second scene feature set, and send a second extended patrol component issue request carrying the second scene feature set to the background server; receiving a second extended inspection component issuing response which is fed back by the background server and is used for responding to the second extended inspection component issuing request, wherein the second extended inspection component issuing response carries X3 extended inspection components, the X3 extended inspection components are subsets of the M extended inspection components, X3 is a positive integer, and any one of the X3 extended inspection components is associated with at least 1 scene feature in the second scene feature set; any one of the second set of scene features is associated with at least 1 of the X3 extended patrol components.
The first compound intelligent inspection robot deactivates the X1 expansion inspection components, activates the X3 expansion inspection components, and the activated X3 expansion inspection components and the N basic inspection components are used for inspecting a first inspection range in the intelligent factory.
In some possible embodiments, at least 1 Scene feature associated with each extended patrol component in the extended library of patrol components is recorded, when the extended patrol component com1 is recorded with a Scene feature Scene-f1 associated with it, the Scene feature Scene-f1 is a specific Scene feature of the Scene1, and the extended patrol component com1 can be used for patrol the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f2 associated with the extended patrol component com1, wherein the Scene characteristics Scene-f1 and Scene characteristics Scene-f2 are the exclusive Scene characteristics of the Scene1, and the extended patrol component com1 can be used for carrying out patrol on the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f3 associated with the extended patrol component, the Scene characteristics Scene-f1 are the exclusive Scene characteristics of the Scene1, the Scene characteristics Scene-f3 are the exclusive Scene characteristics of the Scene3, and the extended patrol component com1 can be used for carrying out patrol on the Scene1 and the Scene 3.
The third aspect of the embodiment of the application provides a compound intelligent patrol robot capable of being applied to multiple scenes, which is applied to an intelligent factory patrol system, wherein the intelligent factory patrol system comprises a background server and a compound intelligent patrol robot cluster, the compound intelligent patrol robot cluster comprises a plurality of compound intelligent patrol robots, and each compound intelligent patrol robot in the compound intelligent patrol robot cluster is in communication connection with the background server; a patrol component base library is preset in each compound intelligent patrol robot in the compound intelligent patrol robot cluster, the patrol component base library comprises N basic patrol components (wherein, the patrol component base libraries preset in each compound intelligent patrol robot in the compound intelligent patrol robot cluster can be identical, the inspection component basic library preset in each composite intelligent inspection robot in the composite intelligent inspection robot cluster comprises N identical basic inspection components, an inspection component expansion library is stored in the background server, and M expansion inspection components are included in the inspection component expansion library; m and N are positive integers; the composite intelligent inspection robot cluster comprises a first composite intelligent inspection robot (wherein the first composite intelligent inspection robot can be any composite intelligent inspection robot in the composite intelligent inspection robot cluster, for example).
Wherein, first compound intelligent inspection robot includes: the system comprises a processor, a memory, an industrial camera and a communication interface, wherein the processor, the memory, the industrial camera and the communication interface are interconnected through a bus.
The processor is used for calling the industrial camera to perform first scanning on a first inspection range in the intelligent factory to obtain a first scanning video, performing scene feature searching on the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, and calling the communication interface to send a first expansion inspection assembly issuing request carrying the first scene feature set to the background server; invoking a communication interface to receive a first expansion routing component issuing response fed back by the background server and used for responding to the first expansion routing component issuing request, wherein the first expansion routing component issuing response carries X1 expansion routing components, the X1 expansion routing components are subsets of the M expansion routing components, X1 is a positive integer, any one of the X1 expansion routing components is associated with at least 1 scene feature in a first scene feature set, and any one of the first scene feature set is associated with at least 1 expansion routing component in the X1 expansion routing components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot.
The intelligent factory comprises a processor, X1 expansion inspection components, N basic inspection components, X1 expansion inspection components and N basic inspection components, wherein the processor is further used for activating the X1 expansion inspection components and the N basic inspection components, and the X1 expansion inspection components and the N basic inspection components are used for inspecting a first inspection range in the intelligent factory.
In some possible implementations, Y1 standard scene feature templates are built in the scene feature searching firmware, and the processor is specifically configured to, through the built-in scene feature searching firmware, perform scene feature searching in the first scan video by using each standard scene feature template of the Y1 standard scene feature templates, and combine the searched scene features to obtain a first scene feature set, where each scene feature in the first scene feature set is matched with at least one standard scene feature template of the Y1 standard scene feature templates.
In some possible implementations, the processor is further configured to invoke the communication interface to receive a scene feature search firmware upgrade instruction sent by the background server, where the scene feature search firmware upgrade instruction carries a version number of a scene feature search firmware of a latest version, compare a version number of the scene feature search firmware built in the first composite intelligent patrol robot with the version number carried in the scene feature search firmware upgrade instruction, invoke the communication interface to feed back a response of the scene feature search firmware upgrade instruction to the background server if the version number of the scene feature search firmware built in the first composite intelligent patrol robot is determined to be not the latest version by comparison, invoke the communication interface to receive a scene feature search firmware upgrade packet carrying an upgrade packet download identifier, invoke the communication interface to receive the scene feature search firmware upgrade packet sent by the background server, upgrade the scene feature search firmware built in the first composite intelligent patrol robot to the scene feature search firmware of the latest version, and install Y2 scene features in the scene feature search firmware of the latest version, and the Y2 scene features of the same standard and Y standard template standard scene feature are not identical.
In some possible embodiments, the processor is further configured to, when it is detected that the built-in scene feature searching firmware is upgraded, invoke the industrial camera, perform a second scan on a first inspection range in the smart factory to obtain a second scanned video, perform a scene feature search on the second scanned video by using the built-in scene feature searching firmware that is upgraded to obtain a second scene feature set, compare the second scene feature set with the first scene feature set, and if at least one scene feature in the second scene feature set does not belong to the first scene feature set, send a second extended inspection component carrying a second subset of scene features to the background server to issue a request, where the second subset of scene features is a subset of the second scene feature set, and any one scene feature in the second subset of scene features does not belong to the first scene feature set; receiving a second extended patrol component issuing response fed back by the background server and used for responding to the second extended patrol component issuing request, wherein the second extended patrol component issuing response carries X2 extended patrol components, the X2 extended patrol components are subsets of the M extended patrol components, X2 is a positive integer, and any one of the X2 extended patrol components is associated with at least 1 scene feature in the second scene feature subset; any one of the second subset of scene features is associated with at least 1 of the X2 extended patrol components.
The processor is further configured to activate the X2 extended routing inspection assemblies, the activated X1 extended routing inspection assemblies, the X2 extended routing inspection assemblies, and the N base routing inspection assemblies are configured to route a first routing inspection range in the smart factory.
In some possible embodiments, the processor is further configured to, when it is detected that the built-in scene feature searching firmware is upgraded, perform a second scan on the first inspection range in the smart factory to obtain a second scan video by using the built-in industrial camera of the first composite intelligent inspection robot, perform scene feature searching on the second scan video by using the built-in scene feature searching firmware that is upgraded to obtain a second scene feature set, invoke a communication interface to send a request issued by a second extended inspection component carrying the second scene feature set to the background server; a communication interface is called to receive a second expansion inspection component issuing response which is fed back by the background server and is used for responding to the second expansion inspection component issuing request, wherein the second expansion inspection component issuing response carries X3 expansion inspection components, the X3 expansion inspection components are subsets of the M expansion inspection components, X3 is a positive integer, and any one expansion inspection component in the X3 expansion inspection components is associated with at least 1 scene feature in the second scene feature set; any one of the second set of scene features is associated with at least 1 of the X3 extended patrol components.
The processor is further configured to deactivate the X1 extended routing inspection components and activate the X3 extended routing inspection components, where the activated X3 extended routing inspection components and the N base routing inspection components are configured to route the first routing inspection range in the smart factory.
In some possible embodiments, at least 1 Scene feature associated with each extended patrol component in the extended library of patrol components is recorded, wherein when the extended patrol component com1 has recorded therein Scene feature Scene-f1 associated with it, the Scene feature Scene-f1 is a proprietary Scene feature of Scene1, and the extended patrol component com1 is capable of being used for patrol of the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f2 associated with the extended patrol component com1, wherein the Scene characteristics Scene-f1 and Scene characteristics Scene-f2 are the exclusive Scene characteristics of the Scene1, and the extended patrol component com1 can be used for carrying out patrol on the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f3 associated with the extended patrol component, the Scene characteristics Scene-f1 are the exclusive Scene characteristics of the Scene1, the Scene characteristics Scene-f3 are the exclusive Scene characteristics of the Scene3, and the extended patrol component com1 can be used for carrying out patrol on the Scene1 and the Scene 3.
A fourth aspect of the embodiments of the present application provides a computer storage medium storing a computer program capable of causing a compound intelligent patrol robot to perform part or all of operations performed by the first compound intelligent patrol robot in the first aspect, the second aspect, or the third aspect when the computer program is deployed in the compound intelligent patrol robot.
A fifth aspect of the embodiments of the present application provides a computer program, which, when deployed in a compound intelligent inspection robot, enables the compound intelligent inspection robot to perform part or all of the operations performed by the first compound intelligent inspection robot in the first aspect, the second aspect, or the third aspect.
According to the technical scheme, the composite intelligent inspection robot can firstly use an industrial camera built in the first composite intelligent inspection robot to perform first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, perform scene feature searching on the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, receive a first expansion inspection component issuing response which is fed back by a background server and is used for responding to a first expansion inspection component issuing request, wherein the first expansion inspection component issuing response carries X1 expansion inspection components, the X1 expansion inspection components are subsets of the M expansion inspection components, X1 is a positive integer, any one expansion inspection component in the X1 expansion inspection components is associated with at least 1 scene feature in the scene feature set, and any one scene feature in the first scene feature set is associated with at least 1 expansion inspection component in the X1 expansion inspection components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot; because the compound intelligent inspection robot can acquire corresponding expansion inspection components from the background server according to scene characteristics of a specific inspection range, the scene adaptation capacity of the inspection robot is greatly improved, and one inspection robot can flexibly adapt to inspection requirements of a plurality of application scenes as required.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an intelligent factory inspection system according to an example of the present application.
Fig. 2 is a flow chart of a configuration method of a compound intelligent inspection robot provided by an example of an embodiment of the application.
Fig. 3 is a flow chart of another configuration method of a compound intelligent inspection robot provided by an example of the embodiment of the application.
Fig. 4 is a schematic structural diagram of a composite intelligent inspection robot according to an example of the present application.
Detailed Description
In order that those skilled in the art will better understand the present application, a technical solution of an embodiment of the present application will be clearly described below with reference to the accompanying drawings in the embodiment of the present application, and it is apparent that the described embodiment is a part of the embodiment of the present application, but not all the embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden, based on some embodiments of the present application are intended to be within the scope of the present application. The terms first, second, third and the like in the description, in the claims and in the drawings, are used for distinguishing between different objects and not necessarily for describing a particular sequential or chronological order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, or article, or apparatus that comprises a list of steps or elements is not limited to only those listed but may optionally include additional steps or elements not listed or inherent to such process, method, article, or apparatus.
Referring to fig. 1, fig. 1 is a network architecture schematic diagram of an intelligent factory inspection system provided by an embodiment of the present application, as shown in fig. 1 by way of example, an intelligent factory inspection system 100, where the intelligent factory inspection system includes a background server 110 and a composite intelligent inspection robot cluster, the composite intelligent inspection robot cluster includes a plurality of composite intelligent inspection robots (in the present application, the composite intelligent inspection robot cluster may be referred to as an inspection robot cluster, and the composite intelligent inspection robot may be referred to as an inspection robot), where each composite intelligent inspection robot in the composite intelligent inspection robot cluster is communicatively connected with the background server 110; the inspection assembly base library is preset in each composite intelligent inspection robot in the composite intelligent inspection robot cluster, and each inspection assembly base library comprises N basic inspection assemblies (the inspection assembly base libraries preset in each composite intelligent inspection robot in the composite intelligent inspection robot cluster can be identical, namely, each inspection assembly base library preset in each composite intelligent inspection robot in the composite intelligent inspection robot cluster comprises N identical basic inspection assemblies). The background server stores an inspection component expansion library, wherein the inspection component expansion library comprises M expansion inspection components; m and N are positive integers; the composite intelligent patrol robot cluster includes a first composite intelligent patrol robot 121 (the first composite intelligent patrol robot may be any one of the composite intelligent patrol robots, for example).
For example, the composite intelligent patrol robot cluster may also include a second composite intelligent patrol robot and other composite intelligent patrol robots.
For example, part or all of the compound intelligent patrol robots in the compound intelligent patrol robot cluster are connected to the same wireless local area network, for example, the first compound intelligent patrol robot and the second compound intelligent patrol robot can be connected to the same wireless local area network.
For example, the first compound intelligent inspection robot is configured to use an industrial camera built in the first compound intelligent inspection robot to perform a first scan on a first inspection range in an intelligent factory to obtain a first scan video, perform a scene feature search on the first scan video through built-in scene feature search firmware to obtain a first scene feature set, and send a first extended inspection component issue request carrying the first scene feature set to the background server; receiving a first extended patrol component issuing response fed back by the background server and used for responding to the first extended patrol component issuing request, wherein the first extended patrol component issuing response carries X1 extended patrol components, the X1 extended patrol components are subsets of the M extended patrol components, X1 is a positive integer, any one of the X1 extended patrol components is associated with at least 1 scene feature in a first scene feature set, and any one of the first scene feature set is associated with at least 1 extended patrol component in the X1 extended patrol components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot.
The first compound intelligent patrol robot activates the X1 expansion patrol components and the N basic patrol components, and the X1 expansion patrol components and the N basic patrol components are activated to patrol a first patrol range in the intelligent factory.
In some possible embodiments, when 1 inspection component (the basic inspection component or the extended inspection component) is activated in the composite intelligent inspection robot, a corresponding inspection process may be run in the composite intelligent inspection robot, and the running inspection process is used for performing relevant detection analysis in the inspection process. That is, when the first composite intelligent patrol robot activates the X1 extended patrol components and the N basic patrol components, then x1+n patrol processes will run in the composite intelligent patrol robot, the x1+n patrol processes are in one-to-one correspondence with the X1 extended patrol components and the N basic patrol components, and so on.
It will be appreciated that an inspection component that is in a deactivated ("deactivated" may also be referred to as "deactivated") may be considered to be in a dormant or off state, and that an extended inspection component that is in a deactivated will not perform an inspection function, and its corresponding inspection process will also be ended.
In some possible embodiments, Y1 standard scene feature templates are built in the scene feature searching firmware, and the first composite intelligent inspection robot is specifically configured to, through the built-in scene feature searching firmware, perform scene feature searching in the first scan video by using each standard scene feature template of the Y1 standard scene feature templates, and combine the searched scene features to obtain a first scene feature set, where each scene feature in the first scene feature set is matched with at least one standard scene feature template of the Y1 standard scene feature templates.
In some possible embodiments, the first compound intelligent patrol robot is further configured to receive a scene feature search firmware upgrade instruction sent by the background server, where the scene feature search firmware upgrade instruction carries a version number of a latest version of scene feature search firmware, compare a version number of a scene feature search firmware built in the first compound intelligent patrol robot with a version number carried in the scene feature search firmware upgrade instruction, and if it is determined by comparing that the version of the scene feature search firmware built in the first compound intelligent patrol robot is not the latest version, feed back a response of the scene feature search firmware upgrade instruction to the background server, where the response of the scene feature search firmware upgrade instruction carries an upgrade packet download identifier, receive a scene feature search firmware upgrade packet sent by the background server, upgrade the scene feature search firmware built in the first compound intelligent patrol robot to the latest version of scene feature search firmware by using the scene feature search firmware upgrade packet, where Y2 features are built in the latest version of scene feature search firmware, where the scene feature search firmware is identical to the scene feature standard of the scene feature standard 2, and the scene feature standard of the latest version 2 template is identical.
In some possible embodiments, the first compound intelligent inspection robot is further configured to, when it is detected that the upgrade of the built-in scene feature searching firmware is completed, perform a second scan on a first inspection range in the intelligent factory to obtain a second scan video by using an industrial camera built in the first compound intelligent inspection robot, perform a scene feature search on the second scan video by using the built-in upgraded scene feature searching firmware to obtain a second scene feature set, compare the second scene feature set with the first scene feature set, and if at least one scene feature in the second scene feature set does not belong to the first scene feature set, send a second expansion inspection component issuing request carrying a second scene feature subset to the background server, where the second scene feature subset is a subset of the second scene feature set, and any one scene feature in the second scene feature subset does not belong to the first scene feature set; receiving a second extended inspection component issuing response fed back by the background server and used for responding to the second extended inspection component issuing request, wherein the second extended inspection component issuing response carries X2 extended inspection components, the X2 extended inspection components are subsets of the M extended inspection components, X2 is a positive integer, and any one of the X2 extended inspection components is associated with at least 1 scene feature in the second scene feature subset; any one of the second subset of scene features is associated with at least 1 of the X2 extended patrol components.
The first compound intelligent patrol robot activates the X2 expansion patrol components, and the activated X1 expansion patrol components, the X2 expansion patrol components and the N basic patrol components are used for patrol the first patrol range in the intelligent factory.
In some possible embodiments, the first compound intelligent patrol robot is further configured to, when it is detected that the upgrade of the built-in scene feature search firmware is completed, perform a second scan on a first patrol range in the intelligent factory to obtain a second scan video by using an industrial camera built in the first compound intelligent patrol robot, perform a scene feature search on the second scan video by using the built-in scene feature search firmware that has been upgraded to obtain a second scene feature set, and send a second extended patrol component issue request carrying the second scene feature set to the background server; receiving a second extended inspection component issuing response which is fed back by the background server and is used for responding to the second extended inspection component issuing request, wherein the second extended inspection component issuing response carries X3 extended inspection components, the X3 extended inspection components are subsets of the M extended inspection components, X3 is a positive integer, and any one of the X3 extended inspection components is associated with at least 1 scene feature in the second scene feature set; any one of the second set of scene features is associated with at least 1 of the X3 extended patrol components.
The first composite intelligent patrol robot deactivates the X1 expansion patrol components, activates the X3 expansion patrol components, and the activated X3 expansion patrol components and the N basic patrol components are used for patrol the first patrol range in the intelligent factory.
In some possible embodiments, at least one scene feature is recorded in an extended inspection component com1 in the inspection component extended library, and the at least one scene feature recorded in the extended inspection component com1 has an association relationship with the extended inspection component com 1. The extended inspection component com1 is any extended inspection component in the inspection component extended library.
In some possible embodiments, at least 1 Scene feature associated with each extended patrol component in the extended library of patrol components is recorded, when the extended patrol component com1 is recorded with a Scene feature Scene-f1 associated with it, the Scene feature Scene-f1 is a specific Scene feature of the Scene1, and the extended patrol component com1 can be used for patrol the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f2 associated with the extended patrol component com1, wherein the Scene characteristics Scene-f1 and Scene characteristics Scene-f2 are the exclusive Scene characteristics of the Scene1, and the extended patrol component com1 can be used for carrying out patrol on the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f3 associated with the extended patrol component, the Scene characteristics Scene-f1 are the exclusive Scene characteristics of the Scene1, the Scene characteristics Scene-f3 are the exclusive Scene characteristics of the Scene3, and the extended patrol component com1 can be used for carrying out patrol on the Scene1 and the Scene 3.
In some possible embodiments, for example, the cluster of compound intelligent patrol robots includes a first compound intelligent patrol robot and a second compound intelligent patrol robot that access the same wireless local area network. For another example, the composite intelligent patrol robot cluster includes a first composite intelligent patrol robot, a second composite intelligent patrol robot, and a third composite intelligent patrol robot that access the same wireless local area network.
The second compound intelligent inspection robot can be used for broadcasting an extended inspection component sharing request in a wireless local area network where the second compound intelligent inspection robot is located if the second compound intelligent inspection robot is detected after the second compound intelligent inspection robot is started, and simultaneously starting a sharing timer, wherein the extended inspection component sharing request carries a second inspection range of the second compound intelligent inspection robot.
The first composite intelligent inspection robot may be further configured to, when receiving an extended inspection component sharing request broadcast in the wireless local area network where the first composite intelligent inspection robot is located, compare a first inspection range with a second inspection range carried by the extended inspection component sharing request, and when a first overlapping proportion of the second inspection range in the first inspection range (the first overlapping proportion is that an area of the second inspection range falls into the first inspection range and occupies a total area of the second inspection range) exceeds a preset overlapping threshold (the preset overlapping threshold is, for example, greater than or equal to 80% or 90%), send a first extended inspection component sharing request response to the second composite intelligent inspection robot, where the first extended inspection component sharing request response may carry the first overlapping proportion and X1 extended inspection components currently activated in the first composite intelligent inspection robot.
The third composite intelligent inspection robot may be further configured to, when receiving an extended inspection component sharing request broadcasted in the wireless local area network where the third composite intelligent inspection robot is located, compare a third inspection range (an inspection range of the third composite intelligent inspection robot) with a second inspection range carried by the extended inspection component sharing request, and when a third overlapping proportion (a third overlapping proportion, that is, a proportion of the second inspection range that falls into an area of the third inspection range and occupies a total area of the second inspection range) of the second inspection range exceeds a preset overlapping threshold (a preset overlapping threshold is, for example, greater than or equal to 80% or 90%, etc.), send a third extended inspection component sharing request response to the second composite intelligent inspection robot, where the third extended inspection component sharing request response may carry the third overlapping proportion and X4 currently activated extended inspection components in the third composite intelligent inspection robot.
The second composite intelligent patrol robot can be used for acquiring X1 expansion patrol components from the first expansion patrol component sharing request response if only the first expansion patrol component sharing request response from the first composite intelligent patrol robot is received before the sharing timer arrives, and activating the X1 expansion patrol components and N basic patrol components, wherein the activated X1 expansion patrol components and N basic patrol components are used for patrol of a second patrol range in the intelligent factory.
In addition, the second composite intelligent patrol robot may be further configured to compare the magnitudes of the first overlapping proportion and the third overlapping proportion if a first extended patrol component sharing request response from the first composite intelligent patrol robot and a third extended patrol component sharing request response from the third composite intelligent patrol robot are received before the arrival of the sharing timer, and acquire X1 extended patrol components from the first extended patrol component sharing request response if the first overlapping proportion is greater than the third overlapping proportion, and activate the X1 extended patrol components and the N basic patrol components, where the activated X1 extended patrol components and the N basic patrol components are used for patrol the second patrol range in the intelligent factory; if the first overlapping proportion is smaller than the third overlapping proportion, acquiring X4 expansion inspection components from a third expansion inspection component sharing request response, activating the X4 expansion inspection components and N basic inspection components, wherein the activated X4 expansion inspection components and N basic inspection components are used for inspecting a second inspection range in the intelligent factory; if the first overlapping proportion is equal to the third overlapping proportion, comparing the sizes of X1 and X4, if X1 is greater than or equal to X4, acquiring X1 expansion inspection components from a first expansion inspection component sharing request response, activating the X1 expansion inspection components and N basic inspection components, wherein the activated X1 expansion inspection components and N basic inspection components are used for inspecting a second inspection range in the intelligent factory; if X1 is smaller than X4, X3 expansion inspection components are obtained from the sharing request response of the third expansion inspection component, the X3 expansion inspection components and N basic inspection components are activated, and the activated X3 expansion inspection components and the N basic inspection components are used for inspecting a second inspection range in the intelligent factory.
In addition, before the arrival of the sharing timer, if the sharing request response of the extended patrol component from other composite intelligent patrol robots is not received, the second composite intelligent patrol robot can use an embedded industrial camera to perform fourth scanning on a second patrol range in the intelligent factory to obtain a fourth scanning video, perform scene feature searching in the fourth scanning video through an embedded scene feature searching firmware to obtain a fourth scene feature set, and send a fourth extended patrol component issuing request carrying the fourth scene feature set to the background server; receiving a fourth extension inspection component issuing response fed back by the background server and used for responding to the fourth extension inspection component issuing request, wherein the fourth extension inspection component issuing response carries X5 extension inspection components, the X5 extension inspection components are subsets of the M extension inspection components, X5 is a positive integer, any one of the X5 extension inspection components is associated with at least 1 scene feature in a fourth scene feature set, and any one of the fourth scene feature set is associated with at least 1 extension inspection component in the X5 extension inspection components; the second inspection range is an inspection range corresponding to the second composite intelligent inspection robot.
The second compound intelligent patrol robot activates the X5 expansion patrol components and the N basic patrol components, and the X5 expansion patrol components and the N basic patrol components are activated to patrol a second patrol range in the intelligent factory.
It can be seen that the above-mentioned expansion inspection component local area network sharing mechanism is beneficial to improving the configuration efficiency of the expansion inspection component.
According to the technical scheme, the composite intelligent inspection robot can firstly use an industrial camera built in the first composite intelligent inspection robot to perform first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, perform scene feature searching on the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, receive a first expansion inspection component issuing response which is fed back by a background server and is used for responding to a first expansion inspection component issuing request, wherein the first expansion inspection component issuing response carries X1 expansion inspection components, the X1 expansion inspection components are subsets of the M expansion inspection components, X1 is a positive integer, any one expansion inspection component in the X1 expansion inspection components is associated with at least 1 scene feature in the scene feature set, and any one scene feature in the first scene feature set is associated with at least 1 expansion inspection component in the X1 expansion inspection components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot; because the compound intelligent inspection robot can acquire corresponding expansion inspection components from the background server according to scene characteristics of a specific inspection range, the scene adaptation capacity of the inspection robot is greatly improved, and one inspection robot can flexibly adapt to inspection requirements of a plurality of application scenes as required.
Referring to fig. 2, fig. 2 is a flow chart of a configuration method of a compound intelligent inspection robot according to an embodiment of the present application, and as shown in fig. 2 by way of example, the configuration method of the compound intelligent inspection robot may be applied to an intelligent factory inspection system 100, and the method may specifically include:
201. the first composite intelligent inspection robot uses an industrial camera built in the first composite intelligent inspection robot to conduct first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, conducts scene feature searching in the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, and sends a first expansion inspection assembly issuing request carrying the first scene feature set to the background server.
In some possible embodiments, Y1 standard scene feature templates are built in the scene feature searching firmware, and the first composite intelligent inspection robot is specifically configured to, through the built-in scene feature searching firmware, perform scene feature searching in the first scan video by using each standard scene feature template of the Y1 standard scene feature templates, and combine the searched scene features to obtain a first scene feature set, where each scene feature in the first scene feature set is matched with at least one standard scene feature template of the Y1 standard scene feature templates.
202. The background server receives a first expansion inspection component issuing request carrying a first scene feature set from a first composite intelligent inspection robot. And searching X1 expansion inspection components associated with the scene features in the first scene feature set in the inspection component expansion library, and sending a first expansion inspection component issuing response for responding to the first expansion inspection component issuing request to the first composite intelligent inspection robot.
203. The first composite intelligent inspection robot receives a first expansion inspection component issuing response fed back by the background server and used for responding to the first expansion inspection component issuing request, wherein the first expansion inspection component issuing response carries X1 expansion inspection components, the X1 expansion inspection components are subsets of the M expansion inspection components, X1 is a positive integer, any one of the X1 expansion inspection components is associated with at least 1 scene feature in a first scene feature set, and any one of the first scene feature set is associated with at least 1 expansion inspection component in the X1 expansion inspection components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot.
The first compound intelligent patrol robot activates the X1 expansion patrol components and the N basic patrol components, and the X1 expansion patrol components and the N basic patrol components are activated to patrol a first patrol range in the intelligent factory.
204. When the background server detects newly written scene feature searching firmware in a scene feature searching firmware cache area (the scene feature searching firmware cache area is used for caching scene feature searching firmware, one or more scene feature searching firmware can be cached in the scene feature searching firmware cache area), and the newly written scene feature searching firmware is the scene feature searching firmware of the latest version in the scene feature searching firmware cache area, the background server sends a scene feature searching firmware upgrading instruction to the first composite intelligent patrol robot, and the scene feature searching firmware upgrading instruction carries the version number of the scene feature searching firmware of the latest version in the scene feature searching firmware cache area.
205. The method comprises the steps that a first compound intelligent patrol robot receives a scene feature searching firmware upgrading instruction sent by a background server, the version number of scene feature searching firmware built in the first compound intelligent patrol robot is compared with the version number carried in the scene feature searching firmware upgrading instruction, if the version of the scene feature searching firmware built in the first compound intelligent patrol robot is determined not to be the latest version through comparison, a scene feature searching firmware upgrading instruction response is fed back to the background server, the scene feature searching firmware upgrading instruction response carries an upgrading packet downloading identifier, and the upgrading packet downloading identifier is used for indicating a scene feature searching firmware of the latest version cached in a scene feature searching firmware cache area of the background server to be requested to be downloaded.
206. The background server receives a scene feature searching firmware upgrading instruction response from the first compound intelligent inspection robot, and the background server sends a scene feature searching firmware upgrading packet to the first compound intelligent inspection robot.
207. The method comprises the steps that a first compound intelligent inspection robot receives a scene feature searching firmware upgrading packet sent by a background server, the scene feature searching firmware upgrading packet is used for upgrading scene feature searching firmware built in the first compound intelligent inspection robot into scene feature searching firmware of the latest version, Y2 standard scene feature templates are built in the scene feature searching firmware of the latest version, and the Y1 standard scene feature templates are not identical with the Y2 standard scene feature templates.
208. When the built-in scene feature searching firmware is detected to be upgraded, the first compound intelligent inspection robot uses an industrial camera built in the first compound intelligent inspection robot to conduct second scanning on a first inspection range in an intelligent factory to obtain a second scanning video, conducts scene feature searching on the second scanning video through the built-in scene feature searching firmware which is upgraded to obtain a second scene feature set, compares the second scene feature set with the first scene feature set, and sends a request to the background server if at least one scene feature in the second scene feature set does not belong to the first scene feature set, wherein the second scene feature subset is a subset of the second scene feature set, and any scene feature in the second scene feature subset does not belong to the first scene feature set.
209. The background server receives a request issued by a second expansion inspection component carrying a second scene feature subset from the first composite intelligent inspection robot. And searching X2 expansion inspection components associated with scene features in a second scene feature subset in the inspection component expansion library, and sending a second expansion inspection component issuing response for responding to the second expansion inspection component issuing request to the first composite intelligent inspection robot.
210. The first composite intelligent inspection robot receives a second extension inspection component issuing response fed back by the background server and used for responding to the second extension inspection component issuing request, wherein the second extension inspection component issuing response carries X2 extension inspection components, the X2 extension inspection components are subsets of the M extension inspection components, X2 is a positive integer, and any one of the X2 extension inspection components is associated with at least 1 scene feature in the second scene feature subset; any one of the second subset of scene features is associated with at least 1 of the X2 extended patrol components.
The first compound intelligent patrol robot activates the X2 expansion patrol components, and the X1 expansion patrol components, the X2 expansion patrol components and the N basic patrol components which are activated are used for patrol the first patrol range in the intelligent factory.
According to the technical scheme, the composite intelligent inspection robot can firstly use an industrial camera built in the first composite intelligent inspection robot to perform first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, perform scene feature searching on the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, receive a first expansion inspection component issuing response which is fed back by a background server and is used for responding to a first expansion inspection component issuing request, wherein the first expansion inspection component issuing response carries X1 expansion inspection components, the X1 expansion inspection components are subsets of the M expansion inspection components, X1 is a positive integer, any one expansion inspection component in the X1 expansion inspection components is associated with at least 1 scene feature in the scene feature set, and any one scene feature in the first scene feature set is associated with at least 1 expansion inspection component in the X1 expansion inspection components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot; because the compound intelligent inspection robot can acquire corresponding expansion inspection components from the background server according to scene characteristics of a specific inspection range, the scene adaptation capacity of the inspection robot is greatly improved, and one inspection robot can flexibly adapt to inspection requirements of a plurality of application scenes as required.
Referring to fig. 3, fig. 3 is a flow chart of another configuration method of a compound intelligent inspection robot provided in an embodiment of the present application, and as shown in fig. 3 by way of example, the configuration method of the compound intelligent inspection robot may be applied to the intelligent factory inspection system 100, and the method may specifically include:
301. the first composite intelligent inspection robot uses an industrial camera built in the first composite intelligent inspection robot to conduct first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, conducts scene feature searching in the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, and sends a first expansion inspection assembly issuing request carrying the first scene feature set to the background server.
In some possible embodiments, Y1 standard scene feature templates are built in the scene feature searching firmware, and the first composite intelligent inspection robot is specifically configured to, through the built-in scene feature searching firmware, perform scene feature searching in the first scan video by using each standard scene feature template of the Y1 standard scene feature templates, and combine the searched scene features to obtain a first scene feature set, where each scene feature in the first scene feature set is matched with at least one standard scene feature template of the Y1 standard scene feature templates.
302. The background server receives a first expansion inspection component issuing request carrying a first scene feature set from a first composite intelligent inspection robot. And searching X1 expansion inspection components associated with the scene features in the first scene feature set in the inspection component expansion library, and sending a first expansion inspection component issuing response for responding to the first expansion inspection component issuing request to the first composite intelligent inspection robot.
303. The first composite intelligent inspection robot receives a first expansion inspection component issuing response fed back by the background server and used for responding to the first expansion inspection component issuing request, wherein the first expansion inspection component issuing response carries X1 expansion inspection components, the X1 expansion inspection components are subsets of the M expansion inspection components, X1 is a positive integer, any one of the X1 expansion inspection components is associated with at least 1 scene feature in a first scene feature set, and any one of the first scene feature set is associated with at least 1 expansion inspection component in the X1 expansion inspection components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot.
The first compound intelligent patrol robot activates the X1 expansion patrol components and the N basic patrol components, and the X1 expansion patrol components and the N basic patrol components are activated to patrol a first patrol range in the intelligent factory.
304. When the background server detects newly written scene feature searching firmware in a scene feature searching firmware cache area (the scene feature searching firmware cache area is used for caching scene feature searching firmware, one or more scene feature searching firmware can be cached in the scene feature searching firmware cache area), and the newly written scene feature searching firmware is the scene feature searching firmware of the latest version in the scene feature searching firmware cache area, the background server sends a scene feature searching firmware upgrading instruction to the first composite intelligent patrol robot, and the scene feature searching firmware upgrading instruction carries the version number of the scene feature searching firmware of the latest version in the scene feature searching firmware cache area.
305. The method comprises the steps that a first compound intelligent patrol robot receives a scene feature searching firmware upgrading instruction sent by a background server, the version number of scene feature searching firmware built in the first compound intelligent patrol robot is compared with the version number carried in the scene feature searching firmware upgrading instruction, if the version of the scene feature searching firmware built in the first compound intelligent patrol robot is determined not to be the latest version through comparison, a scene feature searching firmware upgrading instruction response is fed back to the background server, the scene feature searching firmware upgrading instruction response carries an upgrading packet downloading identifier, and the upgrading packet downloading identifier is used for indicating a scene feature searching firmware of the latest version cached in a scene feature searching firmware cache area of the background server to be requested to be downloaded.
306. The background server receives a scene feature searching firmware upgrading instruction response from the first compound intelligent inspection robot, and the background server sends a scene feature searching firmware upgrading packet to the first compound intelligent inspection robot.
307. The method comprises the steps that a first compound intelligent inspection robot receives a scene feature searching firmware upgrading packet sent by a background server, the scene feature searching firmware upgrading packet is used for upgrading scene feature searching firmware built in the first compound intelligent inspection robot into scene feature searching firmware of the latest version, Y2 standard scene feature templates are built in the scene feature searching firmware of the latest version, and the Y1 standard scene feature templates are not identical with the Y2 standard scene feature templates.
308. When the built-in scene feature searching firmware is detected to be updated, the first compound intelligent inspection robot uses an industrial camera built in the first compound intelligent inspection robot to conduct second scanning on a first inspection range in an intelligent factory to obtain a second scanning video, scene feature searching is conducted in the second scanning video through the built-in scene feature searching firmware after being updated to obtain a second scene feature set, and a second expansion inspection assembly sending request carrying the second scene feature set is sent to the background server.
309. The background server receives a request issued by a second expansion inspection component carrying a second scene feature set from the first composite intelligent inspection robot. And searching X3 expansion inspection components associated with the scene features in the second scene feature set in the inspection component expansion library, and sending a second expansion inspection component issuing response for responding to the second expansion inspection component issuing request to the first composite intelligent inspection robot.
310. The first composite intelligent inspection robot receives a second extended inspection component issuing response which is fed back by the background server and is used for responding to the second extended inspection component issuing request, wherein the second extended inspection component issuing response carries X3 extended inspection components, the X3 extended inspection components are subsets of the M extended inspection components, X3 is a positive integer, and any one of the X3 extended inspection components is associated with at least 1 scene feature in the second scene feature set; any one of the second set of scene features is associated with at least 1 of the X3 extended patrol components.
The first compound intelligent inspection robot deactivates the X1 expansion inspection components, activates the X3 expansion inspection components, and the activated X3 expansion inspection components and the N basic inspection components are used for inspecting a first inspection range in the intelligent factory.
According to the technical scheme, the composite intelligent inspection robot can firstly use an industrial camera built in the first composite intelligent inspection robot to perform first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, perform scene feature searching on the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, receive a first expansion inspection component issuing response which is fed back by a background server and is used for responding to a first expansion inspection component issuing request, wherein the first expansion inspection component issuing response carries X1 expansion inspection components, the X1 expansion inspection components are subsets of the M expansion inspection components, X1 is a positive integer, any one expansion inspection component in the X1 expansion inspection components is associated with at least 1 scene feature in the scene feature set, and any one scene feature in the first scene feature set is associated with at least 1 expansion inspection component in the X1 expansion inspection components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot; because the compound intelligent inspection robot can acquire corresponding expansion inspection components from the background server according to scene characteristics of a specific inspection range, the scene adaptation capacity of the inspection robot is greatly improved, and one inspection robot can flexibly adapt to inspection requirements of a plurality of application scenes as required.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a compound intelligent inspection robot applicable to multiple scenes, where the compound intelligent inspection robot can be applied to an intelligent factory inspection system, the intelligent factory inspection system includes a background server and a compound intelligent inspection robot cluster, the compound intelligent inspection robot cluster includes multiple compound intelligent inspection robots, and each compound intelligent inspection robot in the compound intelligent inspection robot cluster is in communication connection with the background server; the inspection device comprises a background server, wherein each composite intelligent inspection robot in a composite intelligent inspection robot cluster is preset with an inspection component base library, each inspection component base library comprises N basic inspection components (the inspection component base libraries preset in each composite intelligent inspection robot in the composite intelligent inspection robot cluster can be identical, namely, each inspection component base library preset in each composite intelligent inspection robot in the composite intelligent inspection robot cluster comprises N identical basic inspection components), and an inspection component expansion library is stored in the background server and comprises M expansion inspection components; m and N are positive integers; wherein the composite intelligent patrol robot cluster includes a first composite intelligent patrol robot 121 (wherein the first composite intelligent patrol robot may be any one of the composite intelligent patrol robots, for example).
The first compound intelligent patrol robot 121 includes: the processor 1211, memory 1212, industrial camera 1214, and communication interface 1213, and the processor 1211, memory 1212, industrial camera 1214, and communication interface 1213 may be interconnected by a bus.
The processor is used for calling the industrial camera to perform first scanning on a first inspection range in the intelligent factory to obtain a first scanning video, performing scene feature searching on the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, and calling the communication interface to send a first expansion inspection assembly issuing request carrying the first scene feature set to the background server; invoking a communication interface to receive a first expansion routing component issuing response fed back by the background server and used for responding to the first expansion routing component issuing request, wherein the first expansion routing component issuing response carries X1 expansion routing components, the X1 expansion routing components are subsets of the M expansion routing components, X1 is a positive integer, any one of the X1 expansion routing components is associated with at least 1 scene feature in the scene feature set, and any one of the first scene feature set is associated with at least 1 expansion routing component in the X1 expansion routing components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot.
The intelligent factory comprises a processor, X1 expansion inspection components, N basic inspection components, X1 expansion inspection components and N basic inspection components, wherein the processor is further used for activating the X1 expansion inspection components and the N basic inspection components, and the X1 expansion inspection components and the N basic inspection components are used for inspecting a first inspection range in the intelligent factory.
In some possible implementations, Y1 standard scene feature templates are built in the scene feature searching firmware, and the processor is specifically configured to, through the built-in scene feature searching firmware, perform scene feature searching in the first scan video by using each standard scene feature template of the Y1 standard scene feature templates, and combine the searched scene features to obtain a first scene feature set, where each scene feature in the first scene feature set is matched with at least one standard scene feature template of the Y1 standard scene feature templates.
In some possible implementations, the processor is further configured to invoke the communication interface to receive a scene feature search firmware upgrade instruction sent by the background server, where the scene feature search firmware upgrade instruction carries a version number of a scene feature search firmware of a latest version, compare a version number of the scene feature search firmware built in the first composite intelligent patrol robot with the version number carried in the scene feature search firmware upgrade instruction, invoke the communication interface to feed back a response of the scene feature search firmware upgrade instruction to the background server if the version number of the scene feature search firmware built in the first composite intelligent patrol robot is determined to be not the latest version by comparison, invoke the communication interface to receive a scene feature search firmware upgrade packet carrying an upgrade packet download identifier, invoke the communication interface to receive the scene feature search firmware upgrade packet sent by the background server, upgrade the scene feature search firmware built in the first composite intelligent patrol robot to the scene feature search firmware of the latest version, and install Y2 scene features in the scene feature search firmware of the latest version, and the Y2 scene features of the same standard and Y standard template standard scene feature are not identical.
In some possible embodiments, the processor is further configured to, when it is detected that the built-in scene feature searching firmware is upgraded, invoke the industrial camera, perform a second scan on a first inspection range in the smart factory to obtain a second scanned video, perform a scene feature search on the second scanned video by using the built-in scene feature searching firmware that is upgraded to obtain a second scene feature set, compare the second scene feature set with the first scene feature set, and if at least one scene feature in the second scene feature set does not belong to the first scene feature set, send a second extended inspection component carrying a second subset of scene features to the background server to issue a request, where the second subset of scene features is a subset of the second scene feature set, and any one scene feature in the second subset of scene features does not belong to the first scene feature set; receiving a second extended patrol component issuing response fed back by the background server and used for responding to the second extended patrol component issuing request, wherein the second extended patrol component issuing response carries X2 extended patrol components, the X2 extended patrol components are subsets of the M extended patrol components, X2 is a positive integer, and any one of the X2 extended patrol components is associated with at least 1 scene feature in the second scene feature subset; any one of the second subset of scene features is associated with at least 1 of the X2 extended patrol components.
The processor is further configured to activate the X2 extended routing inspection assemblies, the activated X1 extended routing inspection assemblies, the X2 extended routing inspection assemblies, and the N base routing inspection assemblies are configured to route a first routing inspection range in the smart factory.
In some possible embodiments, the processor is further configured to, when it is detected that the built-in scene feature searching firmware is upgraded, perform a second scan on the first inspection range in the smart factory to obtain a second scan video by using the built-in industrial camera of the first composite intelligent inspection robot, perform scene feature searching on the second scan video by using the built-in scene feature searching firmware that is upgraded to obtain a second scene feature set, invoke a communication interface to send a request issued by a second extended inspection component carrying the second scene feature set to the background server; a communication interface is called to receive a second expansion inspection component issuing response which is fed back by the background server and is used for responding to the second expansion inspection component issuing request, wherein the second expansion inspection component issuing response carries X3 expansion inspection components, the X3 expansion inspection components are subsets of the M expansion inspection components, X3 is a positive integer, and any one expansion inspection component in the X3 expansion inspection components is associated with at least 1 scene feature in the second scene feature set; any one of the second set of scene features is associated with at least 1 of the X3 extended patrol components.
The processor is further configured to deactivate the X1 extended routing inspection components and activate the X3 extended routing inspection components, where the activated X3 extended routing inspection components and the N base routing inspection components are configured to route the first routing inspection range in the smart factory.
In some possible embodiments, at least 1 Scene feature associated with each extended patrol component in the extended library of patrol components is recorded, wherein when the extended patrol component com1 has recorded therein Scene feature Scene-f1 associated with it, the Scene feature Scene-f1 is a proprietary Scene feature of Scene1, and the extended patrol component com1 is capable of being used for patrol of the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f2 associated with the extended patrol component com1, wherein the Scene characteristics Scene-f1 and Scene characteristics Scene-f2 are the exclusive Scene characteristics of the Scene1, and the extended patrol component com1 can be used for carrying out patrol on the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f3 associated with the extended patrol component, the Scene characteristics Scene-f1 are the exclusive Scene characteristics of the Scene1, the Scene characteristics Scene-f3 are the exclusive Scene characteristics of the Scene3, and the extended patrol component com1 can be used for carrying out patrol on the Scene1 and the Scene 3.
The embodiment of the application also provides a computer storage medium, wherein the computer storage medium stores a computer program, and when the computer program is deployed in the compound intelligent inspection robot, the compound intelligent inspection robot can execute part or all of operations executed by the first compound intelligent inspection robot, the second compound intelligent inspection robot or the third compound intelligent inspection robot in the embodiment.
The embodiment of the application also provides a computer program, when the computer program is deployed in the compound intelligent inspection robot, the compound intelligent inspection robot can execute part or all of the operations executed by the first compound intelligent inspection robot, the second compound intelligent inspection robot or the third compound intelligent inspection robot in the embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It will be apparent to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above described system, apparatus and unit etc. may refer to corresponding procedures in the foregoing method or other embodiments, and are not repeated herein.
For convenience and brevity, the method embodiments may also be referred to by mutual reference, and will not be described in detail. In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, such as the division of the units, merely a logical function division, and there may be additional divisions in actual implementation, such as multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (e.g. a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.
The foregoing is merely illustrative of some embodiments of the present application, and the scope of the present application is not limited thereto, and any person skilled in the art can easily think about variations or substitutions within the scope of the present application. The protection scope of the application shall therefore be subject to the claims.

Claims (10)

1. But compound intelligent inspection robot of many scene applications, its characterized in that is applied to intelligent mill inspection system, wherein, intelligent mill inspection system includes: the intelligent inspection system comprises a background server and a composite intelligent inspection robot cluster, wherein the composite intelligent inspection robot cluster comprises a plurality of composite intelligent inspection robots, and each composite intelligent inspection robot in the composite intelligent inspection robot cluster is in communication connection with the background server; a patrol component basic library is preset in each composite intelligent patrol robot in the composite intelligent patrol robot cluster, the patrol component basic library comprises N basic patrol components, a patrol component expansion library is stored in the background server, and M expansion patrol components are included in the patrol component expansion library; m and N are positive integers; the composite intelligent inspection robot cluster comprises a first composite intelligent inspection robot;
Wherein,,
the first compound intelligent inspection robot is used for using an industrial camera built in the first compound intelligent inspection robot to perform first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, performing scene feature searching in the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, and sending a first expansion inspection assembly issuing request carrying the first scene feature set to the background server; receiving a first extended patrol component issuing response fed back by the background server and used for responding to the first extended patrol component issuing request, wherein the first extended patrol component issuing response carries X1 extended patrol components, the X1 extended patrol components are subsets of the M extended patrol components, X1 is a positive integer, any one of the X1 extended patrol components is associated with at least 1 scene feature in the first scene feature set, and any one of the first scene feature set is associated with at least 1 extended patrol component in the X1 extended patrol components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot;
The first compound intelligent patrol robot activates the X1 expansion patrol components and the N basic patrol components, and the X1 expansion patrol components and the N basic patrol components are activated to patrol a first patrol range in the intelligent factory.
2. The composite intelligent inspection robot according to claim 1, wherein Y1 standard scene feature templates are built in the scene feature searching firmware, the first composite intelligent inspection robot is specifically configured to, through the built-in scene feature searching firmware, perform scene feature searching in the first scan video by using each standard scene feature template of the Y1 standard scene feature templates, and combine the searched scene features to obtain a first scene feature set, where each scene feature in the first scene feature set is matched with at least one standard scene feature template of the Y1 standard scene feature templates.
3. The composite intelligent patrol robot according to claim 2, wherein the first composite intelligent patrol robot is further configured to receive a scene feature search firmware upgrade instruction sent by the background server, where the scene feature search firmware upgrade instruction carries a version number of a latest version of scene feature search firmware; comparing the version number of the scene feature searching firmware built in the first compound intelligent patrol robot with the version number carried in the scene feature searching firmware upgrading instruction, and if the version of the scene feature searching firmware built in the first compound intelligent patrol robot is determined to be not the latest version by comparison, feeding back a scene feature searching firmware upgrading instruction response to the background server, receiving a scene feature searching firmware upgrading packet sent by the background server, and upgrading the scene feature searching firmware built in the first compound intelligent patrol robot into the scene feature searching firmware of the latest version by using the scene feature searching firmware upgrading packet, wherein Y2 standard scene feature templates are built in the scene feature searching firmware of the latest version, and the Y1 standard scene feature templates and the Y2 standard scene feature templates are not identical.
4. The composite intelligent inspection robot according to claim 3, wherein,
the first compound intelligent inspection robot is further used for performing second scanning on a first inspection range in an intelligent factory by using an industrial camera built in the first compound intelligent inspection robot when the completion of the upgrading of built-in scene feature searching firmware is detected, so as to obtain a second scanning video, performing scene feature searching on the second scanning video by the built-in scene feature searching firmware after the completion of the upgrading so as to obtain a second scene feature set, comparing the second scene feature set with the first scene feature set, and sending a second expansion inspection assembly issuing request carrying a second scene feature subset to the background server if at least one scene feature in the second scene feature set does not belong to the first scene feature set, wherein the second scene feature subset is a subset of the second scene feature set, and any one scene feature in the second scene feature subset does not belong to the first scene feature set; receiving a second extended patrol component issuing response fed back by the background server and used for responding to the second extended patrol component issuing request, wherein the second extended patrol component issuing response carries X2 extended patrol components, the X2 extended patrol components are subsets of the M extended patrol components, X2 is a positive integer, and any one of the X2 extended patrol components is associated with at least 1 scene feature in the second scene feature subset; any one scene feature in the second scene feature subset is associated with at least 1 expansion patrol component in the X2 expansion patrol components;
The first compound intelligent patrol robot activates the X2 expansion patrol components, and the X1 expansion patrol components, the X2 expansion patrol components and the N basic patrol components which are activated are used for patrol the first patrol range in the intelligent factory.
5. The composite intelligent inspection robot according to claim 3, wherein,
the first composite intelligent inspection robot is further used for performing second scanning on a first inspection range in an intelligent factory by using an industrial camera built in the first composite intelligent inspection robot when the completion of the upgrading of the built-in scene feature searching firmware is detected, so as to obtain a second scanning video, performing scene feature searching on the second scanning video by the built-in scene feature searching firmware after the upgrading is completed, so as to obtain a second scene feature set, and sending a second expansion inspection assembly issuing request carrying the second scene feature set to the background server; receiving a second extended inspection component issuing response which is fed back by the background server and is used for responding to the second extended inspection component issuing request, wherein the second extended inspection component issuing response carries X3 extended inspection components, the X3 extended inspection components are subsets of the M extended inspection components, X3 is a positive integer, and any one of the X3 extended inspection components is associated with at least 1 scene feature in the second scene feature set; any one scene feature in the second scene feature set is associated with at least 1 expansion patrol component in the X3 expansion patrol components;
The first compound intelligent inspection robot deactivates the X1 expansion inspection components, activates the X3 expansion inspection components, and the activated X3 expansion inspection components and the N basic inspection components are used for inspecting a first inspection range in the intelligent factory.
6. The composite intelligent patrol robot according to any one of claim 1 to 5, wherein,
at least 1 Scene characteristic associated with each expansion inspection component in the inspection component expansion library is recorded in each expansion inspection component, wherein when the Scene characteristic Scene-f1 associated with each expansion inspection component com1 is recorded in each expansion inspection component com1, the Scene characteristic Scene-f1 is a proprietary Scene characteristic of the Scene1, and the expansion inspection component com1 can be used for inspecting the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f2 associated with the extended patrol component com1, wherein the Scene characteristics Scene-f1 and Scene characteristics Scene-f2 are the exclusive Scene characteristics of the Scene1, and the extended patrol component com1 can be used for carrying out patrol on the Scene 1; or when the extended patrol component com1 records Scene characteristics Scene-f1 and Scene characteristics Scene-f3 associated with the extended patrol component, the Scene characteristics Scene-f1 are the exclusive Scene characteristics of the Scene1, the Scene characteristics Scene-f3 are the exclusive Scene characteristics of the Scene3, and the extended patrol component com1 can be used for carrying out patrol on the Scene1 and the Scene 3.
7. The intelligent factory inspection system is characterized by comprising a background server and a composite intelligent inspection robot cluster, wherein the composite intelligent inspection robot cluster comprises a plurality of composite intelligent inspection robots, and each composite intelligent inspection robot in the composite intelligent inspection robot cluster is in communication connection with the background server; a patrol component basic library is preset in each composite intelligent patrol robot in the composite intelligent patrol robot cluster, the patrol component basic library comprises N basic patrol components, a patrol component expansion library is stored in the background server, and M expansion patrol components are included in the patrol component expansion library; m and N are positive integers; the composite intelligent inspection robot cluster comprises a first composite intelligent inspection robot;
wherein,,
the first compound intelligent inspection robot is used for using an industrial camera built in the first compound intelligent inspection robot to perform first scanning on a first inspection range in an intelligent factory to obtain a first scanning video, performing scene feature searching in the first scanning video through built-in scene feature searching firmware to obtain a first scene feature set, and sending a first expansion inspection assembly issuing request carrying the first scene feature set to the background server;
The background server is used for receiving a first expansion inspection component issuing request from the first composite intelligent inspection robot, searching X1 expansion inspection components associated with scene features in a first scene feature set in the inspection component expansion library, and sending a first expansion inspection component issuing response for responding to the first expansion inspection component issuing request to the first composite intelligent inspection robot;
the first composite intelligent inspection robot is further configured to receive a first extended inspection component issuing response fed back by the background server and used for responding to the first extended inspection component issuing request, wherein the first extended inspection component issuing response carries X1 extended inspection components, the X1 extended inspection components are subsets of the M extended inspection components, X1 is a positive integer, any one of the X1 extended inspection components is associated with at least 1 scene feature in the first scene feature set, and any one of the first scene feature set is associated with at least 1 extended inspection component in the X1 extended inspection components; the first inspection range is an inspection range corresponding to the first composite intelligent inspection robot;
The first compound intelligent inspection robot is further used for activating the X1 expansion inspection components and the N basic inspection components, and the X1 expansion inspection components and the N basic inspection components are used for inspecting a first inspection range in the intelligent factory.
8. The intelligent factory inspection system according to claim 7, wherein Y1 standard scene feature templates are built in the scene feature searching firmware, the first composite intelligent inspection robot is specifically configured to perform scene feature searching in the first scan video by using each standard scene feature template of the Y1 standard scene feature templates through the built-in scene feature searching firmware, and combine the searched scene features to obtain a first scene feature set, wherein each scene feature in the first scene feature set is matched with at least one standard scene feature template of the Y1 standard scene feature templates.
9. The intelligent factory inspection system of claim 8, wherein,
the background server is also used for sending a scene characteristic searching firmware upgrading instruction to the first compound intelligent patrol robot;
The first compound intelligent patrol robot is further configured to receive a scene feature search firmware upgrade instruction sent by the background server, where the scene feature search firmware upgrade instruction carries a version number of a scene feature search firmware of a latest version, compare the version number of the scene feature search firmware built in the first compound intelligent patrol robot with the version number carried in the scene feature search firmware upgrade instruction, and if the version of the scene feature search firmware built in the first compound intelligent patrol robot is determined to be not the latest version by comparison, feed back a scene feature search firmware upgrade instruction response to the background server, where the scene feature search firmware upgrade instruction response carries an upgrade packet download identifier, receive a scene feature search firmware upgrade packet sent by the background server, upgrade the scene feature search firmware built in the first compound intelligent patrol robot to the scene feature search firmware of the latest version by using the scene feature search firmware upgrade packet, where Y2 scene feature templates are built in the scene feature search firmware of the latest version, and the scene feature templates of the latest version are identical in the scene feature search firmware, where the Y2 scene feature templates are identical in standard and Y standard templates.
10. The intelligent factory inspection system of claim 9, wherein,
the first compound intelligent inspection robot is further used for performing second scanning on a first inspection range in an intelligent factory by using an industrial camera built in the first compound intelligent inspection robot when the completion of the upgrading of built-in scene feature searching firmware is detected, so as to obtain a second scanning video, performing scene feature searching on the second scanning video by the built-in scene feature searching firmware after the completion of the upgrading so as to obtain a second scene feature set, comparing the second scene feature set with the first scene feature set, and sending a second expansion inspection assembly issuing request carrying a second scene feature subset to the background server if at least one scene feature in the second scene feature set does not belong to the first scene feature set, wherein the second scene feature subset is a subset of the second scene feature set, and any one scene feature in the second scene feature subset does not belong to the first scene feature set; receiving a second extended patrol component issuing response fed back by the background server and used for responding to the second extended patrol component issuing request, wherein the second extended patrol component issuing response carries X2 extended patrol components, the X2 extended patrol components are subsets of the M extended patrol components, X2 is a positive integer, and any one of the X2 extended patrol components is associated with at least 1 scene feature in the second scene feature subset; any one scene feature in the second scene feature subset is associated with at least 1 expansion patrol component in the X2 expansion patrol components;
The first compound intelligent patrol robot activates the X2 expansion patrol components, and the X1 expansion patrol components, the X2 expansion patrol components and the N basic patrol components which are activated are used for patrol the first patrol range in the intelligent factory.
CN202311082504.8A 2023-08-28 2023-08-28 Composite intelligent inspection robot capable of being applied to multiple scenes and related system Active CN116828288B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202311818865.4A CN117733881A (en) 2023-08-28 2023-08-28 Configuration method of inspection robot, inspection robot and medium program
CN202311709419.XA CN117687655A (en) 2023-08-28 2023-08-28 Patrol robot upgrading management method, patrol robot and medium program
CN202311082504.8A CN116828288B (en) 2023-08-28 2023-08-28 Composite intelligent inspection robot capable of being applied to multiple scenes and related system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311082504.8A CN116828288B (en) 2023-08-28 2023-08-28 Composite intelligent inspection robot capable of being applied to multiple scenes and related system

Related Child Applications (2)

Application Number Title Priority Date Filing Date
CN202311709419.XA Division CN117687655A (en) 2023-08-28 2023-08-28 Patrol robot upgrading management method, patrol robot and medium program
CN202311818865.4A Division CN117733881A (en) 2023-08-28 2023-08-28 Configuration method of inspection robot, inspection robot and medium program

Publications (2)

Publication Number Publication Date
CN116828288A true CN116828288A (en) 2023-09-29
CN116828288B CN116828288B (en) 2024-01-02

Family

ID=88127754

Family Applications (3)

Application Number Title Priority Date Filing Date
CN202311709419.XA Pending CN117687655A (en) 2023-08-28 2023-08-28 Patrol robot upgrading management method, patrol robot and medium program
CN202311818865.4A Pending CN117733881A (en) 2023-08-28 2023-08-28 Configuration method of inspection robot, inspection robot and medium program
CN202311082504.8A Active CN116828288B (en) 2023-08-28 2023-08-28 Composite intelligent inspection robot capable of being applied to multiple scenes and related system

Family Applications Before (2)

Application Number Title Priority Date Filing Date
CN202311709419.XA Pending CN117687655A (en) 2023-08-28 2023-08-28 Patrol robot upgrading management method, patrol robot and medium program
CN202311818865.4A Pending CN117733881A (en) 2023-08-28 2023-08-28 Configuration method of inspection robot, inspection robot and medium program

Country Status (1)

Country Link
CN (3) CN117687655A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117056570A (en) * 2023-10-12 2023-11-14 广州信邦智能装备股份有限公司 Robot inspection data processing method and related system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004220208A (en) * 2003-01-10 2004-08-05 Yamaha Corp Basic program and recording medium capable of easily switching program environment
US20140200963A1 (en) * 2006-03-17 2014-07-17 Raj Abhyanker Neighborhood polling in a geo-spatial environment
CN107139211A (en) * 2017-05-26 2017-09-08 上海思依暄机器人科技股份有限公司 The cost recovery control method and device of a kind of domestic robot
CN110798654A (en) * 2018-08-01 2020-02-14 华为技术有限公司 Method and system for defining camera by software and camera
CN112748734A (en) * 2020-12-18 2021-05-04 河北润忆安全技术服务有限公司 Self-adaptive inspection method and inspection system
CN114783188A (en) * 2022-05-17 2022-07-22 阿波罗智联(北京)科技有限公司 Inspection method and device
CN115862177A (en) * 2022-11-24 2023-03-28 浙江中控技术股份有限公司 Equipment inspection method and device
CN116226204A (en) * 2021-11-29 2023-06-06 新智我来网络科技有限公司 Scene determination method, device, equipment and storage medium based on joint learning platform
CN116600260A (en) * 2023-05-22 2023-08-15 中国长江三峡集团有限公司 Intelligent operation and maintenance management system of data center based on inspection robot

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105653299A (en) * 2014-11-12 2016-06-08 杭州华三通信技术有限公司 Firmware upgrade method device
CN108764134A (en) * 2018-05-28 2018-11-06 江苏迪伦智能科技有限公司 A kind of automatic positioning of polymorphic type instrument and recognition methods suitable for crusing robot
CN109117158A (en) * 2018-08-02 2019-01-01 郑州云海信息技术有限公司 Firmware update and device
CN110245759A (en) * 2019-05-17 2019-09-17 网宿科技股份有限公司 A kind of method for inspecting, system, server and equipment
CN113010197B (en) * 2020-06-11 2023-04-11 深圳市科脉技术股份有限公司 Application silence upgrading method, system, terminal equipment and storage medium
CN112070456B (en) * 2020-07-31 2023-12-29 深圳市优必选科技股份有限公司 Method for issuing task, terminal equipment, robot and storage medium
US20230073154A1 (en) * 2021-09-07 2023-03-09 Nvidia Corporation Semantic rearrangement of unknown objects from natural language commands
CN115741746A (en) * 2022-12-23 2023-03-07 国家电网有限公司客户服务中心 Intelligent inspection system and inspection method thereof
CN116244318A (en) * 2022-12-29 2023-06-09 深信服科技股份有限公司 Equipment inspection method and device, electronic equipment and storage medium
CN116125997B (en) * 2023-04-14 2023-06-27 北京安录国际技术有限公司 Intelligent inspection control method and system for robot

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004220208A (en) * 2003-01-10 2004-08-05 Yamaha Corp Basic program and recording medium capable of easily switching program environment
US20140200963A1 (en) * 2006-03-17 2014-07-17 Raj Abhyanker Neighborhood polling in a geo-spatial environment
CN107139211A (en) * 2017-05-26 2017-09-08 上海思依暄机器人科技股份有限公司 The cost recovery control method and device of a kind of domestic robot
CN110798654A (en) * 2018-08-01 2020-02-14 华为技术有限公司 Method and system for defining camera by software and camera
CN112748734A (en) * 2020-12-18 2021-05-04 河北润忆安全技术服务有限公司 Self-adaptive inspection method and inspection system
CN116226204A (en) * 2021-11-29 2023-06-06 新智我来网络科技有限公司 Scene determination method, device, equipment and storage medium based on joint learning platform
CN114783188A (en) * 2022-05-17 2022-07-22 阿波罗智联(北京)科技有限公司 Inspection method and device
CN115862177A (en) * 2022-11-24 2023-03-28 浙江中控技术股份有限公司 Equipment inspection method and device
CN116600260A (en) * 2023-05-22 2023-08-15 中国长江三峡集团有限公司 Intelligent operation and maintenance management system of data center based on inspection robot

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117056570A (en) * 2023-10-12 2023-11-14 广州信邦智能装备股份有限公司 Robot inspection data processing method and related system
CN117056570B (en) * 2023-10-12 2024-01-02 广州信邦智能装备股份有限公司 Robot inspection data processing method and related system
CN117786165A (en) * 2023-10-12 2024-03-29 广州信邦智能装备股份有限公司 Extraction processing method of inspection event, related server and medium program

Also Published As

Publication number Publication date
CN117733881A (en) 2024-03-22
CN116828288B (en) 2024-01-02
CN117687655A (en) 2024-03-12

Similar Documents

Publication Publication Date Title
CN116828288B (en) Composite intelligent inspection robot capable of being applied to multiple scenes and related system
CN101849216B (en) Method and apparatus for wireless digital content management
CN100369004C (en) Information terminal device and content backup method
CN103049405B (en) Android device file management method and system
CN105263142A (en) Method and device for identifying pseudo base station
CN109428740B (en) Method and device for recovering equipment failure
CN110856126A (en) Information reporting and receiving method, terminal equipment and storage medium
CN105336173A (en) Image information acquisition method and related device
CN105282505A (en) Video data transmission method and device
CN100395978C (en) Unloading method and terminal
CN117056570B (en) Robot inspection data processing method and related system
CN105472640A (en) WiFi information collection method and system
CN104331948B (en) Tachographs upgrade information sending method, method of reseptance, apparatus and system
CN111291012A (en) Rule file deployment system, method, equipment and medium
CN102868992B (en) Device and method for shielding terminal signal, device and method for removing shielding of terminal signal, and terminal signal management system
CN105610596A (en) Resource directory management method and network terminal
KR100736098B1 (en) Apparatus and method for controlling digital device using by short message service
US9693111B2 (en) Video transmission system
CN113792014B (en) Nuclear power station file management method and device, terminal equipment and storage medium
CN104333583A (en) Document transmission method and device
CN112311736A (en) Remote control device, household appliance and communication protocol configuration method and device thereof
CN111741251A (en) Monitoring system, local host and camera remote preview control method
CN112702388B (en) Method, device and system for rapidly receiving and processing position sensing data
CN113965275B (en) Wireless base function detection method based on Bluetooth communication
CN105431833A (en) Information processing device, information processing system, information processing method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant