CN114265381B - Remote fault diagnosis system for hydropower station - Google Patents

Remote fault diagnosis system for hydropower station Download PDF

Info

Publication number
CN114265381B
CN114265381B CN202111330132.7A CN202111330132A CN114265381B CN 114265381 B CN114265381 B CN 114265381B CN 202111330132 A CN202111330132 A CN 202111330132A CN 114265381 B CN114265381 B CN 114265381B
Authority
CN
China
Prior art keywords
conference
fault
remote
expert
fault diagnosis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111330132.7A
Other languages
Chinese (zh)
Other versions
CN114265381A (en
Inventor
张翅飞
周波
刘江涛
钟用
杜东伟
赖星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Huaneng Baoxinghe Hydropower Co Ltd
Original Assignee
Sichuan Huaneng Baoxinghe Hydropower Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Huaneng Baoxinghe Hydropower Co Ltd filed Critical Sichuan Huaneng Baoxinghe Hydropower Co Ltd
Priority to CN202111330132.7A priority Critical patent/CN114265381B/en
Publication of CN114265381A publication Critical patent/CN114265381A/en
Application granted granted Critical
Publication of CN114265381B publication Critical patent/CN114265381B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y04INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
    • Y04SSYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
    • Y04S10/00Systems supporting electrical power generation, transmission or distribution
    • Y04S10/50Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
    • Y04S10/52Outage or fault management, e.g. fault detection or location

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a hydropower station remote fault diagnosis system, and relates to the field of power station operation and maintenance devices. Aiming at the problem that a great deal of time is spent on going to a fault place during the fault diagnosis of hydropower plant equipment, the remote fault diagnosis is carried out on the hydropower plant through the remote fault diagnosis system, so that the commute time is greatly reduced, and expert personnel can carry out remote diagnosis on the fault equipment in a comfortable conference room, thereby greatly improving the working efficiency and the working comfort of the expert personnel; the non-medium air imaging is realized through the equivalent negative refractive index flat lens (DCT-plate), the real-time picture of the fault site can be clearly and accurately reflected, and in addition, the non-contact imaging mode is adopted under the background of epidemic situation, so that the epidemic prevention effect can be effectively realized; RGB_D image data of a fault site are collected through a binocular camera and sent to a conference server, and the real-time image of the fault site is reconstructed through point cloud data with depth data and displayed through a conference projector.

Description

Remote fault diagnosis system for hydropower station
Technical Field
The invention relates to the field of operation and maintenance devices of power stations, in particular to a hydropower station remote fault diagnosis system.
Background
The hydroelectric power generation system of the hydropower station is a very complex system, the related equipment operation principle and structure are complex and huge in quantity, the requirements on the professional knowledge and capability of operation maintenance personnel of the hydropower station are very high, and the abundant experience of the expert is a precious financial resource.
At present, when complex faults occur in power station equipment, the traditional method is that relevant technicians of a telephone call manufacturer seek help, but telephone communication is difficult to describe clearly for the complex faults and is not beneficial to understanding the actual conditions of the faults, so that correct judgment is difficult to make; also, this approach is relatively inefficient, and disadvantageous in terms of urgent resolution of the field problem, by inviting specialists and related manufacturer technicians to the field meeting. Therefore, hydropower station equipment faults are efficiently processed in the condition that specialists and related manufacturer personnel are not in the field usually by means of telephone or remote video conference; however, the current video conference is mainly applied to a display or a simple conference picture, so that the conference picture is not real enough, and a remote expert cannot achieve a realistic effect, so that the fact grasp of faults is not accurate enough.
For this purpose, publication No.: the invention application of CN111683219A provides a hydropower station equipment fault remote diagnosis system and a hydropower station equipment fault remote diagnosis method. The invention aims to provide an accurate and efficient remote diagnosis system and method for hydropower station equipment faults. The technical scheme of the invention is as follows: the system comprises a field conference terminal, a conference server and a plurality of expert conference terminals, wherein the field conference terminal is in communication connection with the conference server, and the conference server is in communication connection with the expert conference terminals; the on-site conference terminal is provided with a video module and an on-site voice input module; the conference server is provided with an image processing module and a conference management module; the expert conference terminal has an interaction module.
However, the above-mentioned invention application does not solve the problem that in the case that the expert and the related manufacturer personnel are not on site, the simple conference picture is not true enough, and the remote expert cannot achieve the realistic effect, so that the fault fact is not mastered accurately. The existing interaction modes are all carried out through screens, and under the severe condition of the existing epidemic situation, germs and other pollution are easy to remain on the screens.
Therefore, it is necessary to provide a new remote failure diagnosis system for hydropower stations to solve the above technical problems.
Disclosure of Invention
In order to solve one of the technical problems, the invention provides a hydropower station remote fault diagnosis system, which comprises a conference server, a conference room end, a fault diagnosis request end, a fault field acquisition end and an expert remote response end; interaction data among the conference room end, the fault diagnosis request end, the fault site acquisition end and the expert remote response end are all uploaded to a conference server in a remote mode, and the conference server is used for coordinating data of all ports and realizing data interaction and remote fault diagnosis; the system comprises a fault diagnosis request end, an expert remote response end, a conference server and a remote assistance request, wherein the fault diagnosis request end is deployed on portable intelligent equipment of hydropower station operation and maintenance personnel, the expert remote response end is deployed on the portable intelligent equipment of the expert personnel, the fault diagnosis request end is used for sending a remote fault diagnosis request to the conference server, the conference server matches corresponding expert personnel according to the fault diagnosis request type, and sends a remote assistance request to the portable intelligent equipment of the expert personnel; expert personnel respond and reply through the expert remote response end; the fault site acquisition end is deployed on the image acquisition equipment of the fault site and is used for acquiring real-time images of the fault site and uploading the real-time images to the conference server; the conference room end is deployed in a remote conference room and used for fault scene image display and conference interaction.
As a further solution, when equipment in the hydropower station fails, and a local operation and maintenance personnel cannot remove the failure and needs an expert to perform remote failure diagnosis, the local operation and maintenance personnel report failure information through a failure diagnosis request terminal; the fault information comprises a fault location, a fault time, a device signal and a fault type; after receiving the fault information sent by the fault diagnosis request end, the conference server automatically searches expert personnel matched with the fault type in the expert database and sends a remote assistance request to portable intelligent equipment of the expert personnel; expert personnel respond back through the expert remote response end, wherein the responding back comprises receiving matching, matching pending and refusing matching; if the matching is accepted, the conference server sends a remote conference room address and assisting time to expert personnel; if the matching is pending, temporarily suspending the remote fault diagnosis request; if the matching is refused, the expert personnel inputs the refusing reason and sends the refusing reason to the fault diagnosis request terminal.
As a still further solution, the teleconferencing room comprises a plurality of conference seats, conference projectors and conference microphones, wherein the conference seats are provided with seat numbers, an expert performs entering and checking and seating through inputting the seat numbers, the conference projectors are used for projecting and displaying real-time images of fault sites, and the conference microphones are used for performing remote conversations with hydropower station operation and maintenance personnel.
As a still further solution, the conference projector performs media-free air imaging through an equivalent negative refractive index plate lens (i.e., DCT-plate), and is placed horizontally below the DCT-plate at a 45 degree angle to the DCT-plate, thereby creating air imaging perpendicular to the horizontal plane.
As a still further solution, the conference projector adjusts the air imaging azimuth through an axial motor, an azimuth adjusting button is arranged in front of the conference seat, and a user adjusts the air imaging azimuth through the azimuth adjusting button.
As a further solution, the azimuth adjusting button is further provided with a one-key alignment button, and the user can quickly and automatically align the air imaging azimuth to the facing azimuth of the current conference seat by pressing the one-key alignment button, and the one-key alignment button is realized by the following steps:
s1, detecting whether a user presses a one-key alignment button: if yes, recording the seat number corresponding to the pressed button and jumping to the next step; if not, continuing to execute the cyclic key detection;
s2, obtaining the seat azimuth corresponding to the button pressing through retrieving a number-azimuth table, wherein the number-azimuth table is a priori comparison table, and writing and checking are performed manually;
s3, obtaining the air imaging azimuth of the current DCT-plate by reading the angle data of the rotating motor, wherein the seat azimuth and the air imaging azimuth are both represented by a center normal, namely, the center normal L1 corresponds to the air imaging azimuth, and the center normal L2 corresponds to the seat azimuth;
s4, calculating an included angle theta of the L1 and the L2 on a horizontal plane, wherein the included angle theta is a clockwise included angle;
s5, rotating the conference projector and the DCT-plate clockwise by an angle theta through an axial motor, and aligning the seat orientation corresponding to the button pressing; the conference projector and the DCT-plate are relatively fixed, and rotate integrally when rotating.
As a further solution, a conference camera and a conference speaker are also arranged in the conference room, and a field interaction end is also arranged on the portable intelligent device of the operation and maintenance personnel; the site interaction terminal can collect real-time audio of the site and send the real-time audio to the conference server; the conference camera can collect real-time images in a conference room and send the images to the conference server; the conference loudspeaker is used for playing the on-site real-time audio which can be acquired by the on-site interaction end, and the on-site interaction end can receive the real-time images in the conference room acquired by the conference camera and play the images in real time through the portable intelligent equipment; when diagnosing the trouble, expert personnel specifically instruct specific position in the air imaging through finger or other appurtenance, the conference camera gathers expert and instructs the video data at trouble position to send to the scene interactive terminal, the scene interactive terminal shows sound, image through portable intelligent device, can clear accurate location trouble position, and confirm the solution through long-range pronunciation.
As a further solution, the fault site acquisition end is based on a binocular camera, rgb_d image data of the fault site is acquired through the binocular camera and sent to the conference server, and the real-time image of the fault site is reconstructed through point cloud data with depth data and displayed through the conference projector.
As a further solution, the conference camera collects gesture interaction cameras, collects gestures of expert personnel through the gesture interaction cameras, and performs gesture control, wherein the gesture control comprises image enlarging, image shrinking, image rotating, annotation image and area frame line, and the gesture interaction cameras are compound cameras, including an infrared laser camera, an infrared camera and a common color camera; the model is a Microsoft Azure Kinect DK camera.
As a further solution, the field interaction end can also project the image content displayed by the conference camera onto the portable intelligent device of the operation and maintenance personnel in real time, wherein the projected content comprises the current view of the expert personnel, the annotation of the expert personnel and the regional frame line of the expert personnel, and the operation and maintenance personnel of the hydropower station can zoom in and out the image, zoom out the image, rotate the image, annotate the image and the regional frame line through the touch display screen of the portable intelligent device.
Compared with the related art, the hydropower station remote fault diagnosis system provided by the invention has the following beneficial effects:
1. aiming at the problem that a great deal of time is spent on going to a fault place during the fault diagnosis of hydropower plant equipment, the remote fault diagnosis is carried out on the hydropower plant through the remote fault diagnosis system, so that the commute time is greatly reduced, and expert personnel can carry out remote diagnosis on the fault equipment in a comfortable conference room, thereby greatly improving the working efficiency and the working comfort of the expert personnel;
2. according to the invention, the conference server carries out automatic matching of expert personnel, after the corresponding expert personnel are found, the conference server inquires whether the expert can participate in remote diagnosis or not, the expert personnel can select to participate, not participate and wait according to the situation of the expert, the matching degree is increased, and meanwhile, the personal arrangement of the expert personnel can be considered;
3. the invention realizes the medium-free air imaging through the equivalent negative refractive index flat lens (DCT-plate), can clearly and accurately reflect the real-time picture of the fault site, and in addition, the imaging can effectively play an epidemic prevention role by adopting the non-contact mode under the epidemic situation background;
4. the invention collects RGB_D image data of a fault site through the binocular camera and sends the RGB_D image data to the conference server, and the real-time image of the fault site is reconstructed through point cloud data with depth data and displayed through the conference projector.
Drawings
FIG. 1 is a schematic diagram of a remote failure diagnosis system for a hydropower station according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an equivalent negative refractive index (DCT-plate) lens according to an embodiment of the invention.
Detailed Description
The invention will be further described with reference to the drawings and embodiments.
As shown in fig. 1 and fig. 2, the remote fault diagnosis system for a hydropower station provided in this embodiment includes a conference server, a conference room end, a fault diagnosis request end, a fault field acquisition end and an expert remote response end; interaction data among the conference room end, the fault diagnosis request end, the fault site acquisition end and the expert remote response end are all uploaded to a conference server in a remote mode, and the conference server is used for coordinating data of all ports and realizing data interaction and remote fault diagnosis; the system comprises a fault diagnosis request end, an expert remote response end, a conference server and a remote assistance request, wherein the fault diagnosis request end is deployed on portable intelligent equipment of hydropower station operation and maintenance personnel, the expert remote response end is deployed on the portable intelligent equipment of the expert personnel, the fault diagnosis request end is used for sending a remote fault diagnosis request to the conference server, the conference server matches corresponding expert personnel according to the fault diagnosis request type, and sends a remote assistance request to the portable intelligent equipment of the expert personnel; expert personnel respond and reply through the expert remote response end; the fault site acquisition end is deployed on the image acquisition equipment of the fault site and is used for acquiring real-time images of the fault site and uploading the real-time images to the conference server; the conference room end is deployed in a remote conference room and used for fault scene image display and conference interaction.
It should be noted that: the hydroelectric power generation system of the hydropower station is a very complex system, and the related equipment operation principle and structure are complex, huge in quantity and complex in structure; therefore, expert personnel are required to perform fault diagnosis and elimination. However, in the current environment, the number of experts in the field of hydropower station equipment is limited, equipment fault diagnosis and elimination work of the national hydropower station is difficult to meet even in saturated work, in addition, the hydropower station has the characteristics of being often built in places where the trails are rare, the commuting time is long, the commuting difficulty is high, when faults occur, the expert needs to delay a great deal of time when going to the fault ground, in fact, a great deal of time is not spent in fault diagnosis and maintenance, the fault ground is the time spent, and life guarantee of the fault ground is also mostly uncomfortable. Therefore, the embodiment provides a hydropower station remote fault diagnosis system, which is used for carrying out remote fault diagnosis on a hydropower station, so that the commute time is greatly reduced, and expert personnel can carry out remote diagnosis on fault equipment in a comfortable conference room, thereby greatly improving the working efficiency and the working comfort of the expert personnel.
As a further solution, when equipment in the hydropower station fails, and a local operation and maintenance personnel cannot remove the failure and needs an expert to perform remote failure diagnosis, the local operation and maintenance personnel report failure information through a failure diagnosis request terminal; the fault information comprises a fault location, a fault time, a device signal and a fault type; after receiving the fault information sent by the fault diagnosis request end, the conference server automatically searches expert personnel matched with the fault type in the expert database and sends a remote assistance request to portable intelligent equipment of the expert personnel; expert personnel respond back through the expert remote response end, wherein the responding back comprises receiving matching, matching pending and refusing matching; if the matching is accepted, the conference server sends a remote conference room address and assisting time to expert personnel; if the matching is pending, temporarily suspending the remote fault diagnosis request; if the matching is refused, the expert personnel inputs the refusing reason and sends the refusing reason to the fault diagnosis request terminal.
It should be noted that: the expert is usually dedicated to a certain field, and the hydropower station has a lot of equipment, so that when a fault occurs, the expert needs to be matched with the expert in the corresponding field in time to quickly and accurately perform fault diagnosis.
As a still further solution, the teleconferencing room comprises a plurality of conference seats, conference projectors and conference microphones, wherein the conference seats are provided with seat numbers, an expert performs entering and checking and seating through inputting the seat numbers, the conference projectors are used for projecting and displaying real-time images of fault sites, and the conference microphones are used for performing remote conversations with hydropower station operation and maintenance personnel.
It should be noted that: because the remote diagnosis needs to keep low delay and high stability of the network, and meanwhile, some fault diagnoses need to be discussed and communicated with each other by each expert, so that the fault diagnosis needs to be conducted in a conference room, in the embodiment, interaction between each data in the conference room and a conference server is coordinated through a conference room end, expert personnel can enter a place to punch cards and check numbers to enter seats through inputting seat numbers, a microphone is used for conducting low-delay communication with hydropower station operation and maintenance personnel on site, and each position of the conference room can clearly see real-time images of the fault site through a projector.
As a still further solution, the conference projector performs media-free air imaging through an equivalent negative refractive index plate lens (i.e., DCT-plate), and is placed horizontally below the DCT-plate at a 45 degree angle to the DCT-plate, thereby creating air imaging perpendicular to the horizontal plane.
It should be noted that: because the hydropower station equipment has a complex structure, when the remote fault diagnosis is carried out, images are required to be displayed in a clear and vivid form, and the holographic technology is used as the highest expression form of optical display, in recent years, huge industrial issues such as hundred degrees, ary and the like, such as air imaging concept products with interactive functions: hundred degrees release "global first-generation artificial intelligence search product. Magic light search", payment treasures release "latest intelligent internet of things service solution. Such as shadow planning", which represents a future development direction to some extent. Currently, air imaging is achieved in a commercially available manner by spraying water vapor into the air, liquefying the water vapor into small water droplets, forming a fog curtain as a whole, and projecting the content onto the fog curtain by projection. However, in essence, the projection mode still needs to present images by means of specific materials and a tangible screen, and the holographic image display effect of 'screen removal' and 'interactive' is not realized, so that the defects of poor display effect, serious light pollution, larger environmental influence, small practicability and the like appear. The four pain points of screen dependence, illusion virtual image, no penetrability and no interactivity are needed to be solved. The medium-free aerial imaging technology based on the equivalent negative refractive index flat lens is a novel display mode realized by utilizing a light field reconstruction mode, and can present pictures in the air without any medium. The display mode has the advantages of no medium imaging, and in addition, the non-contact mode can effectively play an epidemic prevention role in the background of epidemic situation.
As shown in fig. 2, the equivalent negative refractive index plate lens appears as a piece of glass, essentially a set of microlens arrays. The core technical barrier of this optical glass consists in realizing the lattice and grating of the inner michelia. The micro lens array can generate a phenomenon called negative refraction, so that the scattered light can be converged again at a plane symmetrical position, and an equal-sized real image is formed, thereby realizing medium-free aerial imaging. The lens has extremely high requirements on optical materials, process standards, chemical material processing flows and the like, so the production difficulty is extremely high, the lens structurally comprises a pair of glass windows with two optical surfaces respectively, and an optical waveguide assembly positioned between the two glass windows, and the optical waveguide assembly comprises a plurality of rows and columns and is 45. A rectangular optical waveguide array which is arranged obliquely, and an edge optical waveguide which is arranged at the periphery of the rectangular optical waveguide array in a circle, wherein the size of each column or each row of the rectangular optical waveguide array is the same. The equivalent negative refractive index flat lens product is in the form of a normal optical flat plate, is not different from the normal optical flat plate glass, and can realize the characteristic of convex lens imaging real image although having no focal plane concept, thus being a flat plate lens. The planar lens reconstructed by the special precise microstructure adopts a plurality of rows and columns of rectangular optical waveguide arrays and peripheral triangular optical waveguides, so that a two-dimensional or three-dimensional light source can directly form real images in air to realize real holographic images, and the three-dimensional stereoscopic display characteristics of naked eyes are realized while the large view field, large aperture, high resolution, no distortion and no dispersion are realized. The lens adopts an upper layer of lens structure and a lower layer of lens structure, the internal reflection strips forming the upper layer of lens and the lower layer of lens are vertical to the surfaces of the lenses, and the reflection strips are arranged in parallel. This has the advantage that the modulation component and the original light component are symmetrical with respect to the mirror in order to have each reflective strip with the same characteristics, e.g. equal modulation angle, for the modulation of the light beam incident at the same azimuth angle. The upper and lower layers of lenses are closely attached, and both sides of the lenses are plated with reflecting films. Through the inseparable laminating of lens, reduce the glue film thickness and arouse the dislocation of the formation of image focal plane of two-layer lens each, bring the astigmatic problem, influence the formation of image definition. The reflective films are plated on the two sides, so that the scattering of impurities, bubbles and the like on the adhesive layer to light rays can be avoided, and the scattered light can be overlapped to an image surface, so that the visual experience of a viewer is greatly influenced. Through both sides coating reflective film, and closely laminating, can the light of this rubberizing of greatly reduced entering to avoid this kind of stray light to the influence of formation of image. The upper layer mirror reflection strip and the lower layer mirror reflection strip are mutually orthogonal. In the imaging process, the characteristic that the light field height is reduced relative to the plane symmetry direction is realized by utilizing right-angle reflection. When the right-angle side is obtuse or acute, the beam is reflected and imaged on two surfaces, and then the ghost image phenomenon of split image appears, so that the visual experience is affected. The light field of all incident light beams can be accurately restored after being reflected by each reflecting surface of the inner unit of the flat plate by limiting the light field to be right angles, so that clear imaging is realized. The thickness of the upper layer lens and the lower layer lens are equal. The design ensures that the phenomena of image distortion, faults and the like caused by disorder ordering are avoided when the flat plate is used or recombined in the later period, and the qualification rate of the processing technology can be ensured.
The refractive index is usually referred to as positive refractive index, and most transparent media such as water, glass, crystal and the like which are available in the market are positive refractive indexes, so that light rays can be dispersed along the original direction after passing through the materials with positive refractive indexes. However, as shown in fig. 2, the negative refractive index materials have very different effects on light, and the light is deflected in opposite directions after being refracted by the materials, so that the materials have a good convergence effect. The equivalent negative refractive index plate lens is a plate lens reconstructed by a special precise microstructure, and a two-dimensional or three-dimensional light source can be directly imaged in the air by adopting a rectangular optical waveguide array with multiple rows and multiple columns and a peripheral triangular optical waveguide. The three-dimensional stereo display characteristic of naked eyes is realized while the large view field, the large aperture, the high resolution, the no distortion and the no dispersion are realized. The technical design originates from an X-ray incidence crystal, when the X-ray is incident on the crystal, the X-ray can be reflected on the microstructure of a crystal lattice crystal face, and Bragg diffraction can occur after the reflected light is emergent and mutually diffracted. The equivalent negative refractive index plate lens refers to a crystal and a crystal face structure similar to a special structure, but x-rays are electromagnetic waves with wavelengths of tens to hundreds of picometers, atoms which are separated from each other by tens to hundreds of picometers in the crystal are arranged periodically, diffraction phenomenon is generated when the x-rays enter the crystal, and basically, the crystal face lattice at the microscopic size of 0.01-100 angstroms carries out one-dimensional retroreflection on the x-rays. However, what we actually need is visible light of different color wavelengths, between 3800 and 7800 angstroms, and in order to achieve similar higher multi-dimensional catadioptric effects, it is necessary to have similar more complex "crystal plane" and "unit cell" optical structures in the prepared equivalent negative refractive index slab lens. The light rays can generate negative refraction phenomenon through the equivalent negative refractive index flat semi-transparent mirror, thousands of light rays are converged again, and a real image plane can be formed in the air.
As a still further solution, the conference projector adjusts the air imaging azimuth through an axial motor, an azimuth adjusting button is arranged in front of the conference seat, and a user adjusts the air imaging azimuth through the azimuth adjusting button.
As a further solution, the azimuth adjusting button is further provided with a one-key alignment button, and the user can quickly and automatically align the air imaging azimuth to the facing azimuth of the current conference seat by pressing the one-key alignment button, and the one-key alignment button is realized by the following steps:
s1, detecting whether a user presses a one-key alignment button: if yes, recording the seat number corresponding to the pressed button and jumping to the next step; if not, continuing to execute the cyclic key detection;
s2, obtaining the seat azimuth corresponding to the button pressing through retrieving a number-azimuth table, wherein the number-azimuth table is a priori comparison table, and writing and checking are performed manually;
s3, obtaining the air imaging azimuth of the current DCT-plate by reading the angle data of the rotating motor, wherein the seat azimuth and the air imaging azimuth are both represented by a center normal, namely, the center normal L1 corresponds to the air imaging azimuth, and the center normal L2 corresponds to the seat azimuth;
s4, calculating an included angle theta of the L1 and the L2 on a horizontal plane, wherein the included angle theta is a clockwise included angle;
s5, rotating the conference projector and the DCT-plate clockwise by an angle theta through an axial motor, and aligning the seat orientation corresponding to the button pressing; the conference projector and the DCT-plate are relatively fixed, and rotate integrally when rotating.
It should be noted that: because meeting projector and DCT-plate receive the damage easily, this embodiment has avoided manual direction adjustment to bring the potential damage risk through setting up the direction adjustment button, can also realize counterpoint fast through a key counterpoint button, easy operation makes expert's personnel focus on diagnosing the trouble more.
As a further solution, a conference camera and a conference speaker are also arranged in the conference room, and a field interaction end is also arranged on the portable intelligent device of the operation and maintenance personnel; the site interaction terminal can collect real-time audio of the site and send the real-time audio to the conference server; the conference camera can collect real-time images in a conference room and send the images to the conference server; the conference loudspeaker is used for playing the on-site real-time audio which can be acquired by the on-site interaction end, and the on-site interaction end can receive the real-time images in the conference room acquired by the conference camera and play the images in real time through the portable intelligent equipment; when diagnosing the trouble, expert personnel specifically instruct specific position in the air imaging through finger or other appurtenance, the conference camera gathers expert and instructs the video data at trouble position to send to the scene interactive terminal, the scene interactive terminal shows sound, image through portable intelligent device, can clear accurate location trouble position, and confirm the solution through long-range pronunciation.
It should be noted that: the conference camera and the conference loudspeaker are additionally arranged, so that communication and communication are convenient, when fault diagnosis is carried out, expert personnel can directly indicate a fault area, and hydropower station operation and maintenance personnel can carry out fault elimination by indicating video data of a fault part through the expert.
As a further solution, the fault site acquisition end is based on a binocular camera, rgb_d image data of the fault site is acquired through the binocular camera and sent to the conference server, and the real-time image of the fault site is reconstructed through point cloud data with depth data and displayed through the conference projector.
It should be noted that: in the conventional camera, the collected data only includes RGB data, however, in the actual fault remote diagnosis, if depth data is absent, the fault area cannot be accurately pointed out, and the fault image cannot fully and clearly reflect the actual situation, so that the embodiment combines the binocular camera to collect rgb_d image data; the rgb_d image data can be used for image remote reconstruction and generate corresponding three-dimensional images through which expert personnel can accurately observe specific malfunctioning equipment.
As a further solution, the conference camera collects gesture interaction cameras, collects gestures of expert personnel through the gesture interaction cameras, and performs gesture control, wherein the gesture control comprises image enlarging, image shrinking, image rotating, annotation image and area frame line, and the gesture interaction cameras are compound cameras, including an infrared laser camera, an infrared camera and a common color camera; the model is a Microsoft Azure Kinect DK camera.
It should be noted that: the medium-free aerial imaging technology based on the equivalent negative refractive index flat lens is a novel display mode realized by utilizing a light field reconstruction mode, and can present pictures in the air without any medium. The display mode has the advantages of no medium imaging, but also brings the difficulty of interaction, the main stream interaction mode of the traditional screen adopts a capacitive screen, the air imaging is obtained by touching the capacitive screen, and the capacitive screen is not dependent on any medium, so that any interaction mode with the medium cannot be used, therefore, a set of interaction system suitable for the medium-free air imaging needs to be developed, and the interaction system needs to meet the characteristics of stability, accuracy and the like, so that a user can use the interaction mode which is the same as the traditional capacitive screen. Novel display brings new interaction demand, and new interaction demand promotes user's new experience and consumption custom, and each trade interdependence, co-development just can be with technological conversion product, brings different life experience for everyone. At present, many schemes for realizing medium-free aerial imaging exist, the development of aerial imaging technology is faster and faster, and a set of proper interaction system is needed along with the appearance of new display modes, so that a user can interact with graphic images in the display system.
According to the embodiment, the gesture interaction camera is used for realizing, an expert can conveniently rotate, amplify and the like the image, and because the image is provided with depth data and can be subjected to fixed point annotation, the annotation area can be displayed at fixed points and cannot be changed along with the movement of a picture. The gesture interaction can be more humanized and more convenient to control interaction.
As a further solution, the field interaction end can also project the image content displayed by the conference camera onto the portable intelligent device of the operation and maintenance personnel in real time, wherein the projected content comprises the current view of the expert personnel, the annotation of the expert personnel and the regional frame line of the expert personnel, and the operation and maintenance personnel of the hydropower station can zoom in and out the image, zoom out the image, rotate the image, annotate the image and the regional frame line through the touch display screen of the portable intelligent device.
It should be noted that: the operation and maintenance personnel of the hydropower plant can see the current view of the expert, the annotation of the expert and the regional frame line of the expert through the mobile phone and other equipment, so that the communication interaction can be accurately carried out, and the communication efficiency and accuracy are improved.
The foregoing description is only illustrative of the present invention and is not intended to limit the scope of the invention, and all equivalent structures or equivalent processes or direct or indirect application in other related technical fields are included in the scope of the present invention.

Claims (7)

1. The remote fault diagnosis system for the hydropower station is characterized by comprising a conference server, a conference room end, a fault diagnosis request end, a fault field acquisition end and an expert remote response end; interaction data among the conference room end, the fault diagnosis request end, the fault site acquisition end and the expert remote response end are all uploaded to a conference server in a remote mode, and the conference server is used for coordinating data of all ports and realizing data interaction and remote fault diagnosis; the system comprises a fault diagnosis request end, an expert remote response end, a conference server and a remote assistance request, wherein the fault diagnosis request end is deployed on portable intelligent equipment of hydropower station operation and maintenance personnel, the expert remote response end is deployed on the portable intelligent equipment of the expert personnel, the fault diagnosis request end is used for sending a remote fault diagnosis request to the conference server, the conference server matches corresponding expert personnel according to the fault diagnosis request type, and sends a remote assistance request to the portable intelligent equipment of the expert personnel; expert personnel respond and reply through the expert remote response end; the fault site acquisition end is deployed on the image acquisition equipment of the fault site and is used for acquiring real-time images of the fault site and uploading the real-time images to the conference server; the conference room end is deployed in a remote conference room and used for fault scene image display and conference interaction;
the remote conference room comprises a plurality of conference seats, conference projectors and conference microphones, wherein the conference seats are provided with seat numbers, an expert performs entering and checking and seating through inputting the seat numbers, the conference projectors are used for projecting and displaying real-time images of fault sites, and the conference microphones are used for performing remote dialogue with hydropower station operation and maintenance personnel;
the conference projector adjusts the air imaging azimuth through an axial motor, an azimuth adjusting button is arranged in front of the conference seat, and a user adjusts the air imaging azimuth through the azimuth adjusting button;
the azimuth adjusting button is also provided with a one-key alignment button, a user can quickly and automatically align the air imaging azimuth to the facing azimuth of the current conference seat by pressing the one-key alignment button, and the one-key alignment button is realized by the following steps:
s1, detecting whether a user presses a one-key alignment button: if yes, recording the seat number corresponding to the pressed button and jumping to the next step; if not, continuing to execute the cyclic key detection;
s2, obtaining the seat azimuth corresponding to the button pressing through retrieving a number-azimuth table, wherein the number-azimuth table is a priori comparison table, and writing and checking are performed manually;
s3, obtaining the air imaging azimuth of the current DCT-plate by reading the angle data of the rotating motor, wherein the seat azimuth and the air imaging azimuth are both represented by a center normal, namely, the center normal L1 corresponds to the air imaging azimuth, and the center normal L2 corresponds to the seat azimuth;
s4, calculating an included angle theta of the L1 and the L2 on a horizontal plane, wherein the included angle theta is a clockwise included angle;
s5, rotating the conference projector and the DCT-plate clockwise by an angle theta through an axial motor, and aligning the seat orientation corresponding to the button pressing; the conference projector and the DCT-plate are relatively fixed, and rotate integrally when rotating.
2. The remote fault diagnosis system of hydropower station according to claim 1, wherein when the equipment in the hydropower station fails, and a local operation and maintenance person cannot remove the fault and needs an expert to perform remote fault diagnosis, the local operation and maintenance person reports fault information through a fault diagnosis request terminal; the fault information comprises a fault location, a fault time, a device signal and a fault type; after receiving the fault information sent by the fault diagnosis request end, the conference server automatically searches expert personnel matched with the fault type in the expert database and sends a remote assistance request to portable intelligent equipment of the expert personnel; expert personnel respond back through the expert remote response end, wherein the responding back comprises receiving matching, matching pending and refusing matching; if the matching is accepted, the conference server sends a remote conference room address and assisting time to expert personnel; if the matching is pending, temporarily suspending the remote fault diagnosis request; if the matching is refused, the expert personnel inputs the refusing reason and sends the refusing reason to the fault diagnosis request terminal.
3. The remote failure diagnosis system of hydropower station according to claim 2, wherein the conference projector performs medium-free air imaging through an equivalent negative refractive index plate lens (i.e., DCT-plate), and the conference projector is horizontally disposed below the DCT-plate and forms an angle of 45 degrees with the DCT-plate, thereby generating air imaging perpendicular to the horizontal plane.
4. The remote fault diagnosis system of hydropower station according to claim 3, wherein a conference camera and a conference speaker are further arranged in the conference room, and a field interaction end is further arranged on the portable intelligent device of the operation and maintenance personnel; the site interaction terminal can collect real-time audio of the site and send the real-time audio to the conference server; the conference camera can collect real-time images in a conference room and send the images to the conference server; the conference loudspeaker is used for playing the on-site real-time audio which can be acquired by the on-site interaction end, and the on-site interaction end can receive the real-time images in the conference room acquired by the conference camera and play the images in real time through the portable intelligent equipment; when diagnosing the trouble, expert personnel specifically instruct specific position in the air imaging through finger or other appurtenance, the conference camera gathers expert and instructs the video data at trouble position to send to the scene interactive terminal, the scene interactive terminal shows sound, image through portable intelligent device, can clear accurate location trouble position, and confirm the solution through long-range pronunciation.
5. The remote fault diagnosis system of hydropower station according to claim 4, wherein the fault site acquisition end is an acquisition end based on a binocular camera, the rgb_d image data of the fault site is acquired through the binocular camera and sent to the conference server, and the real-time image of the fault site is reconstructed through point cloud data with depth data and displayed through a conference projector.
6. The hydropower station remote fault diagnosis system according to claim 5, wherein the conference camera collects gesture interaction cameras, the gesture interaction cameras collect gestures of expert personnel and perform gesture control, the gesture control comprises zooming in images, zooming out images, rotating images, annotating images and region frame wires, and the gesture interaction cameras are compound cameras, and comprise infrared laser cameras, infrared cameras and a common color camera; the model is a Microsoft Azure Kinect DK camera.
7. The remote fault diagnosis system of hydropower station according to claim 6, wherein the field interaction end can also project the image content displayed by the conference camera onto the portable intelligent device of the operation and maintenance personnel in real time, the projected content comprises the current view of the expert personnel, the annotation of the expert personnel and the regional frame line of the expert personnel, and the operation and maintenance personnel of the hydropower station can zoom in and out the image, the reduced image, the rotation image, the annotation image and the regional frame line through the touch display screen of the portable intelligent device.
CN202111330132.7A 2021-11-11 2021-11-11 Remote fault diagnosis system for hydropower station Active CN114265381B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111330132.7A CN114265381B (en) 2021-11-11 2021-11-11 Remote fault diagnosis system for hydropower station

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111330132.7A CN114265381B (en) 2021-11-11 2021-11-11 Remote fault diagnosis system for hydropower station

Publications (2)

Publication Number Publication Date
CN114265381A CN114265381A (en) 2022-04-01
CN114265381B true CN114265381B (en) 2024-02-09

Family

ID=80824949

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111330132.7A Active CN114265381B (en) 2021-11-11 2021-11-11 Remote fault diagnosis system for hydropower station

Country Status (1)

Country Link
CN (1) CN114265381B (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06205410A (en) * 1992-12-28 1994-07-22 Canon Inc Video conference system
JP2012029174A (en) * 2010-07-26 2012-02-09 Canon Inc Conference terminal device and video conference system
CN105306868A (en) * 2014-06-17 2016-02-03 三亚中兴软件有限责任公司 Video conferencing system and method
CN108932519A (en) * 2017-05-23 2018-12-04 中兴通讯股份有限公司 A kind of meeting-place data processing, display methods and device and intelligent glasses
CN209028562U (en) * 2018-11-16 2019-06-25 上海先研光电科技有限公司 A kind of interaction and feedback device based on no medium air-borne imagery
CN110471249A (en) * 2019-09-17 2019-11-19 荆门市探梦科技有限公司 Live holographic display system
CN210687674U (en) * 2019-09-26 2020-06-05 北京安博智信教育科技有限公司 Conference table device capable of realizing holographic projection
CN111312118A (en) * 2020-03-16 2020-06-19 长沙英芙机电科技有限公司 Immersive interactive display system
CN111338177A (en) * 2020-04-17 2020-06-26 荆门市探梦科技有限公司 Reflective geometric holographic display system
CN111683219A (en) * 2020-07-07 2020-09-18 中国电建集团华东勘测设计研究院有限公司 Remote diagnosis system and method for equipment faults of hydropower station
CN112001993A (en) * 2020-07-14 2020-11-27 深圳市规划国土房产信息中心(深圳市空间地理信息中心) Multi-GPU (graphics processing Unit) city simulation system for large scene
CN112051867A (en) * 2020-09-15 2020-12-08 成都极米科技股份有限公司 Method and device for automatically adjusting projection position, projection equipment, system and medium
CN213405315U (en) * 2020-08-18 2021-06-11 安徽省东超科技有限公司 A conference table that is used for image device of conference table and has it
CN113489938A (en) * 2020-10-28 2021-10-08 青岛海信电子产业控股股份有限公司 Virtual conference control method, intelligent device and terminal device

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06205410A (en) * 1992-12-28 1994-07-22 Canon Inc Video conference system
JP2012029174A (en) * 2010-07-26 2012-02-09 Canon Inc Conference terminal device and video conference system
CN105306868A (en) * 2014-06-17 2016-02-03 三亚中兴软件有限责任公司 Video conferencing system and method
CN108932519A (en) * 2017-05-23 2018-12-04 中兴通讯股份有限公司 A kind of meeting-place data processing, display methods and device and intelligent glasses
CN209028562U (en) * 2018-11-16 2019-06-25 上海先研光电科技有限公司 A kind of interaction and feedback device based on no medium air-borne imagery
CN110471249A (en) * 2019-09-17 2019-11-19 荆门市探梦科技有限公司 Live holographic display system
CN210687674U (en) * 2019-09-26 2020-06-05 北京安博智信教育科技有限公司 Conference table device capable of realizing holographic projection
CN111312118A (en) * 2020-03-16 2020-06-19 长沙英芙机电科技有限公司 Immersive interactive display system
CN111338177A (en) * 2020-04-17 2020-06-26 荆门市探梦科技有限公司 Reflective geometric holographic display system
CN111683219A (en) * 2020-07-07 2020-09-18 中国电建集团华东勘测设计研究院有限公司 Remote diagnosis system and method for equipment faults of hydropower station
CN112001993A (en) * 2020-07-14 2020-11-27 深圳市规划国土房产信息中心(深圳市空间地理信息中心) Multi-GPU (graphics processing Unit) city simulation system for large scene
CN213405315U (en) * 2020-08-18 2021-06-11 安徽省东超科技有限公司 A conference table that is used for image device of conference table and has it
CN112051867A (en) * 2020-09-15 2020-12-08 成都极米科技股份有限公司 Method and device for automatically adjusting projection position, projection equipment, system and medium
CN113489938A (en) * 2020-10-28 2021-10-08 青岛海信电子产业控股股份有限公司 Virtual conference control method, intelligent device and terminal device

Also Published As

Publication number Publication date
CN114265381A (en) 2022-04-01

Similar Documents

Publication Publication Date Title
CN112584080B (en) Three-dimensional telepresence terminal and method
CN102084650B (en) Telepresence system, method and video capture device
US9927628B2 (en) Image display apparatus
JP2019525220A (en) Prompters and how to use aerial imaging elements in prompters
Hong et al. See-through multi-projection three-dimensional display using transparent anisotropic diffuser
CN102520527A (en) Naked eye stereo display system and method
CN102590923B (en) Lens, hologram projection production system and method thereof
CN106383407A (en) Flexible naked eye three-dimensional display thin film device based on micro-nano structure
WO2021052104A1 (en) Holographic display system
CN111105735A (en) All-solid-state holographic projector
CN102256100B (en) Two-way imaging-display system based on micro lens array and panel display integration
Yu et al. 360-degree directional micro prism array for tabletop flat-panel light field displays
CN102879995A (en) Display device
CN107490846A (en) A kind of projection lens
CN114265381B (en) Remote fault diagnosis system for hydropower station
Zhang et al. Omnidirectional 3D autostereoscopic aerial display with continuous parallax
CN212541009U (en) Transmission type geometric holographic display system for optimizing display configuration
CN212808904U (en) Reflective geometric holographic display system with optimized display configuration
Yasui et al. Wide viewing angle with a downsized system in projection-type integral photography by using curved mirrors
US20230204832A1 (en) Diffraction sheet and method for manufacturing the same, three-dimensional display device, light beam reproduction device, three-dimensional spatial display system, light beam reproduction method, and program
US10887566B2 (en) Image display system
US20220253975A1 (en) Panoramic presentation methods and apparatuses
CN112351358B (en) 360-degree free three-dimensional type three-dimensional display sound box based on face detection
CN102457732A (en) Single channel rear projection stereoscopic display system based on single machine figure work station
WO2022028448A1 (en) Geometrical holographic display system with optimized display configuration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant