CN113391639A - Outdoor space sightseeing method and system - Google Patents
Outdoor space sightseeing method and system Download PDFInfo
- Publication number
- CN113391639A CN113391639A CN202110721020.8A CN202110721020A CN113391639A CN 113391639 A CN113391639 A CN 113391639A CN 202110721020 A CN202110721020 A CN 202110721020A CN 113391639 A CN113391639 A CN 113391639A
- Authority
- CN
- China
- Prior art keywords
- sightseeing
- controller
- unmanned aerial
- aerial vehicle
- outdoor space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 230000000007 visual effect Effects 0.000 claims abstract description 40
- 238000012545 processing Methods 0.000 claims abstract description 19
- 230000008569 process Effects 0.000 claims abstract description 12
- 230000009471 action Effects 0.000 claims description 14
- 230000009467 reduction Effects 0.000 claims description 10
- 238000007664 blowing Methods 0.000 claims description 3
- 239000000284 extract Substances 0.000 claims description 3
- 230000003068 static effect Effects 0.000 claims description 3
- 230000000875 corresponding effect Effects 0.000 description 12
- 238000004891 communication Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000004888 barrier function Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000007654 immersion Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/08—Control of attitude, i.e. control of roll, pitch, or yaw
- G05D1/0808—Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Navigation (AREA)
Abstract
The invention provides an outdoor space sightseeing method and system. The controller determines a target sightseeing route from at least one sightseeing route preset in the current outdoor space according to a sightseeing route selection instruction input by a user; the controller demarcates an electronic fence according to the target sightseeing route so as to guide a user and a flight controller to jointly control the unmanned aerial vehicle to fly in the current outdoor space within the range of the electronic fence; the unmanned aerial vehicle acquires audio and video data in the flight process in real time through a preset camera; the controller carries out AR processing on the audio and video data to generate real-time audio and video stream which can be played by the display equipment; and the display equipment plays the audio and video stream after AR processing so that a user can sightseeing the current outdoor space through the visual angle of the unmanned aerial vehicle. The scheme provided by the invention can provide better sightseeing experience for the tourists.
Description
Technical Field
The invention relates to the technical field of unmanned aerial vehicles, in particular to an outdoor space sightseeing method and system.
Background
At present, because the operation mode of the traditional tourism industry is relatively fixed, better sightseeing experience can not be provided for tourists in certain scenes. For example, the passenger flow in hot scenic spots and hot tourist cities is large and concentrated, and a lot of time is spent in scenes with intensive personnel, such as ticket purchase, during the sightseeing process, so that the experience of tourists is influenced; in addition, the situation of insufficient sight spot play may occur in some scenes, such as feeling tired during play, requiring a stop and rest, or the position and topography of the sight spot to be viewed are dangerous or the path is not repaired, so that the visitors cannot approach to view the sight spot. In view of the foregoing, there is a need for a method to solve the above problems and provide a better sightseeing experience for tourists.
Disclosure of Invention
The present application is proposed to solve the above-mentioned technical problems. The embodiment of the application provides an outdoor space sightseeing method and system, which can provide better sightseeing experience for tourists.
According to an aspect of the present invention, an embodiment of the present invention provides an outdoor space sightseeing method, including: the controller determines a target sightseeing route from at least one sightseeing route preset in the current outdoor space according to a sightseeing route selection instruction input by a user; the controller demarcates an electronic fence according to the target sightseeing route so as to guide a user and a flight controller to jointly control the unmanned aerial vehicle to fly in the current outdoor space within the range of the electronic fence; the unmanned aerial vehicle acquires audio and video data in the flight process in real time through a preset camera; the controller carries out AR processing on the audio and video data to generate real-time audio and video stream which can be played by the display equipment; and the display equipment plays the audio and video stream after AR processing so that a user can sightseeing the current outdoor space through the visual angle of the unmanned aerial vehicle.
In one embodiment, the outdoor space sightseeing method further comprises: when the distance value between the unmanned aerial vehicle and any boundary of the electronic fence is smaller than a first threshold value, the controller generates and displays prompt information in the audio and video stream after AR processing so as to guide a user to control the unmanned aerial vehicle to be far away from the boundary; and when the distance value between the unmanned aerial vehicle and any boundary of the electronic fence is smaller than a second threshold value, the controller sends a control instruction to the flight controller so that the flight controller controls the unmanned aerial vehicle to be far away from the boundary, wherein the second threshold value is smaller than the first threshold value.
In an embodiment, each of the sightseeing routes includes at least one scenic spot area, and the outdoor space sightseeing method further includes: when the unmanned aerial vehicle flies into the range of the target scenery spot area, the controller acquires an explanation audio preset in the target scenery spot area; and the controller outputs the explanation audio to the display device for playing.
In one embodiment, the outdoor space sightseeing method further comprises: the display device identifies a visual angle adjustment action of a user; the controller converts the visual angle adjusting action into a corresponding visual angle adjusting instruction; and the flight controller adjusts the posture of the camera of the unmanned aerial vehicle according to the visual angle adjusting instruction.
In one embodiment, the view angle adjusting instruction includes: zooming in and out, rotating the visual angle in the downward direction, rotating the visual angle in the upward direction, rotating the visual angle in the left direction, rotating the visual angle in the right direction, and restoring the initial visual angle.
In one embodiment, the outdoor space sightseeing method further comprises: the unmanned aerial vehicle acquires external environment information in real time in flight; and the controller adjusts the watching environment of the user according to the external environment information.
In one embodiment, the external environment information includes wind speed information and wind direction information, and the controller adjusts the viewing environment in which the user is located according to the external environment information includes: the controller adjusts a preset blowing angle of at least one fan according to the wind direction information; controlling the at least one fan to blow according to the wind speed information;
in one embodiment, the external environment information includes temperature information, and the controller adjusts the viewing environment in which the user is located according to the external environment information includes: and the controller adjusts the temperature of the watching environment according to the temperature information.
In one embodiment, the outdoor space sightseeing method further comprises: the controller extracts audio data in the audio and video data; extracting noise data in the audio data according to the audio features of the noise; and performing noise reduction processing on the noise data.
In one embodiment, the outdoor space sightseeing method further comprises: the unmanned aerial vehicle sends millimeter wave beams according to a preset time interval through a preset millimeter wave radar to detect a route environment; when an obstacle is detected, the controller judges whether the obstacle is in a moving state; when the obstacle is static, the unmanned aerial vehicle is controlled to avoid the obstacle through the flight controller; when the obstacle is in a moving state, the controller simulates a moving path of the obstacle; and the controller controls the unmanned aerial vehicle to avoid the obstacle through the flight controller according to the moving path.
According to another aspect of the present invention, an embodiment of the present invention provides an outdoor space sightseeing system, including: the system comprises a controller, a flight controller, an unmanned aerial vehicle and display equipment; the controller is used for determining a target sightseeing route from at least one sightseeing route preset in the current outdoor space according to a sightseeing route selection instruction input by a user; an electronic fence is defined according to the target sightseeing route so as to guide a user and a flight controller to jointly control the unmanned aerial vehicle to fly in the current outdoor space within the range of the electronic fence; the unmanned aerial vehicle is used for acquiring audio and video data in the flight process in real time through a preset camera; the controller is further configured to perform AR processing on the audio/video data to generate a real-time audio/video stream that can be played by the display device; and the display equipment is used for playing the real-time audio and video stream after AR so that a user can sightseeing the current outdoor space from the visual angle of the unmanned aerial vehicle.
According to the outdoor space sightseeing method and system provided by the embodiment of the invention, the flight controller takes over the unmanned aerial vehicle and transmits the control instruction, then route guidance is carried out according to a target sightseeing route selected by a user from a plurality of preset sightseeing routes, and the user is guided to control the unmanned aerial vehicle to fly according to the target sightseeing route in the planned electronic fence. After the unmanned aerial vehicle takes off, audio and video data in the flight process are acquired in real time through the camera and transmitted back to the controller, the controller transcodes the audio and video data into audio and video streams which can be played by the display device, and the display device plays the real-time audio and video streams processed by the AR, so that visitors experience scenes shot by the unmanned aerial vehicle in real time in an immersion mode in the display device. The scheme that this application provided passes through unmanned aerial vehicle, has opened up unique air tour route for outdoor space, can reach the place that many tourists can't arrive on foot to the tourists need not spend a large amount of time on the way, can not feel tired in the sightseeing in-process yet, experience for the tourists provides better sightseeing.
Drawings
Fig. 1 is a schematic flow chart of an outdoor space sightseeing method according to an exemplary embodiment of the present application.
Fig. 2 is a schematic flow chart of another outdoor space sightseeing method according to an exemplary embodiment of the present application.
Fig. 3 is a schematic flow chart of another outdoor space sightseeing method according to an exemplary embodiment of the present application.
Fig. 4 is a flowchart illustrating a method for adjusting a viewing angle according to an exemplary embodiment of the present disclosure.
Fig. 5 is a schematic flow chart of another outdoor space sightseeing method according to an exemplary embodiment of the present application.
Fig. 6 is a flowchart illustrating a noise reduction method according to an exemplary embodiment of the present application.
Fig. 7 is a schematic flowchart of an obstacle avoidance method for an unmanned aerial vehicle according to an exemplary embodiment of the present application.
Fig. 8 is a schematic structural diagram of an outdoor space sightseeing system according to an exemplary embodiment of the present application.
Fig. 9 is a schematic structural diagram of another outdoor space sightseeing system provided in an exemplary embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Further, in the exemplary embodiments, since the same reference numerals denote the same components having the same structure or the same steps of the same method, if an embodiment is exemplarily described, only a structure or a method different from the already described embodiment is described in other exemplary embodiments.
Throughout the specification and claims, when one element is described as being "connected" to another element, the one element may be "directly connected" to the other element or "electrically connected" to the other element through a third element. Furthermore, unless explicitly described to the contrary, the term "comprising" and its corresponding terms should only be taken as including the stated features, but should not be taken as excluding any other features.
An embodiment of the invention provides an outdoor space sightseeing method, which comprises the following steps:
step 110: the controller determines a target sightseeing route from at least one sightseeing route preset in the current outdoor space according to a sightseeing route selection instruction input by a user.
Specifically, each sightseeing route is planned according to a pre-surveyed environment, each sightseeing route can comprise all or some representative scenic spots of outdoor space of a scenic area, the sightseeing route comprising all the scenic spots is long, the time required for watching is more, and a user can select the sightseeing route according to the scenic spot which the user wants to watch or according to the expected watching time.
Step 120: the controller demarcates the electronic fence according to the target sightseeing route so as to guide the user and the flight controller to jointly control the unmanned aerial vehicle to fly in the current outdoor space within the range of the electronic fence.
In particular, since the manipulation of the drone requires some basis and for ease of management, each sightseeing route is actually a relatively fixed and enclosed area, i.e. an electronic fence. Route guidance appears after the target sightseeing route is determined, and a user is guided to control the unmanned aerial vehicle according to the route guidance. Meanwhile, the flight controller can also perform auxiliary control on the unmanned aerial vehicle through the background, so that the unmanned aerial vehicle is ensured not to leave a target sightseeing route, and the flight controller intervenes to prevent dangerous operation behaviors when necessary. The route of each sightseeing route between the scenic spots can be set to be a relatively small range, and the advance of the unmanned aerial vehicle can be guaranteed. After the sight spot is reached, a larger range can be established in a sightseeing route around the sight spot, so that the user can control the unmanned aerial vehicle to move in the range, and the scenery of the sight spot can be viewed in an all-round manner. In conclusion, through the relatively fixed sightseeing route and the auxiliary control of the flight controller, the danger and the uncertainty caused by various human factors can be avoided. And a relatively free browsing area is arranged near each scenic spot, so that the user experience is ensured. For example, the sightseeing route comprises at least one hovering area, the unmanned aerial vehicle end starts to move along the sightseeing route from the starting point, suspends for a preset time after reaching each hovering area, and then continues to move along the sightseeing route until reaching the end point. It is understood that the sightseeing path may be closed graphics or non-closed graphics.
Step 130: the unmanned aerial vehicle acquires audio and video data in the flight process in real time through a preset camera.
Specifically, the unmanned aerial vehicle is provided with a communication module and a camera, the camera is used for acquiring audio and video data of an unmanned site, realizing multi-angle video and audio shooting, and reporting the audio and video data to the controller, and the controller is used as a medium of the unmanned aerial vehicle and the display equipment and forwards the audio and video data to the display equipment; in order to ensure the data reporting rate and stability, the communication between the unmanned aerial vehicle and the controller is carried out through self-contained wireless signals. Through this wireless signal, on the one hand can transmit the control signal of controller to unmanned aerial vehicle, and on the other hand receives the audio and video data that unmanned aerial vehicle returned. If the communication module uses WIFI signals, the communication is limited by the signal range. After unmanned aerial vehicle left WIFI signal scope, the connection between controller and the unmanned aerial vehicle can break off, leads to the unable passback of audio and video data, and the controller also can lose the control to unmanned aerial vehicle, and the user can't see unmanned aerial vehicle's the removal condition at the condition that does not have the audio and video data passback, can't come manual control unmanned aerial vehicle according to the picture of seeing, accident takes place easily. Therefore, the 4G/5G module can be installed on the unmanned aerial vehicle, and the audio and video information sent by the unmanned aerial vehicle is forwarded to the display device through the 4G/5G module. Because 4G/5G's signal coverage model essay is great, unmanned aerial vehicle can guarantee signal transmission's integrality, speed and signal quality in whole scenic spot outdoor space or in whole sightseeing route. Data transmission between the unmanned aerial vehicle and the display device is transferred through 4G/5G, so that the reliability and the transmission speed of the data transmission between the unmanned aerial vehicle and the display device are enhanced, and the data transmission quality is improved. In addition, the distance and the coverage range of the audio and video data return can be expanded in a wider range through the 4G/5G module, the flying and control radius of the unmanned aerial vehicle is enlarged, and a wider space is explored.
Step 140: and the controller performs AR processing on the audio and video data to generate real-time audio and video stream which can be played by the display equipment.
Specifically, if only shoot the picture through unmanned aerial vehicle and transmit the picture to the screen of equipment such as cell-phone, computer on to watch and lack first visual angle and immerse and feel to only watch through traditional screen when receiving the influence of watching conditions such as illumination in the environment, probably bring the not good experience of watching for the user, consequently, use the display device that can play real-time audio video stream to watch and can guarantee user's the experience of watching. Images such as scenic spots, geographical names, historical appearances, geological changes and the like related to outdoor space are overlaid and displayed on the real scene through the AR technology, and the watching effect is enriched. The display device can be a pair of head-mounted intelligent glasses, an intelligent helmet, an all-in-one machine with a display screen or an experience cabin, and other audio output devices such as earphones can also be added.
Step 150: and the display equipment plays the audio and video stream after AR processing so that the user can sightseeing the current outdoor space through the visual angle of the unmanned aerial vehicle.
Specifically, the drone takes video and stereo shots with a camera, but the audio-video data cannot be directly used for the display device. After the controller forwards the audio and video data to the display device, the display device performs processing such as coding and decoding, AR effect and the like on the audio and video data, and converts the audio and video data into an on-site audio and video stream image of the unmanned aerial vehicle. The user can be more three-dimensional, the visual scene picture of watching unmanned aerial vehicle through display device, sightseeing the sight spot from different angles, satisfies user's the demand of watching and watches experience.
In an embodiment of the present invention, as shown in fig. 2, the outdoor space sightseeing method may further include the steps of:
step 210: when the distance value between the unmanned aerial vehicle and any boundary of the electronic fence is smaller than a first threshold value, the controller generates and displays prompt information in the audio and video stream after the AR processing so as to guide a user to control the unmanned aerial vehicle to be far away from the boundary.
Specifically, as described above, the unmanned aerial vehicle flies along the relatively fixed sightseeing route in the environment surveyed in advance, and ensuring the operation safety of the unmanned aerial vehicle is a key for ensuring the stable and reliable execution of the sightseeing method, so that the control of the user on the unmanned aerial vehicle is limited, the user can control the unmanned aerial vehicle to fly in the range allowed by the target sightseeing route, but the unmanned aerial vehicle cannot fly away from the range of the electronic fence to which the target sightseeing route belongs. When the distance value is smaller than the preset first threshold value, that is, the unmanned aerial vehicle is approaching the boundary of the target sightseeing route, the unmanned aerial vehicle may fly away from the target sightseeing route if the unmanned aerial vehicle continues to keep the current moving state, so that prompt information is generated in the audio and video stream to guide the user to adjust the flight direction of the unmanned aerial vehicle, for example, a direction arrow is displayed in the audio and video stream through an AR to prompt the user to adjust the flight direction of the unmanned aerial vehicle to the direction.
Step 220: when the distance value between the unmanned aerial vehicle and any boundary of the electronic fence is smaller than a second threshold value, the controller sends a control instruction to the flight controller so that the flight controller controls the unmanned aerial vehicle to be far away from the boundary, wherein the second threshold value is smaller than the first threshold value.
Specifically, when the distance value is smaller than the preset second threshold, the second threshold is smaller than the first threshold, which indicates that the boundary between the unmanned aerial vehicle and the electronic fence is very close to the first threshold, and the unmanned aerial vehicle can leave the target sightseeing route quickly when flying in the direction. In order to prevent danger and uncertainty caused by human factors, the flight controller intervenes in the direction control of the unmanned aerial vehicle, forcibly drives the unmanned aerial vehicle to change the flight direction and keeps flying in a target sightseeing route. When necessary, the control instruction input by the user can be completely cut off, and the controller controls the unmanned aerial vehicle to hover or fly to the electronic fence range of the target sightseeing route, so that the safety of the flight process is ensured.
In an embodiment of the present invention, as shown in fig. 3, each of the sightseeing routes includes at least one scenic spot area, and the outdoor space sightseeing method may further include the following steps:
step 310: when the unmanned aerial vehicle flies to a target scenic spot area range, the controller acquires an explanation audio preset in the target scenic spot area.
Specifically, in order to further improve the sightseeing experience of the user, the user can know the characteristics of each scenic spot and landscape, and a corresponding explanation audio is set for each scenic spot in advance. The content of the explained audio comprises the natural environment, the social environment, the cultural environment and the like of the scenic spot. Preferably, the explanation contents can be classified into various explanation words including geological landforms, climate, hydrology, biology, cultural relics, folk custom, local specials and the like in advance.
Step 320: the controller outputs the explanation audio to the display device for playing.
Specifically, in the regional scope of unmanned aerial vehicle flight to target sight spot, begin to play the explanation content that has set up in advance, help the better understanding this sight spot of user. In addition, some auxiliary explanation contents, such as pictures, animations or videos, can be inserted into the audio/video stream contents while the explanation contents are played, so that the sightseeing experience of the user is further improved.
As shown in fig. 4, on the basis of the outdoor space sightseeing method, an embodiment of the present invention provides a method for adjusting a viewing angle, including:
step 410: the display device recognizes a viewing angle adjustment action of a user.
Specifically, for the viewing preferences of different users, the display device can also recognize the viewing angle adjustment action made by the user while displaying the audio/video stream. Before performing motion recognition, a detection object, such as a user's head, needs to be set as a recognition reference object, that is, recognition is performed according to the motion of the user's head. The visual angle adjusting action comprises: the object to be detected is rotated upward, the object to be detected is rotated downward, the object to be detected is rotated leftward, the object to be detected is rotated rightward, and the like.
Step 420: the controller converts the visual angle adjusting action into a corresponding visual angle adjusting instruction.
Specifically, the corresponding relationship between each visual angle adjusting action and each visual angle adjusting instruction is as follows: the object to be detected rotates upward and rotates upward corresponding to the angle of view, the object to be detected rotates downward and rotates downward corresponding to the angle of view and rotates downward, the object to be detected rotates leftward corresponding to the angle of view and rotates leftward, and the object to be detected rotates rightward corresponding to the angle of view and rotates rightward. For the visual magnification, the visual reduction and the restoration of the initial visual angle, other corresponding visual angle adjusting actions can be set to correspond to the visual magnification, if the detected object is a head, the head stretching action can correspond to the visual magnification, the head retracting action can correspond to the visual reduction, and the head shaking three times continuously corresponds to the restoration of the initial visual angle.
Step 430: the flight control ware adjusts unmanned aerial vehicle's camera gesture according to visual angle adjustment instruction.
Specifically, the flight controller controls the unmanned aerial vehicle end to perform actions such as view enlargement, view reduction, view depression rotation, view elevation rotation, view left rotation, view right rotation, no action, initial view restoration and the like, the unmanned aerial vehicle end receives a view adjustment instruction while flying/hovering in the air, and executes corresponding actions according to the view adjustment instruction, so that a user can view a view more reasonably and individually according to the needs of the user.
In an embodiment of the present invention, as shown in fig. 5, the outdoor space sightseeing method may further include:
step 510: the unmanned aerial vehicle acquires external environment information in real time in flight.
Step 520: the controller adjusts the viewing environment in which the user is located according to the external environment information.
In an embodiment of the present invention, the external environment information includes wind speed information and wind direction information, and the adjusting, by the controller, the viewing environment in which the user is located according to the external environment information includes:
the controller adjusts a preset blowing angle of at least one fan according to the wind direction information; and
controlling at least one fan to blow according to the wind speed information;
in an embodiment of the present invention, the external environment information includes temperature information, and the adjusting, by the controller, the viewing environment in which the user is located according to the external environment information includes:
the controller adjusts the temperature of the viewing environment according to the temperature information.
Specifically, in order to improve the user's sense of immersion during sightseeing, devices for simulating a live-action environment, such as fans and a central air conditioner, disposed in various directions are also provided around the display device. The rotating speed and the direction of the fan can be freely controlled, and the temperature, the wind direction and the wind speed of an outdoor space are simulated by combining a central air conditioner.
On the basis of the outdoor space sightseeing method, as shown in fig. 6, an embodiment of the present invention provides a noise reduction method, including:
step 610: the controller extracts audio data in the audio and video data.
Step 620: and extracting noise data in the audio data according to the audio features of the noise.
Step 630: and carrying out noise reduction processing on the noise data.
In particular, as the unmanned aerial vehicle moves in the air, some noise affecting the viewing experience can be generated in the moving process, such as wind noise generated when the moving speed is fast or the natural wind is strong. After the audio and video data are obtained, the noise data are extracted according to the audio characteristics of the noise, and noise reduction processing is carried out. For example, by calculating the sound wave characteristics of the noise data, the reverse sound waves are emitted to cancel each other out, thereby playing a role of noise reduction.
As shown in fig. 7, on the basis of the outdoor space sightseeing method, an embodiment of the present invention provides an unmanned aerial vehicle obstacle avoidance method, which includes:
step 710: the unmanned aerial vehicle sends millimeter wave beams to detect the air route environment according to a preset time interval through a preset millimeter wave radar.
Step 720: when the obstacle is detected, the controller determines whether the obstacle is in a moving state.
Step 730: when the barrier is static, the unmanned aerial vehicle is controlled by the flight controller to avoid the barrier.
Step 740: when the obstacle is in a moving state, the controller simulates a moving path of the obstacle.
Step 750: the controller is according to the removal route, avoids the barrier through flying controller control unmanned aerial vehicle.
Specifically, in order to prevent the unmanned aerial vehicle from collision accidents in the moving process, whether an obstacle exists on a route is detected by sending millimeter wave beams at intervals of a period of time through a millimeter wave radar, and when the obstacle is detected, whether the obstacle is in a moving state is determined according to whether the positions of the obstacle obtained at a plurality of detection time points are the same. If the positions of the obstacles detected by the detection time points are the same, controlling the unmanned aerial vehicle to avoid the obstacles according to the positions of the obstacles. If the positions of the obstacles are different at a plurality of detection time points, the moving path of the obstacles is simulated according to the change distance and the change direction of the positions, and the moving path is avoided, so that the obstacles are prevented from colliding.
In addition, whether the normal work of unmanned aerial vehicle body is concerned with whether sightseeing can normally go on, so guarantee unmanned aerial vehicle body's operation safety is the key of the reliable and stable work of guarantee system. Consequently, the controller can also monitor operating condition such as the functioning speed of unmanned aerial vehicle body, course, declination, and after discovering unusually, in time control unmanned aerial vehicle body and drop to appointed position and maintain the work. When unmanned aerial vehicle electric quantity is not enough or breaks down, controller control unmanned aerial vehicle falls to the district that charges of predetermineeing and detects and charge.
As shown in fig. 8, an embodiment of the present invention provides an outdoor space sightseeing system, including:
a controller 810, a flight controller 820, a drone 830, and a display device 840;
a controller 810 for determining a target sightseeing route from at least one sightseeing route preset in a current outdoor space, from a sightseeing route selection instruction input by a user; an electronic fence is defined according to the target sightseeing route so as to guide the user and the flight controller 820 to jointly control the unmanned aerial vehicle 830 to fly in the current outdoor space within the range of the electronic fence;
the unmanned aerial vehicle 830 is used for acquiring audio and video data in the flight process in real time through a preset camera;
the controller is further configured to perform AR processing on the audio/video data to generate a real-time audio/video stream that can be played by the display device 840; and
and the display device 840 is configured to play the real-time audio/video stream after AR so that the user can watch the current outdoor space from the view angle of the unmanned aerial vehicle 830.
In an embodiment of the present invention, as shown in fig. 9, the controller may include a central control module 811 and a plurality of consoles, the outdoor space sightseeing system further includes a plurality of flight controllers 820, each flight controller 820 is configured to receive a control instruction of the central control module, and the unmanned aerial vehicle controlled by the flight controller 820 is controlled according to the control instruction, for example, two consoles are used, the console 812 and the console 813 are in communication with the central control module 811, each console is connected to a plurality of display devices 840 and receives an unmanned aerial vehicle control instruction output by a user through a control lever, and sends the control instruction to the central control module 811, and the central control module 811 forwards the control instruction to the corresponding flight controller 820, so as to control the unmanned aerial vehicle.
The foregoing describes the general principles of the present application in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present application are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present application. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the foregoing disclosure is not intended to be exhaustive or to limit the disclosure to the precise details disclosed.
The block diagrams of devices, apparatuses, systems referred to in this application are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".
It should also be noted that in the methods and systems of the present application, the components or steps may be broken down and/or recombined. These decompositions and/or recombinations are to be considered as equivalents of the present application.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the application to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.
Claims (10)
1. A method for viewing an outdoor space, comprising:
the controller determines a target sightseeing route from at least one sightseeing route preset in the current outdoor space according to a sightseeing route selection instruction input by a user;
the controller demarcates an electronic fence according to the target sightseeing route so as to guide a user and a flight controller to jointly control the unmanned aerial vehicle to fly in the current outdoor space within the range of the electronic fence;
the unmanned aerial vehicle acquires audio and video data in the flight process in real time through a preset camera;
the controller carries out AR processing on the audio and video data to generate real-time audio and video stream which can be played by the display equipment; and
and the display equipment plays the audio and video stream after AR processing so that a user can sightseeing the current outdoor space through the visual angle of the unmanned aerial vehicle.
2. The outdoor space sightseeing method of claim 1 further comprising:
when the distance value between the unmanned aerial vehicle and any boundary of the electronic fence is smaller than a first threshold value, the controller generates and displays prompt information in the audio and video stream after AR processing so as to guide a user to control the unmanned aerial vehicle to be far away from the boundary; and
when the distance value between the unmanned aerial vehicle and any boundary of the electronic fence is smaller than a second threshold value, the controller sends a control instruction to the flight controller so that the flight controller controls the unmanned aerial vehicle to be far away from the boundary, wherein the second threshold value is smaller than the first threshold value.
3. The outdoor space sightseeing method of claim 1 wherein each of the sightseeing routes includes at least one attraction area therein, the outdoor space sightseeing method further comprising:
when the unmanned aerial vehicle flies into the range of the target scenery spot area, the controller acquires an explanation audio preset in the target scenery spot area; and
and the controller outputs the explanation audio to the display equipment for playing.
4. The outdoor space sightseeing method of claim 1 wherein the outdoor space sightseeing method further comprises:
the display device identifies a visual angle adjustment action of a user;
the controller converts the visual angle adjusting action into a corresponding visual angle adjusting instruction; and
and the flight controller adjusts the posture of the camera of the unmanned aerial vehicle according to the visual angle adjusting instruction.
5. The outdoor space sightseeing method of claim 4,
the view angle adjustment instruction includes: zooming in and out, rotating the visual angle in the downward direction, rotating the visual angle in the upward direction, rotating the visual angle in the left direction, rotating the visual angle in the right direction, and restoring the initial visual angle.
6. The outdoor space sightseeing method of claim 1 wherein the outdoor space sightseeing method further comprises:
the unmanned aerial vehicle acquires external environment information in real time in flight; and
and the controller adjusts the watching environment of the user according to the external environment information.
7. The outdoor space sightseeing method of claim 6,
the external environment information comprises wind speed information and wind direction information, and the controller adjusts the viewing environment of the user according to the external environment information comprises:
the controller adjusts a preset blowing angle of at least one fan according to the wind direction information; and
controlling the at least one fan to blow according to the wind speed information;
and/or the presence of a gas in the gas,
the external environment information includes temperature information, and the controller adjusts a viewing environment in which the user is located according to the external environment information includes:
and the controller adjusts the temperature of the watching environment according to the temperature information.
8. The outdoor space sightseeing method of claim 1 wherein the outdoor space sightseeing method further comprises:
the controller extracts audio data in the audio and video data;
extracting noise data in the audio data according to the audio features of the noise; and
and performing noise reduction processing on the noise data.
9. The outdoor space sightseeing method of claim 1 wherein the outdoor space sightseeing method further comprises:
the unmanned aerial vehicle sends millimeter wave beams according to a preset time interval through a preset millimeter wave radar to detect a route environment;
when an obstacle is detected, the controller judges whether the obstacle is in a moving state;
when the obstacle is static, the unmanned aerial vehicle is controlled to avoid the obstacle through the flight controller;
when the obstacle is in a moving state, the controller simulates a moving path of the obstacle; and
the controller controls the unmanned aerial vehicle to avoid the obstacle through the flight controller according to the moving path.
10. An outdoor space sightseeing system comprising:
the system comprises a controller, a flight controller, an unmanned aerial vehicle and display equipment;
the controller is used for determining a target sightseeing route from at least one sightseeing route preset in the current outdoor space according to a sightseeing route selection instruction input by a user; an electronic fence is defined according to the target sightseeing route so as to guide a user and a flight controller to jointly control the unmanned aerial vehicle to fly in the current outdoor space within the range of the electronic fence;
the unmanned aerial vehicle is used for acquiring audio and video data in the flight process in real time through a preset camera;
the controller is further configured to perform AR processing on the audio/video data to generate a real-time audio/video stream that can be played by the display device; and
and the display equipment is used for playing the real-time audio and video stream after AR so that a user can sightseeing the current outdoor space through the visual angle of the unmanned aerial vehicle.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110721020.8A CN113391639A (en) | 2021-06-28 | 2021-06-28 | Outdoor space sightseeing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110721020.8A CN113391639A (en) | 2021-06-28 | 2021-06-28 | Outdoor space sightseeing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113391639A true CN113391639A (en) | 2021-09-14 |
Family
ID=77624194
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110721020.8A Pending CN113391639A (en) | 2021-06-28 | 2021-06-28 | Outdoor space sightseeing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113391639A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114666493A (en) * | 2021-12-22 | 2022-06-24 | 杭州易现先进科技有限公司 | AR (augmented reality) viewing service system and terminal |
| CN115460539A (en) * | 2022-06-30 | 2022-12-09 | 亮风台（上海）信息科技有限公司 | Method, device, medium and program product for acquiring electronic fence |
-
2021
- 2021-06-28 CN CN202110721020.8A patent/CN113391639A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114666493A (en) * | 2021-12-22 | 2022-06-24 | 杭州易现先进科技有限公司 | AR (augmented reality) viewing service system and terminal |
| CN114666493B (en) * | 2021-12-22 | 2024-01-26 | 杭州易现先进科技有限公司 | AR sightseeing service system and terminal |
| CN115460539A (en) * | 2022-06-30 | 2022-12-09 | 亮风台（上海）信息科技有限公司 | Method, device, medium and program product for acquiring electronic fence |
| CN115460539B (en) * | 2022-06-30 | 2023-12-15 | 亮风台（上海）信息科技有限公司 | Method, equipment, medium and program product for acquiring electronic fence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200394009A1 (en) | Systems and methods for gimbal simulation | |
| JP2022119858A (en) | Systems and methods for augmented reality representations of networks | |
| KR101683275B1 (en) | Remote navigating simulation system for unmanned vehicle | |
| US20190179511A1 (en) | Information processing device, information processing method, and program | |
| CN113391639A (en) | Outdoor space sightseeing method and system | |
| EP3629309A2 (en) | Drone real-time interactive communications system | |
| CN108733070A (en) | Unmanned aerial vehicle (UAV) control method and control system | |
| US20180278995A1 (en) | Information processing apparatus, information processing method, and program | |
| US20240078776A1 (en) | Data processing program, data processing method and data processing device for displaying external information in virtual space | |
| CN108766314A (en) | Unmanned plane viewing system based on VR technologies | |
| KR20190063883A (en) | System for providing augmented reality interactive game contents using a drones | |
| WO2021038834A1 (en) | Operation simulation system and method for unmanned aircraft | |
| JP2016208255A (en) | Movable projection device | |
| Walter et al. | Virtual UAV ground control station | |
| CN113677412B (en) | Information processing device, information processing method, and program | |
| WO2018209557A1 (en) | Method and device for controlling device, and computer readable storage medium | |
| JP6687954B2 (en) | Mobile projection device and projection system | |
| CN110389661A (en) | Equipment is experienced in immersion long haul travel based on VR technology, small drone and high speed communication technology | |
| EP3400991A1 (en) | Transport simulation in a location-based mixed-reality game system | |
| KR101881227B1 (en) | Flight experience method using unmanned aerial vehicle | |
| CN113093915A (en) | Multi-person interaction control method, device, equipment and storage medium | |
| EP3400992A1 (en) | Providing a location-based mixed-reality experience | |
| CN111923918A (en) | Method for assisting virtual reality in a vehicle and associated control device | |
| WO2018206605A1 (en) | Transport simulation in a location-based mixed-reality game system | |
| KR102620333B1 (en) | System for Controlling Media Art Content by using Viewing data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210914 |