CN112068701A - Virtual imaging social equipment - Google Patents
Virtual imaging social equipment Download PDFInfo
- Publication number
- CN112068701A CN112068701A CN202010923038.1A CN202010923038A CN112068701A CN 112068701 A CN112068701 A CN 112068701A CN 202010923038 A CN202010923038 A CN 202010923038A CN 112068701 A CN112068701 A CN 112068701A
- Authority
- CN
- China
- Prior art keywords
- virtual imaging
- inflation
- chassis
- central control
- social
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 claims abstract description 15
- 230000001953 sensory effect Effects 0.000 claims abstract description 14
- 230000009471 action Effects 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims abstract description 5
- 239000002245 particle Substances 0.000 claims description 30
- 238000003860 storage Methods 0.000 claims description 14
- 238000004040 coloring Methods 0.000 claims description 12
- 230000009467 reduction Effects 0.000 claims description 9
- 238000002347 injection Methods 0.000 claims description 8
- 239000007924 injection Substances 0.000 claims description 8
- 230000033001 locomotion Effects 0.000 claims description 8
- 230000004888 barrier function Effects 0.000 claims description 7
- 210000000697 sensory organ Anatomy 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 5
- 230000007246 mechanism Effects 0.000 claims description 5
- 238000005259 measurement Methods 0.000 claims description 4
- 238000005362 photophoresis Methods 0.000 claims description 2
- 230000002194 synthesizing effect Effects 0.000 claims description 2
- 230000006854 communication Effects 0.000 abstract description 8
- 230000006870 function Effects 0.000 abstract description 8
- 238000000034 method Methods 0.000 abstract description 8
- 238000004891 communication Methods 0.000 abstract description 7
- 238000011840 criminal investigation Methods 0.000 abstract description 4
- 230000035943 smell Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 241000282414 Homo sapiens Species 0.000 description 4
- 235000019083 Osmanthus fragrans Nutrition 0.000 description 4
- 244000242564 Osmanthus fragrans Species 0.000 description 4
- 238000010276 construction Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 3
- 239000011521 glass Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008054 signal transmission Effects 0.000 description 2
- 239000011165 3D composite Substances 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/005—Language recognition
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Electromagnetism (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Toys (AREA)
Abstract
A virtual imaging social device comprises a sense device, an odor output device, a virtual imaging device, a chassis device and a central control device; the sensory device comprises an image acquisition unit, a projection unit, an infrared ranging unit and a voice recognition unit; the odor output device releases the odor of the corresponding article according to the name of the odorous article identified by the voice identification unit; the virtual imaging device is used for processing the 3D synthetic image into a 3D virtual image; the chassis device is used for executing the action of the equipment according to the instruction sent by the central control device; the central control device is connected with and controls the devices; therefore, the functions of camera shooting, virtual 3D imaging, image projection, voice communication, obstacle avoidance, smell identification, distance following and the like are realized, people can be placed in a remote real environment, the sense is improved in multimedia social contact, and the method can be widely applied to the fields of tourism, education, office, shopping, criminal investigation and the like.
Description
Technical Field
The invention relates to the technical field of social robots, in particular to virtual imaging social equipment.
Background
Most of social products widely applied in the market currently mainly display 2-dimensional images and communicate languages, and people make different social devices and really use the social devices in production and life, but cannot achieve the degree of integrating multiple functions. The prior art can realize 2-dimensional image display, language communication, file transmission and the like, or a user can see the full view of an object only by wearing special visual equipment such as VR (virtual reality) and AR (augmented reality) glasses. However, no virtual imaging social device integrating multiple functions is applied to human beings, and with the progress of activities such as human production and life, the demand on social tools is more and more strong, and functions such as camera shooting, virtual 3D imaging, image projection, voice communication, obstacle avoidance, odor identification and distance following are integrated, so that the virtual imaging social device is a problem to be solved urgently for meeting various demands of human production and life.
Disclosure of Invention
In order to solve the problems, the invention provides a virtual imaging social device which realizes the functions of camera shooting, virtual 3D imaging, image projection, voice communication, obstacle avoidance, odor identification, distance following and the like through the control of a central control device, can enable people to be placed in a remote real environment, not only can bring sense enhancement to people in multimedia social contact, but also can be widely applied to the fields of tourism, education, office work, shopping, criminal investigation and the like.
The invention is realized by adopting the following technical scheme:
a virtual imaging social device comprising: a sense device, a smell output device, a virtual imaging device, a chassis device and a central control device;
the sensory device comprises an image acquisition unit, a projection unit, an infrared ranging unit and a voice recognition unit;
the image acquisition unit is used for acquiring images and synthesizing the acquired images into a 3D synthetic image; the projection unit is used for projecting the 3D virtual image; the infrared ranging unit is used for measuring the distance between an obstacle and the equipment; the voice recognition unit is used for judging and recognizing the language of the user;
the odor output device releases the odor of the corresponding article according to the name of the odorous article identified by the voice identification unit;
the virtual imaging device is used for processing the 3D synthetic image into a 3D virtual image;
the chassis device is used for executing the action of the equipment according to the instruction sent by the central control device;
the central control device is connected with and controls the sense organ device, the smell output device, the virtual imaging device and the chassis device.
Further, the image acquisition unit comprises two cameras;
the infrared ranging unit comprises a ranging hole, an infrared transmitting part and an infrared receiving tube; the infrared emission component is arranged in the ranging hole and used for emitting infrared rays; the infrared rays are projected outwards through the distance measuring holes; the infrared signal is received by the infrared receiving tube after being reflected by the barrier.
Further, the odor output device comprises an odor controller and a plurality of gas storage cylinders, and each gas storage cylinder is provided with an inflation component and an air injection component;
and after receiving the signal of the name of the odorous article identified by the voice identification unit, the central control device judges the number of the gas cylinder and sends an instruction to the odor controller, and the odor controller controls the gas injection part of the gas cylinder with the corresponding number to be opened and releases the gas odor in the gas cylinder with the corresponding number.
Further, the inflation component comprises an inflation pipe, an inflation pump, a plurality of inflation branch pipes and a plurality of inflation electromagnetic valves;
the inflation pump is connected with an inflation pipe, the inflation pipe is respectively connected with each inflation branch pipe, and each inflation branch pipe is connected with the corresponding gas storage bottle so as to inflate the corresponding gas storage bottle through each inflation branch pipe; and when the inflation electromagnetic valve corresponding to a certain gas storage bottle is opened, the inflation pump works and inflates the gas storage bottle through the inflation pipe and the corresponding inflation branch pipe.
Further, the virtual imaging device comprises a plurality of volume imaging tubes, and the volume imaging tubes comprise a volume image projection control device, a particle emission device, a photophoretic trap control device and a particle coloring device.
The particle emission device is used for emitting particles into the photophoretic trap when the photophoretic trap is free of the particles;
the device for controlling the photophoretic traps is used for controlling the positions of the photophoretic traps so as to control the movement tracks of the particles;
the particle coloring device is used for coloring the particles in the photophoresis trap;
the volume body image projection control device is connected with and controls the particle emission device, the photophoretic trap control device and the particle coloring device.
Further, the chassis device comprises rear wheels, front wheels, a driving motor, a reduction gearbox, a transmission rod, a steering pull rod, a differential mechanism, a steering motor and a chassis controller;
the driving motor is connected with the reduction gearbox, the reduction gearbox is connected with the differential mechanism through the transmission rod, the front wheels are connected through the steering pull rod, the differential mechanism and the steering motor are installed on the steering pull rod, and the chassis controller is used for receiving instructions of the central control device and controlling the equipment to act.
Further, the chassis device comprises a photosensitive sensor and a speed measuring port, wherein the photosensitive sensor and the speed measuring port are arranged on any front wheel and used for measuring the speed of the equipment.
Further, after receiving the infrared signal received by the infrared receiving tube, the central control device determines the distance and direction of the obstacle and sends a corresponding instruction to the chassis controller, and the chassis controller controls the equipment to move.
Further, after receiving the speed signal of the device measured by the photosensitive sensor and the speed measuring port, the central control device makes a judgment on the speed signal and sends a corresponding instruction to the chassis controller, and the chassis controller controls the device to move.
Further, a Bluetooth device is included;
the Bluetooth device is connected with wearable equipment or a mobile phone;
setting an automatic following distance in the wearable device or cell phone;
measuring the actual distance from the wearable equipment or the mobile phone to the virtual imaging social equipment through the flight time of the electromagnetic waves;
transmitting the automatic following distance and actual distance information to the central control device;
and the central control device sends an instruction to the chassis controller according to the automatic following distance and the actual distance, and the chassis controller controls the motion of the equipment.
Compared with the prior art, the invention has the following beneficial technical effects:
1. the virtual imaging social equipment can realize the functions of camera shooting, virtual 3D imaging, image projection, voice communication, obstacle avoidance, odor identification, distance following and the like, and can enable people to be in a remote real environment;
2. the invention can bring sense enhancement to people in multimedia social contact, and can be widely applied to the fields of tourism, education, office work, shopping, criminal investigation and the like.
Drawings
FIG. 1 is a schematic diagram of the structure of a virtual imaging social device of the present invention;
FIG. 2 is a schematic diagram of the structure of the sensory device of the present invention;
FIG. 3 is a schematic view of the construction of the scent output apparatus of the present invention;
FIG. 4 is a schematic diagram of the construction of a volumetric imaging tube of the present invention;
FIG. 5 is a schematic structural view of the chassis apparatus of the present invention;
FIG. 6 is a schematic view of the front wheel construction of the present invention;
FIG. 7 is a schematic view of the rear wheel brake assembly and rear wheel braking action of the present invention;
FIG. 8 is a schematic view of the construction of the chassis assembly for right and left turns of the apparatus of the present invention;
FIG. 9 is a schematic illustration of a virtual imaging social device imaging process in a particular embodiment;
fig. 10 is a schematic diagram of the scent recognition process in an example embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings in conjunction with the following detailed description. It should be understood that the description is intended to be exemplary only, and is not intended to limit the scope of the present invention. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present invention.
The invention provides a virtual imaging social device, as shown in fig. 1, the device of the invention comprises: a sensory apparatus 100, a smell output apparatus 200, a virtual imaging apparatus 300, a chassis apparatus 400, and a central control apparatus.
Specifically, as shown in fig. 1, a side view of the virtual imaging apparatus of the present invention is shown. Fig. 1 shows a rectangular device by way of example, but in practical applications the device may be of any shape. The sense organ device 100 is located at the front side of the top of the virtual imaging social device (not limited to being located at the front side of the top, and may be at any position, as long as the operation of each unit in the sense organ device 100 is facilitated), the odor output device 200 is located at the rear side of the top of the device, is horizontally arranged side by side with the sense organ device 100, and is located at the rear side of the sense organ device 100 (not limited to being located at the rear side of the top, and may be at any position, as long as the odor output device 200 releases the odor of the corresponding object according to the name of the object), the virtual imaging device 300 is located at the middle position of the device (not limited to being located at the middle position, and may be at any position, as long as the 3D synthetic image is conveniently processed into a 3D virtual image), the chassis device 400 is located at the bottom end of the device (not limited to being located at the bottom end, to execute the action of the device), the central control device is connected with and controls the sense organ device 100, the odor output device 200, the virtual imaging device 300 and the chassis device 400, and the chassis device 400 executes the action of the virtual imaging social device according to the instruction sent by the central control device.
As shown in fig. 2, the sensory device 100 includes an image capturing unit 110, a projecting unit 120, an infrared ranging unit 130, and a voice recognition unit 140.
Specifically, the image acquisition unit 110 includes two cameras 111 and 112, and the two cameras 111 and 112 are horizontally and parallelly installed in the middle of the sensory device 100, and are separated by 5cm, so as to simulate a human viewing angle; the two cameras 111 and 112 work simultaneously, images at two angles are collected simultaneously, the collected images are synthesized into a 3D synthetic image, the 3D synthetic image is transmitted to the same equipment at the other end of the network through data transmission, the same equipment at the other end of the network processes the transmitted 3D synthetic image through the virtual imaging device 300 to obtain a 3D virtual image, the 3D virtual image is projected by the projection unit 120 finally, and the projection unit 120 is installed at the upper right corner of the sensory device 100; the infrared ranging unit 130 is located at the middle position of the top of the sensory device 100, and is used for measuring the distance between the obstacle and the equipment and transmitting the distance information to the central control device.
The infrared ranging unit 130 includes an infrared ranging hole 131, an infrared emitting part 132, and an infrared receiving tube 133; an infrared ray emitting part 132 installed in the ranging hole 131 for emitting infrared rays; the infrared ray receiving tube 133 is arranged at a position close to the aperture of the ranging hole 131; the infrared ray penetrates the distance measuring hole 131 to be projected outwards, and the infrared ray signal is reflected by the barrier and then received by the infrared ray receiving tube 133; after receiving the infrared signal received by the infrared receiving tube 133, the central control device determines the distance and direction of the obstacle and sends a corresponding command to a chassis controller in the chassis device, and the chassis controller controls the operation of the equipment.
Specifically, when an obstacle appears in front of the device, the infrared signal is reflected by the obstacle and then received by the infrared receiving tube 133, and the distance and direction information is transmitted to the central control device, and the central control device makes a corresponding judgment on the distance and direction of the obstacle and then sends an instruction to a chassis controller in the chassis device.
Two speakers 150 are horizontally and symmetrically installed at both sides of the sensory device 100 near the edge, a microphone 160 is installed at the middle position of the bottom of the sensory device 100, and a voice recognition unit 140 is installed at the upper left corner of the sensory device 100 for judging and recognizing the user's language. The installation position of each part of the invention is not limited to the above, and can be any position as long as each part and equipment can conveniently realize corresponding functions
As shown in fig. 3, the odor output apparatus 200 includes an odor controller and a plurality of gas cylinders 210, each gas cylinder 210 having an air charging part 211 and an air discharging part 212 mounted thereon, and the odor output apparatus 200 discharges the odor of a corresponding article according to the name of the article recognized by the voice recognition unit 140.
Specifically, after receiving the signal of the name of the odorous article recognized by the voice recognition unit 140, the central control device determines the number of the gas cylinder 210 and sends an instruction to the odor controller, and the odor controller controls the gas injection part 212 of the gas cylinder 210 with the corresponding number to open, so as to release the gas odor in the gas cylinder 210 with the corresponding number.
The inflation part 211 comprises an inflation tube 211a, an inflation pump 211b, a plurality of inflation branch tubes 211c and a plurality of inflation solenoid valves 211d, the inflation pump 211b is connected with the inflation tube 211a, the inflation tube 211a is respectively connected with each inflation branch tube 211c, and each inflation branch tube 211c is connected with a corresponding gas cylinder 210 so as to inflate the gas cylinder 210 through each inflation branch tube 211 c; each of the branch inflation pipes 211c is installed with an inflation solenoid valve 211d, and when the inflation solenoid valve 211d of a certain gas cylinder 210 is opened, the inflator 211b operates and inflates the gas cylinder 210 via the inflation pipe 211a and the corresponding branch inflation pipe 211 c.
As shown in fig. 4, the virtual imaging apparatus 300 includes a plurality of volumetric imaging tubes 310, configured to process a 3D synthetic image transmitted from the same device at the other end of the network into a 3D virtual image; each volume imaging tube 310 is arranged seamlessly, and all volume imaging tubes 310 are surrounded by one glass tube; the volumetric imaging tube 310 includes a volumetric image projection control device 311, a particle emission device 312, a photopheresis trap control device 313 and a particle coloring device 314.
In particular, the particle emitting device 312 is used for emitting particles into the photophoretic traps when there are no particles in the photophoretic traps; the photophoretic trap control device 313 is used for controlling the position of the photophoretic trap so as to control the movement track of the particles; the particle coloring device 314 is used for coloring the particles in the photophoretic trap; the volume image projection control device 311 is connected with and controls the particle emission device 312, the photopheresis trap control device 313 and the particle coloring device 314.
The same device at the other end of the network collects and synthesizes into a 3D synthetic image through the two cameras 111 and 112, and in the device, a 3D virtual image is formed through the processing of the virtual imaging device 300 based on the principle of the photophoretic trap projection.
As shown in fig. 5, the chassis device 400 includes a rear wheel 410, two front wheels 420, a driving motor 430, a reduction box 440, three cardan drive rods 450, a steering rod 460, a differential 470, a steering motor 480, and a chassis controller 490; the driving motor 430 is connected with a reduction gearbox 440, the reduction gearbox 440 and a differential 470 are connected through a cardan drive rod 450, the two front wheels 420 are connected through the steering tie rod 460, the differential 470 and the steering motor 480 are installed on the steering tie rod 460, and a chassis controller is used for receiving commands of a central control device and controlling the motion of the equipment, so that the motions of advancing, backing, steering, braking and the like instructed by the central control device can be accurately completed.
As shown in fig. 6, a speed measurement port 421 is provided on a front wheel 420, and a light sensor 422 is installed on the front wheel 420 to accurately measure the speed per hour of the virtual imaging social device.
After receiving the speed signal of the device measured by the light sensor 422 and the speed measuring port 421, the central control device determines the speed signal and sends a corresponding command to the chassis controller of the chassis device 400.
Specifically, the A user sets up keeping away of A equipment in cell-phone APP and hinders the distance and be 1 meter, A equipment is in moving ahead through infrared emission effect as infrared ranging unit 130, detect the place ahead barrier of 1 meter, and through photosensor 422 and behind 421 measuring the speed of calculating the equipment, and with the distance of barrier, direction and equipment speed signal transmission to central control unit, central control unit sends the instruction that slows down and turn to the disk controller, the brake block solenoid valve circular telegram of chassis device, turn to the motor simultaneously and start, A equipment speed descends and turns to, thereby accomplish and keep away the barrier operation.
As shown in fig. 7, the rear wheel 410 is provided with a brake pad solenoid 411, a brake pad 412, and a brake pad return spring 413, and the brake pad 412 is opened and loosened by the cooperation of the brake pad solenoid 411 and the brake pad return spring 413, so as to achieve the braking purpose.
The device further comprises a Bluetooth device 600, the Bluetooth device 600 is connected with wearable equipment or a mobile phone, an automatic following distance is set in the wearable equipment or the mobile phone, the actual distance between the wearable equipment or the mobile phone and the virtual imaging social equipment is measured through the flight time of electromagnetic waves, the information of the automatic following distance and the actual distance is transmitted to a central control device, the central control device sends an instruction to a chassis controller according to the automatic following distance and the actual distance, the motion of the equipment is controlled by the chassis controller, and the equipment is controlled by the chassis controller to move forwards, backwards, turn or decelerate.
The equipment sends out an instruction through the central control device, is connected with a wireless network, and can transmit all data to the cloud end in real time through the wireless network.
The equipment is provided with the GPS positioning chip, and data obtained by the GPS positioning chip can be uploaded to a server side through a mobile communication network (gsm/gprs network) no matter in a starting state or a shutdown state, so that the position of the equipment can be inquired in real time at the cloud side.
Specifically, when A, B two users use the device to communicate, a user a mentions a name of an odorous article in the communication process, a user B identifies the name of the article through the voice identification unit 140, for example, the odor of the article is just in the odor storage bottle 210 of the device, after the central control device receives the signal of the name of the odorous article identified by the voice identification unit 140, the central control device judges the number of the gas storage bottle 210 and sends a corresponding instruction to the odor controller, the odor controller controls to open the corresponding gas injection component (gas injection solenoid valve) on the top of the gas storage bottle 210, the odor in the gas storage bottle is released, and the user B can smell the released odor.
The following is a detailed description of the virtual imaging social device of the present invention.
The following describes and detects whether the virtual imaging social device of the present invention is working properly in a specific embodiment.
A, B two users applying the virtual imaging social equipment provided by the invention start and log in equipment (respectively equipment A and equipment B) through the APP of the mobile phone end of the users respectively to communicate. As shown in fig. 9, the device a acquires images of the user a through the two cameras, synthesizes the images into a 3D synthesized image, and transmits the 3D synthesized image data to the device B, and the device B performs 3D virtual imaging on the 3D synthesized image data transmitted by the device a in the virtual imaging device 300 to present a 3D virtual image of the user a; the B device also transmits the 3D composite video of the B user to the a device in the same manner, and the a device presents the 3D virtual video of the B user in the a device.
A. The B user carries out voice communication, a microphone converts a voice signal of the user into an electric signal, and the electric signal is converted into the voice signal through a loudspeaker in the device at the other end, so that A, B two-bit users carry out voice conversation by using A, B two devices.
When a user A has a file to share with a user B, the file can be transmitted to the device B through a mobile phone APP, a projection unit (projection lens) of the device B is started, and the received file is put on a screen or the surface of other objects through the projection unit (projection lens) so as to show the file to the user B.
As shown in fig. 10, when two users are communicating, a user a mentions an object with a distinct odor, such as sweet osmanthus, a device B determines that the user a says "sweet osmanthus" through a voice recognition unit, if a certain gas cylinder D02 of an odor output device of the device B just stores the odor of sweet osmanthus, the device B opens an air injection component (an air injection solenoid valve) on a D02 gas cylinder through an odor controller, the odor in a D02 gas cylinder is injected, and the user B smells the odor of sweet osmanthus.
When a user A sets the automatic following distance of equipment A in a mobile phone APP to be 2 meters, the user A installs the mobile phone on the body of the user A, the user A changes the position in the process of communicating with a user B, the distance between the user A and the equipment A is increased to be more than 2 meters, the distance between the mobile phone of the user A and the equipment A is measured and calculated by the device A through a Bluetooth device to be more than 2 meters, a central control device judges a distance signal and sends an instruction to a chassis controller, and the chassis controller controls a driving motor of a chassis device of the device A to enable the device A to travel to be close to the user A until the distance reaches 2 meters; when the A user is 3 meters on the right side of the A device, the A device is close to the A user, the chassis controller controls a steering motor of a chassis device of the A device to be started, the right side facing direction of the A device is adjusted, then a driving motor is started, and the A device is driven to move forwards until the distance reaches 2 meters.
The obstacle avoidance distance that A user set up A equipment in cell-phone APP is 1 meter, and the A equipment passes through the infrared emission effect when infrared ranging unit in moving ahead, detects the place ahead barrier of 1 meter to measure out the speed of equipment through the photosensor, and with signal transmission to central control unit, central control unit sends the instruction that slows down and turn to the chassis control unit, and the brake block solenoid valve circular telegram of chassis device turns to the motor simultaneously and starts, and A equipment speed descends and turns to.
In summary, the present invention provides a virtual imaging social device, which includes a sensory device, an odor output device, a virtual imaging device, a chassis device, and a central control device; the sensory device comprises an image acquisition unit, a projection unit, an infrared ranging unit and a voice recognition unit; the odor output device releases the odor of the corresponding article according to the name of the odorous article identified by the voice identification unit; the virtual imaging device is used for processing the 3D synthetic image into a 3D virtual image; the chassis device is used for executing the action of the equipment according to the instruction sent by the central control device; the central control device is connected with and controls the devices; therefore, the functions of camera shooting, virtual 3D imaging, image projection, voice communication, obstacle avoidance, smell identification, distance following and the like are realized, people can be placed in a remote real environment, the sense is improved in multimedia social contact, and the method can be widely applied to the fields of tourism, education, office, shopping, criminal investigation and the like.
It is to be understood that the above-described embodiments of the present invention are merely illustrative of or explaining the principles of the invention and are not to be construed as limiting the invention. Therefore, any modification, equivalent replacement, improvement and the like made without departing from the spirit and scope of the present invention should be included in the protection scope of the present invention. Further, it is intended that the appended claims cover all such variations and modifications as fall within the scope and boundaries of the appended claims or the equivalents of such scope and boundaries.
Claims (10)
1. A virtual imaging social device, comprising: a sense device, a smell output device, a virtual imaging device, a chassis device and a central control device;
the sensory device comprises an image acquisition unit, a projection unit, an infrared ranging unit and a voice recognition unit;
the image acquisition unit is used for acquiring images and synthesizing the acquired images into a 3D synthetic image; the projection unit is used for projecting the 3D virtual image; the infrared ranging unit is used for measuring the distance between an obstacle and the equipment; the voice recognition unit is used for judging and recognizing the language of the user;
the odor output device releases the odor of the corresponding article according to the name of the odorous article identified by the voice identification unit;
the virtual imaging device is used for processing the 3D synthetic image into a 3D virtual image;
the chassis device is used for executing the action of the equipment according to the instruction sent by the central control device;
the central control device is connected with and controls the sense organ device, the smell output device, the virtual imaging device and the chassis device.
2. The virtual imaging social device as claimed in claim 1, wherein said image capturing unit comprises two cameras;
the infrared ranging unit comprises a ranging hole, an infrared transmitting part and an infrared receiving tube; the infrared emission component is arranged in the ranging hole and used for emitting infrared rays; the infrared rays are projected outwards through the distance measuring holes; the infrared signal is received by the infrared receiving tube after being reflected by the barrier.
3. The virtual imaging social device as claimed in claim 2, wherein the odor output means comprises an odor controller and a plurality of gas cylinders, each gas cylinder having an air charging part and an air jetting part mounted thereon;
and after receiving the signal of the name of the odorous article identified by the voice identification unit, the central control device judges the number of the gas cylinder and sends an instruction to the odor controller, and the odor controller controls the gas injection part of the gas cylinder with the corresponding number to be opened and releases the gas odor in the gas cylinder with the corresponding number.
4. The virtual imaging social device as claimed in claim 3, wherein the inflation component comprises an inflation tube, an inflation pump, inflation branches and inflation solenoid valves;
the inflation pump is connected with an inflation pipe, the inflation pipe is respectively connected with each inflation branch pipe, and each inflation branch pipe is connected with the corresponding gas storage bottle so as to inflate the corresponding gas storage bottle through each inflation branch pipe; and when the inflation electromagnetic valve corresponding to a certain gas storage bottle is opened, the inflation pump works and inflates the gas storage bottle through the inflation pipe and the corresponding inflation branch pipe.
5. The virtual imaging social device as claimed in claim 4, wherein the virtual imaging means comprises a plurality of volumetric imaging tubes, the volumetric imaging tubes comprising volumetric image projection control means, particle emission means, photophoretic trap control means and particle coloring means.
The particle emission device is used for emitting particles into the photophoretic trap when the photophoretic trap is free of the particles;
the device for controlling the photophoretic traps is used for controlling the positions of the photophoretic traps so as to control the movement tracks of the particles;
the particle coloring device is used for coloring the particles in the photophoresis trap;
the volume body image projection control device is connected with and controls the particle emission device, the photophoretic trap control device and the particle coloring device.
6. The virtual imaging social device as claimed in claim 5, wherein said chassis means comprises rear wheels, front wheels, drive motors, reduction gearboxes, transfer bars, steering tie rods, differentials, steering motors and chassis controllers;
the driving motor is connected with the reduction gearbox, the reduction gearbox is connected with the differential mechanism through the transmission rod, the front wheels are connected through the steering pull rod, the differential mechanism and the steering motor are installed on the steering pull rod, and the chassis controller is used for receiving instructions of the central control device and controlling the equipment to act.
7. The virtual imaging social device as claimed in claim 6, wherein the chassis device comprises a light sensor and a speed measurement port, the light sensor and the speed measurement port are mounted on any one of the front wheels for measuring the speed of the device.
8. The virtual imaging social device according to claim 7, wherein the central control device, after receiving the infrared signal received by the infrared receiving tube, makes a judgment on the distance and direction of the obstacle and sends a corresponding instruction to the chassis controller, and the chassis controller controls the device to move.
9. The virtual imaging social device according to claim 8, wherein the central control device receives a speed signal of the device measured by the light-sensitive sensor and the speed measurement port, makes a judgment on the speed signal, and sends a corresponding instruction to the chassis controller, and the chassis controller controls the device to move.
10. The virtual imaging social device as claimed in claim 9, comprising bluetooth means;
the Bluetooth device is connected with wearable equipment or a mobile phone;
setting an automatic following distance in the wearable device or cell phone;
measuring the actual distance from the wearable equipment or the mobile phone to the virtual imaging social equipment through the flight time of the electromagnetic waves;
transmitting the automatic following distance and actual distance information to the central control device;
and the central control device sends an instruction to the chassis controller according to the automatic following distance and the actual distance, and the chassis controller controls the motion of the equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010923038.1A CN112068701A (en) | 2020-09-04 | 2020-09-04 | Virtual imaging social equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010923038.1A CN112068701A (en) | 2020-09-04 | 2020-09-04 | Virtual imaging social equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112068701A true CN112068701A (en) | 2020-12-11 |
Family
ID=73666497
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010923038.1A Pending CN112068701A (en) | 2020-09-04 | 2020-09-04 | Virtual imaging social equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112068701A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06165173A (en) * | 1992-11-17 | 1994-06-10 | Nippon Telegr & Teleph Corp <Ntt> | System for attaining virtual society |
| US20040230486A1 (en) * | 2003-05-15 | 2004-11-18 | Greenlee Garrett M. | System and method for creating a dynamic and interactive simulated remote-locale atmosphere |
| CN103926941A (en) * | 2014-04-17 | 2014-07-16 | 浙江理工大学 | Virtual smell generation device driven by stepping motor |
| CN105807920A (en) * | 2016-03-03 | 2016-07-27 | 北京小鸟看看科技有限公司 | Virtual reality equipment as well as method and device for monitoring ground obstacles under using scene of virtual reality equipment |
| CN105809741A (en) * | 2016-03-03 | 2016-07-27 | 史国新 | Interactive indoor environment experiencing system |
| CN106227356A (en) * | 2016-09-14 | 2016-12-14 | 武汉软工硕成技术有限公司 | A kind of rehabilitation system based on virtual roaming Yu network social intercourse |
| CN107203149A (en) * | 2017-07-24 | 2017-09-26 | 中山市博林树投资管理有限公司 | A kind of virtual artificial intelligence companion |
| CN109413364A (en) * | 2018-12-04 | 2019-03-01 | 湖北安心智能科技有限公司 | A kind of interactive remote meeting system and method |
| CN109901371A (en) * | 2019-03-01 | 2019-06-18 | 懿春秋(北京)科技有限公司 | A kind of holographic imaging systems and method |
-
2020
- 2020-09-04 CN CN202010923038.1A patent/CN112068701A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06165173A (en) * | 1992-11-17 | 1994-06-10 | Nippon Telegr & Teleph Corp <Ntt> | System for attaining virtual society |
| US20040230486A1 (en) * | 2003-05-15 | 2004-11-18 | Greenlee Garrett M. | System and method for creating a dynamic and interactive simulated remote-locale atmosphere |
| CN103926941A (en) * | 2014-04-17 | 2014-07-16 | 浙江理工大学 | Virtual smell generation device driven by stepping motor |
| CN105807920A (en) * | 2016-03-03 | 2016-07-27 | 北京小鸟看看科技有限公司 | Virtual reality equipment as well as method and device for monitoring ground obstacles under using scene of virtual reality equipment |
| CN105809741A (en) * | 2016-03-03 | 2016-07-27 | 史国新 | Interactive indoor environment experiencing system |
| CN106227356A (en) * | 2016-09-14 | 2016-12-14 | 武汉软工硕成技术有限公司 | A kind of rehabilitation system based on virtual roaming Yu network social intercourse |
| CN107203149A (en) * | 2017-07-24 | 2017-09-26 | 中山市博林树投资管理有限公司 | A kind of virtual artificial intelligence companion |
| CN109413364A (en) * | 2018-12-04 | 2019-03-01 | 湖北安心智能科技有限公司 | A kind of interactive remote meeting system and method |
| CN109901371A (en) * | 2019-03-01 | 2019-06-18 | 懿春秋(北京)科技有限公司 | A kind of holographic imaging systems and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210311476A1 (en) | Patrol robot and patrol robot management system | |
| US10872584B2 (en) | Providing positional information using beacon devices | |
| CN109636924B (en) | Vehicle-mounted multi-mode augmented reality system based on real road condition information three-dimensional modeling | |
| JP2022520968A (en) | Estimating object attributes using visual image data | |
| EP3995782A1 (en) | Systems and methods for estimating future paths | |
| CN103237685B (en) | Blind area display device and method | |
| JP7200946B2 (en) | Information processing device, control system, information processing method and program | |
| JP2019537080A (en) | Vehicle navigation based on detected barriers | |
| CN106020201A (en) | Mobile robot 3D navigation and positioning system and navigation and positioning method | |
| JP2020522002A (en) | Method and system for recognizing, tracking, and focusing a moving target | |
| US11237241B2 (en) | Microphone array for sound source detection and location | |
| CN110998596A (en) | Night sensing | |
| KR101896654B1 (en) | Image processing system using drone and method of the same | |
| CN107543531B (en) | A kind of Robot visual location system | |
| CN109733283A (en) | Be blocked obstacle recognition early warning system and identification method for early warning based on AR | |
| CN108928348A (en) | Generate the method and system of wide area perception scene figure | |
| WO2023102911A1 (en) | Data collection method, data presentation method, data processing method, aircraft landing method, data presentation system and storage medium | |
| CN115320584A (en) | Vehicle remote driving assistance method and remote driving system considering obstacle early warning | |
| WO2019174166A1 (en) | Projection mobile phone-based flight control system for unmanned aerial vehicle | |
| CN101770707B (en) | Camera based virtual vehicle driving system and virtual driving method | |
| WO2019214165A1 (en) | Intelligent flight follower for navigation for blind people | |
| CN112068701A (en) | Virtual imaging social equipment | |
| CN101308586A (en) | Motor vehicle day and night running observing recorder | |
| CN217801729U (en) | Outdoor robot | |
| CN208384420U (en) | Expressway unmanned emergency processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201211 |
|
| RJ01 | Rejection of invention patent application after publication |