CN107229342A - Document handling method and user equipment - Google Patents
Document handling method and user equipment Download PDFInfo
- Publication number
- CN107229342A CN107229342A CN201710521870.7A CN201710521870A CN107229342A CN 107229342 A CN107229342 A CN 107229342A CN 201710521870 A CN201710521870 A CN 201710521870A CN 107229342 A CN107229342 A CN 107229342A
- Authority
- CN
- China
- Prior art keywords
- user equipment
- file
- user
- functions
- pending file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of document handling method and user equipment, methods described includes：Start the augmented reality AR functions on user equipment；Using the AR functions, the pending file in the user equipment is projected；The gesture operation of the user of the currently used user equipment is detected by the camera of the user equipment；According to the gesture operation, the pending file of projection is handled.The present invention can use AR technologies easily to handle the file on user equipment.
Description
Technical field
The present invention relates to augmented reality field, more particularly to a kind of document handling method and user equipment.
Background technology
AR (Augmented Reality, augmented reality) is the new technology grown up on the basis of virtual reality,
It is referred to as mixed reality.AR technologies are the skills that the information increase user provided by computer system perceives to real world
Art, by virtual Information application to real world, and dummy object, scene or the system prompt information superposition that computer is generated
Into real scene, so as to realize the enhancing to reality.
At present, user can the storage file (such as presentation file) on user equipment (such as smart mobile phone) in advance, needing
Will when the file opened on user equipment handled.However, the limitation of the display screen due to user equipment, user makes
It is very inconvenient when being handled with user equipment file.
It can be seen that, how the use of AR technologies to be easily a skill urgently to be resolved hurrily to the file progress processing on user equipment
Art problem.
The content of the invention
In view of the foregoing, it is necessary to provide a kind of document handling method and user equipment, AR technologies can be used convenient
Ground is handled the file on user equipment.
A kind of document handling method, including：
Start the augmented reality AR functions on user equipment；
Using the AR functions, the pending file in the user equipment is projected；
The gesture operation of the user of the currently used user equipment is detected by the camera of the user equipment；
According to the gesture operation, the pending file of projection is handled.
In a kind of possible implementation, the camera by the user equipment detects the currently used use
After the gesture operation of the user of family equipment, methods described also includes：
It is determined that the distance between described pending file and the hand of the user for projecting；
Judge whether the distance is less than pre-determined distance threshold value；
If the distance is less than the pre-determined distance threshold value, perform it is described according to the gesture operation, to the institute of projection
Pending file is stated to be handled.
In a kind of possible implementation, methods described also includes：
The gesture operation of the user and the pending file of projection are shot simultaneously using the camera
Synthesis, obtains AR images；
By the AR images shares to the first object equipment with the AR functions.
In a kind of possible implementation, after the AR functions of starting on the user equipment, and the profit
With the AR functions, before the pending file in the user equipment is projected, methods described also includes：
In with the AR of AR functions applications, the file stored in the user equipment is inserted；By described in insertion
File is defined as the pending file；Or
Using the AR functions, the All Files of the user equipment storage is projected out；Receive based on user selection
The selection instruction of file destination, responds the selection instruction, the file destination is defined as into the pending file.
In a kind of possible implementation, methods described also includes：
By the image projection presented in the view-finder of the camera to the second target bound with the user equipment
Equipment.
A kind of user equipment, the user equipment includes processor, memory, camera and input/output unit, institute
Stating memory is used to store at least one instruction, and the processor is used to perform at least one described instruction to realize：
Start the augmented reality AR functions on user equipment；
Using the AR functions, the pending file in the user equipment is thrown by the input/output unit
Shadow；
The gesture operation of the user of the currently used user equipment is detected by the camera of the user equipment；
According to the gesture operation, the pending file of projection is handled.
In a kind of possible implementation, the processor detects currently used by the camera of the user equipment
After the gesture operation of the user of the user equipment, the processor is additionally operable to perform at least one described instruction to realize：
It is determined that the distance between described pending file and the hand of the user for projecting；
Judge whether the distance is less than pre-determined distance threshold value；
If the distance is less than the pre-determined distance threshold value, perform it is described according to the gesture operation, to the institute of projection
Pending file is stated to be handled.
In a kind of possible implementation, the processor is additionally operable to perform at least one described instruction to realize：
The gesture operation of the user and the pending file of projection are shot simultaneously using the camera
Synthesis, obtains AR images；
By the input/output unit by the AR images shares to the first object equipment with the AR functions.
In a kind of possible implementation, the processor starts after the AR functions on the user equipment, and
The processor utilizes the AR functions, is carried out the pending file in the user equipment by the input/output unit
Before projection, the processor is additionally operable to perform at least one described instruction to realize：
In with the AR of AR functions applications, the file stored in the user equipment is inserted；By described in insertion
File is defined as the pending file；Or
Using the AR functions, the All Files that the user equipment is stored is projected out by the input/output unit；
Selection instruction based on user's selection target file is received by the input/output unit, the selection instruction is responded,
The file destination is defined as the pending file.
In a kind of possible implementation, the processor is additionally operable to perform at least one described instruction to realize：
The image projection presented in the view-finder of the camera is used to described by the input/output unit
Second target device of family apparatus bound.
In above technical scheme, the present invention, user equipment can start the augmented reality AR functions on user equipment, profit
With the AR functions, the pending file in the user equipment is projected, further, user equipment can pass through institute
The gesture operation of the user of the currently used user equipment of camera detection of user equipment is stated, and is grasped according to the gesture
Make, the pending file of projection is handled.It can be seen that, by embodiments of the invention, user equipment can use AR
Technology need to pending file to be processed project to space, spatial dimension is very big, and user can be very easily to being projected in sky
Between in pending file carry out gesture operation, user equipment can be according to the gesture operation of user, directly to described in projection
Pending file is handled, so as to easily be handled using AR technologies the file on user equipment.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
The embodiment of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
The accompanying drawing of offer obtains other accompanying drawings.
Fig. 1 is a kind of flow chart of the preferred embodiment of document handling method disclosed by the invention.
Fig. 2 is a kind of schematic diagram of file projection disclosed by the invention.
Fig. 3 is a kind of schematic diagram of AR images disclosed by the invention.
Fig. 4 is the flow chart of the preferred embodiment of another document handling method disclosed by the invention.
Fig. 5 is the flow chart of the preferred embodiment of another document handling method disclosed by the invention.
Fig. 6 is a kind of functional block diagram of the preferred embodiment of document handling apparatus disclosed by the invention.
Fig. 7 is the functional block diagram of the preferred embodiment of another document handling apparatus disclosed by the invention.
Fig. 8 is a kind of structural representation of user equipment for realizing document handling method disclosed by the invention.
Main element symbol description
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
In order to facilitate the understanding of the purposes, features and advantages of the present invention, it is below in conjunction with the accompanying drawings and specific real
Applying mode, the present invention is further detailed explanation.
Wherein, the user equipment is a kind of can to carry out numerical computations automatically according to the instruction for being previously set or storing
And/or the equipment of information processing, its hardware includes but is not limited to microprocessor, application specific integrated circuit (Application
Specific Integrated Circuit, ASIC), programmable gate array (Field-Programmable Gate
Array, FPGA), digital processing unit (Digital Signal Processor, DSP), embedded device etc..
The user equipment include but is not limited to any one can with user by keyboard, mouse, remote control, touch pad or
The modes such as voice-operated device carry out the electronic product of man-machine interaction, for example, personal computer, tablet personal computer, smart mobile phone, individual number
Word assistant (Personal Digital Assistant, PDA), IPTV (Internet Protocol
Television, IPTV), intellectual Wearable, digital camera etc..Above-mentioned user equipment is only citing, and non exhaustive, bag
Contain but be not limited to above-mentioned terminal device.
Fig. 1 is referred to, Fig. 1 is a kind of flow chart of the preferred embodiment of document handling method disclosed by the invention.Wherein,
This document processing method is applied to user equipment, and the user equipment has AR (Augmented Reality, augmented reality) work(
Energy.According to different demands, the order of step can change in the flow chart, and some steps can be omitted.
S11, user equipment start the augmented reality AR functions on user equipment.
In the embodiment of the present invention, user equipment has AR functions, wherein, AR technologies are a kind of brand-new man-machine interaction skills
Art, it utilizes camera, and sensor calculates and matching technique, real environment and virtual object are superimposed in real time in real time
Exist simultaneously to same picture or space.User can experience the institute in the objective physical world by virtual reality system
The verisimilitude of " on the spot in person " of experience, moreover it is possible to break through space, time and other objective limitations, experience in real world
Can not personal experience experience.
Specifically, can be that the system of user equipment carries AR functions, such as the hardware supported line holographic projections of user equipment,
Or, can be that the application APP installed on user equipment has AR functions, the embodiment of the present invention is not limited.
User can trigger startup AR functions by clicking on AR start buttons virtual on user equipment, or, can be with
AR functions when reaching at default time point on automatic start user equipment.
S12, user equipment utilize the AR functions, and the pending file in the user equipment is projected.
In the embodiment of the present invention, user can store multiple files on a user device in advance, when user needs to handle it
In some pending file when, user equipment can utilize AR functions, by the user equipment pending file carry out
Projection.Wherein, the pending file can need any played file to be processed, such as PPT, word document, cad file,
Photo, video image etc..The space is usually the space residing for the front of user, and the pending file projected in space is
Virtual file, optionally, user can be moved by gesture operation to the position of the pending file of the projection.
In one embodiment, after step s 11, and before step S12, user equipment can be with the AR
In the AR applications of function, the file stored in the user equipment is inserted；The file of insertion is defined as described pending
File；Or, user equipment can utilize the AR functions, the All Files of the user equipment storage is projected out；Reception is based on
The selection instruction of user's selection target file, responds the selection instruction, and the file destination is defined as described to wait to locate
Manage file.
S13, user equipment detect the user's of the currently used user equipment by the camera of the user equipment
Gesture operation.
In the embodiment of the present invention, user equipment can have preposition dual camera, and user equipment can be preposition double using this
Camera detects the gesture operation of the user of the currently used user equipment；Or, user equipment can have AR cameras,
User equipment can detect the gesture operation of the user of the currently used user equipment using the AR cameras.Wherein, the hand
Gesture operation can include but is not limited to " touch operation ", " clicking operation " and " slide " etc..Optionally, user can be with
Self-defined specific gesture operation.
S14, user equipment are handled the pending file of projection according to the gesture operation.
In the embodiment of the present invention, it is assumed that the gesture operation be touch operation, then user equipment can according to the touch operation,
The pending file of projection is zoomed in or out, it is assumed that the gesture operation is clicking operation, then user equipment can
To enter edlin to the pending file of projection according to the clicking operation.
Please also refer to Fig. 2, Fig. 2 is a kind of schematic diagram of file projection disclosed by the invention.As shown in Fig. 2 user sets
Standby to be above configured with preposition dual camera and line holographic projections device, when it is determined that after pending file, user equipment just can be using complete
Breath projector projects pending file to the space (being usually front) residing for user, meanwhile, user equipment can be with profit
The gesture operation of the user of the currently used user equipment is detected with preposition dual camera, and according to the gesture operation, it is right
The pending file of projection is handled.
Please also refer to Fig. 3, Fig. 3 is a kind of schematic diagram of AR images disclosed by the invention.As shown in figure 3, user equipment
Display screen on show the pending files of user and line holographic projections and integrate the AR images of composition, i.e. user equipment will
Real user is integrated in same picture with virtual pending file, and can also be seen that user in line holographic projections
Operated on pending file.
In the embodiment of the present invention, it is possible to use the AR functions on user equipment, the gesture of the user in real world is grasped
Make to integrate with the pending file of the projection of virtual world, user can be in real time to treating for being presented in the virtual world
Processing file is operated, and is realized the real-time, interactive between user and the pending file of projection, that is, is realized holographic throwing
Shadow and holographic operation, meanwhile, the collaborative work of real world and virtual world is also achieved, Consumer's Experience is improved.
In one embodiment, after step s 13, user equipment also need to determine projection the pending file with
The distance between hand of the user, judges whether the distance is less than pre-determined distance threshold value, if the distance is less than described pre-
If distance threshold, user equipment could be handled the pending file of projection according to the gesture operation.In the reality
Apply in example, user carry out gesture operation when, only the hand of user with projection pending file distance default apart from model
When enclosing interior, user equipment could be triggered according to the gesture operation, the pending file of projection is handled, so,
The maloperation of user can be avoided.
In the method flow described by Fig. 1, user equipment can start the augmented reality AR functions on user equipment, profit
With the AR functions, the pending file in the user equipment is projected, further, user equipment can pass through institute
The gesture operation of the user of the currently used user equipment of camera detection of user equipment is stated, and is grasped according to the gesture
Make, the pending file of projection is handled.It can be seen that, by embodiments of the invention, user equipment can use AR
Technology need to pending file to be processed project to space, spatial dimension is very big, and user can be very easily to being projected in sky
Between in pending file carry out gesture operation, user equipment can be according to the gesture operation of user, directly to described in projection
Pending file is handled, so as to easily be handled using AR technologies the file on user equipment.
Fig. 4 is referred to, Fig. 4 is the flow chart of the preferred embodiment of another document handling method disclosed by the invention.Its
In, this document processing method is applied to user equipment, and the user equipment has AR (Augmented Reality, augmented reality)
Function.According to different demands, the order of step can change in the flow chart, and some steps can be omitted.
S41, user equipment start the augmented reality AR functions on user equipment.
S42, user equipment insert the file stored in the user equipment in the AR of AR functions applications,
The file of insertion is defined as the pending file.
The AR applications for possessing AR functions are installed, user is opened on user equipment in the embodiment of the present invention, on user equipment
AR applications after, can be inserted in the insertion interface that AR is applied and prestore file on a user device, so, so that it may
So that the file of insertion is defined as into pending file.
Optionally, step S42 can also be replaced with following steps：
Using the AR functions, the All Files of the user equipment storage is projected out；Receive based on user selection
The selection instruction of file destination, responds the selection instruction, the file destination is defined as into the pending file.
In the optional embodiment, user equipment can utilize the AR functions, be projected out the user equipment and deposit
The All Files of storage；Wherein, the All Files of the projection is presented in the form of a file, and user cannot see that this document is pressed from both sides
The content of the inside, but user can be determined involved by file by the file identification (such as Folder Name) of file
Content；Further, user can select a file destination by way of click from multiple files, to trigger generation pin
To the selection instruction of the file destination in the All Files, so, user equipment can just respond the selection instruction, by institute
State file destination and be defined as the pending file.
S43, user equipment utilize the AR functions, and the pending file in the user equipment is projected.
S44, user equipment detect the user's of the currently used user equipment by the camera of the user equipment
Gesture operation.
S45, user equipment determine the distance between the pending file of projection and the hand of the user.
In the embodiment of the present invention, user equipment can detect the first of user equipment and user by preposition dual camera
Second relative position of relative position and detection user equipment and the pending file of projection, and then can be according to first phase
The pending file of projection and the hand of the user are determined to position, the second relative position and default model algorithm
The distance between.Wherein, the hand of the user is the hand for being currently executing gesture operation, can be a hand, or
Both hands.
S46, user equipment judge whether the distance is less than pre-determined distance threshold value, if so, step S47 is performed, if it is not, knot
This flow of beam.
Wherein, the pre-determined distance threshold value is that can meet the minimum range handled the pending file of projection, such as
1m.Because the pending file of the projection is the virtual file of projection to space, in space, the pending file of the projection can
To be three-dimensional or plane.
In the embodiment of the present invention, if user equipment judges that the distance is less than pre-determined distance threshold value, show that the distance is met
The trigger condition handled the pending file of projection, user equipment can be according to the gesture operation, to projection
The pending file is handled, if user equipment judge the distance be more than or equal to pre-determined distance threshold value, show this away from
The trigger condition handled from the pending file being unsatisfactory for projection, user equipment can not be to the pending text of projection
Part carries out any processing.
S47, user equipment are handled the pending file of projection according to the gesture operation.
S48, user equipment are using the camera to the gesture operation of the user and the pending text of projection
Part is shot and synthesized, and obtains AR images.
In the embodiment of the present invention, user equipment can also use gesture operation and throwing of the camera to the user
The pending file of shadow is shot and synthesized, and obtains AR images.Wherein, the AR images are by the user's of real world
The pending file of the projection of gesture operation and virtual world carries out integrated image.
S49, user equipment are by the AR images shares to the first object equipment with the AR functions.
In the embodiment of the present invention, the first object equipment can be any electronic equipment with AR functions, wherein, the electricity
Sub- equipment, which includes but is not limited to any one, to pass through the modes such as keyboard, mouse, remote control, touch pad or voice-operated device with user
The electronic product of man-machine interaction is carried out, for example, personal computer, tablet personal computer, smart mobile phone, personal digital assistant
(Personal Digital Assistant, PDA), IPTV (Internet Protocol Television,
IPTV), intellectual Wearable, digital camera etc..Above-mentioned user equipment is only citing, and non exhaustive, including but not limited to
Above-mentioned terminal device.
The AR images shares to the first object equipment with the AR functions, so, are achieved that by user equipment
With other people shared AR images, improve with it is interactive between other people.
In the method flow described by Fig. 4, user equipment can use AR technologies to need pending file to be processed
Space is projected to, spatial dimension is very big, user easily can carry out gesture behaviour very to the pending file of projection in space
Make；When it is determined that the distance between the pending file of projection and the hand of the user is less than pre-determined distance threshold value, user
Equipment can be directly handled the pending file of projection, so as to use AR according to the gesture operation of user
Technology is easily handled the file on user equipment, in addition, user equipment can also be by the AR images shares of acquisition extremely
First object equipment with the AR functions, it is achieved thereby that with other people shared AR images, raising and the interaction between other people
Property.
Fig. 5 is referred to, Fig. 5 is the flow chart of the preferred embodiment of another document handling method disclosed by the invention.Its
In, this document processing method is applied to user equipment, and the user equipment has AR (Augmented Reality, augmented reality)
Function.According to different demands, the order of step can change in the flow chart, and some steps can be omitted.
S51, user equipment start the augmented reality AR functions on user equipment.
S52, user equipment insert the file stored in the user equipment in the AR of AR functions applications,
The file of insertion is defined as the pending file.
The AR applications for possessing AR functions are installed, user is opened on user equipment in the embodiment of the present invention, on user equipment
AR applications after, can be inserted in the insertion interface that AR is applied and prestore file on a user device, so, so that it may
So that the file of insertion is defined as into pending file.
Optionally, step S52 can also be replaced with following steps：
Using the AR functions, the All Files of the user equipment storage is projected out；Receive based on user selection
The selection instruction of file destination, responds the selection instruction, the file destination is defined as into the pending file.
In the optional embodiment, user equipment can utilize the AR functions, be projected out the user equipment and deposit
The All Files of storage；Wherein, the All Files of the projection is presented in the form of a file, and user cannot see that this document is pressed from both sides
The content of the inside, but user can be determined involved by file by the file identification (such as Folder Name) of file
Content；Further, user can select a file destination by way of click from multiple files, to trigger generation pin
To the selection instruction of the file destination in the All Files, so, user equipment can just respond the selection instruction, by institute
State file destination and be defined as the pending file.
S53, user equipment utilize the AR functions, and the pending file in the user equipment is projected.
S54, user equipment detect the user's of the currently used user equipment by the camera of the user equipment
Gesture operation.
S55, user equipment determine the distance between the pending file of projection and the hand of the user.
S56, user equipment judge whether the distance is less than pre-determined distance threshold value, if so, step S57 is performed, if it is not, knot
This flow of beam.
S57, user equipment are handled the pending file of projection according to the gesture operation.
S58, user equipment tie up the image projection presented in the view-finder of the camera to the user equipment
The second fixed target device.
Wherein, second target device can be any electronic equipment with AR functions, wherein, the electronic equipment includes
But be not limited to any one by modes such as keyboard, mouse, remote control, touch pad or voice-operated devices can carry out man-machine friendship with user
Mutual electronic product, for example, personal computer, tablet personal computer, smart mobile phone, personal digital assistant (Personal Digital
Assistant, PDA), IPTV (Internet Protocol Television, IPTV), intellectual Wearable
Equipment, digital camera etc..Above-mentioned user equipment is only citing, and non exhaustive, including but not limited to above-mentioned terminal device.Wherein,
Second target device can be bound with user equipment in advance.
Wherein, user equipment can also be by the image presented in the view-finder of the camera (user equipment in such as Fig. 3
On the AR images that are presented) project to the second target device (such as computer, television set) bound with the user equipment.So,
User can just be more clearly seen the image presented in view-finder on the second target device.
In the method flow described by Fig. 5, user equipment can use AR technologies to need pending file to be processed
Space is projected to, spatial dimension is very big, user easily can carry out gesture behaviour very to the pending file of projection in space
Make；When it is determined that the distance between the pending file of projection and the hand of the user is less than pre-determined distance threshold value, user
Equipment can be directly handled the pending file of projection, so as to use AR according to the gesture operation of user
Technology is easily handled the file on user equipment, in addition, user equipment can also be by the view-finder of the camera
Middle presented image projection is to the second target device bound with the user equipment, and so, user just can be in the second mesh
The image presented in view-finder is more clearly seen on marking device.
Fig. 6 is referred to, Fig. 6 is a kind of functional block diagram of the preferred embodiment of document handling apparatus disclosed by the invention.
Wherein, the document handling apparatus shown in Fig. 6 is used to perform any described document handling method, tool in Fig. 1, Fig. 4 and Fig. 5
Body refers to Fig. 1, Fig. 4 and Fig. 5 associated description, will not be repeated here.The document handling apparatus 11 includes start unit
101st, input-output unit 102, detection unit 103 and processing unit 104, wherein, the unit alleged by the present invention refers to one kind
Can be performed by processor 13 and the series of computation machine program segment of fixing function can be completed, it is stored in memory 12
In.In the present embodiment, the function on each unit will be described in detail in follow-up embodiment.
Start unit 101, for starting the augmented reality AR functions on user equipment；
Input-output unit 102, for utilizing the AR functions, the pending file in the user equipment is thrown
Shadow；
Detection unit 103, the use of the currently used user equipment is detected for the camera by the user equipment
The gesture operation at family；
Processing unit 104, for according to the gesture operation, handling the pending file of projection.
In the document handling apparatus described by Fig. 6, the augmented reality AR functions on user equipment can be started, institute is utilized
AR functions are stated, the pending file in the user equipment is projected, it is possible to further pass through the user equipment
Camera detects the gesture operation of the user of the currently used user equipment, and according to the gesture operation, to the institute of projection
Pending file is stated to be handled.It can be seen that, by embodiments of the invention, AR technologies can be used to need to be processed pending
File projects to space, and spatial dimension is very big, and user easily can carry out hand very to the pending file of projection in space
Gesture is operated, and directly the pending file of projection can be handled, according to the gesture operation of user so as to use
AR technologies are easily handled the file on user equipment.
As shown in fig. 7, Fig. 7 is the functional module of the preferred embodiment of another document handling apparatus disclosed by the invention
Figure.Wherein, the document handling apparatus shown in Fig. 7 is used to perform any described document handling method in Fig. 4 or Fig. 5, specifically
Fig. 4 or Fig. 5 associated description are referred to, be will not be repeated here.Wherein, the document handling apparatus shown in Fig. 7 is shown in Fig. 6
Further optimize what is obtained, compared with the document handling apparatus shown in Fig. 6, the text shown in Fig. 7 on the basis of document handling apparatus
Part processing unit, which also includes determining unit 105 and judging unit 106, optionally, the document handling apparatus shown in Fig. 7, also to be included
Shooting unit 107, optionally, the document handling apparatus shown in Fig. 7 also include insertion unit 108.Wherein, the list alleged by the present invention
Member refer to it is a kind of can be performed by processor 13 and the series of computation machine program segment of fixing function can be completed, it is stored
In memory 12.In the present embodiment, the function on each unit will be described in detail in follow-up embodiment.
Determining unit 105, for detecting currently used described by the camera of the user equipment in detection unit 103
After the gesture operation of the user of user equipment, it is determined that projection the pending file and the user hand between away from
From；
Judging unit 106, for judging whether the distance is less than pre-determined distance threshold value；
Processing unit 104, specifically for when the judging unit 106 judge the distance be less than pre-determined distance threshold value when,
According to the gesture operation, the pending file of projection is handled.
Shooting unit 107, for using the camera to waiting to locate described in the gesture operation of the user and projection
Reason file is shot and synthesized, and obtains AR images；
The input-output unit 102, is additionally operable to the AR images shares to the first object with the AR functions
Equipment.
Unit 108 is inserted, after starting the AR functions on the user equipment in the start unit 101, and
The input-output unit 102 utilizes the AR functions, before the pending file in the user equipment is projected,
In AR applications with the AR functions, the file stored in the user equipment is inserted；
The determining unit 105, is additionally operable to the file of insertion being defined as the pending file；
The input-output unit 102, is additionally operable to utilize the AR functions, is projected out all of the user equipment storage
File, and receive the selection instruction based on user's selection target file；
The determining unit 105, is additionally operable to respond the selection instruction, the file destination is defined as described pending
File.
The input-output unit 102, be additionally operable to the image projection that will be presented in the view-finder of the camera to
Second target device of the user equipment binding.
In the document handling apparatus described by Fig. 7, AR technologies can be used to need pending file projection to be processed
To space, spatial dimension is very big, and user easily can carry out gesture operation very to the pending file of projection in space；
It is determined that when the distance between hand of described pending file and the user of projection is less than pre-determined distance threshold value, can according to
The gesture operation at family, is directly handled the pending file of projection, so as to using AR technologies easily to
File in the equipment of family is handled, further, it is also possible to by the AR images shares of acquisition to the first mesh with the AR functions
Marking device, it is achieved thereby that sharing AR images with other people, is improved and interactive between other people, further, it is also possible to be taken the photograph described
As head view-finder in the image projection that is presented to the second target device bound with the user equipment, so, user is just
The image presented in view-finder can be more clearly seen on the second target device.
The above-mentioned integrated unit realized in the form of software function module, can be stored in a computer-readable storage
In medium.Wherein, the computer-readable recording medium can store computer program, and the computer program is being executed by processor
When, the step of each above-mentioned embodiment of the method can be achieved.Wherein, the computer program includes computer program code, described
Computer program code can be source code form, object identification code form, executable file or some intermediate forms etc..The meter
Calculation machine readable storage medium storing program for executing can include：Can carry any entity or device of the computer program code, recording medium,
USB flash disk, mobile hard disk, magnetic disc, CD, computer storage, read-only storage (ROM, Read-Only Memory), arbitrary access
Memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..Need
It is bright, the content that the computer-readable recording medium is included can according in jurisdiction legislation and patent practice will
Ask and carry out appropriate increase and decrease, such as, in some jurisdictions, according to legislation and patent practice, computer-readable medium does not include
Electric carrier signal and telecommunication signal.
Fig. 8 is referred to, Fig. 8 is a kind of structural representation of user equipment for realizing document handling method disclosed by the invention
Figure.The user equipment 1 includes memory 12, processor 13, camera 14 and input/output unit 15.It should be noted that
User equipment shown in Fig. 8 can also be included than illustrating more or less parts, such as touch-screen.
The user equipment 1, which also includes but is not limited to any one, to pass through keyboard, mouse, remote control, touch with user
The mode such as plate or voice-operated device carries out the electronic product of man-machine interaction, for example, personal computer, tablet personal computer, smart mobile phone, individual
Personal digital assistant (Personal Digital Assistant, PDA), game machine, IPTV (Internet
Protocol Television, IPTV), intellectual Wearable etc..Network residing for the user equipment 1 is included but not
It is limited to internet, wide area network, Metropolitan Area Network (MAN), LAN, VPN (Virtual Private Network, VPN) etc..
The memory 12 alternatively includes one or more computer-readable recording mediums, for storing at a kind of file
The program of reason method and various data, and realize high speed in the process of running, be automatically completed the access of program or data.It is described
Memory 12 alternatively includes high-speed random access memory, and also alternatively includes nonvolatile memory, such as one
Or multiple disk storage equipments, flash memory device or other non-volatile solid state memory equipment.
The processor 13 is also known as central processing unit (CPU, Central Processing Unit), is one piece of super large rule
The integrated circuit of mould, is the arithmetic core (Core) and control core (Control Unit) of user equipment 1.The processor 13
The operating system of the user equipment 1 and types of applications program, the program code of installation etc. are can perform, such as file process is filled
Put 11.
With reference to Fig. 1, Fig. 4 and Fig. 5, the memory 12 in the user equipment 1 stores multiple instruction to realize one
Document handling method is planted, the processor 13 can perform the multiple instruction to realize：
Start the augmented reality AR functions on user equipment；
Using the AR functions, the pending file in the user equipment is carried out by the input/output unit 15
Projection；
The gesture operation of the user of the currently used user equipment is detected by the camera 14 of the user equipment；
According to the gesture operation, the pending file of projection is handled.
According to the preferred embodiment of the present invention, the processor 13 is detected by the camera 14 of the user equipment currently to be made
After gesture operation with the user of the user equipment, the processor 13 can perform the multiple instruction to realize：
It is determined that the distance between described pending file and the hand of the user for projecting；
Judge whether the distance is less than pre-determined distance threshold value；
If the distance is less than the pre-determined distance threshold value, perform it is described according to the gesture operation, to the institute of projection
Pending file is stated to be handled.
According to the preferred embodiment of the present invention, the processor 13 can perform the multiple instruction to realize：
Shot using the gesture operation of described 14 couples of users of camera and the pending file of projection
And synthesize, obtain AR images；
By the input/output unit 15 by the AR images shares to the first object equipment with the AR functions.
According to the preferred embodiment of the present invention, the processor 13 starts after the AR functions on the user equipment, and
The processor 13 utilizes the AR functions, by the input/output unit 15 by the pending file in the user equipment
Before being projected, the processor 13 can perform the multiple instruction to realize：
In with the AR of AR functions applications, the file stored in the user equipment is inserted；By described in insertion
File is defined as the pending file；Or
Using the AR functions, all texts that the user equipment is stored are projected out by the input/output unit 15
Part；Selection instruction based on user's selection target file is received by the input/output unit 15, the selection is responded
Instruction, the pending file is defined as by the file destination.
According to the preferred embodiment of the present invention, the processor 13 can perform the multiple instruction to realize：
By the input/output unit 15 by the image projection presented in the view-finder of the camera to it is described
Second target device of user equipment binding.
Specifically, the processor 13 refers to correspondence in Fig. 1, Fig. 4 and Fig. 5 to the concrete methods of realizing of above-mentioned instruction
The description of correlation step, will not be described here in embodiment.
In the user equipment described by Fig. 8, user equipment can start the augmented reality AR functions on user equipment, profit
With the AR functions, the pending file in the user equipment is projected, further, user equipment can pass through institute
The gesture operation of the user of the currently used user equipment of camera detection of user equipment is stated, and is grasped according to the gesture
Make, the pending file of projection is handled.It can be seen that, by embodiments of the invention, user equipment can use AR
Technology need to pending file to be processed project to space, spatial dimension is very big, and user can be very easily to being projected in sky
Between in pending file carry out gesture operation, user equipment can be according to the gesture operation of user, directly to described in projection
Pending file is handled, so as to easily be handled using AR technologies the file on user equipment.
In several embodiments provided by the present invention, it should be understood that disclosed system, apparatus and method can be with
Realize by another way.For example, device embodiment described above is only schematical, for example, the module
Divide, only a kind of division of logic function there can be other dividing mode when actually realizing.
The module illustrated as separating component can be or may not be it is physically separate, it is aobvious as module
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of module therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional module in each embodiment of the invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, it would however also be possible to employ hardware adds the form of software function module to realize.
It is obvious to a person skilled in the art that the invention is not restricted to the details of above-mentioned one exemplary embodiment, Er Qie
In the case of without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, embodiment all should be regarded as exemplary, and be nonrestrictive, the scope of the present invention is by appended power
Profit is required rather than described above is limited, it is intended that all in the implication and scope of the equivalency of claim by falling
Change is included in the present invention.The right that any attached associated diagram mark in claim should not be considered as involved by limitation will
Ask.Furthermore, it is to be understood that the word of " comprising " one is not excluded for other units or step, odd number is not excluded for plural number.Stated in system claims
Multiple units or device can also be realized by a unit or device by software or hardware.Second grade word is used for table
Show title, and be not offered as any specific order.
Finally it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention and it is unrestricted, although reference
The present invention is described in detail for preferred embodiment, it will be understood by those within the art that, can be to the present invention's
Technical scheme is modified or equivalent substitution, without departing from the spirit and scope of technical solution of the present invention.
Claims (11)
1. a kind of document handling method, it is characterised in that including：
Start the augmented reality AR functions on user equipment；
Using the AR functions, the pending file in the user equipment is projected；
The gesture operation of the user of the currently used user equipment is detected by the camera of the user equipment；
According to the gesture operation, the pending file of projection is handled.
2. according to the method described in claim 1, it is characterised in that the camera by the user equipment detects current
After gesture operation using the user of the user equipment, methods described also includes：
It is determined that the distance between described pending file and the hand of the user for projecting；
Judge whether the distance is less than pre-determined distance threshold value；
If the distance is less than the pre-determined distance threshold value, perform it is described according to the gesture operation, to being treated described in projection
Processing file is handled.
3. method according to claim 2, it is characterised in that methods described also includes：
The gesture operation of the user and the pending file of projection are shot and synthesized using the camera,
Obtain AR images；
By the AR images shares to the first object equipment with the AR functions.
4. the method according to any one of claims 1 to 3, it is characterised in that the AR on the startup user equipment
After function, and it is described using the AR functions, it is described before the pending file in the user equipment is projected
Method also includes：
In with the AR of AR functions applications, the file stored in the user equipment is inserted；By the file of insertion
It is defined as the pending file；Or
Using the AR functions, the All Files of the user equipment storage is projected out；Receive and be based on user's selection target
The selection instruction of file, responds the selection instruction, the file destination is defined as into the pending file.
5. the method according to any one of claims 1 to 3, it is characterised in that methods described also includes：
By the image projection presented in the view-finder of the camera to the second target device bound with the user equipment.
6. a kind of user equipment, it is characterised in that the user equipment includes processor, memory, camera and inputted defeated
Go out device, the memory is used to store at least one instruction, and the processor is used to perform at least one described instruction with reality
It is existing：
Start the augmented reality AR functions on user equipment；
Using the AR functions, the pending file in the user equipment is projected by the input/output unit；
The gesture operation of the user of the currently used user equipment is detected by the camera of the user equipment；
According to the gesture operation, the pending file of projection is handled.
7. user equipment according to claim 6, it is characterised in that the shooting that the processor passes through the user equipment
After the gesture operation of the user of the currently used user equipment of head detection, the processor is additionally operable at least one described in execution
It is individual to instruct to realize：
It is determined that the distance between described pending file and the hand of the user for projecting；
Judge whether the distance is less than pre-determined distance threshold value；
If the distance is less than the pre-determined distance threshold value, perform it is described according to the gesture operation, to being treated described in projection
Processing file is handled.
8. user equipment according to claim 7, it is characterised in that the processor is additionally operable at least one described in execution
Instruct to realize：
The gesture operation of the user and the pending file of projection are shot and synthesized using the camera,
Obtain AR images；
By the input/output unit by the AR images shares to the first object equipment with the AR functions.
9. the user equipment according to any one of claim 6 to 8, it is characterised in that the processor starts the user
After AR functions in equipment, and the processor utilizes the AR functions, is used by the input/output unit by described
Before pending file in the equipment of family is projected, the processor is additionally operable to perform at least one described instruction to realize：
In with the AR of AR functions applications, the file stored in the user equipment is inserted；By the file of insertion
It is defined as the pending file；Or
Using the AR functions, the All Files that the user equipment is stored is projected out by the input/output unit；Pass through
The input/output unit receives the selection instruction based on user's selection target file, the selection instruction is responded, by institute
State file destination and be defined as the pending file.
10. the user equipment according to any one of claim 6 to 8, it is characterised in that the processor is additionally operable to perform institute
At least one instruction is stated to realize：
The image projection presented in the view-finder of the camera is set to the user by the input/output unit
Second target device of standby binding.
11. a kind of computer-readable recording medium, it is characterised in that the computer-readable recording medium storage has at least one
The file process side as described in claim 1 to 5 any one is realized in instruction, at least one described instruction when being executed by processor
Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710521870.7A CN107229342A (en) | 2017-06-30 | 2017-06-30 | Document handling method and user equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710521870.7A CN107229342A (en) | 2017-06-30 | 2017-06-30 | Document handling method and user equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107229342A true CN107229342A (en) | 2017-10-03 |
Family
ID=59935212
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710521870.7A Pending CN107229342A (en) | 2017-06-30 | 2017-06-30 | Document handling method and user equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107229342A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109271573A (en) * | 2018-10-19 | 2019-01-25 | 维沃移动通信有限公司 | A kind of file management method and VR equipment |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100075281A (en) * | 2008-12-24 | 2010-07-02 | 전자부품연구원 | Apparatus having function of space projection and space touch and the controlling method thereof |
| US8913037B1 (en) * | 2012-10-09 | 2014-12-16 | Rawles Llc | Gesture recognition from depth and distortion analysis |
| CN104575120A (en) * | 2015-01-09 | 2015-04-29 | 代四广 | Display system for aided teaching |
| CN104796455A (en) * | 2015-03-12 | 2015-07-22 | 安徽讯飞皆成软件技术有限公司 | Cross-platform multi-screen interacting method, device and system |
| CN104796675A (en) * | 2014-01-20 | 2015-07-22 | 鸿富锦精密工业（深圳）有限公司 | Projection system and projection method |
| CN105260021A (en) * | 2015-10-15 | 2016-01-20 | 深圳市祈锦通信技术有限公司 | Intelligent interactive projection system |
| CN205353495U (en) * | 2016-01-27 | 2016-06-29 | 李科 | Multi -functional collapsible intelligent glasses |
| CN106249882A (en) * | 2016-07-26 | 2016-12-21 | 华为技术有限公司 | A kind of gesture control method being applied to VR equipment and device |
| CN106484085A (en) * | 2015-08-31 | 2017-03-08 | 北京三星通信技术研究有限公司 | Method and its head mounted display of real-world object is shown in head mounted display |
| CN106548517A (en) * | 2016-09-30 | 2017-03-29 | 深圳前海勇艺达机器人有限公司 | The method and device of video conference is carried out based on augmented reality |
| CN106648098A (en) * | 2016-12-23 | 2017-05-10 | 武汉市马里欧网络有限公司 | User-defined scene AR projection method and system |
-
2017
- 2017-06-30 CN CN201710521870.7A patent/CN107229342A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100075281A (en) * | 2008-12-24 | 2010-07-02 | 전자부품연구원 | Apparatus having function of space projection and space touch and the controlling method thereof |
| US8913037B1 (en) * | 2012-10-09 | 2014-12-16 | Rawles Llc | Gesture recognition from depth and distortion analysis |
| CN104796675A (en) * | 2014-01-20 | 2015-07-22 | 鸿富锦精密工业（深圳）有限公司 | Projection system and projection method |
| CN104575120A (en) * | 2015-01-09 | 2015-04-29 | 代四广 | Display system for aided teaching |
| CN104796455A (en) * | 2015-03-12 | 2015-07-22 | 安徽讯飞皆成软件技术有限公司 | Cross-platform multi-screen interacting method, device and system |
| CN106484085A (en) * | 2015-08-31 | 2017-03-08 | 北京三星通信技术研究有限公司 | Method and its head mounted display of real-world object is shown in head mounted display |
| CN105260021A (en) * | 2015-10-15 | 2016-01-20 | 深圳市祈锦通信技术有限公司 | Intelligent interactive projection system |
| CN205353495U (en) * | 2016-01-27 | 2016-06-29 | 李科 | Multi -functional collapsible intelligent glasses |
| CN106249882A (en) * | 2016-07-26 | 2016-12-21 | 华为技术有限公司 | A kind of gesture control method being applied to VR equipment and device |
| CN106548517A (en) * | 2016-09-30 | 2017-03-29 | 深圳前海勇艺达机器人有限公司 | The method and device of video conference is carried out based on augmented reality |
| CN106648098A (en) * | 2016-12-23 | 2017-05-10 | 武汉市马里欧网络有限公司 | User-defined scene AR projection method and system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109271573A (en) * | 2018-10-19 | 2019-01-25 | 维沃移动通信有限公司 | A kind of file management method and VR equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11962930B2 (en) | Method and apparatus for controlling a plurality of virtual characters, device, and storage medium | |
| CN108245888A (en) | Virtual object control method, device and computer equipment | |
| US10191612B2 (en) | Three-dimensional virtualization | |
| CN105338238B (en) | A kind of photographic method and electronic equipment | |
| KR101732839B1 (en) | Segmentation of content delivery | |
| US9607394B2 (en) | Information processing method and electronic device | |
| CN110321048A (en) | The processing of three-dimensional panorama scene information, exchange method and device | |
| WO2017032078A1 (en) | Interface control method and mobile terminal | |
| CN105306835A (en) | Image processing system | |
| CN108156384A (en) | Image processing method, device, electronic equipment and medium | |
| CN109840946A (en) | Virtual objects display methods and device | |
| WO2024022349A1 (en) | Image processing method and apparatus, and electronic device and storage medium | |
| CN108027936A (en) | For method, system and the medium of interactive elements to be presented in video content | |
| CN109656363A (en) | It is a kind of for be arranged enhancing interaction content method and apparatus | |
| CN112738403A (en) | Photographing method, photographing apparatus, electronic device, and medium | |
| CN103927093B (en) | A kind of information processing method and electronic equipment | |
| CN111766989B (en) | Interface switching method and device | |
| CN107229342A (en) | Document handling method and user equipment | |
| CN115967854A (en) | Photographing method and device and electronic equipment | |
| CN115640092A (en) | Interface display method and device, electronic equipment and readable storage medium | |
| CN115037874A (en) | Photographing method and device and electronic equipment | |
| CN113810624A (en) | Video generation method and device and electronic equipment | |
| CN111766947A (en) | Display method, display device, wearable device and medium | |
| CN115589457A (en) | Shooting method, shooting device, electronic equipment and readable storage medium | |
| CN105761203B (en) | A kind of information processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171003 |