CN108958588A - Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation - Google Patents
Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation Download PDFInfo
- Publication number
- CN108958588A CN108958588A CN201810771120.XA CN201810771120A CN108958588A CN 108958588 A CN108958588 A CN 108958588A CN 201810771120 A CN201810771120 A CN 201810771120A CN 108958588 A CN108958588 A CN 108958588A
- Authority
- CN
- China
- Prior art keywords
- user
- interface icon
- interface
- icon
- operation instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses control method, system, equipment and the readable storage medium storing program for executing of interface icon operation.Wherein, for method comprising steps of scanning either objective scene, is presented AR display interface on the display screen of intelligent terminal after scanning successfully, interface icon is presented based on target scene in AR display interface in a manner of augmented reality；The first user operation instruction is obtained, at least one interface icon is selected in AR display interface according to the first user operation instruction；Second user operational order is obtained, according to the mobile interface icon chosen of second user operational order；Third user operation instruction is obtained, the interface icon chosen is placed to specified location in user according to third user operation instruction.System, equipment and readable storage medium storing program for executing both correspond to a kind of control method of intelligent terminal interface icon operation based on augmented reality.It is become easy the invention enables user's cell phone desktop icons and intelligent, and improves operating efficiency, user experience is good.
Description
Technical field
The present invention relates to intelligent terminal control fields, the intelligent terminal interface icon operation specially based on augmented reality
Control method, system, equipment and readable storage medium storing program for executing.
Background technique
In the prior art, interface icon (such as desk-top picture of the user in intelligent movable equipment (such as mobile phone, tablet computer)
Mark) when, it needs long-pressing icon and reaches by switching screen to want that the position placed just is able to achieve moving operation.Since user needs
By finger long-pressing, and screen need to be switched when carrying out interface icon movement and placed, this operating process is cumbersome, and only
It can move one by one, integrated operation process mechanism degree is high, inconvenient, poor user experience.
Summary of the invention
The present invention is directed to solve at least some of the technical problems in related technologies.For this purpose, of the invention
Purpose is to provide that a kind of operating efficiency is high, the control of the good intelligent terminal interface icon operation based on augmented reality of user experience
Method, system, equipment and readable storage medium storing program for executing.
The technical scheme adopted by the invention is that:
In a first aspect, a kind of control method of the intelligent terminal interface icon operation based on augmented reality, which is characterized in that
Include:
Either objective scene is scanned, AR display interface is presented after scanning successfully on the display screen of intelligent terminal, it is described
Interface icon is presented based on the target scene in AR display interface in a manner of augmented reality；
The first user operation instruction is obtained, selects at least one in the AR display interface according to the first user operation instruction
A interface icon；
Second user operational order is obtained, according to the mobile interface icon chosen of second user operational order；
Third user operation instruction is obtained, the interface icon chosen is placed to user according to third user operation instruction
Designated position.
Further, the scanning either objective scene, being based on the display screen of intelligent terminal after scanning successfully should
Interface icon is presented in target scene in a manner of augmented reality, specifically further include: based on the intelligent terminal and target scene it
Between distance and/or relative displacement, adjust the size that shows of interface icon and/or the position in AR display interface.
Alternatively the first preferred embodiment of interface icon step, first user operation instruction include intelligence
Terminal vertically moves signal；The first user operation instruction of the acquisition is shown according to the first user operation instruction in the AR
At least one described interface icon is selected in interface, is specifically included: being obtained the action signal of intelligent terminal vertically moved, is worked as institute
When stating the display area of interface icon more than preset area, the stopping duration of the intelligent terminal is recorded；When the stopping duration
When beyond the first preset duration, it is determined as choosing the interface icon.
Alternatively second of preferred embodiment of interface icon step, first user operation instruction includes user
To the touching signals of display screen；The first user operation instruction of the acquisition, it is aobvious in the AR according to the first user operation instruction
Show and select at least one described interface icon in interface, specifically include: obtaining user to the touching signals of display screen, work as user
When interface icon described in touch/long-pressing, it is determined as choosing the interface icon.
Alternatively the third preferred embodiment of interface icon step, first user operation instruction includes user
To the crawl hand signal of the interface icon；The first user operation instruction of the acquisition, exists according to the first user operation instruction
At least one described interface icon is selected in the AR display interface, is specifically included: obtaining user and the interface icon is grabbed
Hand signal is taken, when user gesture signal is to grab the interface icon, is determined as choosing the interface icon.
Further, the first user operation instruction of the acquisition shows boundary in the AR according to the first user operation instruction
At least one described interface icon is selected in face, is specifically included: being obtained the first user operation instruction, is referred to according to the first user's operation
First interface icon is chosen in order in AR display interface, and pops up choice box on the display screen, to be confirmed whether under selection
One interface icon；Such as confirm the next interface icon of selection, continues to obtain the first user operation instruction, be grasped according to the first user
It instructs and chooses second interface icon in AR display interface, and pop up choice box on the display screen, to be confirmed whether to select
Select next interface icon；And so on carry out multiple interface icon selections.
Further, the first user operation instruction of the acquisition shows boundary in the AR according to the first user operation instruction
At least one described interface icon is selected in face, is specifically included: being obtained the first user operation instruction, is referred to according to the first user's operation
First interface icon is chosen in order in AR display interface, whether then monitors the stopping duration of the intelligent terminal more than second
Preset duration；It is in this way then confirm the next interface icon of selection, continue to obtain the first user operation instruction, be grasped according to the first user
Instruct and choose second interface icon in AR display interface, then monitor the intelligent terminal stopping duration whether be more than
Second preset duration；And so on carry out multiple interface icon selections.
Further, second operational order includes that intelligent terminal moves in parallel signal；The acquisition second user
Operational order is specifically included according to the mobile interface icon chosen of second user operational order: obtaining the flat of intelligent terminal
Row movable signal, according to the shifting for moving in parallel signal and the interface icon chosen being presented in AR display interface of intelligent terminal
Movement.
Further, second operational order includes the gesture movable signal of user；The acquisition second user operation
Instruction is specifically included according to the mobile interface icon chosen of second user operational order: being obtained user and is maintained grasping movement
Gesture movable signal, maintain mobile present in AR display interface of the movable signal of the gesture of grasping movement to select according to user
In the interface icon shift action.
Further, the third operational order includes that intelligent terminal moves down action signal and/or user to discharge touch-control dynamic
Make signal and/or user discharges crawl gesture motion signal.
Further, the first user operation instruction of the acquisition selects at least one institute according to the first user operation instruction
After stating interface icon, further includes: obtain fourth user operational order, cancel interface icon choosing according to fourth user operational order
It selects.
Further, the fourth user operational order includes clicking interface icon action signal.
Further, the acquisition second user operational order, according to the mobile surface chart of second user operational order
After mark, further includes: obtain the 5th user operation instruction, control the interface icon according to the 5th user operation instruction and be back to original
Position.
Further, the 5th user operation instruction includes overturning intelligent terminal action signal.
Second aspect, the control system for the intelligent terminal interface icon operation based on augmented reality that the present invention also provides a kind of
System, comprising:
Interface icon display module, for showing the interface icon of intelligent terminal in a manner of augmented reality；
Interface icon selecting module is selected for obtaining the first user operation instruction, and according to the first user operation instruction
At least one described interface icon；
Interface icon mobile module, for obtaining second user operational order, and it is mobile according to second user operational order
The interface icon；
Interface icon puts down module, for obtaining third user operation instruction, puts down institute according to third user operation instruction
State interface icon.
Further, further includes: cancellation module is falsely dropped, it is described to falsely drop the input terminal for cancelling module and interface icon selection mould
The output end of block connects, and cancels interface icon choosing for obtaining fourth user operational order, and according to fourth user operational order
It selects.
Further, further includes: abandon mobile module, the input terminal for abandoning mobile module and the mobile mould of interface icon
The output end of block connects, and controls the surface chart for obtaining the 5th user operation instruction, and according to the 5th user operation instruction
Mark is back to original position.
The control of the third aspect, the intelligent terminal interface icon operation based on augmented reality that the present invention also provides a kind of is set
It is standby, comprising: at least one processor；And the memory being connect at least one described processor communication；Wherein, described to deposit
Reservoir is stored with the instruction that can be executed by least one described processor, and described instruction is executed by least one described processor,
So that at least one described processor is able to carry out the control of the intelligent terminal interface icon operation based on augmented reality
Method.
Fourth aspect, the present invention also provides a kind of computer readable storage medium, the computer readable storage medium is deposited
Contain computer executable instructions, it is described based on augmented reality that the computer executable instructions are used to making computer to execute
The control method of intelligent terminal interface icon operation.
The beneficial effects of the present invention are:
It is provided by the invention based on augmented reality intelligent terminal interface icon operation control method, system, equipment and
Readable storage medium storing program for executing shows intelligent terminal interface icon using augmented reality mode, by setting predetermined registration operation and Rule of judgment,
Required moving icon is subjected to customized movement in conjunction with human-computer interaction.Compared with prior art, this programme overcomes interface icon
The more hard defect of moving operation effectively increases interface icon mobile operating efficiency and operating experience.
In addition, the operational means by combining setting moving icon simultaneously, so that the movement of more icons is more humanized, just
Victoryization.
The present invention is suitable for the interface icon operating system of various intelligent terminals.
Detailed description of the invention
Specific embodiments of the present invention will be further explained with reference to the accompanying drawing:
Fig. 1 is the principle signal for the interface icon for showing intelligent terminal in the embodiment of the present invention one in a manner of augmented reality
Figure；
Fig. 2 is the process for showing the interface icon step of intelligent terminal in the embodiment of the present invention one in a manner of augmented reality
Figure；
Fig. 3 is the control flow chart of one icon of movement in the embodiment of the present invention one；
The control flow chart of mobile multiple icons while Fig. 4 is in the embodiment of the present invention one；
Fig. 5 is to cancel selection/cancellation moving icon operation control flow chart in the embodiment of the present invention one；
Fig. 6 is the system schematic of the intelligent terminal interface icon operation based on augmented reality of the embodiment of the present invention two.
Specific embodiment
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase
Mutually combination；Printed words such as " first " " second " " third " " the 4th " " the 5 " employed herein not to data or execution order into
Row limits, and is distinguished to function and the essentially identical identical entry of effect or similar item.
As shown in Figure 1, smart machine of the present invention includes that mobile phone, tablet computer etc. have the intelligence of communication function eventually
End, below only by taking mobile phone 100 as an example；Interface icon of the present invention includes desktop icons, icon etc. inside application program, under
Face is only by taking desktop icons 111 as an example；Target scene of the present invention can be any reality scene, below only with plane scene
For 200；The technical solution that the present invention will be described in detail.
In the following example, by camera collection image/vision signal built in mobile phone, realizes and obtain a variety of user behaviour
It instructs, specifically includes:
Scanning target scene obtains scene image: passing through camera (mobile phone rear camera or front camera)
The image/video in scene or acquisition reality scene in scanning reality.
Crawl hand signal of the user to the interface icon: when crawl gesture (such as thumb and index finger kneading hand of user
Gesture) (identification to crawl gesture can be realized by image analysis algorithm) when appearing between camera and target scene, it will use
The crawl gesture at family is presented in AR display interface, when the crawl gesture of user (such as thumb Chong Die with the position of a certain interface icon
Refer to that fingertip location is Chong Die with the position of a certain interface icon) when, be determined as user to the crawl hand signal of the interface icon,
Then choose the interface icon.
The gesture movable signal of user: after user chooses one or more interface icons, the crawl gesture of user occurs
Between camera and target scene and displacement action is generated, is determined as the gesture movable signal of user, then according to crawl gesture
The corresponding mobile interface icon chosen of the size and Orientation of displacement.
User discharges crawl gesture motion signal: after the mobile interface icon chosen of user reaches specified location in user,
User is obtained using camera and discharges crawl gesture motion image/video (such as thumb and index finger separately act), is determined as user
Release crawl gesture motion signal, then put down the interface icon chosen in current location.
In the following example, the shift action signal of mobile phone is detected and obtained by the gyro sensor built in mobile phone
Deng specifically including:
Mobile phone vertically moves signal: the displacement action of mobile phone is incuded by gyroscope, when mobile phone hanging down along plane scene
When histogram is to movement (i.e. mobile phone moves up and down), be determined as mobile phone vertically moves signal.
Mobile phone moves in parallel signal: the displacement action of mobile phone is incuded by gyroscope, when mobile phone is along plane scene
When parallel direction mobile (i.e. mobile phone back and forth or left and right is mobile), be determined as mobile phone moves in parallel signal.
Mobile phone moves down action signal: after the mobile interface icon chosen of user reaches specified location in user, passing through top
Spiral shell instrument incudes the displacement action of mobile phone, when mobile phone moves down (i.e. mobile phone moves down) along the vertical direction of plane scene, determines
Action signal is moved down for mobile phone.
In the following example, position or the attitude signal of mobile phone are detected and obtained by the direction sensor built in mobile phone
Deng, comprising:
It overturns mobile phone action signal: the angle change of mobile phone is incuded by direction sensor, when mobile phone angle change meets
When rotary movement (such as angle change is more than or equal to 180 degree), it is determined as the rotary movement signal of mobile phone.
In the following example, ambient lighting conditions are perceived by light sensor, to adjust dummy object (desk-top picture
Mark) brightness；By display screen on touch sensible module (touch screen) detect user touching signals (including user touching
Touch/long-pressing interface icon action signal, click interface icon action signal etc.).
Embodiment one
The control method for the mobile phone desktop icon operation based on augmented reality that the present embodiment provides a kind of, comprising:
AR display interface icon step: scanning either objective scene, after scanning successfully on the display screen of intelligent terminal
AR display interface is presented, interface icon is presented based on the target scene in the AR display interface in a manner of augmented reality.
Selection interface icon step: obtaining the first user operation instruction, shows boundary in AR according to the first user operation instruction
At least one interface icon is selected in face.
After selection interface icon step, such as want to cancel the interface icon chosen, can be performed and cancel interface icon selection
Step；Such as think the mobile interface icon chosen, moving boundary icon step can be performed.
Cancel interface icon and select step: after selection interface icon step, obtaining fourth user operational order, according to
Fourth user operational order cancels interface icon selection.
Moving boundary icon step: obtaining second user operational order, is chosen according to the movement of second user operational order
Interface icon.
In moving boundary icon step, such as wants to cancel movement, can be performed and cancel interface icon moving step；Such as want to place
The interface icon chosen, it is executable to put down interface icon step.
Cancel interface icon moving step: obtaining the 5th user operation instruction, institute is controlled according to the 5th user operation instruction
It states interface icon and is back to original position.
It puts down interface icon step: obtaining third user operation instruction, chosen according to the placement of third user operation instruction
Interface icon is to specified location in user.
Each step is explained in detail below is specifically realization process.
1.AR display interface icon step
Referring to Figures 1 and 2, in the present embodiment, when user wants the desktop icons 111 on cell phone 100, then user
It controls mobile phone 100 and opens augmented reality mode (AR mode), then user enters 100 augmented reality interface of mobile phone.
Specifically, the mobile phone 100, by scanning either objective scene, target scene can be any reality scene.Such as
A plane scene 200 (such as desktop or metope) is scanned by mobile phone 100, the current of the plane scene 200 is locked after scanning successfully
Region 210 (when current region 210 of the desktop or wall section that preceding camera is aligned as plane scene 200), and in mobile phone
Desktop icons 111 are presented in the current region 210 based on the plane scene 200 on 100 display screen, i.e., by desktop icons 111
Insertion is fixed in the current region 210 based on the plane scene 200, forms AR display interface 110, and in AR display interface
AR desktop icons 111 are shown in 110.AR display interface 110 be based on the distance between the intelligent terminal and target scene and/or
Relative displacement adjusts size and/or position that the desktop icons 111 in AR display interface 110 are shown.In the present embodiment,
When the mobile phone 100 is directed at desktop icons 111 in AR display interface 110 and moves closer to the plane scene 200, the table
Display area of the face icon 111 in the AR display interface 110 is gradually increased；When the mobile phone 100 is gradually distance from described put down
Face scene 200, display area of the desktop icons 111 in the AR display interface 110 are gradually reduced；When the mobile phone
100 opposite 200 current regions 210 of plane scene move in parallel, position of the desktop icons 111 in AR display interface 110
It moves.
2. selection interface icon step.
2.1 selection single interface icon steps
Referring to Fig. 3, the first user operation instruction is obtained, a desktop icons 111 are selected according to the first user operation instruction；
First user operation instruction include mobile phone vertically move signal and/or user to display screen touching signals and/or
Crawl hand signal etc. of the user to the desktop icons 111.Below only using the first user operation instruction as the vertical of mobile phone
Explanation is unfolded for movable signal.
Referring to Fig. 3, single target icon selects step, mobile phone 100 is moved close to perpendicular to plane scene 200
(the vertically moving signal of mobile phone), by constantly adjusting the distance between mobile phone 100 and plane scene 200, so that mobile phone 100 is aobvious
Displaying target icon (target desktop icon 111) in display screen curtain, while continuing close to plane scene 200, target icon is aobvious
Display area on display screen curtain is gradually increased；When display area is more than systemic presupposition area, as desktop icons 111 occupy screen
Maximum area is hit exactly, then mobile phone 100 is static (can use the jitter error that stabilization algorithm avoids holding mobile phone 100), stops
Operation, and keep former movement, the stopping duration of system start recording mobile phone 100；The first preset duration is reached (such as when stopping duration
1.5 seconds) when, then determine to choose target desktop icon 111；100 automatically scanning of mobile phone frames target icon with wire bar system and completes
Target icon selection.
When the first user operation instruction be user to display screen touching signals or user to the desktop icons 111
When grabbing hand signal, select single interface icon step and the first user operation instruction for class when vertically moving signal of mobile phone
Seemingly, it is summarized as follows respectively:
It (can when the crawl gesture (such as thumb and index finger kneading gesture) of user appears between camera and target scene
The identification to crawl gesture is realized by image analysis algorithm), the crawl gesture of user is presented in AR display interface 110,
When the crawl gesture of user (the position weight of such as thumb tip position and a certain interface icon Chong Die with the position of a certain interface icon
It is folded) when, it is determined as that user to the crawl hand signal of the interface icon, then chooses the interface icon.
In AR display interface 110, the touch-control of user is detected by the touch sensible module (touch screen) on display screen
Signal such as detects user's touch/long-pressing a certain interface icon action signal, is judged to choosing the interface icon.
The 2.2 multiple interface icon steps of selection
Referring to Fig. 4, when user has chosen a desktop icons 111, multiple desk-top pictures can be realized by following two mode
The selection of mark 111:
Multiple solutions icon selection mode one
The first user operation instruction is obtained, chooses first in AR display interface 110 according to the first user operation instruction
Interface icon, and choice box is popped up on the display screen, to be confirmed whether to select next interface icon；Such as confirm that selection is next
A interface icon ("Yes" is such as selected in choice box) continues to obtain the first user operation instruction, according to the first user operation instruction
Second interface icon is chosen in AR display interface 110, and pops up choice box on the display screen, to be confirmed whether under selection
One interface icon；... if confirmation selects next interface icon, continues to obtain the first user operation instruction, be used according to first
Family operational order chooses n-th interface icon in AR display interface 110, and pops up choice box on the display screen, with confirmation
Whether next interface icon is selected；Until user stops selection desktop icons 111 (such as selecting "No" in choice box).
Multiple solutions icon selection mode two
The first user operation instruction is obtained, chooses first in AR display interface 110 according to the first user operation instruction
Then whether interface icon monitors the stopping duration of the intelligent terminal more than the second preset duration (such as 2 seconds)；It is in this way then confirm
Next interface icon is selected, continues to obtain the first user operation instruction, according to the first user operation instruction in AR display interface
Second interface icon is chosen in 110, then monitor the intelligent terminal stopping duration it is whether default more than second when
It is long；... it is in this way then confirm the next interface icon of selection, continue to obtain the first user operation instruction, according to the first user's operation
Instruction n-th interface icon is chosen in AR display interface 110, then monitor the intelligent terminal stopping duration whether be more than
Second preset duration；Until user stops selection desktop icons 111 (such as mobile desktop icon 111 in the second preset duration).
After choosing target icon each time, by being in the covering of translucent full color covering pattern in AR display interface 110
The target icon being now entirely selected.
2.3, which cancel interface icon, selects step
Referring to Fig. 5, cancel the control flow chart of icon selection in the present embodiment.If user is in selection interface icon step
In, falsely drop in do not need operation desktop icons 111, then can by such as click the action signals such as the desktop icons 111 (the 4th behaviour
Instruct) cancelled.Wherein, the click of the user desktop is detected by the touch sensible module (touch screen) on display screen
The action signal of icon 111.
2.4 moving boundary icon steps
After interface icon (one or more) is chosen, second user operational order is obtained, according to second user operational order
The mobile desktop icons 111；Second operational order includes that the gesture for moving in parallel signal and/or user of mobile phone is mobile
Signal etc..
Moving boundary icon mode one
After selection interface icon step has selected one or more interface icons, then signal is moved in parallel according to mobile phone
(it is mobile to be parallel to plane scene 200), (desktop is presented in mobile phone 100AR display interface 110 in synchronizing moving target icon
The shift action of icon 111).
Moving boundary icon mode two
After selection interface icon step has selected one or more interface icons, the crawl gesture of user appears in camera shooting
Between head and target scene and displacement action is generated, is determined as the gesture movable signal of user, then according to crawl gesture displacement
(shifting of the desktop icons 111 is presented in the corresponding mobile interface icon chosen of size and Orientation in mobile phone A R display interface 110
Movement).
2.5 cancel interface icon moving step
Referring to Fig. 5, in moving boundary icon step, such as wants to cancel movement, can be performed and cancel interface icon moving step.
Specifically, can be by such as carrying out mobile phone 100 to overturn etc. action signal (the 5th user operation instruction), system identification takes for user
Disappear moving operation, the position of (mobile before) before desktop icons 111 automatically return to.Wherein, hand is incuded by direction sensor
The angle change of machine 100 determines when 100 angle change of mobile phone meets rotary movement (such as angle change is more than or equal to 180 degree)
For the rotary movement signal of mobile phone 100.
2.6 put down interface icon step
When selected target icon to be moved to interface location (in the desktop scope) of the desired placement of user, third is obtained
User operation instruction puts down the desktop icons 111 according to third user operation instruction.The third operational order includes mobile phone
It moves down action signal and/or user discharges touch action signal and/or user discharges crawl gesture motion signal etc..Below only with
Third operational order is that explanation is unfolded for mobile phone moves down action signal.
After the mobile interface icon chosen of user reaches specified location in user, the position of mobile phone 100 is incuded by gyroscope
It is mobile to make, when mobile phone 100 is moved down along the vertical direction of plane scene 200, it is determined as the action signal that moves down of mobile phone 100, then
Drop target is illustrated at this position, and it is mobile to complete target icon.
2.7 exit AR display interface step
After completing target icon movement, AR display interface can be exited by the exit button in AR display interface 110
110,100 display interface of regular handset is returned to, and the desktop icons for completing moving operation are presented in 100 display interface of regular handset
111。
Embodiment two
Referring to Fig. 6, a kind of control system of mobile phone desktop icon operation based on augmented reality, packet are present embodiments provided
It includes:
Desktop icons display module, for showing the desktop icons of mobile phone in a manner of augmented reality.Desktop icons are shown
Module can use including but not limited to mobile phone camera, gyroscope, light sensor and realize.The mobile phone passes through (camera)
Either objective scene is scanned, target scene can be any reality scene.Such as by mobile phone scan a plane scene (such as desktop or
Metope), the plane scene present image is locked after scanning successfully, and current based on the plane scene on the display screen of mobile phone
Desktop icons are presented in image, i.e., desktop icons insertion are fixed in the plane scene present image, form AR desktop icons.It is logical
Cross the shift action of gyroscope induction mobile phone.When the mobile phone moves closer to the desktop icons, the desktop icons are described
Display area on display screen is gradually increased；When the mobile phone is gradually distance from the desktop icons, the desktop icons are in institute
The display area stated on display screen is gradually reduced；When the mobile phone is moved in parallel with respect to plane scene present image, the table
Face icon is moved in parallel relative to mobile phone.By light sensor for perceiving light conditions, to adjust dummy object (desktop
Icon) display brightness, improve the real sense of reality that shows of icon.
Desktop icons selecting module is selected for obtaining the first user operation instruction, and according to the first user operation instruction
One or more desktop icons.Desktop icons selecting module is realized using including but not limited to gyroscope or touches display
Screen.For example, incuding mobile phone action signal using gyroscope.Mobile phone is moved close to perpendicular to plane scene, and constantly
Close to plane scene, by constantly adjusting the distance between mobile phone and plane scene, so that only display mesh in mobile phone display screen curtain
It marks on a map (target desktop icon), while continuing alignment and close plane scene, the display surface of target icon on the display screen
Product is gradually increased；When display area is more than systemic presupposition area, if icon occupies screen center maximum area, then mobile phone is static
(can use the jitter error that stabilization algorithm avoids holding mobile phone), stops operation, and keep former movement, system start recording
The stopping duration of mobile phone；When stopping duration arrival the first preset duration (such as 1.5 seconds), then determine that mobile phone user need to carry out target
The motion scan of icon operates；Mobile phone automatically scanning frames target icon with wire bar system and completes target icon selection.
Cancellation module is falsely dropped, the input terminal for falsely dropping cancellation module is connect with the output end of desktop icons selecting module,
Cancel desktop icons selection for obtaining fourth user operational order, and according to fourth user operational order.If user is selecting
During icon, falsely drops and take unwanted desktop icons, then it can be by such as clicking the action signals such as the desktop icons (the 4th behaviour
Instruct) cancelled.
Desktop icons mobile module, for obtaining second user operational order, and it is mobile according to second user operational order
The desktop icons.Desktop icons mobile module is realized using including but not limited to gyroscope or touch display screen.Example
Such as, mobile phone action signal is incuded using gyroscope.According to the movement (it is mobile to be parallel to plane scene) of mobile phone, synchronizing moving mesh
It marks on a map and (shift action of the desktop icons is presented on mobile phone display screen curtain based on plane scene).
Mobile module is abandoned, the input terminal for abandoning mobile module is connect with the output end of desktop icons mobile module,
For obtaining the 5th user operation instruction, and the desktop icons are controlled according to the 5th user operation instruction and are back to original position.
It, can be by the way that such as mobile phone be overturn etc. if desktop icons mobile module, in executing icon moving process, decision is abandoned moving
Action signal (the 5th user operation instruction), system identification are that user abandons moving operation, desktop icons automatically return to before (not
Before movement) position.
Desktop icons put down module, for obtaining third user operation instruction, put down institute according to third user operation instruction
State desktop icons.Desktop icons mobile module is realized using including but not limited to gyroscope or touch display screen.For example,
Mobile phone action signal is incuded using gyroscope.When by selected target icon be moved to user want place interface location (
In desktop scope) when, it can integrally be moved down by mobile phone (mobile phone moves vertically downward along plane scene), then determine drop target figure
It is marked in this position, it is mobile to complete target icon.
It should be noted that the control system operated by the mobile phone desktop icon based on augmented reality in this present embodiment
It is based on identical inventive concept with the control method of the mobile phone desktop icon operation based on augmented reality in above-described embodiment one,
Therefore, the corresponding contents in embodiment of the method one are equally applicable to this system embodiment, and and will not be described here in detail.
Embodiment three
A kind of control equipment of mobile phone desktop icon operation based on augmented reality is also provided in the present embodiment, comprising:
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one
A processor executes, so that at least one described processor is able to carry out the method.
It should be noted that the control system operated by the mobile phone desktop icon based on augmented reality in this present embodiment
It is based on identical inventive concept with the control method of the mobile phone desktop icon operation based on augmented reality in above-described embodiment one,
Therefore, the corresponding contents in embodiment of the method one are equally applicable to this system embodiment, and and will not be described here in detail.
Example IV
In the present embodiment, the present invention also provides a kind of computer readable storage medium, the computer readable storage medium
Computer executable instructions are stored with, the computer executable instructions are used to that computer to be made to execute the method.
It should be noted that the control system operated by the mobile phone desktop icon based on augmented reality in this present embodiment
Identical invention is based on the control method of the mobile phone desktop icon operation based on augmented reality in above-described embodiment one and two
Design, therefore, the corresponding contents in embodiment of the method one are equally applicable to this system embodiment, and and will not be described here in detail.
Control method, system, the equipment and readable of mobile phone desktop icon operation provided by the invention based on augmented reality
Required moving icon is carried out customized movement or even nothing by human-computer interaction using augmented reality mode desktop by storage medium
Human finger is needed directly to contact, it is very intelligent, conveniently, meet the AI epoch, the completely new mode of operation of augmented reality bring allows use
Family cell phone desktop icons become easy and intelligence, and improve operating efficiency, and user experience is good.
It is to be illustrated to preferable implementation of the invention, but the invention is not limited to the implementation above
Example, those skilled in the art can also make various equivalent variations on the premise of without prejudice to spirit of the invention or replace
It changes, these equivalent deformations or replacement are all included in the scope defined by the claims of the present application.
Claims (13)
1. a kind of control method of the intelligent terminal interface icon operation based on augmented reality characterized by comprising
Either objective scene is scanned, AR display interface is presented after scanning successfully on the display screen of the intelligent terminal, it is described
Interface icon is presented based on the target scene in AR display interface in a manner of augmented reality；
The first user operation instruction is obtained, at least one institute is selected in the AR display interface according to the first user operation instruction
State interface icon；
Second user operational order is obtained, according to the mobile interface icon chosen of second user operational order；
Third user operation instruction is obtained, it is specified to user that the interface icon chosen is placed according to third user operation instruction
Position.
2. a kind of control method of intelligent terminal interface icon operation based on augmented reality according to claim 1,
It is characterized in that, the scanning either objective scene, is based on the target scene after scanning successfully on the display screen of intelligent terminal
Interface icon is presented in a manner of augmented reality, specifically further include:
Based on the distance between the intelligent terminal and the target scene and/or relative displacement, the AR display interface is adjusted
In the size that shows of the interface icon and/or position.
3. a kind of control method of intelligent terminal interface icon operation based on augmented reality according to claim 1 or 2,
It is characterized in that,
First user operation instruction includes that intelligent terminal vertically moves signal；The first user operation instruction of the acquisition,
At least one described interface icon is selected in the AR display interface according to the first user operation instruction, is specifically included: being obtained
The action signal of the intelligent terminal vertically moved, when the display area of the interface icon is more than preset area, record
The stopping duration of the intelligent terminal；When the stopping duration exceeding the first preset duration, it is determined as choosing the surface chart
Mark；
Alternatively,
First user operation instruction includes touching signals of the user to display screen；The first user's operation of the acquisition refers to
It enables, at least one described interface icon is selected in the AR display interface according to the first user operation instruction, specifically includes: obtaining
Family is taken to the touching signals of display screen, when the interface icon described in user's touch/long-pressing, is determined as choosing the surface chart
Mark；
Alternatively,
First user operation instruction includes crawl hand signal of the user to the interface icon；The first user of the acquisition
Operational order selects at least one described interface icon according to the first user operation instruction, specifically in the AR display interface
It include: to obtain user to the crawl hand signal of the interface icon, when user gesture signal is to grab the interface icon,
It is determined as choosing the interface icon.
4. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality, special
Sign is, the first user operation instruction of the acquisition, selected in the AR display interface according to the first user operation instruction to
A few interface icon, specifically includes:
The first user operation instruction is obtained, chooses first surface chart in AR display interface according to the first user operation instruction
Mark, and choice box is popped up on the display screen, to be confirmed whether to select next interface icon；Such as confirm that selection is next
Interface icon continues to obtain the first user operation instruction, chooses second in AR display interface according to the first user operation instruction
A interface icon, and choice box is popped up on the display screen, to be confirmed whether to select next interface icon；And so on
Carry out multiple interface icon selections.
5. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality, special
Sign is, the first user operation instruction of the acquisition, selected in the AR display interface according to the first user operation instruction to
A few interface icon, specifically includes:
The first user operation instruction is obtained, first interface is chosen in the AR display interface according to the first user operation instruction
Then whether icon monitors the stopping duration of the intelligent terminal more than the second preset duration；It is in this way then confirm selection it is next
Interface icon continues to obtain the first user operation instruction, be chosen in the AR display interface according to the first user operation instruction
Then whether second interface icon monitors the stopping duration of the intelligent terminal more than the second preset duration；And so on into
The multiple interface icon selections of row.
6. a kind of control method of intelligent terminal interface icon operation based on augmented reality according to claim 1 or 2,
It is characterized in that,
Second operational order includes that intelligent terminal moves in parallel signal；
The acquisition second user operational order, according to the mobile interface icon chosen of second user operational order, specifically
Include:
Obtain intelligent terminal moves in parallel signal, and choosing is presented in AR display interface according to the signal that moves in parallel of intelligent terminal
In the interface icon shift action.
7. a kind of control method of intelligent terminal interface icon operation based on augmented reality according to claim 1 or 2,
It is characterized in that,
Second operational order includes the gesture movable signal of user；
The acquisition second user operational order, according to the mobile interface icon chosen of second user operational order, specifically
Include:
The movable signal that user maintains the gesture of grasping movement is obtained, the movable signal of the gesture of grasping movement is maintained according to user
The mobile shift action that the interface icon chosen is presented in AR display interface.
8. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality, special
Sign is, the third operational order include intelligent terminal move down action signal and/or user discharge touch action signal and/or
User discharges crawl gesture motion signal.
9. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality, special
Sign is that the first user operation instruction of the acquisition selects at least one described interface icon according to the first user operation instruction
Later, further includes:
Fourth user operational order is obtained, the interface icon is cancelled according to fourth user operational order and is selected；
The fourth user operational order includes clicking interface icon action signal.
10. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality,
It is characterized in that, the acquisition second user operational order, after the mobile interface icon of second user operational order, also wraps
It includes:
The 5th user operation instruction is obtained, the interface icon is controlled according to the 5th user operation instruction and is back to original position；
5th user operation instruction includes overturning intelligent terminal action signal.
11. a kind of control system of the intelligent terminal interface icon operation based on augmented reality characterized by comprising
Interface icon display module, for showing the interface icon of intelligent terminal in a manner of augmented reality；
Interface icon selecting module, for obtaining the first user operation instruction, and at least according to the selection of the first user operation instruction
One interface icon；
Interface icon mobile module, for obtaining second user operational order, and according to the movement of second user operational order
Interface icon；
Interface icon puts down module, for obtaining third user operation instruction, puts down the boundary according to third user operation instruction
Face icon.
12. a kind of control equipment of the intelligent terminal interface icon operation based on augmented reality characterized by comprising
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one
It manages device to execute, so that at least one described processor is able to carry out method as described in any one of claim 1 to 10.
13. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer can
It executes instruction, the computer executable instructions are for making computer execute method as described in any one of claim 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810771120.XA CN108958588A (en) | 2018-07-13 | 2018-07-13 | Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810771120.XA CN108958588A (en) | 2018-07-13 | 2018-07-13 | Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108958588A true CN108958588A (en) | 2018-12-07 |
Family
ID=64483230
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810771120.XA Pending CN108958588A (en) | 2018-07-13 | 2018-07-13 | Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108958588A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112148120A (en) * | 2020-08-18 | 2020-12-29 | 华为技术有限公司 | Method, equipment and storage medium for displaying virtual interface |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110107216A1 (en) * | 2009-11-03 | 2011-05-05 | Qualcomm Incorporated | Gesture-based user interface |
| US20110296357A1 (en) * | 2008-10-13 | 2011-12-01 | Lg Electronics Inc. | Method For Providing A User Interface Using Three-Dimensional Gestures And An Apparatus Using The Same |
| CN102918477A (en) * | 2010-04-13 | 2013-02-06 | 诺基亚公司 | Apparatus, method, computer program and user interface |
| CN105144197A (en) * | 2013-03-14 | 2015-12-09 | 高通股份有限公司 | Image-based application launcher |
| CN105229720A (en) * | 2013-05-21 | 2016-01-06 | 索尼公司 | Display control unit, display control method and recording medium |
-
2018
- 2018-07-13 CN CN201810771120.XA patent/CN108958588A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110296357A1 (en) * | 2008-10-13 | 2011-12-01 | Lg Electronics Inc. | Method For Providing A User Interface Using Three-Dimensional Gestures And An Apparatus Using The Same |
| US20110107216A1 (en) * | 2009-11-03 | 2011-05-05 | Qualcomm Incorporated | Gesture-based user interface |
| CN102918477A (en) * | 2010-04-13 | 2013-02-06 | 诺基亚公司 | Apparatus, method, computer program and user interface |
| CN105144197A (en) * | 2013-03-14 | 2015-12-09 | 高通股份有限公司 | Image-based application launcher |
| CN105229720A (en) * | 2013-05-21 | 2016-01-06 | 索尼公司 | Display control unit, display control method and recording medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112148120A (en) * | 2020-08-18 | 2020-12-29 | 华为技术有限公司 | Method, equipment and storage medium for displaying virtual interface |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6791994B2 (en) | Display device | |
| US9360962B2 (en) | Electronic apparatus and a method for controlling the same | |
| CN117032519A (en) | Apparatus, method and graphical user interface for interacting with a three-dimensional environment | |
| US10585531B2 (en) | Information processing apparatus, control method, and program | |
| US8638292B2 (en) | Terminal apparatus, display control method, and display control program for three dimensional perspective display | |
| US8860672B2 (en) | User interface with z-axis interaction | |
| CN103348311B (en) | Gesture is dragged in user interface | |
| CN115167676A (en) | Apparatus and method for displaying applications in a three-dimensional environment | |
| US9313406B2 (en) | Display control apparatus having touch panel function, display control method, and storage medium | |
| US10477090B2 (en) | Wearable device, control method and non-transitory storage medium | |
| US9152301B2 (en) | Information processing apparatus including plurality of display portions and information processing system | |
| US20090146968A1 (en) | Input device, display device, input method, display method, and program | |
| CN108205419A (en) | Double screens control method, apparatus, mobile terminal and computer readable storage medium | |
| KR20150130431A (en) | Enhancing touch inputs with gestures | |
| KR102606743B1 (en) | Electronic apparatus, method for controlling the electronic apparatus and storage medium | |
| US9195311B2 (en) | Imaging device, imaging method, and program with flick gesture to acquire an image | |
| US20120075267A1 (en) | Information processing apparatus capable of associating data with each other, information processing system, and storage medium storing information processing program | |
| CN109479096A (en) | Electronic equipment and its control method | |
| US20150035800A1 (en) | Information terminal apparatus | |
| CN106899765A (en) | Mobile terminal dual camera changing method and device | |
| JP7433810B2 (en) | Electronic devices, control methods for electronic devices, programs and storage media | |
| CN103577092B (en) | Information processing equipment and information processing method | |
| JPWO2020080107A1 (en) | Information processing equipment, information processing methods, and programs | |
| CN108958588A (en) | Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation | |
| JP2021015637A (en) | Display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181207 |
|
| RJ01 | Rejection of invention patent application after publication |