CN109857316A - The adjustment based on prediction at tangible interface - Google Patents

The adjustment based on prediction at tangible interface Download PDF

Info

Publication number
CN109857316A
CN109857316A CN201711231781.5A CN201711231781A CN109857316A CN 109857316 A CN109857316 A CN 109857316A CN 201711231781 A CN201711231781 A CN 201711231781A CN 109857316 A CN109857316 A CN 109857316A
Authority
CN
China
Prior art keywords
touch area
size
area size
interface
prediction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711231781.5A
Other languages
Chinese (zh)
Inventor
路光明
刘增卫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to CN201711231781.5A priority Critical patent/CN109857316A/en
Publication of CN109857316A publication Critical patent/CN109857316A/en
Pending legal-status Critical Current

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

This disclosure relates to the adjustment based on prediction at tangible interface.A kind of method for the display adjusting tangible interface includes predicting the touch area size of the certain positions touched by indicator about the tangible interface to be presented;And the display at tangible interface at this location is adjusted based on the touch area size of prediction.

Description

The adjustment based on prediction at tangible interface
Technical field
This disclosure relates to the display management at tangible interface, the in particular to adjustment of tangible interface display.
Background technique
Tangible user interface is widely used to various situations, and user can touch this interface, to touch according on interface The element touched performs various functions.
In fact, tangible user interface can be used for different types of equipment, such as mobile phone, portable phone, TV, projector etc., and can be shown according to the layout being previously programmed so that its functional element to be presented to the user.It is tangible User interface can be used by different people, such as male and female, adult and children, and can pass through body by user Position (such as finger, toe, nose etc.) or any other tool (such as stylus etc.) that can be touched touch, to execute phase The function answered
In different touches, the size of the touch area of user's touch interface usually can be different, this is depended on The mode of user's touch interface, user hold mode of equipment of display interface etc..Accordingly, it is possible to it is worth noting that, can be with Show tangible interface more suitably to cope with such different touch scene.
Method described in this section is the method that can be carried out, but is not necessarily the method previously conceived or carried out. Therefore, unless otherwise indicated, it should not assuming any method described in this section merely because being included in this section and becoming The prior art.Equally, the problem of unless otherwise stated, recognized about one or more methods, should not be based only on this It saves and is considered all recognizing in the prior art any
Summary of the invention
One purpose of the disclosure is adaptively to manage/adjust the display at tangible interface, so as to cope with it is various touch/ Application scenarios.
The present disclosure proposes a kind of improved display managements for tangible interface.Particularly, the present disclosure proposes bases The display at tangible interface is adaptively adjusted in the prediction of touch area size
On one side, a kind of device of display for adjusting tangible interface is provided, and includes: predicting unit, is matched It is set to the touch area size at the prediction tangible interface to be presented;And adjustment unit, it is configured as the touch based on prediction Area size adjusts the display at tangible interface.
On the other hand, a kind of method of display for adjusting tangible interface is provided, and can including predict to be presented The touch area size of touch interface;And the display at tangible interface is adjusted based on the touch area size of prediction.
Yet another aspect provides a kind of equipment including at least one processor and at least one storage equipment, institute It states at least one storage equipment and is stored thereon with instruction, which may make described when being executed by least one described processor At least one processor executes method as described herein
Yet another aspect, provides a kind of storage medium for being stored with instruction, which when executed by the processor may be used So that executing method as described herein.
Yet another aspect, providing a kind of includes device for executing the component of method as described herein
From being described below for the exemplary embodiment referring to attached drawing, other feature of the invention be will become apparent.
Detailed description of the invention
Be incorporated in specification and the attached drawing for constituting part of specification show the embodiment of the present invention, and with retouch State principle for explaining the present invention together.In the accompanying drawings, similar appended drawing reference indicates similar project.
Fig. 1 is the flow chart for showing method according to an embodiment of the present disclosure.
Fig. 2 is the block diagram for showing device according to an embodiment of the present disclosure.
Fig. 3 is the flow chart for showing method according to the first exemplary embodiment of the disclosure.
Fig. 4 shows the exemplary contacts user interface as the interface to be presented
Fig. 5 shows the exemplary contact region when user's touch interface.
Fig. 6 is the block diagram for showing device according to the first exemplary embodiment of the disclosure.
Fig. 7 shows the exemplary adjustment at interface.
Fig. 8 shows the another exemplary adjustment of user interface.
Fig. 9 shows the user interface with some label buttons, wherein when user's touch button, it may occur that accidentally It touches (ambiguity).
Figure 10 shows the exemplary adjustment for overcoming a part only for user interface accidentally touched.
Figure 11 illustrates how the example that equipment is divided into different contact areas
Figure 12 shows singlehanded usage scenario.
Figure 13 shows the software keyboard used in touch apparatus environment.
Figure 14 shows the pattern of the touch area size in right hand usage scenario.
Figure 15 shows the adjusted software keyboard user interface for right hand usage scenario.
Figure 16 shows both hands usage scenario.
Figure 17 shows the patterns of the touch area size in both hands service condition.
Figure 18 shows the adjusted contacts user interface of both hands usage scenario.
Figure 19 shows the scene of the contactless touch operation using camera.
Figure 20 shows touch input device and shows the mapping relations between equipment.
Figure 21 shows the contacts user interface that minimum touch area size is greater than tangible element size.
Figure 22 shows user interface adjusted.
Figure 23 is the block diagram for showing the exemplary hardware arrangement for the computer system that can be realized the embodiment of the present invention.
Specific embodiment
There has been described exemplary possible embodiments related with the adjustment of tangible user interface.In following description In, for illustrative purposes, numerous specific details are set forth in order to provide thorough understanding of the present invention.However, it will be apparent that , the present invention can be practiced without these specific details.In other cases, it is not described in detail well known knot Structure and device, to avoid unnecessarily sheltering, covering or obscuring the present invention.
Although tangible user interface has been used to various scenes, routinely, tangible user interface usually makes It will not be changed relative to special scenes with period, the result is that the availability of tangible user interface reduces, such as causing can The mistake of energy touches
Entitled " User Interface Adaptation From an Input Source Identifier The U. S. application US2015/0153897A1 of Change " provides a kind of method for handling different usage scenarios.In the U.S. Shen Please in, provide user interface adaptation (UIA) component, and user interface is mainly adapted to according to input source identifier.Work as input Source change when, user interface is adapted, for example, disabling and/or enable user interface components, thus change font size, layout, Shape and/or component show size, accidentally touch to avoid possible.As an example, input source may include user's touch interface Organ, the finger of such as user;Tool used in user's touch interface, such as various point devices.The change of various input sources (such as change between the change between mouse and finger, or elasticity and non-resilient input source) is some the showing of input source variation Example
It is this in the prior art, user interface only input source change be detected when be adapted.Therefore, work as input source It is changed and when specific input source is identified, user interface layout is adapted according to such specific input source.For example, working as When input source changes into stylus from user's finger, corresponding user interface layout will be used and shown
However, in the prior art, when input source changes, user interface is only adapted to scheduled corresponding interface, and makes The size and layout of element on used time interface are fixed.
But the finger of input source, especially people, it is three-dimensional and wet soft.Contact area size is due to pressure and angle It is different.Even for identical finger, different zones on screen are touched in pressing or when with the touch of different gestures, touch area Size would also vary from, and in this case, unconverted user interface cannot meet actual scene well, and may lead Cause unnecessary accidentally touching.
Therefore, even if not detecting that input source changes, it is desirable to can adaptively be adjusted according to actual application scenarios User interface to avoid accidentally touching, and makes touch operation more comfortable, simple and accurate.
Hereinafter reference will be made to the drawings carrys out detailed description of the present invention embodiment.It should be noted that similar appended drawing reference in the accompanying drawings Similar project is indicated with letter, and therefore once a project is defined in an attached drawing, then for subsequent attached drawing It no longer needs to be described it.
Firstly, in order to help thoroughly and suitably to understand the present invention, it hereafter will be above and below the explanation disclosure first The meaning of term as used herein.
Touching relevant information may refer to information relevant to touch/gripping of the user for interface, and can wrap It includes information relevant to touch operation of the user previously on interface and information relevant with user's holding interface (especially exists At least one of the holding mode of the equipment of display interface during use), and alternatively referred to as touch relevant parameter.In addition, In broad terms, it is contemplated that interface must show that the characterisitic parameter of display device also may be considered that by the equipment that user touches It is a kind of touch relevant information.
Touch area size also refers to the size of the touch area between user and touch interface, and depends on using The touch manner at family, for example, touch area size may include the touch area size of user's finger touch interface or as hand The touch area size of indicating equipment (such as stylus etc.) touch interface of any other type of the substitution of finger.
Note that as described herein, touch refers not only to directly touch, and wherein user can pass through the physical feeling of user (such as finger) or other tools directly physically touch display interface, and also refer to indirectly touch (can also be counted as Virtual touch), although wherein not physically touch interface, for example by by the physical feeling (such as finger) of user or its The image of his tool is mapped on display interface the case where with analog subscriber touch interface, so that user can be with to the operation at interface It is processed as user's touch interface.In the following description, the object for directly or indirectly being touched, such as with The physical feeling at family or any other tool etc. all may be collectively referred to herein as indicator (indicating equipment).
" prediction " of touch area size may include predicting the use on the interface to be presented based on relevant information is touched The touch area size at family, the touch relevant information are the previous touch area size such as collected in previous touch operation (being referred to as historical touch area size), display of the user for the equipment of the holding mode of equipment, even display interface Characteristic etc., so that interface adaptively can be adapted to and be presented according to the touch area size of prediction.
The adjustment at tangible interface may refer to adjustment interface on one or more elements display mode, such as with The sizes of one or more elements at family interface, position, shape, text attribute, image attributes, type etc., this can also claim For the display layout of one or more elements on adjustment interface.
In the disclosure, term " first ", " second " etc. are used only for distinguishing elements or steps, rather than when indicating Between sequence, preferential selection or importance.
Hereinafter, with reference to the accompanying drawings shown in attached drawing come the method that describes the first embodiment according to the application.
Fig. 1 is the flow chart for showing method according to an embodiment of the present disclosure.
In step S101 (also referred to as prediction steps), touch area size is predicted for the interface to be presented.
In step S102 (also referred to as set-up procedure), the boundary to be presented is adjusted according to the touch area size of prediction Face.
The solution of the disclosure reflected by this method can be predicted based on touch area size adaptively to adjust It is whole and tangible user interface is thus presented, it may may on the interface as caused by immobile interface so as to decrease or even eliminate Mistake touching, therefore tangible user interface can be well adapted for all use environments and can be easy in all use environments And it accurately operates.
Hereinafter, it will be described in each operation in each step.
The prediction of touch area size
In one implementation, touch area size, such as previous touch area can be predicted based on relevant information is touched Size, the holding mode at interface, equipment display characteristic information (display resolution) of sensu lato equipment etc..
It in one implementation, can be before receiving the expectation interface to present in equipment, based on aobvious in equipment The previous touch area size of the user on interface shown predicts touch area size.It can be previous during touch operation This previous touch area size is collected and stores, and the interface for collecting previous touch area size may belong to and it The interface application program that the application program being presented is similar and different, and can be different from the interface to be presented, or even can With interface identical as the interface to be presented, such as reloading.
Such previously touch area size can be collected in various ways.In one implementation, whenever user touches boundary When face, this previous touch area size can be collected.In a further implementation, can by predefined interval (such as 30 seconds, 10 Second etc.) or the every touch (such as every 3 times touch etc.) of predefined number collect such previous user touch data.
In one implementation, touch area size can store together with other relevant parameters of touch.In a kind of realization In, touch area size can be with the touch location on the interface at the interface, display that touch, this touching of the generation on interface Element touched etc. is stored together.Note that any previous touch area size and the touch area size of prediction can by with it is upper The similar mode of mode is stated to store.
This previous touch area size can store in various ways.In one implementation, all collections be can store Previous user touch data.In a further implementation, only predetermined amount of time (its be typically longer than be used to collect touch area it is big Small time interval) in previous user touch data or predetermined touch number (its be typically larger than be used to collect touch area The predefined touch number of size) in previous user touch data will to be stored to save storage to a certain extent empty Between.In this case, in the case where exceeding such predetermined amount of time or touching number, when the touch area for collecting new is big Hour, oldest touch area size will be abandoned.
In one implementation, when receiving the interface to be presented, such as when equipment will open new interface, when equipment will When returning first front interface from other changing interfaces, when user opens equipment etc., the prediction of touch area size can be executed.
In one implementation, can based on before receiving such interface in predetermined amount of time or predetermined touch The touch area size previously collected in number comes the touch area size of prediction interface, and in general, such predetermined time Section or predetermined touch number, which can be, to be counted from receiving such interface.
It in a further implementation, can be based on the touch area size (touching of for example, at least two previous predictions of previous prediction Touch area size) carry out the touch area size of prediction interface.
It, can be based on the touch area size for the touch area size and previous prediction previously collected in another realization (the touch area size of such as at least one previous prediction) carrys out the touch area size of prediction interface.For example, can be based on first The touch area size of preceding collection predicts touch area size, then by the touch area size of this prediction and previous prediction Touch area size combinations to obtain the touch area size finally predicted.
In a further implementation, regardless of received interface to be presented, can be by such as calculating mathematics The well known algorithm of statistical data integrates the touch area size in the touch of in every predetermined amount of time or every pre-determined number For statistical data, and such statistical data is once obtained, then statistical data obtained can be stored as history system It counts, and alternatively, the previous Petting Area in corresponding predetermined amount of time or pre-determined number touch can be abandoned Domain size is to save memory space.Note that this predetermined amount of time or predetermined touch number can with for predicting touch area The predetermined amount of time or predetermined touch number of size are identical or different, and are typically larger than for collecting previous touch area size Predefined time interval or touch number.In this case, when receiving the interface to be presented, at least one can be based on A previous statistical data (such as recent statistics data, two or more newest statistical data etc.) obtains interface The touch area size to be predicted.
In one implementation, touch area size can be predicted by previous touch area size in various ways.Example Such as, touch area size of the statistical data of previous touch area size as prediction can be obtained according to various algorithms.
In one implementation, it can determine that the user of prediction touches number based on the weighted average of previous touch area size According to.In one implementation, the weight of previous touch area size can depend on touch area size to be presented with receiving The degree of closeness of the time at interface.Previous touch area size is closer, then bigger weight is used for it.The value of weight It can be empirically determined.
In a further implementation, the touch of prediction can be determined based on the weighted average of the touch area size of previous prediction Area size.In one implementation, it is big can to depend on the touch area predicted for the weight of the touch area size of previous prediction The small degree of closeness with the time for receiving the interface to be presented.The touch area size of previous prediction is closer, then for it Using bigger weight.The value of weight can be empirically determined.Note that such realization can be applied to as described above may be used The case where to obtain the touch area size predicted based on previous statistical data.
It is, of course, also possible to using other known for determining the algorithm of prediction data.
It, can be big for the user touch area at different object implementatio8 interfaces according to the display management/adjustment mode at interface Small prediction.
It in one implementation, can be based on previous touch area size (such as, the previously touching on the entire interface to be presented Touch the weighted average of area size or touch area size/statistical data weighted average of previous prediction) come for this is whole Touch area size is predicted at a interface, and therefore, entire interface (all elements and layout at such as interface) is by the touching based on prediction Area size is touched to be adapted.
In a further implementation, this prediction can be executed for a part at interface.For example, interface can be divided into it is more A region, and for each region, it can be based on previous touch area size (such as, the previous touch area in the region The weighted average of the touch area size of the weighted average or previous prediction of size) predict touch area size, because The each region at this interface will be adapted to based on the corresponding prediction touch area size in the region.It, can be with as another realization This prediction is executed for the specific region (such as, most frequent touch area) for meeting predetermined condition, and can use pre- The touch data of survey is adapted to the region.In such a case, it is possible to based on the previous touch area size about entire interface Or the touch area size of prediction is obtained only about the previous touch area size in the region.
It, can in a similar way to above correspondingly at least one predetermined-element at interface in another realization Predict corresponding user touch area size, therefore at least one predetermined-element at interface will be based on the corresponding prediction touching of the element It touches area size and is adapted to.For example, the touch area size of the element (being referred to as project) on interface can be based on and this The relevant previous touch area size of the element of sample, the previous touch area size in region including the element or entire interface Previous touch area size be predicted.
In one implementation, as being arranged in view of the operation in previous touch operation is accidentally touched extremely A predetermined-element less, and such element therefore will be adjusted, to avoid possible in the operation in future of user on the surface The mistake of generation is touched.
Note that above-mentioned three kinds of predictions can also combine in various ways, for example, at least two predictions or whole can be combined Three kinds of predictions.
It in one implementation, then can be according to each for example, can predict first each region in interface The prediction touch data in region predicts the touch area size at entire interface.In this case, it is flat that weight also can be used Equal algorithm by each region predicts entire interface, and can be for example according to the touch frequency of each region come to corresponding area Domain applies weight.One region is touched more frequent, then the weight in this region is bigger.
In a further implementation, for interface region prediction, each element for including in the region can be held first Row prediction, then executes prediction by all prediction touch areas size of each element.In this case, power also can be used Average algorithm is weighed to be predicted by each element for including in region region, and can be for example according to the touching of each element It touches frequency and weight is applied to each element.Element is touched more frequent, then the weight of such element is bigger.
In a further implementation, for the prediction at entire interface, interface can be divided into multiple regions, and each region Prediction can as described above based on for include element in this region prediction, then can be with for the prediction at interface As described above based on the prediction to each region.
Additionally or as substitution, prediction is also based on the holding mode at interface, such as user holds for showing boundary The mode of the equipment in face.
In one implementation, it is contemplated that holding mode can correspond to the predetermined display mode of the element on interface/interface, Such as the scheduled layout mode and/or size of the element on interface, and interface will be shown according to such preassigned pattern, respectively The display size and layout of a element can be determined accordingly, and be used as user's touch data of prediction.
It in a further implementation, can be according to related to this holding mode if initially without scheduled display pattern Historical touch area size predict touch area size, therefore boundary can be determined based on this prediction touch area size The layout of each element on face, and such case can be similar to prediction and adjustment based on previous touch area size.This Outside, identified layout can be used as predetermined display mode corresponding with holding mode and be stored, thus can in the future by with In the prediction for this holding mode.
Note that prediction based on previous touch area size can be combined in various ways and based on the pre- of holding mode It surveys.In one implementation, can prediction interface first at least part of touch area size, and if desired, can be with The touch area size of prediction is further modified according to predetermined display layout pattern corresponding with holding mode.
Additionally or as substitution, the characteristic also based on the equipment for display interface is predicted.For example, can consider The touch area size of prediction is further modified in the case where the display resolution of the equipment using as the Petting Area finally predicted Domain size.
Note that display characteristic may include the minimum touch area size for showing the equipment of user interface.In a kind of realization In, minimum touch area size is calculated according to the resolution ratio and size of the resolution ratio of touch apparatus and display equipment, The case where can obtaining the gesture of user especially for touch apparatus and it is mapped to the indirect touch of display equipment.
Interface adjustment
The adjustment at tangible interface may include adjusting the display mode of one or more elements on interface, such as user The size of at least one element at interface, position, shape, text attribute, image attributes, type etc., this is referred to as adjusting The display layout of one or more elements on whole interface.
In one implementation, the adjustment of the element on interface may include the touch area size according to prediction, increase or Reduce the size of element, such as increases or reduces the width (in the case where element is rectangle) of element or radius (is in element In circular situation).Additionally or as substitution, the text or shape of element can be correspondingly adjusted.In a further implementation, such as The touch area size of fruit prediction and the touch area size of previous prediction are without bigger difference, such as their difference is in threshold In value, then it may not be needed to adjust the element.
In one implementation, the adjustment of element is it is further contemplated that show the characteristic of equipment.For example, can be by prediction Touch area size is compared with the upper and lower bound of the display resolution of equipment, and such limit value, then may be used if more than The touch area size of prediction is limited to the limit value, and alternatively, such estimated touch area size can be abandoned.
In a further implementation, the adjustment of element is further contemplated that the previous display size of element.For example, the touch of prediction Area size can be compared with previous display size, and only when the variation between them is more than threshold value, by base Such element is adjusted in the touch area size of prediction.
Pay attention to, it is contemplated that the display resolution limit value of equipment and the previously above-mentioned adjustment of display size can be incorporated into pre- In survey processing, that is, during prediction, the touch area size of prediction can show size with display resolution limit value and previously It is compared, to obtain the touch area size finally predicted.
In one implementation, the adjustment of touch interface can be based on the touch area size of prediction, and can be based on pre- The touch area size of survey adjusts all elements on interface in the same scale.For example, the size of all elements on interface It can increase or reduce in the same scale.
It note that this adjust also can be applied at least part at interface, and in this case, adjustment can be with Carried out in based on the ratio of the prediction touch area size at entire interface, or by based on interface this is at least part of pre- The ratio of touch area size is surveyed to carry out.In a further implementation, this to adjust at least one spy that also can be applied to interface Determine element, and in this case, adjustment can be carried out in based on the ratio of the prediction touch area size at entire interface, Or it is carried out in based on the ratio of the prediction touch area size of a part at the interface for including these element-specifics, or press base It is carried out in the ratio of the prediction touch area size of at least one element.
In one implementation, such at least part at interface can be the portion more frequently touched in prior operation Point.In a further implementation, such element-specific can be the element more frequently touched in prior operation, or may It is easy to happen the element of accidentally touching.
Fig. 2 shows the block diagrams of device according to an embodiment of the present disclosure.
Device 200 includes: predicting unit 201, is configured as predicting the touch area size at interface to be presented;With And adjustment unit 202, it is configured as adjusting the display at interface based on the touch area size of prediction.
Predicting unit 201 and adjustment unit 202 can be realized in various ways, such as software module, hardware component, firmware Deng as long as they can be realized described function.
In addition, device 200 can also include for storing any previous historical touch area size or any previously pre- The storage equipment of the touch area size of survey, and for receiving the collected receiving unit for touching relevant information.Certainly, this Kind storage equipment and receiving unit can be located at the outside of device 200.
In addition, the device can also include comparing unit, the touch area size for being used to predict and predetermined value are carried out Compare, and the variation of the touch area size of prediction is compared with threshold value.In the implementation, this comparing unit can wrap It includes in predicting unit or adjustment unit, or can be with predicting unit and adjustment unit juxtaposition.
Hereinafter, some exemplary embodiments of the invention be will be described in.
First embodiment
Hereinafter, it describes to adjust tangible user circle based on touch area size according to the disclosure with reference to the accompanying drawings The embodiment in face.
Fig. 3 is the flow chart for showing the adjustment based on prediction touch area size.
In step S301, user interface to be presented is received.For example, user's point touching screen is applied to activate, example Such as contact application, request shows the user interface of the application.As another example, user can be clicked on the touchscreen to return Return to previous interface.
Fig. 4 shows the example contacts user interface to be presented.User interface has a list element, vertical Ground shows the contact person of user one by one.The height of each contacts element is identical.Here " element size " is defined.It is touching Touch the height and width of element.It is for judging whether touch operation can cause accidentally to touch.If " element size " is less than prediction Touch area size can then occur accidentally to touch.In case of accidentally touching, then should expand " element size ".
In step s 302, touch area size is predicted according to touch relevant information.
When user operates on touch apparatus, collects and touch relevant information.Collecting operation can be a kind of continuous operation, It is for touch every time or the touch of each predetermined time interval or pre-determined number.The information may include touching parameter, such as Touch location, direction or angle and the shapes and sizes of contact area etc..The information can also include other information, such as Accidentally touching property, the touch element of operation, the touch area of operation, the interface etc. of touch.Furthermore, it is possible to the physics category of collecting device Property, such as resolution ratio, size.Certainly, due to relatively fixed, the physical attribute of equipment can be collected only once, can also be obtained in advance ?.
When user touches touch screen, contact area shape may be different.It is in irregular shape.But they usually it is similar or Close to ellipse.Fig. 5 shows the oval sample of contact area.Note that the touch area size of prediction can also be by this Shape representation.
When user touches touch screen, the mistake touching touched between element can be in the horizontal direction on (direction " x " in Fig. 5) Occur, occurs on vertical direction (direction " y " in Fig. 5), or all occur in the horizontal direction and the vertical direction.Here, " x " It is the horizontal direction value of the touch area size of prediction." y " is the vertical direction value of the touch area size of prediction.
In order to avoid accidentally touching, if it is first close to touching in the range of " x " distance to there is at least one in the horizontal direction The touch element of element, the then width for touching element should be greater than " x " for the touch area size predicted, and if in Vertical Square There is at least one upwards in the range of " y " distance close to the touch element for touching element, then the height for touching element should Greater than " y " of the touch area size of prediction.
In one implementation, it when predicting touch area size, is obtained first in predetermined time range (such as nearest 1 Minute, 5 minutes etc.) in collected touch relevant information;Then the statistical weight for calculating the touch area size of collection is average Value.It is how to calculate the exemplary formula of the touch area size of prediction below.
In formula (1) above, predict_touch_area_size is the touch area size of prediction.Number_ Collected_touch_points_in_time_span is the quantity of the at the appointed time interior touch point collected of range. Touch_area_size is the area size for the touch point collected.
In one implementation, it is contemplated that when user touches touch screen, press angle and pressure may be different, predicting In, if there is previous prediction result, then current predictive result is corrected using previous prediction result will be helpful.
If predicted operation has previously executed, the touch area size of previous prediction will be used to adjust current predictive Touch area size.The touch area size of such previous prediction may include at least one nearest touch area size. Then different coefficients is used, the touch area size of prediction is adjusted.Touch operation is closer, then weight is bigger.How here is Adjust the exemplary formula of the touch area size of prediction.
Predicted_touch_area_size=
predicted_touch_area_size*k+predicted_touch_area_size_old*m (2)
In the formula, predict_touch_area_size_old is the touch area size of previous prediction.K and m are Coefficient value, k+m=1, such as k=0.8, m=0.2, k=0.6, m=0.4 etc..
Certainly, when using the touch area size of at least two previous predictions, the touch area of each previous prediction is big Small to apply coefficient, prediction touch area size is closer, then coefficient is bigger.Here be how to adjust prediction touch area it is big Small exemplary formula.
Predicted_touch_area_size=
predicted_touch_area_size*k+predicted_touch_area_size_old1*m1
+predicted_touch_area_size_old2*m2 (3)
In the formula, predict_touch_area_size_old1 is that the touch area of nearest previous prediction is big It is small, and predict_touch_area_size_old2 is the touch area size of previous prediction earlier.K and m is coefficient Value, k+m1+m2=1, such as k=0.7, m1=0.2 and m2=0.1 etc..
Of course it is possible to use the touch area size of the previous prediction of other quantity, and can be similarly as described above Create corresponding formula.
In step S303, after predicted operation terminates, check whether the touch area size of prediction is virtual value.Have The touch area size of effect should be greater than minimum touch area size, and be less than maximum touch area size.Minimum touch area is big Small and maximum touch area size is for ensuring that the visibility of user interface and the value of availability, so that user interface element is big It is small not too large or too small, and may relate to the configuration of the application program for showing the interface or the system of the application program.It is logical Often, when system or application program launching, minimum touch area size and maximum touch area size can be initialized.
If the touch area size of prediction is virtual value, predict_touch_area_size be may proceed to down One step, while it can be saved as predict_touch_area_size_old so that subsequent predicted operation uses.If It is not that the touch area size then predicted will be abandoned, then can restarts to predict, such as big for collecting touch area Small time range can increase to be predicted using more previously touch area sizes.
Alternatively, when the touch area size of prediction is greater than maximum touch area size, the Petting Area of this prediction Domain size can be set as maximum touch area size, and when the touch area size of prediction is less than maximum touch area size When, the touch area size of this prediction can be set as minimum touch area size.
In step s 304, do you judge to predict that the variation of touch area size is more than threshold value?
When (predict_touch_area_size_ can be used in the touch area size of predicted operation completion and previous prediction Old has value) when, the difference between the touch area size of prediction and old prediction touch area size will be calculated, then sentenced Whether this species diversity of breaking is more than threshold value.
|predicted_touch_area_size-predicted_touch_area_size_old|>threshold (4)
If the value of variation is less than the threshold value ("No"), without adjusting user interface.If the value of variation is greater than the threshold It is worth ("Yes"), it means that touch area size variation is big, then in order to reduce a possibility that accidentally touching or display more multielement, should adjust Whole user interface.
Note that the touch area size of such previous prediction can also be by the previous display size generation of the element on interface It replaces, and comparison expression can be similar to above-mentioned formula (4).
In step S305, user interface layout is adjusted based on the touch area size of prediction.
The adjustment may include changing the size and/or position, text attribute, image attributes, object of user interface element Type etc..No matter which kind of modification is carried out, and " element size " of element has to be larger than touch area size.For different users circle Face layout, modification are different.
Fig. 6 shows the block diagram of device according to an embodiment of the present disclosure.
Device 600 includes the receiving unit 601 for being configured as receiving interface to be presented, and being configured as prediction will be in The predicting unit 603 of the touch area size at existing interface is configured as the ratio being compared to the touch area size of prediction Compared with unit 602 and it is configured as adjusting the adjustment unit 604 of the display at interface based on the touch area size of prediction.
Receiving unit 601, comparing unit 602, predicting unit 603 and adjustment unit 604 can realize in various ways, example Such as software module, hardware component, firmware, as long as they can be realized described function.
In one implementation, comparing unit 602 may include size comparing unit, be configured as the Petting Area that will be predicted Domain size is compared with each of minimum touch area size and maximum touch area size;And difference in size compares Unit, the difference for being configured as the touch area size by the touch area size of prediction and previous prediction compare with threshold value Compared with.
In the context of specification, " comparison " is referred to as " checking ", and therefore, " comparing processing/unit " can also be with Referred to as " inspection processing/unit ".
Note that the diagram of Fig. 6 is merely exemplary, and receiving unit 601 is not required device 600, and The outside of device 600 can be disposed in.
On the other hand, comparing unit 602 can be incorporated into any one of predicting unit 603 and adjustment unit 604. E.g., including at least one of two units in comparing unit 602 can be incorporated to predicting unit 603 or adjustment unit 604。
In addition, device 600 can also include for storing any previous touch area size or any previous prediction The storage equipment of touch area size.Certainly, this storage equipment can be located at the outside of device 600.
It is two examples of the first embodiment below.
Example 1
The contact person that this example can correspond to the equipment (mobile phone etc.) for the display screen for having relatively small uses Family interface, and be exemplified in the following conditions:
Resolution ratio: 1280 pixel *, 720 pixel
Size: 5.4 inches
The touch area size of prediction: 120*120 pixel
The height of contacts element: 100 pixels
Fig. 7 (a) shows the situation before adjustment, and black circles indicate the touch area of user, it is evident that " element size " (100 pixels on the direction " y ") are less than " the touch area size of prediction " (being in the " y " direction 120 pixels).In such case Under, inevitably occur accidentally to touch.
In order to avoid accidentally touching, element height is adjusted so that " element size " is greater than " the touch area size of prediction ".Adjustment Effect may be as shown in Fig. 7 (b).After adjustment, contacts element height increases, such as element height is increased to 132 pixels (120*(1+*0.1)).It is accidentally touched in such a case, it is possible to eliminate.
Example 2
Such example can correspond to have equipment (such as PAD, the tangible display of relatively large display screen Deng) contacts user interface, and be exemplified in the following conditions:
Resolution ratio: 1280 pixel *, 720 pixel
Size: 10.1 cun
The touch area size of prediction: 60*60 pixel
The height of contacts element: 100 pixels
Fig. 8 (a) shows the situation before adjustment, and black circles indicate the touch area of user, and " element size " is (in the side " y " Upward 100 pixel) it is greater than " the touch area size of prediction " (60 pixel in the " y " direction).In this case, " boundary is arrived Distance " it is too big, therefore contacts list is only able to display the element of limited quantity.If reducing the height of element, while making " member Plain size " is still greater than " the touch area size of prediction ", and contacts list will include more multielement, and accidentally touching still will not send out It is raw.
Fig. 8 (b) shows adjustment effect." black circles " indicate touch area.After adjustment (right part of flg), contacts element Height reduces, such as element height is reduced to 66 pixels (60* (1+0.1)).
Example 3
The example corresponds to the adjustment according to the touch area size of prediction to the element-specific on interface.For example, in this way Element-specific can be there is operation accidentally touching and the element being then adjusted in second display in first time display.
Fig. 9 shows a user interface, and tetra- tangibly labels of B1, B2, B3 and B4 are arranged at top." black circles " table Show touch area.Touch area size is greater than " element size " of button.In this example, some users in screen are only adjusted Interface element.
When above screen is shown for the first time, user clicks B2 and B3, as shown in Figure 9.For eliminating the use of accidentally touching Family interface is demonstrated, and such as amplifies touch area.In eliminating the accidentally user interface of touching, B2 is selected.Collect these operation informations.
When occurring above-mentioned screen next time, since B2 is previously selected in the case where accidentally touching, and because B2's is " first Plain size " is less than the touch area size of prediction, and because on only in horizontal direction there are some tangible elements (B1 and B3) close to B2, therefore the width of B2 should increase above the prediction touch area size in the direction " x ".Petting Area based on prediction Domain size adjusts such element, as shown in Figure 10.After adjustment, the touch area that the width of the B2 in Figure 10 is greater than prediction is big Small " x ".
Example 4
The example corresponds to the adjustment according to the touch area size of prediction to the region at interface.In some cases, may be used Different zones on touch interface may be touched with different touch area sizes.It therefore, can be suitably in region On the basis of adjust interface, rather than adjust entire interface in the same scale.
As an example, interface can be divided into multiple regions, and in each area, contact point is recorded respectively.In advance The touch area size of survey is separate computations.
The embodiment is in the following conditions for example:
Instrument size: 5.4 inches
Device resolution: 1280 pixel *, 720 pixel
Holding mode: the right hand is held
As shown in figure 11, touch screen is fifty-fifty divided into 3 parts in the horizontal direction and is divided into 5 in vertical direction A part, there are width be 240 pixels, high 256 pixel 15 regions beCollected touch information is according to touching Which region the position for touching information belongs to and is divided into this 15 regions.The touch information in this 15 regions is received respectively Collect, the prediction touch area size in this 15 regions is calculated respectively.
Some test datas are collected for region G~O in Figure 11.(unit is pixel) is listed below in they.
Table 1
Such test data obtains in the experiment of such as Android (Android) application program, and for each area Domain executes six touches, and obtains its corresponding data as test data.
After eliminating more than the minimum value of touch area size and the value of maximum value, the average value of remaining value is each The touch area size in region, and can be used for obtaining the statistical data of the touch area size as prediction.
Finally, each region on interface can be adjusted separately according to the prediction data in the region.
Note that such case can correspond generally to the case where equipment may be slightly tilted, equipment can be hold by one hand The case where situation, equipment are caught and are operated by both hands etc..
Embodiment 2
Hereinafter, embodiment related with the prediction based on holding mode is described with reference to the accompanying drawings.In one embodiment In, every kind of holding mode can correspond to the predetermined display layout pattern at the interface to be presented, therefore works as and receiving and to present Interface when determining holding mode, touch area size can be predicted according to corresponding scheduled layout mode.At another It, then can be based on the previous touch collected in similar holding mode if there is no such preassigned pattern in embodiment Area size predicts such touch area size, and can be stored as the layout pattern for using in the future.
Some examples of second embodiment are described below in detail.
Example 1
The example corresponds to the case where holding mode, and can be according to the previous touching collected in similar holding mode Area size is touched to adjust interface.
Figure 12 shows singlehanded the case where using, as the right hand uses.Figure 13 shows software keyboard.When as shown in figure 12 single Holding stop machine when, if required key is located at opposite side (key in dashed rectangle in Figure 13), it is accurate to be difficult Ground pressing.In addition, in one hand in use, the size of touch area in the different zones of screen is very different.In addition, touching The size in region changes with pressure and angle, and people can not accurately control it.Therefore, keyboard should be adaptively adjusted.
For determining holding mode, user interface can be unevenly adjusted.Such adjustment can according to gripping The corresponding scheduled layout pattern of mode or the touch area size (such as first of the prediction in first top rake/holding mode The embodiment 4 of embodiment) Lai Jinhang.
After obtaining such as the test data in above-mentioned table 1, rough pattern can only be obtained from the value in table.Along with some Theory deduction obtains the pattern of the touch area distribution used for the right hand as shown in figure 14.In Figure 14, " circle " is indicated Touch area size at different location.It in the case where the right hand, more keeps left, the size of touch area is bigger.
Figure 15 shows uneven keyboard adjusted.As shown in figure 15, " element size " of key according to the position at The touch area size of prediction adjust.After adjustment, " element size " of key is greater than the touch area size of prediction.So It in the case where the right hand, more keeps left, S/W key is bigger.Equally, it in the case where left hand, more keeps right, S/W key is bigger.
As a result, a possibility that accidentally touching or incorrect touch target can be reduced.
Example 2
The example, which corresponds to, the case where adjusting interface, such as to be schemed according to scheduled layout pattern corresponding with holding mode Shown in 16, Figure 16 shows " both hands use " equipment holding method.
Figure 17 corresponds to the possibility layout patterns appropriate of the touch area size on the interface used for this both hands, Wherein " black circles " approximatively indicate the contact area of touch point.Figure 17 shows " both hands use " equipment shown in Figure 16 In the case where holding method, the distribution of the touch area size at different screen position.
As shown in figure 17, touch area size is different in different location.So user interface is contacted in Figure 17, Some " element sizes " of element of contact are less than the correspondence touch area size at the position, and some " members of element of contact Plain size " is greater than the correspondence touch area size at the position.
In this case, non-uniform layout is more suitable for user's operation, therefore can predict opposite with layout patterns The touch area size for the position answered, such as relative to the touch area size almost the same with element size, it can be correspondingly Prediction is directed to the touch area size of larger or smaller black circles, such as is zoomed in or out with fixed proportion.Certainly, each The touch area size of position can be predicted in any other manner, as long as the touch area size energy on each position of prediction Enough nearly correspond to scheduled layout patterns.
In Figure 18, " element size " of contacts element is adjusted according to the prediction touch area size at position. Close to the top of user interface, " element size " is less than the touch area size predicted at position, inevitably occurs accidentally to touch. In order to avoid accidentally touching, element height increases, so that " element size " is greater than the touch area size at the position.Close to user circle The bottom in face, " element size " is greater than the touch area size of the prediction at position, because screen size is smaller, to show more Element, element height is reduced, but is still greater than the touch area size of prediction.By such adjustment, mistake is on the one hand eliminated Touching.On the other hand, more contacts elements can be shown in list.Therefore, contacts user interface shown in Figure 18 is grasped The property made is better than uniform interface.
3rd embodiment
Hereinafter, embodiment relevant to the prediction of the characteristic of the equipment based on display interface will be described with reference to the drawings. The characteristic may include the minimum touch area size of equipment, and this example show the minimum touchings of the limitation as equipment Touch how area size influences operation accidentally touching.The present embodiment is related to considering the interface display of such minimum touch area size Adjustment.
Hereinafter, an example of detailed description 3rd embodiment.
In some man-machine interactive systems, as shown in figure 19, the RGB for existing that serve as the input equipment of capture user's operation is taken the photograph Camera or depth transducer, and the LCD or projector of the output equipment as display user interface.In this case, it uses Family does not touch the display device for being used for display interface directly, however, it is possible to by the image capture of video camera by the touch of user Gesture is mapped on display interface, therefore by image capture and analysis, can be executed on the display device and this touch hand The corresponding some operations of gesture.Touching the interface of display just as user with the touch area size being mapped.From broadly It says, such operation is also considered a kind of touch operation (being referred to as touching indirectly).
When the touch operation of RGB camera or depth transducer capture user, touch operation is mapped to display equipment.? In some cases, the resolution ratio by the resolution ratio of RGB camera or depth transducer captured image lower than display equipment.For example, It is 480 × 320 by the resolution ratio of depth transducer captured image in Figure 20.The resolution ratio of projector is 1920 × 1280. As a result, the 1 pixel touch input in the capture image from depth transducer is mapped in the projected image for projector 16 pixels ((1920*1280)/(480*320)=16=4*4).
In addition, in many cases, there are minimums to identify size for equipment in hand touch detection algorithm.Minimum identification Size is related to the resolution ratio of equipment.For example, the minimum identification size of hand touch operation is 20 × 20=400 pixel.It will input The minimum identification size of equipment is mapped to display equipment can obtain minimum touch area size in the display device.This is minimum Touch area size is the limitation of this man-machine interactive system.The size of the object shown on the display device by equipment resolution Rate and size determine.Then ,/calculating minimum touching is determined by the resolution ratio and size of the resolution ratio of touch apparatus and display equipment Touch area size.It is how to calculate the formula of the minimum touch area size of touch apparatus below:
Minimum_touch_area_size=
minimum_recognition_size*mapping_ratio
In formula above, minimum_touch_area_size is minimum touch area size.It is mapped to it is aobvious The value of minimum identification size after showing equipment, that is, the touch area size mapped.Minimum_recognition_size is can With the minimal size of the user's touch gestures identified by input equipment.Mapping_ratio is for will be in input equipment Ratio of the pixel-map to display equipment.
Using above-mentioned formula, minimum touch area size is 80*80 pixel, and 80 be to be calculated by 4 multiplied by 20.
Figure 21 is received user interface.This is the interface of contact person.In this original user interface, each element Height is 60 pixels.Collected touch area size is consistently greater than or is equal to minimum touch area size.If " the member of element Plain size " is less than minimum touch area size, then can occur accidentally to touch.Because " y " direction value 80 of minimum touch area size is big In the height of each element, so being certain to occur accidentally to touch.
In order to avoid accidentally touching, original user interface needs to be modified." element size " of element of contact has to be larger than equipment Minimum touch area size.It is for based on the minimum touch area size for calculating minimum " element size " below To predict the formula of touch area size.
Predicted_touch_area_size=
k*minimum_touch_area_size
In above-mentioned formula, predict_touch_area_size is the prediction element size of tangible object. Minimum_touch_area_size is the touch area size of minimum detectable.K is predefined coefficient.It can be arrived 1.2 Between 1.5.In the present embodiment, 1.5 k.Height, which can be calculated, increases to 120 pixels.After this modification, it can keep away Exempt from accidentally to touch.As a result, increasing the availability of user interface.
Modified user interface is as shown in figure 22.Element height increases to 120 pixels.After adjustment, " element size " is big In minimum touch area size.Accidentally touching is eliminated.
Figure 23 is the block diagram for showing the exemplary hardware arrangement of computer system 1000 of implementable the embodiment of the present invention.
As shown in figure 23, computer system includes computer 1110.Computer 1110 is deposited including processing unit 1120, system Nonvolatile memory interface 1150, user's input can be removed in reservoir 1130, non-removable nonvolatile memory interface 1140 Interface 1160, socket 1170, video clip 1190 and output peripheral interface 1195, they are connected by system bus 1121 It connects.
System storage 1130 includes ROM (read-only memory) 1131 and RAM (random access memory) 1132.BIOS (basic input output system) 1133 resides in ROM 1131.Operating system 1134, application program 1135, other program modules 1136 and some program datas 1137 reside in RAM 1132.
Non-removable nonvolatile memory 1141 (such as hard disk) is connected to non-removable nonvolatile memory interface 1140.Non-removable nonvolatile memory 1141 can store such as operating system 1144, application program 1145, other program moulds Block 1146 and some program datas 1147.
Removable nonvolatile memory (such as floppy disk drive 1151 and CD-ROM drive 1155) is connected to removable Except nonvolatile memory interface 1150.For example, diskette 1 152 can be inserted into floppy disk drive 1151, and CD (CD) 1156 can It is inserted into CD-ROM drive 1155.
Such as input equipment of mouse 1161 and keyboard 1162 is connected to user input interface 1160.
Computer 1110 can be connected to remote computer 1180 by socket 1170.For example, socket 1170 can Remote computer 1180 is connected to through local area network 1171.Alternatively, socket 1170 may be connected to modem (modulation Device-demodulator) 1172, and modem 1172 is connected to remote computer 1180 through wide area network 1173.
Remote computer 1180 may include the memory 1181 of such as hard disk, store remote application 1185.
Video clip 1190 is connected to monitor 1191.
Output peripheral interface 1195 is connected to printer 1196 and loudspeaker 1197.
Computer system shown in Figure 23 is merely illustrative, and is in no way intended to limit the present invention, its application or is made With.
Computer system shown in Figure 23 can be implemented as any embodiment at the place in standalone computer or equipment Reason system, wherein can remove one or more unnecessary components or one or more additional components can be added.
[industrial feasibility]
The present invention can be used for many applications.For example, the present invention can be used for the static state of detection and tracking camera capture Object in image or mobile video, and for portable device, the mobile phone of (being based on camera) etc. equipped with camera Etc. being especially advantageous.
It is noted that method and apparatus described in the text can be implemented as software, firmware, hardware or any combination of them. Some components can for example be implemented as the software run on digital signal processor or microprocessor.Other assemblies can be such as It is embodied as hardware and/or specific integrated circuit.
In addition, various ways can be used to carry out method and system of the invention.For example, software, hardware, firmware can be passed through Or any combination of them carries out method and system of the invention.The sequence of the step of this method described above is only explanation Property, and unless specifically stated otherwise, otherwise the step of method of the invention is not limited to the sequence being described in detail above.This Outside, in some embodiments, the present invention can also be embodied as the program recorded in recording medium, including for implementing according to this hair The machine readable instructions of bright method.Therefore, present invention also contemplates that storage is for implementing program according to the method for the present invention Recording medium.
Although describing the present invention by reference to example embodiment, it should be understood that it is real that the present invention is not limited to disclosed examples Apply example.Following the scope of the claims will be given broadest explanation, to include all such modifications and equivalent knot Structure and function.
In specification in front, the embodiment of the present invention is described referring to many details, it can be from reality It now arrives realization and changes.Therefore, unique and unique instruction of invention is intention of the applicant as invention, is with this application One group of claim that the concrete form (including subsequent corrigendum) of sending is issued from the application.For being wrapped in these claims The term contained, any definition being expressly recited herein will determine the meaning of term used in claim.Therefore, claim In there is no any restrictions clearly described, element, attribute, feature, advantage or attribute should limit this right in any way and want The range asked.Therefore, the description and the appended drawings are considered illustrative rather than restrictive.

Claims (27)

1. a kind of device for the display for adjusting tangible interface, comprising:
Predicting unit is configured as predicting the touch of the certain positions touched by indicator about the tangible interface to be presented Area size;
Adjustment unit is configured as adjusting the aobvious of tangible interface at this location based on the touch area size of prediction Show.
2. the apparatus according to claim 1, wherein predict the touch area size based on relevant information is touched.
3. the apparatus of claim 2, wherein the touching touched when relevant information includes user's previous touch interface Touch information, user holds at least one of mode and display characteristic of equipment of the equipment for showing the interface.
4. device according to claim 3, wherein the touch information includes when the user had previously touched the interface When interface on previous touch area size.
5. device according to claim 4, wherein previous touch area size is collected with predefined time interval, Alternatively,
Wherein, previous touch area size is collected every the touch of predefined number.
6. device according to claim 4, wherein based in the predetermined amount of time before receiving the interface to be presented or The weighted average of previous user touch area size in the touch of pre-determined number predicts touch area size.
7. device according to claim 3, wherein the touch information includes by when user previously touches the interface The statistical data that previous touch area size on the interface obtains.
8. device according to claim 7, wherein the statistical data is by predetermined amount of time or pre-determined number What the previous user touch area size in touch determined.
9. device according to claim 7, wherein the touch area size be based on receive the interface to be presented it At least one preceding statistical data is weighted and averaged to predict.
10. device according to claim 3, wherein the display characteristic includes that the described of the display tangible interface sets Standby minimum touch area size,
Wherein, minimum touch area size is calculated by the resolution ratio and size of the resolution ratio of touch apparatus and display equipment.
11. device according to claim 10, wherein by touch interface resolution ratio and display interface resolution ratio and Size calculates minimum touch area size.
12. the apparatus according to claim 1, wherein the adjustment unit includes:
Whether size inspection unit, the touch area size for being configured to check for prediction are greater than predefined minimum available size simultaneously And it is less than predefined maximum available size;
Wherein when the touch area size of the prediction is in predefined minimum available size and predefined maximum available size Between when, the touch area size of the prediction remains unchanged, and
When the touch area size of the prediction is less than predefined minimum available size, the touch area size of the prediction It is changed to predefined minimum available size, or can be used when the touch area size of the prediction is greater than predefined maximum When size, the touch area size of the prediction is changed to predefined maximum available size.
13. the apparatus according to claim 1, wherein the adjustment unit includes:
Size difference inspection unit is configured to check for the difference of the touch area size of prediction and the touch area size of previous prediction Whether predetermined threshold is greater than;
Wherein, when the difference is greater than the threshold value, the display at the tangible interface is adjusted.
14. the apparatus according to claim 1 is configured as adjusting wherein the adjustment unit includes element adjustment unit At least one of size, position, text attribute and the image attributes of at least one element at the whole interface.
15. the apparatus according to claim 1 is configured as base wherein the adjustment unit includes element adjustment unit In the touch area size for the entire interface prediction come the size, the position, text category that adjust all elements at the interface At least one of property and image attributes.
16. the apparatus according to claim 1 is configured as base wherein the adjustment unit includes element adjustment unit In the touch area size for the entire interface prediction or be the interface at least one regional prediction touch area Size adjusts at least one of size, position, text attribute and the image attributes of element at least one region.
17. the apparatus according to claim 1 is configured as base wherein the adjustment unit includes element adjustment unit It in the touch area size for the entire interface prediction or is the area including at least one predetermined-element on the interface The touch area size of domain prediction or for the touch area size of at least one described predetermined-element prediction come adjust it is described extremely At least one of size, position, text attribute and the image attributes of a few predetermined-element.
18. the apparatus according to claim 1, wherein at least one described predetermined-element is that have when showing first time Operation accidentally touching, at least one element being then adjusted when showing for second.
19. a kind of method for the display for adjusting tangible interface, comprising:
Predict the touch area size of the certain positions touched by indicator about the tangible interface to be presented;
The display at tangible interface at this location is adjusted based on the touch area size of prediction.
20. according to the method for claim 19, wherein the display for adjusting tangible interface includes:
Whether the touch area size of inspection prediction is greater than predefined minimum available size and can less than predefined maximum Use size;
Wherein when the touch area size of the prediction is in predefined minimum available size and predefined maximum available size Between when, the touch area size of the prediction remains unchanged, and
When the touch area size of the prediction is less than predefined minimum available size, the touch area size of the prediction It is changed to predefined minimum available size, or can be used when the touch area size of the prediction is greater than predefined maximum When size, the touch area size of the prediction is changed to predefined maximum available size.
21. according to the method for claim 19, wherein the display for adjusting tangible interface includes:
Check whether the difference of the touch area size of prediction and the touch area size of previous prediction is greater than predetermined threshold;
Wherein, when the difference is greater than the threshold value, the display at the tangible interface is adjusted.
22. according to the method for claim 19, wherein the display for adjusting tangible interface includes adjusting the interface extremely At least one of size, position, text attribute and the image attributes of a few element.
23. according to the method for claim 19, wherein the display for adjusting tangible interface includes being based upon the entire boundary In size, position, text attribute and image attributes of the touch area size of face prediction to adjust all elements at the interface At least one.
24. according to the method for claim 19, wherein the display for adjusting tangible interface includes being based upon the entire boundary The touch area size of face prediction adjusts this extremely for the touch area size of at least one regional prediction at the interface At least one of size, position, text attribute and the image attributes of element in a few region.
25. according to the method for claim 19, wherein the display for adjusting tangible interface includes being based upon the entire boundary The touch area size that face is predicted or the Petting Area for the regional prediction including at least one predetermined-element on the interface Domain size or at least one described predetermined-element is adjusted for the touch area size of at least one described predetermined-element prediction At least one of size, position, text attribute and image attributes.
26. a kind of equipment, including
At least one processor;With
At least one storage equipment, at least one described storage equipment store instruction on it, the instruction is by described at least one When a processor executes, at least one described processor is made to execute method described in any one of 9-25 according to claim 1.
27. a kind of storage medium of store instruction, which can make to execute 9- according to claim 1 when executed by the processor Method described in any one of 25.
CN201711231781.5A 2017-11-30 2017-11-30 The adjustment based on prediction at tangible interface Pending CN109857316A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711231781.5A CN109857316A (en) 2017-11-30 2017-11-30 The adjustment based on prediction at tangible interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711231781.5A CN109857316A (en) 2017-11-30 2017-11-30 The adjustment based on prediction at tangible interface

Publications (1)

Publication Number Publication Date
CN109857316A true CN109857316A (en) 2019-06-07

Family

ID=66887571

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711231781.5A Pending CN109857316A (en) 2017-11-30 2017-11-30 The adjustment based on prediction at tangible interface

Country Status (1)

Country Link
CN (1) CN109857316A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111314552A (en) * 2020-02-13 2020-06-19 北京小米移动软件有限公司 User interface control method and device and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101770323A (en) * 2008-12-30 2010-07-07 英业达股份有限公司 Input device and method for generating touch control keyboard
US20110291970A1 (en) * 2010-05-28 2011-12-01 Compal Electronics, Inc. Electronic device and operation method thereof
US20120192111A1 (en) * 2011-01-20 2012-07-26 Chi Mei Communication Systems, Inc. Electonic device and method for varying icon sizes of menu icons
CN103246475A (en) * 2013-04-27 2013-08-14 华为终端有限公司 Method and device for adjusting button identification area
CN103577068A (en) * 2013-10-15 2014-02-12 广东欧珀移动通信有限公司 Method for dynamically adjusting size of desktop icon, and mobile terminal
CN104423855A (en) * 2013-08-26 2015-03-18 联想(北京)有限公司 Information processing method and electronic device
CN104850319A (en) * 2015-03-31 2015-08-19 北京畅游天下网络技术有限公司 Method and device for dynamically adjusting icon on touch screen
CN107203313A (en) * 2017-05-24 2017-09-26 维沃移动通信有限公司 Adjust desktop and show object method, mobile terminal and computer-readable recording medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101770323A (en) * 2008-12-30 2010-07-07 英业达股份有限公司 Input device and method for generating touch control keyboard
US20110291970A1 (en) * 2010-05-28 2011-12-01 Compal Electronics, Inc. Electronic device and operation method thereof
US20120192111A1 (en) * 2011-01-20 2012-07-26 Chi Mei Communication Systems, Inc. Electonic device and method for varying icon sizes of menu icons
CN103246475A (en) * 2013-04-27 2013-08-14 华为终端有限公司 Method and device for adjusting button identification area
CN104423855A (en) * 2013-08-26 2015-03-18 联想(北京)有限公司 Information processing method and electronic device
CN103577068A (en) * 2013-10-15 2014-02-12 广东欧珀移动通信有限公司 Method for dynamically adjusting size of desktop icon, and mobile terminal
CN104850319A (en) * 2015-03-31 2015-08-19 北京畅游天下网络技术有限公司 Method and device for dynamically adjusting icon on touch screen
CN107203313A (en) * 2017-05-24 2017-09-26 维沃移动通信有限公司 Adjust desktop and show object method, mobile terminal and computer-readable recording medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111314552A (en) * 2020-02-13 2020-06-19 北京小米移动软件有限公司 User interface control method and device and storage medium

Similar Documents

Publication Publication Date Title
CN108021259B (en) False touch prevention method and electronic equipment
CN106227520B (en) Application interface switching method and device
US9582070B2 (en) Detecting user input provided to a projected user interface
EP2742412B1 (en) Manipulating layers of multi-layer applications
KR101892315B1 (en) Touch event anticipation in a computing device
US10489632B2 (en) Electronic device and detection method
TWI471776B (en) Method and computing device for determining angular contact geometry
US9471763B2 (en) User input processing with eye tracking
US20130222338A1 (en) Apparatus and method for processing a plurality of types of touch inputs
EP2905680B1 (en) Information processing apparatus, information processing method, and program
TWI528271B (en) Method, apparatus and computer program product for polygon gesture detection and interaction
CN108415654A (en) Virtual input system and correlation technique
US20120050194A1 (en) Information processing apparatus and information processing method
CN107219993A (en) Display methods and related electronic device
CN104081328A (en) Smart touch screen key activation detection
JP5712339B1 (en) Input device, input method, and program
CN112489235A (en) Attendance checking device and method thereof
CN102129332A (en) Detection method and device of touch points for image recognition
EP3029555A1 (en) Method for processing input from capacitve input pad and related computer program and system
CN108734061A (en) The non-warning region initialization system and its setting method of personnel's detector
CN110413183A (en) A kind of method and apparatus that the page is presented
CN109375833B (en) Touch instruction generation method and device
CN105912158B (en) A kind of touch screen photographic method, device and the mobile terminal of mobile terminal
CN109857316A (en) The adjustment based on prediction at tangible interface
CN108132743B (en) Display processing method and display processing apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190607