CN109074189A - For being timed the system and method to minimize time delay to input sensing, rendering and display - Google Patents
For being timed the system and method to minimize time delay to input sensing, rendering and display Download PDFInfo
- Publication number
- CN109074189A CN109074189A CN201780019312.9A CN201780019312A CN109074189A CN 109074189 A CN109074189 A CN 109074189A CN 201780019312 A CN201780019312 A CN 201780019312A CN 109074189 A CN109074189 A CN 109074189A
- Authority
- CN
- China
- Prior art keywords
- touch
- time
- input
- application
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/0418—Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
- G06F3/04184—Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/39—Control of the bit-mapped memory
- G09G5/393—Arrangements for updating the contents of the bit-mapped memory
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2310/00—Command of the display device
- G09G2310/06—Details of flat display driving waveforms
- G09G2310/067—Special waveforms for scanning, where no circuit details of the gate driver are given
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2310/00—Command of the display device
- G09G2310/08—Details of timing specific for flat panels, other than clock recovery
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/12—Frame memory handling
- G09G2360/127—Updating a frame memory using a transfer of data from a source area to a destination area
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Disclosed system and method relate in general to user to the input field of touch-sensitive device, relate more specifically to reduce the user input systems and method of the time delay between the display of the rendering frame of the event that recently inputs and this input of reflection.In one embodiment, at the time of the method for reducing the time delay between the display of frame of input touch event and reflection input touch event in touch-sensitive device includes: to estimate next frame refreshing；The touch data of reflection input touch event is received from operating system；It determines and the input associated application of touch event；The time that estimation application is handled and rendered to received touch data；It is based at least partially on using the estimation moment for being handled touch data and being rendered estimation time and next frame refreshing used, at the time of to application delivering touch data allowing that touch data is handled and rendered before applying at the time of next frame refreshing to determine；And touch data is provided to application before the identified moment.
Description
Cross reference to related applications
The application is on 2 2nd, 2016 U.S. Provisional Patent Application submitted the 62/290,347th non-provisional Shens
Please, and the priority of the temporary patent application is required, entire disclosure is incorporated herein by reference.The application is in 2015 11
U.S. Patent Application No. 14/945, the 083 part continuation application that the moon is submitted on the 18th, and require the preferential of the patent application
Power, entire disclosure is incorporated herein by reference, and the U.S. Patent Application No. 14/945,083 is in November, 2014 in itself
The non-provisional application of the U.S. Patent Application No. submitted for 18th 62/081,261, and require its priority.This application include by
The material of copyright protection.Copyright owner does not oppose that anyone discloses carry out photocopy to this patent, just as it appear in patent and
In Trademark Office file or record, but retain all copyrights in another aspect.
Technical field
Disclosed system and method relate in general to user to the input field of touch-sensitive device, relate more specifically to reduce
Recently input the user input systems and method of the time delay between the display of the rendering frame of event and this input of reflection.
Detailed description of the invention
Pass through the following more specifical description to each embodiment as shown in drawings, above-mentioned and other mesh of the disclosure
Mark, feature and advantage will become obvious, and in the accompanying drawings, the appended drawing reference in each figure indicates same section.These attached drawings
It is not necessarily to scale, but focuses on and show in the principle of the present invention.
Fig. 1 shows the figure for illustrating existing double buffering scheme.
Fig. 2 and Fig. 3 shows the figure for illustrating existing rendering method.
Fig. 4 and Fig. 5 accelerates to show diagram by accelerating to render and accelerating to refresh scheme of the screen to reduce lag
The schematic diagram of embodiment.
Fig. 6 shows the reality for illustrating the system and method for the disclosure for being provided with the system being timed to the rendering of GUI
Apply the schematic diagram of example.
Specific embodiment
It reference will now be made in detail to the preferred embodiment of the present invention now, shown in the drawings of the example of the preferred embodiment.With
Lower description and attached drawing are illustrative, and being not construed as limiting property.It is thorough to provide to describe numerous specific details
Understand.However, in some instances, not describing well-known or conventional details to avoid making description thicken.In the disclosure
In, the reference to the same embodiment is not necessarily to the reference of one embodiment or embodiment, this class reference means at least
One embodiment.
The reference of " embodiment " or " embodiment " is meaned in conjunction with described in the embodiment in this specification
Specific features, structure or characteristic include at least one embodiment of the disclosure.Different location in the present specification occurs
The phrase " in one embodiment " is not necessarily all referring to the same embodiment, nor referring to the list mutually exclusive with other embodiments
Only or alternative embodiment.In addition, also describing can be presented by some embodiments and can not be presented by other embodiments various
Feature.Similarly, also describing may be the various requirement for not being for some embodiments but not requirement for other embodiments.
Below with reference to for being timed input sensing, rendering and display to minimize the method and apparatus of time delay
Block diagram and operational illustration yet describe the present invention.It should be understood that each of block diagram or operational illustration yet frame and block diagram or behaviour
The combination of frame in illustrating can be realized by analog or digital hardware and computer program instructions.These computer programs
Instruction can store on a computer-readable medium and be provided to the processor of general purpose computer, special purpose computer, ASIC
Or other programmable data processing devices, so that at via the processor or other programmable datas of the computer
It manages these instructions that equipment executes and realizes the function action specified in block diagram or single operation frame or multiple frames.It is certain can
It selects in implementation, pointed function action can not occur according to the sequence marked in operational illustration yet in frame.Example
Such as, related function action can be depended on, two frames continuously shown can actually be executed substantially simultaneously, or
These frames can execute in the reverse order sometimes.
Interactive device can be considered the combination of multiple portions, comprising: input sensing, processing and rendering task and output are aobvious
Show.It is required that will input sense organ (such as finger touch) to be converted into the assembly line of eye response is not to occur immediately；Each movement can
Time delay, such as the processing information required time spent are introduced due to various reasons, or in the case of a display, display
To redraw entire screen or part thereof of frequency.Even if making these movements are parallel to execute in the conceived case as a result, it is
It unites also only fast as most slow movement.For example, display may only refresh once every 60Hz, it means that if other dynamic
Make before next refresh cycle faster (or can obtain), system, which is also forced, waits display to get out display new information.
It is an object of the present invention to reduce the time delay, (as user is input to system and system to the figure of the input
Time between response).The present invention also aims to be synchronised by refreshing input capture and processing with display, make it possible to
Enough show nearest input information.In the past, any input information was handled as much as possible, and often under the pressure of the next refreshing of waiting
Period.Only this will introduce waiting time, and reflect and arrive whole system time delay.The implementation of disclosed method according to the present invention
Example, the system consider it is next refresh when and this is taken into account in order to provide up-to-date event, rendered with just-in-time.
In one embodiment, refresh at the time of display and for being sampled to input pickup and calculating touch point
Time is known.Therefore, input sensing is postponed and is overlapped to terminate when refreshing will start.In one embodiment, exist
Start to render at the time of finally possible, so that completing the rendering and being ready to refresh for next display to be exported.This just and
When rendering will access nearest incoming event, as a result, caused by display will include the figure with minimal time delay amount.
In another embodiment, time at the time of refreshing and for being sampled to input pickup is unknown,
It needs to measure in advance.Measurement is executed based on material time stamp, this allows we be sure that time-sequencing and sequence.By measuring,
Input sampling rate and display refresh rates become it is known that and the rendering of figure can be timed like that as briefly mentioned above, so as to most
Smallization time delay.
In another embodiment, (or being defined as constant) is inputted come to such measurement using external measurement devices and user
It is detected.
In another embodiment, these measurements change according to system's work-load, and these measurements and inaccurate, and only
It is intended merely to reduce the waiting to display.Rendering exports the complexity that the required time is the output and contention system activity (more
Complicated output usually requires the more time to be rendered, and the competitive activities on CPU or GPU may drag slow rendering etc.)
Function.In this embodiment, system estimates render time based on some combinations of following data: export complexity model,
The knowledge of competitive activities on critical system component renders time required for previous frame and the past similar output institute of rendering
The time needed.
In another embodiment, once display complete its vertically refresh and there is buffer when to can be used for rendering when,
System just renders output.After the completion of rendering, system based on by input pickup additional incoming event sampling come more
New rendering, until next vertical refreshing.For example, system renders the view of GUI, it is based on additional input thing later
Part is converted, at the time of must show the rendering.
Fig. 1 shows existing double buffering scheme.In this scenario, display is in two buffers for showing and rendering
(A&B) between " overturning " or " exchange ".When buffer A is visible, equipment is rendered into buffer B.The system is with defined speed
Rate overturning/exchange buffering, so that buffer B is current as it can be seen that and can be rendered into buffer A.When buffer is outside screen
(offscreen) when, which is removed and is rendered.
Fig. 2 and Fig. 3 shows existing rendering method.The GUI is carried out using data and application state is recently input
Rendering.The feelings being had differences between application state (including input) when GUI is rendered and when it is finally shown in screen
Under condition, time delay (lag) can be generated.In Fig. 3, render A lag be illustrated as rendering A beginning with by rendering A as the result is shown
The time between vertical refreshing on the screen.
Fig. 4 and Fig. 5 is shown by more accelerating to render and accelerating to refresh scheme of the screen to reduce lag.For example, one
Scheme, which can include that faster GPU or other is such in their system, to be improved, and can be with faster refresh rate (ratio
Such as 100Hz rather than 60Hz) run their display.In this mode, the figure after rendering be not only created more quickly but also
It is displayed for a user more quickly in screen, thus reduce the beginning of rendering and shows the time between the GUI to user.As long as
Having time is for removing buffer and rendering GUI between the vertical refreshing of screen, and this method will reduce lag, but cost is
Need more powerful rendering engine and faster more expensive display.
Fig. 6, which is shown, to be timed the rendering of GUI so that it is approaching the disclosure completed when vertical refreshing as far as possible
The embodiment of system and method.In this manner, obtainable user's input recently and obtainable recently can be used in rendering
Application state generates rendered image, to reduce lag.
In one embodiment, a kind of acquisition with associated rendering for the reduction touch data in touch-sensitive device is provided
The system and method for time delay between the processing of task, which has can be to touch the touching that sample rate generates touch data
It touches sensing system and there is the display system for showing frame with refresh rate.At least one of the system estimation following data: it (a) uses
In the period sampled from above-mentioned touch-sensing system to touch data, (b) according to the touch data meter sampled
Calculate the period of touch event data and (c) for frame to be rendered into the period of frame buffer.The system is at least partly
It is determined based on the estimation for (a) to sample touch data from touch-sensing system, (b) is according to the touching sampled
Data are touched to calculate touch event data and frame (c) is rendered into the period Tc of frame buffer.The system determines a moment
Tr will refresh display system from frame buffer in moment Tr.Tr and Tc are based at least partially on come when calculating sampling beginning
It carves.The sampling of touch-sensing system is initiated to obtain the touch data sampled in sampling start time.According to sampling
Touch data calculate touch event data, before moment Tr, it is slow to reflect that the frames of the touch event data is rendered into frame
Rush device.Later, refresh from the frame buffer and show.
In one embodiment, when required for system determination calculating touch event data according to the touch data sampled
Between section Tc and will from frame buffer refresh show at the time of Tr.Touch-sensing system is created the touching sampled by sampling
Touch data.Touch event data are calculated according to the touch data sampled, which starts to be postponed, so as at least
Occur at the time of equally early with (Tr-Tc).Frame is rendered into frame buffer before moment Tr, is refreshed later from the frame buffer aobvious
Show system.
In one embodiment, a kind of acquisition with associated rendering for the reduction touch data in touch-sensitive device is provided
The method of time delay between the processing of task, the touch-sensitive device have (a) can be to touch the touch that sample rate generates touch data
Sensing system and the display system that frame (b) is shown with the refresh rate with refresh synchronization.Start in sample-synchronous to touch
The sampling of sensor output, the output sampled are placed in sample buffer with sample rate.Start in refresh synchronization to multiple
A buffer in display buffer carries out frame rendering, the display display figure corresponding with rendered frame in refresh synchronization
Picture.Period Tc corresponding with for collecting the estimation time of output in sample buffer is determined, and for according to being received
The estimation time corresponding period Tm that the output of collection calculates touch event data is determined, and touches thing with for rendering to correspond to
The estimation time of the frame of number of packages evidence, corresponding period Tr was determined.Based on refresh synchronization, Tc, Tm and Tr come when calculating beginning
It carves, initiates in sample buffer in the start time to the collection of output.Later, it is touched according to collected output to calculate
Event data renders frame corresponding with the touch event data.
In one embodiment, can be used for when being ready to by showing to by the image after application rendering during exchange buffering
Device presentation is estimated.In one embodiment, other strategies can be used also to estimate graphical usability；Such as estimating to scheme
As the optional strategy of availability also may include to frame buffer (for example, queue, Double Register, three buffers are (or any mostly slow
Storage scheme), storehouse, hash, heap, chained list, doubly linked list) abstract based on buffer be monitored, but be not limited to
This.In one embodiment, it is possible to provide the application with API, wherein the API allows the application is specified to execute required for rendering
Time, for example, starting to terminate with rendering by instruction rendering.In one embodiment, it can choose a random period to make
For the estimated value during rendering.
In one embodiment, scheduling is adjusted using the estimation of input sample and/or output processing, as a result, such as system
In various processing the time it takes amounts can be monitored, input sample and/or output processing the available adjustment of scheduling
To compensate the time.In one embodiment, it is possible to create multiple overlappings scheduling, wherein generate have multiple candidate outputs and
The given correctly output of selection one in the case where executing rendering or in other ways the spent special time amount of processing input.
In one embodiment, to one of the following or multiple can be monitored: the sampling time, (operating system, UI frame, using or
One or more of other processing) calculating time, rendering, hardware given input is rendered required for the time and
Time required for being inputted to application delivering.It in one embodiment, can be to such as operating system for inputting and exporting processing institute
The time of cost is monitored and is fed to scheduler.
In one embodiment, it is scheduled by the display of processing and its effect on the screen to input to improve system
Time delay.Such as operating system is utilized under local mode and the feelings of the access for being inserted at rendering are not provided inherently
Under condition, this may be ideal.During given processing step, it can be brought it about by dispatching the processing specific defeated
After entering or before specific display refreshing (or when about the reproduction of the input or display, scheduling that is predetermined or persistently adjusting), from
And realize the improvement of time delay.In one embodiment, output and/or incoming event be can skip.In one embodiment, by passing
The processing for giving application program is scheduled, so that the incoming event from multiple input frames is packaged with.
As described above, determining when the rendering to application view should occur by executing scheduling.In one embodiment, it examines
Consider to when executing the input delivering to application and should include the scheduling of input which is sampled, it is nearest to ensure
Input is processed and its effect is shown in the input of screen.In one embodiment, the scheduling to input is executed.Implement one
In example, the scheduling to output is executed.In one embodiment, the two is executed.As a result, in one embodiment, operating system is by thing
Number of packages is transmitted to the processing for merging and dispatching for the delivering to event data to application according to (such as touch event data).
In one embodiment, which can merge multiple events, including (it may or may not be with phase from multiple sensors
Like sample frequency run) event.In one embodiment, the delivering that opposite direction is applied is scheduled can be based on for combined thing
The input processing time and output processing time of part.In one embodiment, it is cut in determining merged event more than frame buffer
Before alternatively in the case where remaining pot life, the delivering of the event can be postponed, until switching it in subsequent frame buffer
Preceding point (for example, before subsequent frame buffer switching), but will include nearest information in delivering.One
In embodiment, in the case where determining the pot life that merged event is more than remaining before frame buffer switches, it can skip
One or more of combined event, input is extracted to allow the display when frame buffer switches as a result,.
In one embodiment, synchronization (or near-synchronous) processing of multi input sampling can be performed.Above-mentioned processing allows will be defeated
Enter sampling to decouple from dispatch deal.As a result, in one embodiment, more samplings to input are taken.When one input it is to be processed with
When arriving at the time of just modifying application state, recent events are sent to the application to update its state.In one embodiment, it is
Mitigate and apply the time for repeatedly updating its state between output frame, which only can be adapted for carrying out update (and wash with watercolours at it
Dye) when be apprised of input.Although the strategy by only recent events are rendered in terms of reducing time delay be it is effective, by
The event skipped may include required or desired information.As a result, in one embodiment, incoming event be queued (or
Otherwise packing/marshalling) and be delivered to the application as group and (or otherwise locate simultaneously or approximately simultaneously
Reason), to reduce using the number for updating its state.The delivering of this incoming event reduces the number for generating and updating, and increases
Incoming event for specific output method/processing correct moment a possibility that being delivered.In addition, using can therefore receive
To with they originally by the benefit without the queuing the case where identical (or essentially identical) input.
In the disclosure, term " touch " can be used, " contact " or other descriptors describe to be detected by sensor
Event or period to the finger of user, stylus, object or physical feeling.In some embodiments, these detection only when
Just occur when the equipment that user and sensor or sensor are included therein physically contacts with.In other embodiments, it can adjust
Humorous sensor is to allow to detect the distance hovered over above touch-surface or otherwise to separate with touch-sensitive device
" touch ".Therefore, the language of the dependence of the physical contact of sensing not shall mean that using hint in the present specification
Described technology is only applied to those embodiments；In fact, most (if not if whole) is described herein
Content will be equally applicable to " to touch " and " hovering " sensor.As used in this application, word " touch event " and word " touching
Touch " it include that or can be used sensor come any other hand for identifying close to touching and close to touch event when being used as noun
Gesture.
It can at least partly in software include disclosed at least some aspects.That is, (such as in response to its processor
Microprocessor) included in memory, (such as ROM, volatibility RAM, nonvolatile memory, caching or long-range storage are set for execution
It is standby) in instruction sequence, the technology can be implemented in dedicated or general purpose computer system or other data processing systems.
It is performed to just to realize that the routine of embodiment may be implemented as operating system, firmware, ROM, middleware, service are passed
Send platform, SDK (Software Development Kit) component, web services or other specific applications, component, programs, objects, module or
Referred to as a part of the instruction sequence of " computer program ".Calling interface to these routines can be used as API (application programming connect
Mouthful) be exposed under software development community.Computer program generally includes each in each memory and storage device in computer
When one or more instruction set for inscribing, one or more of instruction set by one or more processors in computer when being held
The computer is set to carry out operation necessary to executing the element for being related to various aspects when row.
Machine readable media can be used for storing software and data, and the software and data by data processing system when being executed
The system is set to execute various methods.Executable software and data can store and locate at various locations, including for example, ROM, volatile
Property RAM, nonvolatile memory and/or caching.The part of this software and/or data can store in these storage equipment
In any one storage equipment.Further, the data and instruction can be obtained from centralized server or peer-to-peer network.It can be
Different time and in different communication sessions or in identical communication session from different centralized server and/
Or peer-to-peer network obtains the different piece of the data and instruction.Data can be completely obtained before executing application and refer to
It enables.Alternatively, when needing to be implemented, the part of the data and instruction dynamically (only in real time) is obtained.It therefore, there is no need to
The data and instruction is at the time of specific example with it on machine readable media.
The example of computer-readable medium includes but is not limited to recordable and non-recordable type medium, such as volatibility
With non-volatile memory devices, read-only memory (ROM), random access memory (RAM), flash memory device, floppy disk and its
His moveable magnetic disc, magnetic disk storage medium, optical storage media is (for example, compact disk read-only memory (CD ROM), digital versatile disc
(DVD) etc.) etc..
In general, machine readable media include provide (for example, storage) using the form of machine-accessible information (for example,
Computer, the network equipment, personal digital assistant, manufacture tool, any equipment of set with one or more processors etc.)
Any mechanism.
In embodiments, hardware circuit can be used together to realize technology with software instruction.Therefore, the technology
Neither limited to any specific combination of hardware circuit and software, it is also not necessarily limited to any spy of the instruction executed by data processing system
Determine source.
Above embodiments and preference are for illustrating the present invention.For this patent, both it is unnecessary be not intended to summary or
Limit every kind of possible combination or embodiment.The inventors have disclosed enough information to permit those skilled in the art's reality
Trample at least one embodiment of the present invention.The case where not departing from the scope of the present invention as defined in following claims
Under, above description and attached drawing are merely to illustrate the present invention, and the variation of component, structure and program is possible.For example, not
In the case where being detached from the present invention, above-described element and/or step can be practiced in a different order and/or according to specific
The following claims of sequence.Therefore, although specifically illustrating and describing the present invention referring to the embodiment of the present invention,
It is it will be understood by those skilled in the art that without departing from the spirit and scope of the present invention, can be done to form and details
Various modifications out.
Claims (2)
1. it is a kind of in touch-sensitive device reduce input touch event and reflect it is described input touch event frame display it
Between time delay method, the touch-sensitive device have operating system and display system, the operating system is operationally and to input
The touch-sensing system of touch event sensitivity is connected, and the display system shows frame with refresh rate, which comprises
At the time of estimating next frame refreshing；
The touch data of reflection input touch event is received from the operating system；
The determining and associated application of the input touch event；
Estimate that the application is handled and rendered the time used to the received touch data；
It is based at least partially on the application and the touch data is handled and rendered used estimation time and described
The estimation moment of next frame refreshing, to determine that described apply described next will be allowed by delivering the touch data to the application
At the time of the touch data is handled and is rendered before at the time of frame refreshing；And
The touch data is provided to the application before the identified moment.
2. it is a kind of for reduced in touch-sensitive device recently input touch event and the frame that reflects the input touch event it is aobvious
The method of time delay between showing, the touch-sensitive device have operating system and display system, the operating system operationally with it is right
The touch-sensing system of input touch event sensitivity is connected, and the display system shows frame with refresh rate, which comprises
At the time of estimating next frame refreshing；
The touch data of reflection with multiple input touch events of the first association is received from the operating system；
Estimate that the application is handled and rendered institute to multiple input touch events in the received touch data
Time；
It is based at least partially on the application and the touch data is handled and rendered used estimation time and described
The estimation moment of next frame refreshing, to determine that described apply described next will be allowed by delivering the touch data to the application
At the time of the touch data is handled and is rendered before at the time of frame refreshing；And
The touch data is provided to the application before the identified moment.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201662290347P | 2016-02-02 | 2016-02-02 | |
| US62/290,347 | 2016-02-02 | ||
| PCT/US2017/016222 WO2017136554A1 (en) | 2016-02-02 | 2017-02-02 | System and method for timing input sensing, rendering, and display to minimize latency |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109074189A true CN109074189A (en) | 2018-12-21 |
Family
ID=59501044
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780019312.9A Withdrawn CN109074189A (en) | 2016-02-02 | 2017-02-02 | For being timed the system and method to minimize time delay to input sensing, rendering and display |
Country Status (4)
| Country | Link |
|---|---|
| JP (1) | JP2019505045A (en) |
| CN (1) | CN109074189A (en) |
| DE (1) | DE112017000610T5 (en) |
| WO (1) | WO2017136554A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110971972A (en) * | 2019-11-27 | 2020-04-07 | 北京凯视达科技有限公司 | Method and device for playing video, storage medium and electronic equipment |
| CN111984181A (en) * | 2020-09-09 | 2020-11-24 | Oppo（重庆）智能科技有限公司 | Picture refreshing method and device, terminal equipment and storage medium |
| CN113867517A (en) * | 2020-06-30 | 2021-12-31 | 北京小米移动软件有限公司 | Touch method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103593155A (en) * | 2013-11-06 | 2014-02-19 | 华为终端有限公司 | Display frame generation method and terminal equipment |
| US20140092150A1 (en) * | 2012-10-02 | 2014-04-03 | Nvidia Corporation | System, method, and computer program product for modifying a pixel value as a function of a display duration estimate |
| US20140198052A1 (en) * | 2013-01-11 | 2014-07-17 | Sony Mobile Communications Inc. | Device and method for touch detection on a display panel |
| US20150062021A1 (en) * | 2013-08-30 | 2015-03-05 | Nvidia Corporation | Methods and apparatus for reducing perceived pen-to-ink latency on touchpad devices |
| CN104820489A (en) * | 2014-01-30 | 2015-08-05 | 三星显示有限公司 | System and method in managing low-latency direct control feedback |
| CN104932754A (en) * | 2008-09-26 | 2015-09-23 | 苹果公司 | Touch detection for touch input devices |
| CN104951129A (en) * | 2014-03-31 | 2015-09-30 | 三星显示有限公司 | Method and system of combining overlay data with video image, and display system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8947420B2 (en) * | 2011-05-27 | 2015-02-03 | Nokia Corporation | Processing image content for content motion or touch input |
| EP2620843A1 (en) * | 2012-01-27 | 2013-07-31 | Research In Motion Limited | Electronic device including touch-sensitive display |
| US9703473B2 (en) * | 2013-01-24 | 2017-07-11 | Facebook, Inc. | Predicting touch input |
| US9293119B2 (en) * | 2014-01-06 | 2016-03-22 | Nvidia Corporation | Method and apparatus for optimizing display updates on an interactive display device |
| US9354744B2 (en) * | 2014-06-09 | 2016-05-31 | Sony Corporation | Adaptive touch panel synchronization |
-
2017
- 2017-02-02 CN CN201780019312.9A patent/CN109074189A/en not_active Withdrawn
- 2017-02-02 JP JP2018536510A patent/JP2019505045A/en active Pending
- 2017-02-02 DE DE112017000610.4T patent/DE112017000610T5/en not_active Withdrawn
- 2017-02-02 WO PCT/US2017/016222 patent/WO2017136554A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104932754A (en) * | 2008-09-26 | 2015-09-23 | 苹果公司 | Touch detection for touch input devices |
| US20140092150A1 (en) * | 2012-10-02 | 2014-04-03 | Nvidia Corporation | System, method, and computer program product for modifying a pixel value as a function of a display duration estimate |
| US20140198052A1 (en) * | 2013-01-11 | 2014-07-17 | Sony Mobile Communications Inc. | Device and method for touch detection on a display panel |
| US20150062021A1 (en) * | 2013-08-30 | 2015-03-05 | Nvidia Corporation | Methods and apparatus for reducing perceived pen-to-ink latency on touchpad devices |
| CN103593155A (en) * | 2013-11-06 | 2014-02-19 | 华为终端有限公司 | Display frame generation method and terminal equipment |
| CN104820489A (en) * | 2014-01-30 | 2015-08-05 | 三星显示有限公司 | System and method in managing low-latency direct control feedback |
| CN104951129A (en) * | 2014-03-31 | 2015-09-30 | 三星显示有限公司 | Method and system of combining overlay data with video image, and display system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110971972A (en) * | 2019-11-27 | 2020-04-07 | 北京凯视达科技有限公司 | Method and device for playing video, storage medium and electronic equipment |
| CN113867517A (en) * | 2020-06-30 | 2021-12-31 | 北京小米移动软件有限公司 | Touch method and device, electronic equipment and storage medium |
| CN111984181A (en) * | 2020-09-09 | 2020-11-24 | Oppo（重庆）智能科技有限公司 | Picture refreshing method and device, terminal equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2019505045A (en) | 2019-02-21 |
| WO2017136554A1 (en) | 2017-08-10 |
| DE112017000610T5 (en) | 2018-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11009994B2 (en) | System and method for timing input sensing, rendering, and display to minimize latency | |
| US11068290B2 (en) | Systems and methods for providing interactive streaming media | |
| US11064267B2 (en) | Systems and methods for providing interactive streaming media | |
| US9612675B2 (en) | Emulating pressure sensitivity on multi-touch devices | |
| EP2638452B1 (en) | Resolving merged touch contacts | |
| US10972798B2 (en) | Display method and device for attached media information | |
| KR20160058117A (en) | Systems and methods for providing response to user input using information about state changes predicting future user input | |
| CN104679307B (en) | A kind of detect touches the method and device that screen slides sensitivity | |
| CN104375862B (en) | A kind of progress bar shows method and device | |
| US20120300123A1 (en) | Processing image content for content motion or touch input | |
| CN109074189A (en) | For being timed the system and method to minimize time delay to input sensing, rendering and display | |
| JP2015534151A (en) | System and method for generating event delivery information | |
| WO2018098960A1 (en) | Method for operating touchscreen device, and touchscreen device | |
| US9946398B2 (en) | System and method for timing input sensing, rendering, and display to minimize latency | |
| JP6966999B2 (en) | Hardware access counters and event generation to coordinate multithreaded processing | |
| US20190042596A1 (en) | Apparatus of continuous profiling for multicore embedded system and method of the same | |
| US11875033B1 (en) | Touch-based occlusion for handheld devices | |
| JP2015170031A (en) | Association method, association program, and association device | |
| JP2021124968A (en) | Information processing device, information processing method, and program | |
| JP2016095747A (en) | Operation reproduction device, operation reproduction method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20181221 |