SG10201807923YA - Exploiting frame to frame coherency in a sort-middle architecture - Google Patents

Exploiting frame to frame coherency in a sort-middle architecture

Info

Publication number
SG10201807923YA
SG10201807923YA SG10201807923YA SG10201807923YA SG10201807923YA SG 10201807923Y A SG10201807923Y A SG 10201807923YA SG 10201807923Y A SG10201807923Y A SG 10201807923YA SG 10201807923Y A SG10201807923Y A SG 10201807923YA SG 10201807923Y A SG10201807923Y A SG 10201807923YA
Authority
SG
Singapore
Prior art keywords
frame
tile
sort
computed
compact representation
Prior art date
Application number
SG10201807923YA
Inventor
Juan Fernandez
Casado Javier Carretero
Pedro Marcuello
Tomas G Akenine-Möller
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Publication of SG10201807923YA publication Critical patent/SG10201807923YA/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/005General purpose rendering architectures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/20Processor architectures; Processor configuration, e.g. pipelining
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/60Memory management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/40Filling a planar surface by adding surface attributes, e.g. colour or texture
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/04Texture mapping
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/10Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/363Graphics controllers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/28Indexing scheme for image data processing or generation, in general involving image processing hardware
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02Details of power systems and of start or stop of display operation
    • G09G2330/021Power management, e.g. power saving
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00Aspects of the architecture of display systems
    • G09G2360/12Frame memory handling
    • G09G2360/122Tiling

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Image Generation (AREA)
  • Processing Or Creating Images (AREA)

Abstract

EXPLOITING FRAME TO FRAME COHERENCY IN A SORT-MIDDLE ARCHITECTURE Pixel values that were computed in a previous frame may be reused for the current frame, operating in a sort-middle architecture. A hash or some other compact representation of all the data used in a tile, including all triangles, uniforms, textures, shaders, etc. is computed and stored for each tile. When rendering the next frame, that compact representation is once again computed for each tile. In a sort-middle architecture, there is a natural break point just before rasterization. At this break point, the compact representation may be compared to the compact representation computed in the previous frame for the same tile. If those compact representations are the same, then there is no need to render anything for this tile. Instead, the contents of the color buffer or other buffers of the previous frame of the tile may be moved to the same buffer of the tile for the current frame. Fig. 2
SG10201807923YA 2014-05-14 2015-04-30 Exploiting frame to frame coherency in a sort-middle architecture SG10201807923YA (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US14/277,239 US9940686B2 (en) 2014-05-14 2014-05-14 Exploiting frame to frame coherency in a sort-middle architecture

Publications (1)

Publication Number Publication Date
SG10201807923YA true SG10201807923YA (en) 2018-10-30

Family

ID=54480444

Family Applications (3)

Application Number Title Priority Date Filing Date
SG10201706498SA SG10201706498SA (en) 2014-05-14 2015-04-30 Exploiting Frame To Frame Coherency In A Sort-Middle Architecture
SG10201807923YA SG10201807923YA (en) 2014-05-14 2015-04-30 Exploiting frame to frame coherency in a sort-middle architecture
SG11201608884PA SG11201608884PA (en) 2014-05-14 2015-04-30 Exploiting frame to frame coherency in a sort-middle architecture

Family Applications Before (1)

Application Number Title Priority Date Filing Date
SG10201706498SA SG10201706498SA (en) 2014-05-14 2015-04-30 Exploiting Frame To Frame Coherency In A Sort-Middle Architecture

Family Applications After (1)

Application Number Title Priority Date Filing Date
SG11201608884PA SG11201608884PA (en) 2014-05-14 2015-04-30 Exploiting frame to frame coherency in a sort-middle architecture

Country Status (9)

Country Link
US (3) US9940686B2 (en)
EP (1) EP3143594B1 (en)
JP (2) JP6337322B2 (en)
KR (3) KR102154456B1 (en)
CN (3) CN106233337B (en)
RU (2) RU2661763C2 (en)
SG (3) SG10201706498SA (en)
TW (3) TWI596571B (en)
WO (1) WO2015175231A1 (en)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102116976B1 (en) 2013-09-04 2020-05-29 삼성전자 주식회사 Apparatus and Method for rendering
KR102122454B1 (en) * 2013-10-02 2020-06-12 삼성전자주식회사 Apparatus and Method for rendering a current frame using an image of previous tile
US9940686B2 (en) 2014-05-14 2018-04-10 Intel Corporation Exploiting frame to frame coherency in a sort-middle architecture
GB2524121B (en) * 2014-06-17 2016-03-02 Imagination Tech Ltd Assigning primitives to tiles in a graphics processing system
US9799091B2 (en) 2014-11-20 2017-10-24 Intel Corporation Apparatus and method for efficient frame-to-frame coherency exploitation for sort-last architectures
GB2532495B (en) * 2014-11-21 2018-05-02 Advanced Risc Mach Ltd Graphics processing systems
GB201602120D0 (en) 2016-02-05 2016-03-23 Bae Systems Plc Method and apparatus for generating an image
GB201602117D0 (en) 2016-02-05 2016-03-23 Bae Systems Plc Method and apparatus for generating an image
US10456672B2 (en) 2016-05-19 2019-10-29 Google Llc Methods and systems for facilitating participation in a game session
US10373286B2 (en) * 2016-08-03 2019-08-06 Samsung Electronics Co., Ltd. Method and apparatus for performing tile-based rendering
CN110192239A (en) * 2017-01-24 2019-08-30 株式会社半导体能源研究所 Display device and electronic equipment
CN110678239B (en) 2017-10-10 2024-02-09 谷歌有限责任公司 Distributed sample-based game profiling with game metadata and metrics and game API platform supporting third party content
JP7005763B2 (en) 2018-03-22 2022-01-24 グーグル エルエルシー Methods and systems for rendering and encoding content for online interactive gaming sessions
US11077364B2 (en) 2018-04-02 2021-08-03 Google Llc Resolution-based scaling of real-time interactive graphics
KR20230017925A (en) 2018-04-02 2023-02-06 구글 엘엘씨 Methods, devices, and systems for interactive cloud gaming
KR102614649B1 (en) * 2018-04-10 2023-12-14 구글 엘엘씨 Memory management in gaming rendering
EP3807766B1 (en) 2018-11-16 2021-10-27 Google LLC Shadow tracking of real-time interactive simulations for complex system analysis
KR20200073697A (en) 2018-12-14 2020-06-24 삼성전자주식회사 An apparatus for rendering objects including path, computing device including the same, and rendering method thereof
GB2580179B (en) * 2018-12-21 2021-08-18 Imagination Tech Ltd Tile-based scheduling
US11016774B1 (en) * 2019-11-26 2021-05-25 Arm Limited Issuing execution threads in a data processor
CN111796709B (en) * 2020-06-02 2023-05-26 南京信息工程大学 Method for reproducing image texture features on touch screen
TW202209259A (en) * 2020-08-17 2022-03-01 美商英特爾股份有限公司 Apparatus and method for efficient graphics processing including ray tracing
US11995767B2 (en) 2020-08-17 2024-05-28 Intel Corporation Apparatus and method for compressing ray tracing acceleration structure build data
US11416960B2 (en) 2020-11-06 2022-08-16 Samsung Electronics Co., Ltd. Shader accessible configurable binning subsystem
US20220319090A1 (en) * 2021-03-31 2022-10-06 Arm Limited System, devices and/or processes for predictive graphics processing
EP4254340A1 (en) * 2022-03-31 2023-10-04 Imagination Technologies Limited Reducing redundant rendering in a graphics system
US11615578B1 (en) * 2022-06-09 2023-03-28 Illuscio, Inc. Systems and methods for efficient rendering and processing of point clouds using textures

Family Cites Families (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1014602A (en) 1961-05-15 1965-12-31 Ass Elect Ind Improvements relating to apparatus for converting pulse code signals into analogue form
EP1027682B1 (en) * 1997-10-31 2003-07-16 Hewlett-Packard Company, A Delaware Corporation Method and apparatus for rapidly rendering an image in response to three-dimensional graphics data in a data rate limited environment
US6738069B2 (en) 2001-12-31 2004-05-18 Intel Corporation Efficient graphics state management for zone rendering
KR100931915B1 (en) * 2002-01-23 2009-12-15 노키아 코포레이션 Grouping of Image Frames in Video Coding
AU2003268575B2 (en) * 2002-12-16 2006-02-02 Canon Kabushiki Kaisha Tiling a Compressed Image
US7268779B2 (en) 2002-12-24 2007-09-11 Intel Corporation Z-buffering techniques for graphics rendering
US7379019B2 (en) 2003-01-31 2008-05-27 Andrew Corporation Method for angle of arrival determination on frequency hopping air interfaces
US7586492B2 (en) * 2004-12-20 2009-09-08 Nvidia Corporation Real-time display post-processing using programmable hardware
US7692642B2 (en) * 2004-12-30 2010-04-06 Intel Corporation Method and apparatus for controlling display refresh
US20080002894A1 (en) * 2006-06-29 2008-01-03 Winbond Electronics Corporation Signature-based video redirection
US7804499B1 (en) * 2006-08-28 2010-09-28 Nvidia Corporation Variable performance rasterization with constant effort
US7702683B1 (en) * 2006-09-18 2010-04-20 Hewlett-Packard Development Company, L.P. Estimating similarity between two collections of information
US9965886B2 (en) * 2006-12-04 2018-05-08 Arm Norway As Method of and apparatus for processing graphics
DE602007010514D1 (en) * 2006-12-18 2010-12-23 Koninkl Philips Electronics Nv IMAGE COMPRESSION AND DECOMPRESSION
ITMI20070038A1 (en) * 2007-01-12 2008-07-13 St Microelectronics Srl RENDERING DEVICE FOR GRAPHICS WITH THREE DIMENSIONS WITH SORT-MIDDLE TYPE ARCHITECTURE.
US8300699B2 (en) * 2007-05-31 2012-10-30 Qualcomm Incorporated System, method, and computer-readable medium for reducing required throughput in an ultra-wideband system
US7743013B2 (en) * 2007-06-11 2010-06-22 Microsoft Corporation Data partitioning via bucketing bloom filters
US20090046098A1 (en) * 2007-08-14 2009-02-19 Stmicroelectronics S.R.L. Primitive binning method for tile-based rendering
GB0801812D0 (en) 2008-01-31 2008-03-05 Arm Noway As Methods of and apparatus for processing computer graphics
US8108931B1 (en) 2008-03-31 2012-01-31 Symantec Corporation Method and apparatus for identifying invariants to detect software tampering
US8908763B2 (en) * 2008-06-25 2014-12-09 Qualcomm Incorporated Fragmented reference in temporal compression for video coding
US20100057618A1 (en) 2008-08-27 2010-03-04 Sean Andrew Spicer System, method, and software to manage financial securities via a 3-dimensional landscape
WO2010069364A1 (en) 2008-12-16 2010-06-24 Telefonaktiebolaget Lm Ericsson (Publ) String matching method and apparatus
CN102460511B (en) * 2009-06-10 2014-04-16 公立大学法人大阪府立大学 Object identification image database creating method, creating apparatus
US9672646B2 (en) * 2009-08-28 2017-06-06 Adobe Systems Incorporated System and method for image editing using visual rewind operation
US8134934B2 (en) * 2009-09-21 2012-03-13 Alcatel Lucent Tracking network-data flows
GB0916924D0 (en) * 2009-09-25 2009-11-11 Advanced Risc Mach Ltd Graphics processing systems
US8988443B2 (en) 2009-09-25 2015-03-24 Arm Limited Methods of and apparatus for controlling the reading of arrays of data from memory
US9349156B2 (en) 2009-09-25 2016-05-24 Arm Limited Adaptive frame buffer compression
JP5751782B2 (en) 2009-09-25 2015-07-22 アーム・リミテッド Graphics processing system
US9406155B2 (en) 2009-09-25 2016-08-02 Arm Limited Graphics processing systems
KR101609266B1 (en) * 2009-10-20 2016-04-21 삼성전자주식회사 Apparatus and method for rendering tile based
KR101661931B1 (en) * 2010-02-12 2016-10-10 삼성전자주식회사 Method and Apparatus For Rendering 3D Graphics
US8619085B2 (en) * 2010-03-08 2013-12-31 Broadcom Corporation Method and system for compressing tile lists used for 3D rendering
US8711163B2 (en) 2011-01-06 2014-04-29 International Business Machines Corporation Reuse of static image data from prior image frames to reduce rasterization requirements
US20120176386A1 (en) * 2011-01-10 2012-07-12 Hutchins Edward A Reducing recurrent computation cost in a data processing pipeline
GB201105716D0 (en) * 2011-04-04 2011-05-18 Advanced Risc Mach Ltd Method of and apparatus for displaying windows on a display
US9411733B2 (en) 2011-09-09 2016-08-09 University Of Rochester Sharing pattern-based directory coherence for multicore scalability (“SPACE”)
US10089774B2 (en) 2011-11-16 2018-10-02 Qualcomm Incorporated Tessellation in tile-based rendering
US9547930B2 (en) 2011-11-30 2017-01-17 Qualcomm Incorporated Hardware switching between direct rendering and binning in graphics processing
US20130271465A1 (en) 2011-12-30 2013-10-17 Franz P. Clarberg Sort-Based Tiled Deferred Shading Architecture for Decoupled Sampling
CN104040589B (en) * 2012-01-16 2018-05-25 英特尔公司 The graphic processing method and equipment being distributed using directional scatter metaplasia into stochastical sampling
US8823736B2 (en) * 2012-01-20 2014-09-02 Intel Corporation Graphics tiling architecture with bounding volume hierarchies
KR101861772B1 (en) 2012-02-07 2018-05-28 삼성전자주식회사 SoC, OPERATION METHOD THEREOF, AND MOBILE DEVICE HAVING THE SAME
US9672584B2 (en) * 2012-09-06 2017-06-06 Imagination Technologies Limited Systems and methods of partial frame buffer updating
US9317948B2 (en) * 2012-11-16 2016-04-19 Arm Limited Method of and apparatus for processing graphics
US9043668B2 (en) 2013-02-08 2015-05-26 Seagate Technology Llc Using ECC data for write deduplication processing
KR102116708B1 (en) * 2013-05-24 2020-05-29 삼성전자 주식회사 Graphics processing unit
US9189881B2 (en) * 2013-05-30 2015-11-17 Arm Limited Graphics processing
US9640148B2 (en) * 2013-06-03 2017-05-02 Arm Limited Method of and apparatus for controlling frame buffer operations
KR102122454B1 (en) * 2013-10-02 2020-06-12 삼성전자주식회사 Apparatus and Method for rendering a current frame using an image of previous tile
US9659393B2 (en) * 2013-10-07 2017-05-23 Intel Corporation Selective rasterization
US9305326B2 (en) * 2013-12-26 2016-04-05 Industrial Technology Research Institute Apparatus and method for tile elimination
US9940686B2 (en) 2014-05-14 2018-04-10 Intel Corporation Exploiting frame to frame coherency in a sort-middle architecture

Also Published As

Publication number Publication date
KR101980990B1 (en) 2019-05-21
TWI566202B (en) 2017-01-11
SG10201706498SA (en) 2017-09-28
CN110544289B (en) 2023-09-19
TW201608521A (en) 2016-03-01
US9904977B2 (en) 2018-02-27
SG11201608884PA (en) 2016-11-29
CN110544289A (en) 2019-12-06
JP2017517799A (en) 2017-06-29
JP6337322B2 (en) 2018-06-06
US20160027144A1 (en) 2016-01-28
CN106233337A (en) 2016-12-14
KR20160134778A (en) 2016-11-23
KR101952922B1 (en) 2019-02-27
RU2677584C1 (en) 2019-01-17
RU2016140574A (en) 2018-04-17
TWI550548B (en) 2016-09-21
JP2017215997A (en) 2017-12-07
WO2015175231A1 (en) 2015-11-19
US20150332429A1 (en) 2015-11-19
TWI596571B (en) 2017-08-21
CN110555895B (en) 2023-09-29
KR102154456B1 (en) 2020-09-10
US20160328820A1 (en) 2016-11-10
JP6504212B2 (en) 2019-04-24
EP3143594B1 (en) 2020-12-02
US9940686B2 (en) 2018-04-10
EP3143594A4 (en) 2017-12-27
CN110555895A (en) 2019-12-10
KR20170094464A (en) 2017-08-17
RU2661763C2 (en) 2018-07-19
TW201706957A (en) 2017-02-16
KR20190020197A (en) 2019-02-27
CN106233337B (en) 2019-09-24
EP3143594A1 (en) 2017-03-22
TW201545118A (en) 2015-12-01
US9922393B2 (en) 2018-03-20

Similar Documents

Publication Publication Date Title
SG10201807923YA (en) Exploiting frame to frame coherency in a sort-middle architecture
GB201309683D0 (en) Graphics processing
WO2020172043A3 (en) Graphics processing chip with machine-learning based shader
USD766968S1 (en) Display screen with animated graphical user interface
USD766970S1 (en) Display screen with animated graphical user interface
MX2021012316A (en) Hybrid rendering.
MX2018006330A (en) Handling multiple hdr image sources.
MX366401B (en) Data reproduction method and reproduction device.
EP3026635A3 (en) Graphic processing unit and method of performing, by graphic processing unit, tile-based graphics pipeline
USD768695S1 (en) Display screen with animated graphical user interface
WO2013151751A3 (en) Patched shading in graphics processing
EP3021285A3 (en) Low latency augmented reality display
IN2014CN03427A (en)
EP3249612A3 (en) Generation of a control stream for a tile
IN2013MU02512A (en)
EP4270325A3 (en) Augmented reality object manipulation
AU2014280960A1 (en) Method, apparatus and system for rendering an image
EP2797054A3 (en) Rendering of an indirect illumination data buffer
TW201614625A (en) Display method and display device
GB2541589A (en) Image modification
JP2017520950A5 (en)
GB2539815A (en) Multi-Z Polyline to single-Z horizons conversion
EP3214599A3 (en) A graphics accelerator
EP2953091A3 (en) A method and technical equipment for image processing
EP2779108A3 (en) Procedural partitioning of a scene